MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-25-gee651cd5b301) initialized Starting run at 05:40:00 UTC on 2022-03-23. Successfully read inputs file ... Castro git describe: 22.02-14-g23fc313a7 AMReX git describe: 22.03-25-gee651cd5b Microphysics git describe: 22.03-9-g65902e18 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.010556241 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.013878831 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.049245634 Gravity::fill_multipole_BCs() time = 0.028632535 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.628693123 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032770704 Gravity::solve_for_phi() time = 0.403649959 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.614945433e+22 ymom added: -4.911261142e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.134275007 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.46396114 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028141129 Gravity::solve_for_phi() time = 0.354265989 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.157801222 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08334120602 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009485222 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009319731 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10802427 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044562655 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.011437082 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01594142045 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009202912 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009309441 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106816271 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044271915 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.01024955 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01486038117 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029526687 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010095648 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.149811276 Castro::reflux() at level 0 : time = 1.029634012 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.005792336 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009735774 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028689651 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030751882 Gravity::solve_for_phi() time = 0.383523683 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852872e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.139757126 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.473599891 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025304633 Gravity::solve_for_phi() time = 0.345505689 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.153584795 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08391700311 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009156183 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009712629 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106640876 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045696892 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010299215 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01614549437 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010384952 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009260618 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107374087 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043217665 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.009890051 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01474348117 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028288461 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.00983713 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809893e+28 ymom added: 8.089770254e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.149493335 Castro::reflux() at level 0 : time = 1.004381456 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.31298491 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009514007 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028975983 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03407647 Gravity::solve_for_phi() time = 0.3864171 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939024e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.132276762 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.443109193 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024907547 Gravity::solve_for_phi() time = 0.332328169 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.37104447e+28 ymom added: 1.370983741e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.155879909 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0857972271 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010258727 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.00989287 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108624212 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043252166 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010032231 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01606600795 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008277379 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009006218 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106317801 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043107273 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.012501797 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01491765524 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029023665 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010009624 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342328e+27 ymom added: 5.311566494e+28 zmom added: 5.312402181e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.146468791 Castro::reflux() at level 0 : time = 0.997791922 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.159176877 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009477018 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028241643 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029204443 Gravity::solve_for_phi() time = 0.37881109 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700677e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.1303174 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441611398 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025509389 Gravity::solve_for_phi() time = 0.332721365 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.151805452 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08644194309 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008433793 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009045514 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106424738 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043117343 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010124971 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01650884144 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008505889 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.008936451 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107574342 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.059273795 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010935511 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01417377689 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028497038 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.009971497 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.156840571 Castro::reflux() at level 0 : time = 1.002853584 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.161898377 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.00964422 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028758632 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024224995 Gravity::solve_for_phi() time = 0.374339614 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150472e+30 ymom added: 3.39980379e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.129883624 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.436140122 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024777577 Gravity::solve_for_phi() time = 0.333049498 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.149354819 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08669259167 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008562235 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.008916681 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106283863 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044482481 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.009963019 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01644689147 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008465834 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.008921327 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105938821 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044672999 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.009937486 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01509714452 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028538852 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010100162 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277777e+28 zmom added: 7.267043465e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.145237744 Castro::reflux() at level 0 : time = 0.927421273 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.058181585 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009644484 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028512374 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029398995 Gravity::solve_for_phi() time = 0.379428777 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919311e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.132275806 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.44218708 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025254161 Gravity::solve_for_phi() time = 0.332967364 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245022e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.15145344 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08639121733 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008536295 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.00898093 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106360379 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043220373 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.0099824 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01652647487 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008388333 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009072559 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10654697 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043183187 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.009896962 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01509641833 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028499846 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.00983998 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.149167884 Castro::reflux() at level 0 : time = 0.932479352 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.062216089 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009634663 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028692716 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030786216 Gravity::solve_for_phi() time = 0.380901281 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151122e+30 ymom added: 4.515687996e+30 zmom added: 4.515608887e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.13457779 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.433462107 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025121037 Gravity::solve_for_phi() time = 0.333807891 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752619e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.151520235 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08629273589 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008256541 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009015807 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107127079 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044264926 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010109546 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0163628888 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008370142 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.008977869 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106627463 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043020684 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010064892 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01511716121 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028642255 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009879405 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.145067509 Castro::reflux() at level 0 : time = 0.929695527 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.133060116 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009685506 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030430125 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029285364 Gravity::solve_for_phi() time = 0.379262492 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064069e+30 ymom added: 4.889542941e+30 zmom added: 4.889455521e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.131006538 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.440002131 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024680675 Gravity::solve_for_phi() time = 0.37891508 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.152518342 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08516756515 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008373794 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.008981391 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105580219 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04309203 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.009951849 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01658734566 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008494705 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009067702 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106403078 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042932344 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010014422 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0151450446 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028179697 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009892864 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907354e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.146101926 Castro::reflux() at level 0 : time = 0.930098744 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.179973554 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009621156 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028200537 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02960352 Gravity::solve_for_phi() time = 0.37859769 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036345e+30 ymom added: 5.53045164e+30 zmom added: 5.530356286e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.132937703 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.444122376 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024920345 Gravity::solve_for_phi() time = 0.379307036 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043356e+28 ymom added: -5.06117034e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.149238931 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08513211983 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008426825 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009098635 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107071439 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043146094 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010013911 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01647191178 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008447392 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.008981335 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106550781 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042987833 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010053557 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01514431799 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028574063 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.009852182 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.148152597 Castro::reflux() at level 0 : time = 0.931841611 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.179424854 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009713065 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028424504 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029336984 Gravity::solve_for_phi() time = 0.379556676 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.88816717e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.130982105 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.445183427 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030835978 Gravity::solve_for_phi() time = 0.385380684 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.146933469 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08493173938 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008481609 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009021083 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105977499 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048737144 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.009901369 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01617606714 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008324971 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.008952227 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106468826 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048773199 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010251079 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01481208282 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028337027 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010125019 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914869e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.144948393 Castro::reflux() at level 0 : time = 0.984978045 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.24037423 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.553394131 seconds Ending run at 05:40:54 UTC on 2022-03-23. Run time = 54.15659913 Run time without initialization = 51.96507036 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.16 ... 54.16 ... 54.16 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4497 16.5073 16.5931 30.64% MLPoisson::Fsmooth() 11992 4.145 4.231 4.374 8.08% Castro::reset_internal_energy() 257 2.902 2.944 2.997 5.53% MultiFab::AddProduct() 4648 2.607 2.613 2.623 4.84% FabArray::setVal() 9464 2.301 2.325 2.353 4.34% MLPoisson::Fapply() 2422 1.854 1.926 2.091 3.86% MLCellLinOp::applyBC() 14630 1.475 1.551 1.747 3.23% MultiFab::Subtract() 601 1.665 1.668 1.673 3.09% FabArray::ParallelCopy_nowait() 5320 1.386 1.407 1.418 2.62% FabArray::ParallelCopy_finish() 5320 0.5781 1.059 1.309 2.42% Castro::enforce_min_density() 254 1.032 1.106 1.198 2.21% Gravity::fill_multipole_BCs() 41 1.08 1.104 1.122 2.07% Castro::derive() 397 0.923 0.9312 0.9378 1.73% MultiFab::sum() 4648 0.8533 0.8559 0.8593 1.59% FluxRegister::Reflux() 180 0.8207 0.8227 0.8257 1.52% FillBoundary_finish() 13093 0.4731 0.6445 0.7481 1.38% MultiFab::Xpay() 2190 0.712 0.718 0.7284 1.35% Castro::reflux() 10 0.6934 0.6955 0.6965 1.29% FillBoundary_nowait() 13093 0.6498 0.6627 0.6764 1.25% Castro::construct_new_gravity_source() 50 0.593 0.6031 0.6124 1.13% Castro::volWgtSum() 242 0.4995 0.5416 0.5804 1.07% CellConservativeLinear::interp() 130 0.3681 0.4544 0.5407 1.00% Castro::normalize_species() 254 0.5094 0.5102 0.511 0.94% Castro::estTimeStep() 69 0.2254 0.413 0.5048 0.93% Castro::computeTemp() 257 0.4667 0.4688 0.4744 0.88% MLPoisson::FFlux() 1040 0.3885 0.39 0.3927 0.73% Castro::finalize_advance() 30 0.3469 0.3532 0.3632 0.67% Gravity::get_new_grav_vector() 52 0.3284 0.3301 0.3324 0.61% FillPatchSingleLevel 853 0.3232 0.3267 0.329 0.61% StateData::FillBoundary(geom) 63 0.3259 0.3269 0.3278 0.61% Castro::post_timestep() 30 0.04994 0.1285 0.2906 0.54% MLMG::addInterpCorrection() 1421 0.2679 0.272 0.2833 0.52% amrex::average_down 1713 0.2682 0.2728 0.2821 0.52% MultiFab::Saxpy() 100 0.2739 0.2752 0.2761 0.51% FillPatchIterator::Initialize 723 0.2419 0.2609 0.2717 0.50% Castro::do_advance_ctu() 30 0.2151 0.217 0.2195 0.41% MLMG::oneIter() 333 0.2111 0.2119 0.213 0.39% Castro::expand_state() 30 0.1894 0.1901 0.1906 0.35% MLCellLinOp::defineAuxData() 81 0.1758 0.1789 0.1841 0.34% VisMF::Write(FabArray) 4 0.162 0.1668 0.1784 0.33% MLCellLinOp::reflux() 116 0.172 0.1738 0.1762 0.33% MLCellLinOp::compGrad() 100 0.1705 0.1714 0.1724 0.32% MultiFab::min() 30 0.007252 0.1032 0.1718 0.32% Gravity::get_old_grav_vector() 30 0.1639 0.1646 0.1654 0.31% Amr::writePlotFile() 2 0.125 0.1424 0.1539 0.28% MultiFab::Multiply() 164 0.1455 0.1462 0.1467 0.27% FabArray::mult() 294 0.1372 0.1386 0.14 0.26% MLMG::ResNormInf() 450 0.0883 0.1227 0.1375 0.25% Castro::construct_old_gravity_source() 30 0.1332 0.1343 0.1349 0.25% FabArray::setDomainBndry() 853 0.1255 0.1281 0.1304 0.24% MultiFab::contains_nan() 60 0.0905 0.09101 0.09154 0.17% BndryData::define() 123 0.08738 0.0892 0.09059 0.17% Castro::construct_old_gravity() 30 0.08665 0.08727 0.08773 0.16% MultiFab::LinComb() 628 0.07064 0.07613 0.08719 0.16% MLMG::prepareForSolve() 80 0.08051 0.08174 0.08398 0.16% Castro::evaluate_source_change() 591 0.07641 0.07757 0.07911 0.15% Gravity::test_level_grad_phi_curr() 20 0.07141 0.07196 0.07244 0.13% Gravity::gravity_sync() 10 0.07118 0.07165 0.07186 0.13% Castro::construct_new_gravity() 30 0.05417 0.05661 0.06362 0.12% Castro::initData() 3 0.05835 0.05935 0.06203 0.11% MLCellLinOp::updateSolBC() 99 0.0571 0.05764 0.05789 0.11% MLCGSolver::bicgstab 83 0 0.01407 0.05626 0.10% Castro::volProductSum() 22 0.04404 0.05037 0.05598 0.10% MultiFab::norm0(mask) 57 0.04584 0.04624 0.04663 0.09% MLCellLinOp::updateCorBC() 78 0.04533 0.04566 0.04591 0.08% Gravity::create_comp_minus_level_grad_phi() 10 0.04495 0.04536 0.04575 0.08% Castro::initialize_do_advance() 30 0.03304 0.0386 0.04505 0.08% MultiFab::max() 40 0.01082 0.02095 0.04375 0.08% Gravity::actual_solve_with_mlmg() 81 0.03739 0.03976 0.04356 0.08% FabArrayBase::CPC::define() 2260 0.02767 0.03187 0.04282 0.08% MLCellLinOp::setLevelBC() 102 0.0405 0.04121 0.04255 0.08% FabArrayBase::getCPC() 8152 0.04061 0.04122 0.04162 0.08% Gravity::test_level_grad_phi_prev() 30 0.04036 0.04077 0.0411 0.08% MLMG::buildFineMask() 80 0.04018 0.0405 0.04094 0.08% MultiFab::Copy() 100 0.03915 0.03935 0.0396 0.07% Gravity::solve_for_phi() 60 0.02689 0.03011 0.03791 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03668 0.03715 0.0375 0.07% AmrMesh::MakeNewGrids() 11 0.03473 0.03484 0.03498 0.06% FabArray::FillBoundary() 13093 0.03067 0.0319 0.03457 0.06% Castro::post_init() 2 0.0003551 0.01728 0.03285 0.06% MLCellLinOp::smooth() 5996 0.02607 0.027 0.02795 0.05% MLCellLinOp::prepareForSolve() 81 0.02431 0.0253 0.02761 0.05% Castro::initialize_advance() 30 0.02585 0.02624 0.02697 0.05% Castro::init(old) 9 0.02607 0.02619 0.02631 0.05% FabArrayBase::getFB() 13093 0.02277 0.02347 0.02528 0.05% Gravity::update_max_rhs() 20 0.02407 0.02431 0.02484 0.05% Amr::coarseTimeStep() 10 0.00131 0.01872 0.02458 0.05% MLCellLinOp::defineBC() 81 0.02378 0.0241 0.0243 0.04% Amr::defBaseLevel() 1 0.02105 0.0217 0.02335 0.04% MLMG::interpCorrection_1 78 0.02266 0.02278 0.02299 0.04% Castro::apply_tagging_restrictions() 11 0.02094 0.02116 0.02174 0.04% Castro::finalize_do_advance() 30 0.002562 0.0132 0.01938 0.04% Castro::build_fine_mask() 153 0.01824 0.01834 0.01853 0.03% FillPatchTwoLevels 394 0.01621 0.01646 0.01667 0.03% StateData::define() 48 0.01496 0.0154 0.01662 0.03% FabArray::ParallelCopy() 5320 0.01417 0.01445 0.01474 0.03% Castro::swap_state_time_levels() 30 0.01308 0.01327 0.01375 0.03% Gravity::actual_multilevel_solve() 10 0.01188 0.01221 0.0125 0.02% MLMG::MLRhsNormInf() 80 0.0119 0.01193 0.01195 0.02% Castro::do_new_sources() 50 0.0008587 0.0057 0.01134 0.02% Amr::regrid() 10 0.009634 0.01016 0.01133 0.02% MultiFab::Dot() 463 0 0.002713 0.01085 0.02% StateDataPhysBCFunct::() 853 0.008995 0.009557 0.0108 0.02% MLMG::solve() 80 0.00319 0.008652 0.0107 0.02% Gravity::GetCrsePhi() 40 0.00949 0.009753 0.01003 0.02% MLCellLinOp::apply() 2422 0.005678 0.00662 0.009077 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008364 0.00849 0.00871 0.02% Castro::apply_problem_tags() 11 0.007495 0.007544 0.007597 0.01% MLLinOp::defineGrids() 81 0.006666 0.007187 0.007577 0.01% MLCGSolver::ParallelAllReduce 692 0 0.00186 0.007439 0.01% Castro::FluxRegFineAdd() 30 0.007105 0.007239 0.007398 0.01% MLLinOp::makeSubCommunicator() 81 0.003175 0.005244 0.006306 0.01% MLCellLinOp::correctionResidual() 1660 0.004549 0.004927 0.005692 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005053 0.005092 0.005177 0.01% AMRErrorTag::operator() 11 0.004786 0.004949 0.005126 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.00492 0.00495 0.004974 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004866 0.004901 0.004927 0.01% CGSolver::sxay() 588 0 0.001159 0.004637 0.01% MLMG::mgVcycle() 489 0.003953 0.004133 0.00433 0.01% main() 1 0.002576 0.003817 0.004268 0.01% Gravity::test_composite_phi() 1 0.003578 0.003954 0.004215 0.01% Castro::enforce_consistent_e() 3 0.003499 0.003626 0.003942 0.01% Castro::do_old_sources() 30 0.0004846 0.001378 0.003591 0.01% MLMG:computeResOfCorrection() 1421 0.003301 0.00341 0.00352 0.01% MLMG::actualBottomSolve() 333 0.0003922 0.001159 0.003456 0.01% FabArrayBase::FB::FB() 131 0.0008474 0.001243 0.002391 0.00% MLMG::mgVcycle_down::0 333 0.002252 0.002289 0.002311 0.00% MLMG::mgVcycle_down::1 333 0.00205 0.002108 0.002146 0.00% MLMG::mgVcycle_down::2 333 0.001927 0.001965 0.00202 0.00% MLCellLinOp::solutionResidual() 530 0.001927 0.001963 0.002002 0.00% Amr::InitAmr() 1 0.001935 0.001945 0.00196 0.00% Castro::subcycle_advance_ctu() 30 0.0001931 0.000649 0.001957 0.00% FillPatchInterp(Fab) 130 0.001677 0.001807 0.001942 0.00% Gravity::solve_phi_with_mlmg() 71 0.00158 0.001664 0.001794 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001485 0.001189 0.001721 0.00% MLMG::MLResNormInf() 97 0.0005837 0.001337 0.001678 0.00% OwnerMask() 11 0.001493 0.001544 0.001641 0.00% Castro::clean_state() 254 0.001539 0.001573 0.001609 0.00% MLMG::mgVcycle_up::0 333 0.001556 0.001579 0.001601 0.00% TagBoxArray::collate() 11 0.001011 0.001254 0.001511 0.00% MLMG::mgVcycle_up::2 333 0.001339 0.001382 0.001469 0.00% MLMG::mgVcycle_up::1 333 0.001353 0.001387 0.001427 0.00% MLMG::mgVcycle_bottom 489 0.001257 0.001311 0.001372 0.00% MLMG::mgVcycle_down::3 211 0.001159 0.001219 0.001307 0.00% MLMG::mgVcycle_down::4 211 0.001114 0.001163 0.001277 0.00% makeSFC 243 0.00101 0.001136 0.001217 0.00% TagBoxArray::mapPRD 11 0.0008458 0.0008677 0.0009124 0.00% MLMG::mgVcycle_up::4 211 0.0007673 0.0008172 0.0009124 0.00% Amr::bldFineLevels() 1 0.000767 0.0008127 0.0008763 0.00% MLMG::mgVcycle_up::3 211 0.0007319 0.0007779 0.0008754 0.00% MLMG::computeResidual() 333 0.000825 0.0008451 0.0008732 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007508 0.0007879 0.0008083 0.00% Amr::timeStep() 30 0.0004684 0.0005289 0.0006978 0.00% Castro::construct_new_source() 250 0.0005602 0.0005974 0.0006667 0.00% MLPoisson::define() 81 0.0005921 0.0006361 0.0006568 0.00% Amr::grid_places() 11 0.0004952 0.0005303 0.0005865 0.00% FabArrayBase::TheFPinfo() 130 0.0005231 0.0005275 0.000539 0.00% DistributionMapping::Distribute() 245 0.0004959 0.0005036 0.0005147 0.00% Castro::enforce_speed_limit() 254 0.0003844 0.0003937 0.0004025 0.00% Castro::apply_source_to_state() 100 0.0003478 0.0003596 0.0003749 0.00% MLPoisson::prepareForSolve() 81 0.000336 0.0003574 0.0003745 0.00% Castro::computeNewDt() 18 0.0001235 0.0001887 0.0003732 0.00% MLLinOp::define() 81 0.0002932 0.0003057 0.0003243 0.00% MLMG::computeMLResidual() 97 0.0003001 0.0003143 0.0003242 0.00% Castro::construct_old_source() 150 0.0002815 0.0002956 0.0003086 0.00% MLMG::miniCycle() 156 0.0002716 0.0002763 0.0002815 0.00% MLMG::getGradSolution() 80 0.000259 0.0002614 0.0002634 0.00% AmrLevel::AmrLevel(dm) 12 0.0002463 0.0002538 0.000263 0.00% Castro::post_regrid() 22 0.0002393 0.0002456 0.0002502 0.00% ClusterList::intersect() 2 0 5.889e-05 0.0002356 0.00% Castro::advance() 30 0.0002047 0.0002127 0.0002263 0.00% FabArray::RecvLayoutMask() 21 0.0001966 0.0001992 0.000204 0.00% Gravity::swapTimeLevels() 30 0.0001788 0.0001894 0.000197 0.00% Castro::check_for_nan() 60 0.0001767 0.0001817 0.0001864 0.00% Castro::errorEst() 11 0.0001237 0.00013 0.000136 0.00% Castro::avgDown(state_indx) 44 0.0001093 0.0001192 0.0001349 0.00% FPinfo::FPinfo() 3 0.0001012 0.0001069 0.0001187 0.00% Amr::FinalizeInit() 1 2.038e-05 4.711e-05 0.0001084 0.00% Castro::create_source_corrector() 30 7.945e-05 8.634e-05 0.0001005 0.00% Gravity::solve_for_delta_phi 10 7.945e-05 8.708e-05 9.497e-05 0.00% amrex::average_down_w_geom 44 8.585e-05 8.867e-05 9.123e-05 0.00% AmrMesh-cluster 2 0 2.275e-05 9.099e-05 0.00% Amr::writeSmallPlotFile() 1 7.14e-05 7.284e-05 7.435e-05 0.00% knapsack() 3 5.972e-05 6.323e-05 7.17e-05 0.00% Castro::retry_advance_ctu() 30 4.597e-05 6.025e-05 7.097e-05 0.00% Castro::avgDown() 11 5.693e-05 5.834e-05 5.989e-05 0.00% Gravity::set_mass_offset() 11 2.6e-05 3.525e-05 5.643e-05 0.00% Castro::gwstrain() 22 3.711e-05 4.186e-05 4.987e-05 0.00% BoxList::parallelComplementIn() 22 4.177e-05 4.384e-05 4.816e-05 0.00% BoxList::complementIn 22 3.933e-05 4.145e-05 4.473e-05 0.00% Amr::initSubcycle() 1 3.462e-05 3.625e-05 4.064e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.096e-05 3.534e-05 3.973e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.861e-05 3.064e-05 3.428e-05 0.00% ClusterList::chop() 2 0 5.475e-06 2.19e-05 0.00% MLMG::compResidual() 1 1.195e-05 1.268e-05 1.329e-05 0.00% Castro::computeInitialDt() 2 1.155e-05 1.216e-05 1.307e-05 0.00% Amr::init() 1 5.211e-06 7.653e-06 1.212e-05 0.00% Amr::InitializeInit() 1 4.978e-06 6.563e-06 1.039e-05 0.00% knapsack()swap 2 4.89e-06 5.514e-06 6.149e-06 0.00% Amr::initialInit() 1 3.53e-06 4.028e-06 4.572e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.15 54.16 54.16 100.00% Amr::coarseTimeStep() 10 51.41 51.41 51.41 94.92% Amr::timeStep() 30 51.11 51.16 51.33 94.78% Castro::advance() 30 35.96 35.96 35.96 66.39% Castro::subcycle_advance_ctu() 30 34.19 34.2 34.21 63.18% Castro::do_advance_ctu() 30 34.19 34.2 34.21 63.18% Castro::construct_ctu_hydro_source() 30 16.45 16.51 16.59 30.64% Gravity::actual_solve_with_mlmg() 81 13.33 13.33 13.34 24.63% MLMG::solve() 80 12.62 12.62 12.62 23.31% Castro::post_timestep() 30 12.1 12.15 12.32 22.75% Castro::clean_state() 254 10.38 10.5 10.65 19.66% MLMG::oneIter() 333 10.58 10.58 10.59 19.55% Gravity::solve_phi_with_mlmg() 71 9.999 10.03 10.05 18.56% Castro::reflux() 10 9.642 9.651 9.67 17.86% MLMG::mgVcycle() 489 9.26 9.267 9.271 17.12% Gravity::solve_for_phi() 60 8.325 8.352 8.366 15.45% MLCellLinOp::smooth() 5996 6.25 6.443 6.781 12.52% Castro::computeTemp() 257 6.167 6.203 6.262 11.56% Castro::reset_internal_energy() 257 5.696 5.734 5.795 10.70% Castro::construct_new_gravity() 30 5.096 5.105 5.11 9.44% Gravity::gravity_sync() 10 5.096 5.097 5.097 9.41% Castro::construct_old_gravity() 30 4.674 4.7 4.718 8.71% Castro::evaluate_source_change() 591 4.458 4.474 4.491 8.29% MLPoisson::Fsmooth() 11992 4.145 4.231 4.374 8.08% Gravity::solve_for_delta_phi 10 4.278 4.279 4.279 7.90% MLMG::mgVcycle_down::0 333 3.895 3.93 4.018 7.42% Castro::enforce_min_density() 254 3.776 3.857 3.953 7.30% FillPatchIterator::Initialize 723 3.273 3.306 3.33 6.15% Castro::do_new_sources() 50 3.224 3.261 3.306 6.10% Amr::regrid() 10 3.116 3.137 3.15 5.82% MLCellLinOp::applyBC() 14630 2.67 2.892 3.137 5.79% Castro::post_regrid() 22 2.925 2.948 2.96 5.47% MLMG::mgVcycle_up::0 333 2.69 2.879 2.946 5.44% FabArray::ParallelCopy() 5320 2.064 2.531 2.783 5.14% MLCellLinOp::apply() 2422 2.482 2.562 2.686 4.96% MultiFab::AddProduct() 4648 2.607 2.613 2.623 4.84% Castro::initialize_do_advance() 30 2.492 2.505 2.521 4.65% FabArray::setVal() 9464 2.301 2.325 2.353 4.34% FillPatchSingleLevel 853 2.243 2.265 2.296 4.24% Amr::init() 1 2.189 2.189 2.189 4.04% MLPoisson::Fapply() 2422 1.854 1.926 2.091 3.86% MLCellLinOp::solutionResidual() 530 1.721 1.76 1.844 3.40% MLCellLinOp::correctionResidual() 1660 1.623 1.677 1.727 3.19% Gravity::multilevel_solve_for_new_phi() 10 1.686 1.686 1.686 3.11% Gravity::actual_multilevel_solve() 10 1.677 1.678 1.678 3.10% MultiFab::Subtract() 601 1.665 1.668 1.673 3.09% Castro::derive() 397 1.644 1.656 1.67 3.08% MLMG:computeResOfCorrection() 1421 1.46 1.515 1.593 2.94% Amr::initialInit() 1 1.56 1.56 1.56 2.88% Castro::do_old_sources() 30 1.479 1.493 1.51 2.79% FabArray::ParallelCopy_nowait() 5320 1.433 1.457 1.471 2.72% FabArray::FillBoundary() 13093 1.201 1.364 1.453 2.68% Castro::volWgtSum() 242 1.307 1.354 1.389 2.57% Castro::initialize_advance() 30 1.351 1.356 1.366 2.52% FabArray::ParallelCopy_finish() 5320 0.5781 1.059 1.309 2.42% Amr::FinalizeInit() 1 1.257 1.26 1.268 2.34% Castro::expand_state() 30 1.143 1.17 1.186 2.19% Amr::writePlotFile() 2 1.182 1.183 1.183 2.18% FillPatchTwoLevels 394 1.146 1.165 1.177 2.17% Gravity::fill_multipole_BCs() 41 1.117 1.141 1.159 2.14% FluxRegister::Reflux() 180 1.116 1.116 1.117 2.06% MLMG::addInterpCorrection() 1421 0.3137 0.8232 0.9996 1.85% Gravity::get_new_grav_vector() 52 0.9866 0.9911 0.9948 1.84% Castro::post_init() 2 0.9539 0.961 0.9823 1.81% MLMG::computeResWithCrseSolFineCor() 78 0.9551 0.9555 0.9567 1.77% MLMG::computeResidual() 333 0.901 0.9133 0.9481 1.75% MLMG::mgVcycle_down::1 333 0.6707 0.7702 0.8648 1.60% MultiFab::sum() 4648 0.8533 0.8559 0.8593 1.59% FillBoundary_finish() 13093 0.4731 0.6445 0.7481 1.38% MultiFab::Xpay() 2190 0.712 0.718 0.7284 1.35% FillBoundary_nowait() 13093 0.6747 0.6874 0.7001 1.29% MLCellLinOp::reflux() 116 0.6558 0.6683 0.6733 1.24% MLMG::mgVcycle_up::2 333 0.2103 0.5318 0.643 1.19% MLMG::computeMLResidual() 97 0.6064 0.6197 0.631 1.17% Castro::construct_new_source() 250 0.5936 0.6037 0.613 1.13% Castro::construct_new_gravity_source() 50 0.593 0.6031 0.6124 1.13% FillPatchInterp(Fab) 130 0.37 0.4562 0.5424 1.00% CellConservativeLinear::interp() 130 0.3681 0.4544 0.5407 1.00% MLMG::mgVcycle_up::1 333 0.469 0.4864 0.536 0.99% Gravity::get_old_grav_vector() 30 0.5242 0.5264 0.5288 0.98% Castro::normalize_species() 254 0.5094 0.5102 0.511 0.94% Castro::estTimeStep() 69 0.2254 0.413 0.5048 0.93% Castro::finalize_advance() 30 0.3905 0.3976 0.4087 0.75% MLPoisson::FFlux() 1040 0.3885 0.39 0.3927 0.73% MLPoisson::define() 81 0.3759 0.3811 0.3882 0.72% Castro::computeNewDt() 18 0.1309 0.2878 0.3445 0.64% StateDataPhysBCFunct::() 853 0.3353 0.3365 0.3386 0.63% StateData::FillBoundary(geom) 63 0.3259 0.3269 0.3278 0.61% amrex::average_down 1713 0.2922 0.302 0.3259 0.60% MLMG::prepareForSolve() 80 0.3087 0.3132 0.3204 0.59% MLMG::mgVcycle_bottom 489 0.1635 0.2024 0.3183 0.59% Amr::InitializeInit() 1 0.292 0.3 0.3027 0.56% Amr::defBaseLevel() 1 0.292 0.2999 0.3027 0.56% MLMG::mgVcycle_down::2 333 0.246 0.2608 0.2851 0.53% Castro::apply_source_to_state() 100 0.2743 0.2755 0.2765 0.51% MultiFab::Saxpy() 100 0.2739 0.2752 0.2761 0.51% Castro::initData() 3 0.2641 0.2709 0.2749 0.51% MLCellLinOp::defineAuxData() 81 0.2167 0.2227 0.2347 0.43% MLMG::getGradSolution() 80 0.2171 0.2178 0.2188 0.40% MLCellLinOp::compGrad() 100 0.2169 0.2176 0.2185 0.40% MLMG::mgVcycle_down::3 211 0.03305 0.07339 0.192 0.35% Amr::bldFineLevels() 1 0.1611 0.1784 0.1857 0.34% VisMF::Write(FabArray) 4 0.162 0.1668 0.1784 0.33% MultiFab::min() 30 0.007252 0.1032 0.1718 0.32% MLMG::ResNormInf() 450 0.1189 0.1529 0.1675 0.31% MLMG::miniCycle() 156 0.163 0.1635 0.164 0.30% MLMG::actualBottomSolve() 333 0.0003922 0.03887 0.1543 0.28% Castro::init(old) 9 0.1488 0.1505 0.1525 0.28% MLCGSolver::bicgstab 83 0 0.03703 0.1481 0.27% MultiFab::Multiply() 164 0.1455 0.1462 0.1467 0.27% MLCellLinOp::defineBC() 81 0.1406 0.1426 0.1438 0.27% FabArray::mult() 294 0.1372 0.1386 0.14 0.26% MLMG::mgVcycle_up::3 211 0.02486 0.05322 0.1365 0.25% Castro::construct_old_source() 150 0.1335 0.1346 0.1352 0.25% Castro::construct_old_gravity_source() 30 0.1332 0.1343 0.1349 0.25% FabArray::setDomainBndry() 853 0.1255 0.1281 0.1304 0.24% Castro::volProductSum() 22 0.1158 0.122 0.1275 0.24% BndryData::define() 123 0.1151 0.1173 0.1189 0.22% Gravity::GetCrsePhi() 40 0.09874 0.1056 0.1179 0.22% Amr::grid_places() 11 0.1106 0.1109 0.1112 0.21% AmrMesh::MakeNewGrids() 11 0.11 0.1104 0.1107 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1055 0.1059 0.1062 0.20% MLCellLinOp::updateSolBC() 99 0.09014 0.0936 0.09649 0.18% Castro::check_for_nan() 60 0.09068 0.09119 0.09172 0.17% MultiFab::contains_nan() 60 0.0905 0.09101 0.09154 0.17% MultiFab::LinComb() 628 0.07064 0.07613 0.08719 0.16% FabArrayBase::getCPC() 8152 0.0684 0.07309 0.08444 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08186 0.08237 0.08291 0.15% Gravity::test_level_grad_phi_curr() 20 0.08049 0.08123 0.08202 0.15% Gravity::update_max_rhs() 20 0.0456 0.05507 0.07758 0.14% MLMG::mgVcycle_down::4 211 0.03177 0.04254 0.07246 0.13% MLCellLinOp::updateCorBC() 78 0.06419 0.06445 0.06483 0.12% Castro::errorEst() 11 0.05917 0.06014 0.06148 0.11% MLCellLinOp::setLevelBC() 102 0.05249 0.05879 0.0613 0.11% Gravity::test_composite_phi() 1 0.05874 0.05876 0.05879 0.11% MLMG::mgVcycle_up::4 211 0.02502 0.03321 0.0561 0.10% MLMG::buildFineMask() 80 0.04947 0.04987 0.05043 0.09% Gravity::test_level_grad_phi_prev() 30 0.04563 0.04617 0.04666 0.09% MultiFab::norm0(mask) 57 0.04584 0.04624 0.04663 0.09% MLMG::MLResNormInf() 97 0.04342 0.04366 0.04381 0.08% MultiFab::max() 40 0.01082 0.02095 0.04375 0.08% FabArrayBase::CPC::define() 2260 0.02767 0.03187 0.04282 0.08% MLMG::interpCorrection_1 78 0.03281 0.036 0.04029 0.07% MultiFab::Copy() 100 0.03915 0.03935 0.0396 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03668 0.03715 0.0375 0.07% MLMG::MLRhsNormInf() 80 0.02787 0.02802 0.02816 0.05% MLPoisson::prepareForSolve() 81 0.02468 0.02565 0.02795 0.05% FabArrayBase::getFB() 13093 0.02364 0.02472 0.02767 0.05% MLCellLinOp::prepareForSolve() 81 0.02431 0.0253 0.02761 0.05% Castro::computeInitialDt() 2 0.01625 0.01902 0.027 0.05% Gravity::swapTimeLevels() 30 0.02185 0.02233 0.02277 0.04% Castro::apply_tagging_restrictions() 11 0.02094 0.02116 0.02174 0.04% Castro::finalize_do_advance() 30 0.002562 0.0132 0.01938 0.04% CGSolver::sxay() 588 0 0.004718 0.01887 0.03% Castro::build_fine_mask() 153 0.01824 0.01834 0.01853 0.03% AmrLevel::AmrLevel(dm) 12 0.01521 0.01565 0.01687 0.03% StateData::define() 48 0.01496 0.0154 0.01662 0.03% MLLinOp::define() 81 0.01239 0.01516 0.01637 0.03% MLLinOp::defineGrids() 81 0.01209 0.01485 0.01604 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01461 0.01498 0.01532 0.03% MLMG::compResidual() 1 0.01388 0.01417 0.01443 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003598 0.01439 0.03% Castro::avgDown() 11 0.01357 0.01374 0.01395 0.03% Castro::avgDown(state_indx) 44 0.01351 0.01369 0.01389 0.03% amrex::average_down_w_geom 44 0.0134 0.01357 0.01377 0.03% Castro::swap_state_time_levels() 30 0.01308 0.01327 0.01375 0.03% MultiFab::Dot() 463 0 0.002713 0.01085 0.02% TagBoxArray::mapPRD 11 0.00557 0.007729 0.009256 0.02% Castro::apply_problem_tags() 11 0.007495 0.007544 0.007597 0.01% Castro::FluxRegFineAdd() 30 0.007105 0.007239 0.007398 0.01% MLLinOp::makeSubCommunicator() 81 0.003175 0.005244 0.006306 0.01% AMRErrorTag::operator() 11 0.004786 0.004949 0.005126 0.01% Castro::enforce_consistent_e() 3 0.003499 0.003626 0.003942 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002248 0.002419 0.002521 0.00% FabArrayBase::FB::FB() 131 0.0008474 0.001243 0.002391 0.00% FabArrayBase::TheFPinfo() 130 0.0008048 0.001858 0.002363 0.00% Amr::InitAmr() 1 0.00197 0.001982 0.002001 0.00% FPinfo::FPinfo() 3 0.0002658 0.00133 0.00184 0.00% DistributionMapping::KnapSackDoIt() 3 0.0001647 0.001223 0.001736 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001485 0.001189 0.001721 0.00% makeSFC 243 0.001497 0.001631 0.001713 0.00% OwnerMask() 11 0.001493 0.001544 0.001641 0.00% TagBoxArray::collate() 11 0.001011 0.001254 0.001511 0.00% DistributionMapping::Distribute() 245 0.0004959 0.0005036 0.0005147 0.00% Castro::enforce_speed_limit() 254 0.0003844 0.0003937 0.0004025 0.00% AmrMesh-cluster 2 0 8.711e-05 0.0003484 0.00% ClusterList::intersect() 2 0 5.889e-05 0.0002356 0.00% FabArray::RecvLayoutMask() 21 0.0001966 0.0001992 0.000204 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.405e-05 0.0001093 0.0001281 0.00% Castro::create_source_corrector() 30 7.945e-05 8.634e-05 0.0001005 0.00% BoxList::parallelComplementIn() 22 8.111e-05 8.529e-05 9.288e-05 0.00% knapsack() 3 6.518e-05 6.875e-05 7.785e-05 0.00% Amr::writeSmallPlotFile() 1 7.14e-05 7.284e-05 7.435e-05 0.00% Castro::retry_advance_ctu() 30 4.597e-05 6.025e-05 7.097e-05 0.00% Gravity::set_mass_offset() 11 2.6e-05 3.525e-05 5.643e-05 0.00% Castro::gwstrain() 22 3.711e-05 4.186e-05 4.987e-05 0.00% BoxList::complementIn 22 3.933e-05 4.145e-05 4.473e-05 0.00% Amr::initSubcycle() 1 3.462e-05 3.625e-05 4.064e-05 0.00% ClusterList::chop() 2 0 5.475e-06 2.19e-05 0.00% knapsack()swap 2 4.89e-06 5.514e-06 6.149e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-25-gee651cd5b301) finalized