MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.04-37-g3cc4a66759c9) initialized Starting run at 12:58:29 UTC on 2022-04-28. Successfully read inputs file ... Castro git describe: 22.04-38-ga2839038b AMReX git describe: 22.04-37-g3cc4a6675 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.020718378 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.023749661 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.030401052 Gravity::fill_multipole_BCs() time = 0.032383486 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.604428744 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034561386 Gravity::solve_for_phi() time = 0.413706713 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -6.214960778e+22 ymom added: -4.911261142e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.148197821 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.459674448 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025184493 Gravity::solve_for_phi() time = 0.325466481 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.15684645 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.083022862 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008476505 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009352047 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110426575 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043004963 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.009969843 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01606128573 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009243331 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009481075 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110080803 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045000962 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010305358 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01443135729 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029070771 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.01008696 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.151312765 Castro::reflux() at level 0 : time = 1.006134398 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.956141108 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.011774281 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030019442 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02800328 Gravity::solve_for_phi() time = 0.373311977 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852867e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.13386884 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.454091297 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024709698 Gravity::solve_for_phi() time = 0.324481846 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.152149937 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08573855201 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008072382 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009411115 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109276791 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044418179 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010122322 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01614457161 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008243145 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009060229 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109188628 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042712202 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010093494 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01495814313 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027658696 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.009984289 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809893e+28 ymom added: 8.089770255e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.151446856 Castro::reflux() at level 0 : time = 0.997635626 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.216216817 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.011878461 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028971342 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028760213 Gravity::solve_for_phi() time = 0.373135189 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939018e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.133191971 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.457033445 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024756097 Gravity::solve_for_phi() time = 0.326520362 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.153855967 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.085649803 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008225137 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009297331 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109525915 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043902707 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.00999736 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01618778411 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009566369 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009297118 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109652343 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04277963 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.009948422 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01478523173 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027711226 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010034471 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342323e+27 ymom added: 5.311566494e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.149127542 Castro::reflux() at level 0 : time = 0.988962182 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.137341425 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.011656579 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029003855 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029441629 Gravity::solve_for_phi() time = 0.375189613 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700661e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.134825848 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.462083774 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025648161 Gravity::solve_for_phi() time = 0.324481655 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.149042267 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08567673108 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008535374 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009021803 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10911264 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042496289 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010037281 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01633411463 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009087231 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009048553 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108480731 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042644884 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010310651 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01490263948 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029002229 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010074929 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.162527118 Castro::reflux() at level 0 : time = 0.962461132 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.12791194 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.01209981 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028916002 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031022776 Gravity::solve_for_phi() time = 0.375063594 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150475e+30 ymom added: 3.399803827e+30 zmom added: 3.399742172e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.133419021 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.464834537 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026218148 Gravity::solve_for_phi() time = 0.325488944 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.150505297 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08535027156 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008130585 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009383917 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109480246 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042713367 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010097646 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01616341452 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008245607 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009099451 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109559834 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04264751 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010086856 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01491436252 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027761175 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010041463 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277776e+28 zmom added: 7.267043465e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.14973219 Castro::reflux() at level 0 : time = 0.93600557 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.095149125 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.011946942 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028689829 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030287933 Gravity::solve_for_phi() time = 0.37589132 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919302e+30 ymom added: 4.094511425e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.134974857 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.473110436 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025237138 Gravity::solve_for_phi() time = 0.325854408 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.29724502e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.150212552 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08524728134 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008500381 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009092961 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110025614 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042875336 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010281348 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01621880325 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008165904 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009132271 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110515649 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042828336 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010459094 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01470057411 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027797643 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.009942682 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.150744495 Castro::reflux() at level 0 : time = 0.942433419 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.106393148 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.011816794 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029443848 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030850134 Gravity::solve_for_phi() time = 0.376124768 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.51615113e+30 ymom added: 4.515687958e+30 zmom added: 4.515609038e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.133703398 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.462878559 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025787127 Gravity::solve_for_phi() time = 0.325932654 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752619e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.150432251 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08540791349 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008200907 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009189873 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110386399 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04289209 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010207813 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01620236828 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008109038 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009121493 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10998393 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042805642 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010258609 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01490625055 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027634119 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009926346 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.150383257 Castro::reflux() at level 0 : time = 0.93422595 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.158277508 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.011955014 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028765331 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034926361 Gravity::solve_for_phi() time = 0.38000234 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064091e+30 ymom added: 4.889542979e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.135047906 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.469498912 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026520579 Gravity::solve_for_phi() time = 0.371870729 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.151227722 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08395290291 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008357053 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009045582 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110722762 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044335487 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010270671 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01607548117 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007974641 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009258195 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10957747 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042330524 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010146838 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01493514314 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.0280914 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009972124 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907354e+27 zmom added: 5.953997699e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.150533137 Castro::reflux() at level 0 : time = 0.935999082 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.236948385 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.011905651 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028534367 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031796161 Gravity::solve_for_phi() time = 0.37772174 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.53103636e+30 ymom added: 5.530451715e+30 zmom added: 5.530356286e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.135806346 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.466354594 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027278312 Gravity::solve_for_phi() time = 0.372908835 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.150570305 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08410558489 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008344437 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009096891 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109787105 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042904866 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010260022 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01623461183 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008221569 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009079288 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110130268 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042751458 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010300627 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01483123093 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027806626 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.009998553 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.149716236 Castro::reflux() at level 0 : time = 0.935605846 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.253592842 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.012096498 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028603229 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031970719 Gravity::solve_for_phi() time = 0.378120472 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167171e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.133545162 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.47080329 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026329454 Gravity::solve_for_phi() time = 0.371712481 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.150461909 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08398080691 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008459596 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009254776 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109202133 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049932683 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.01009974 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01583220057 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008348602 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009221049 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108489809 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048164201 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010036065 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01466993105 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027769306 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010011045 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914869e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.149926533 Castro::reflux() at level 0 : time = 0.990749448 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.321813897 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.539527349 seconds Ending run at 12:59:23 UTC on 2022-04-28. Run time = 54.53177308 Run time without initialization = 52.13437797 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.53 ... 54.53 ... 54.53 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4923 16.6526 16.8386 30.88% MLPoisson::Fsmooth() 11992 4.143 4.21 4.376 8.02% Castro::reset_internal_energy() 257 2.892 2.988 3.081 5.65% MultiFab::AddProduct() 4648 2.625 2.647 2.661 4.88% FabArray::setVal() 9464 2.315 2.354 2.396 4.39% MLPoisson::Fapply() 2422 1.847 1.868 1.917 3.52% MLCellLinOp::applyBC() 14630 1.45 1.517 1.685 3.09% MultiFab::Subtract() 601 1.647 1.659 1.667 3.06% FabArray::ParallelCopy_nowait() 5320 1.371 1.394 1.412 2.59% FabArray::ParallelCopy_finish() 5320 0.594 1.062 1.366 2.50% Gravity::fill_multipole_BCs() 41 1.068 1.093 1.144 2.10% Castro::enforce_min_density() 254 1.027 1.08 1.134 2.08% Castro::derive() 397 0.9173 0.9234 0.9308 1.71% MultiFab::sum() 4648 0.8932 0.9004 0.9053 1.66% FluxRegister::Reflux() 180 0.8366 0.8478 0.8723 1.60% Castro::normalize_species() 254 0.8514 0.8586 0.8677 1.59% MultiFab::Xpay() 2190 0.7104 0.7188 0.7349 1.35% FillBoundary_nowait() 13093 0.6607 0.6694 0.6749 1.24% Castro::reflux() 10 0.6486 0.6517 0.6538 1.20% Castro::do_advance_ctu() 30 0.2772 0.4785 0.6444 1.18% Castro::construct_new_gravity_source() 50 0.5988 0.6057 0.6128 1.12% FillBoundary_finish() 13093 0.4707 0.5034 0.5626 1.03% Castro::volWgtSum() 242 0.5214 0.5366 0.5513 1.01% CellConservativeLinear::interp() 130 0.3695 0.4571 0.5444 1.00% Castro::estTimeStep() 69 0.2239 0.3385 0.5057 0.93% Castro::computeTemp() 257 0.4608 0.4686 0.473 0.87% MLPoisson::FFlux() 1043 0.3874 0.3882 0.3892 0.71% Castro::finalize_advance() 30 0.3466 0.3526 0.3625 0.66% Gravity::get_new_grav_vector() 52 0.3304 0.3308 0.3318 0.61% FillPatchSingleLevel 853 0.3274 0.3286 0.3296 0.60% StateData::FillBoundary(geom) 63 0.3203 0.3218 0.3237 0.59% amrex::average_down 1713 0.2768 0.2821 0.2933 0.54% MultiFab::Saxpy() 100 0.2773 0.2786 0.2792 0.51% MLMG::addInterpCorrection() 1421 0.2578 0.263 0.2756 0.51% FillPatchIterator::Initialize 723 0.2549 0.2606 0.2671 0.49% MLMG::oneIter() 333 0.2088 0.21 0.2107 0.39% Castro::expand_state() 30 0.1892 0.1904 0.1927 0.35% MLCellLinOp::defineAuxData() 81 0.1685 0.1735 0.1824 0.33% VisMF::Write(FabArray) 4 0.163 0.1689 0.1806 0.33% MLCellLinOp::reflux() 116 0.1707 0.1722 0.1739 0.32% MLCellLinOp::compGrad() 100 0.1678 0.1693 0.1704 0.31% Gravity::get_old_grav_vector() 30 0.1633 0.1646 0.1655 0.30% MultiFab::Multiply() 164 0.1492 0.1494 0.1497 0.27% FabArray::mult() 294 0.1425 0.1439 0.1452 0.27% Castro::construct_old_gravity_source() 30 0.134 0.1349 0.1357 0.25% FabArray::setDomainBndry() 853 0.1298 0.1316 0.1335 0.24% Castro::post_timestep() 30 0.04012 0.08185 0.1303 0.24% Amr::writePlotFile() 2 0.1135 0.1227 0.129 0.24% Castro::initData() 3 0.0601 0.08725 0.1144 0.21% MLMG::ResNormInf() 450 0.09467 0.1016 0.1077 0.20% MultiFab::contains_nan() 60 0.09275 0.09313 0.09362 0.17% Castro::construct_old_gravity() 30 0.08589 0.0867 0.08819 0.16% BndryData::define() 123 0.08587 0.08647 0.08783 0.16% MLMG::prepareForSolve() 80 0.07961 0.08097 0.08269 0.15% MultiFab::LinComb() 628 0.06302 0.0677 0.07866 0.14% Castro::evaluate_source_change() 591 0.07551 0.07663 0.07766 0.14% Gravity::test_level_grad_phi_curr() 20 0.07105 0.07177 0.07258 0.13% MultiFab::max() 40 0.0137 0.04458 0.07178 0.13% Gravity::gravity_sync() 10 0.07052 0.07089 0.07155 0.13% MLCellLinOp::updateSolBC() 99 0.0575 0.05812 0.05882 0.11% MLCGSolver::bicgstab 83 0 0.01398 0.05593 0.10% Castro::construct_new_gravity() 30 0.05271 0.05282 0.05304 0.10% Castro::volProductSum() 22 0.04956 0.05073 0.05261 0.10% Castro::apply_tagging_restrictions() 11 0.04414 0.04738 0.05039 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04467 0.04561 0.04678 0.09% MLCellLinOp::updateCorBC() 78 0.04544 0.04607 0.04644 0.09% MultiFab::norm0(mask) 57 0.04494 0.04516 0.0454 0.08% FabArrayBase::CPC::define() 2260 0.02751 0.03215 0.04417 0.08% Gravity::actual_solve_with_mlmg() 81 0.03583 0.04011 0.04256 0.08% FabArrayBase::getCPC() 8152 0.04048 0.04107 0.04194 0.08% Gravity::test_level_grad_phi_prev() 30 0.04045 0.04106 0.04169 0.08% MLCellLinOp::setLevelBC() 102 0.0403 0.04077 0.04126 0.08% AmrMesh::MakeNewGrids() 11 0.03602 0.03805 0.04064 0.07% Gravity::solve_for_phi() 60 0.0264 0.03177 0.04042 0.07% MultiFab::Copy() 100 0.03903 0.03914 0.03923 0.07% MLMG::buildFineMask() 80 0.03753 0.03774 0.03806 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03516 0.03564 0.03632 0.07% Castro::initialize_do_advance() 30 0.03352 0.03435 0.03504 0.06% FabArray::FillBoundary() 13093 0.03053 0.03178 0.03474 0.06% MLCellLinOp::prepareForSolve() 81 0.02435 0.02529 0.0278 0.05% MLCellLinOp::smooth() 5996 0.02578 0.02618 0.02708 0.05% Castro::init(old) 9 0.02623 0.02624 0.02626 0.05% Castro::initialize_advance() 30 0.02512 0.02565 0.02601 0.05% Amr::defBaseLevel() 1 0.02074 0.0234 0.02596 0.05% FabArrayBase::getFB() 13093 0.02241 0.02322 0.02541 0.05% MLCellLinOp::defineBC() 81 0.02389 0.02422 0.02479 0.05% Gravity::update_max_rhs() 20 0.02385 0.0241 0.02425 0.04% MLMG::interpCorrection_1 78 0.02271 0.02282 0.02301 0.04% Castro::finalize_do_advance() 30 0.01647 0.01865 0.02181 0.04% Amr::coarseTimeStep() 10 0.0007709 0.0162 0.02138 0.04% Castro::post_init() 2 0.000404 0.01236 0.02002 0.04% Castro::build_fine_mask() 163 0.01804 0.01817 0.01854 0.03% StateData::define() 48 0.01478 0.01678 0.01811 0.03% Castro::do_new_sources() 50 0.000828 0.005674 0.01711 0.03% FillPatchTwoLevels 394 0.01493 0.01627 0.01705 0.03% FabArray::ParallelCopy() 5320 0.01406 0.01426 0.01472 0.03% Castro::swap_state_time_levels() 30 0.01303 0.01349 0.01403 0.03% Gravity::actual_multilevel_solve() 10 0.01185 0.01206 0.01223 0.02% MLMG::MLRhsNormInf() 80 0.01184 0.01189 0.01196 0.02% Amr::regrid() 10 0.009328 0.009958 0.01107 0.02% MultiFab::Dot() 463 0 0.002696 0.01079 0.02% Gravity::GetCrsePhi() 40 0.009375 0.009636 0.00988 0.02% StateDataPhysBCFunct::() 853 0.008091 0.008751 0.009256 0.02% MLCellLinOp::apply() 2422 0.005657 0.006508 0.008993 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008256 0.008442 0.008931 0.02% MLMG::solve() 80 0.004683 0.006529 0.008474 0.02% Castro::apply_problem_tags() 11 0.007581 0.007914 0.00825 0.02% MLLinOp::makeSubCommunicator() 81 0.002459 0.005604 0.008158 0.01% MLLinOp::defineGrids() 81 0.007469 0.007605 0.007917 0.01% Castro::FluxRegFineAdd() 30 0.007301 0.007414 0.007611 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001842 0.007368 0.01% Castro::enforce_consistent_e() 3 0.003729 0.005216 0.006833 0.01% MLCellLinOp::correctionResidual() 1660 0.004627 0.004947 0.005826 0.01% AMRErrorTag::operator() 11 0.004877 0.005275 0.005742 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005041 0.005067 0.005082 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0008754 0.001987 0.005047 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004894 0.004929 0.004979 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004826 0.00484 0.004858 0.01% CGSolver::sxay() 588 0 0.001206 0.004824 0.01% main() 1 0.002571 0.004151 0.004727 0.01% Gravity::test_composite_phi() 1 0.003891 0.004285 0.004661 0.01% MLMG::mgVcycle() 489 0.003987 0.004105 0.004346 0.01% MLMG::actualBottomSolve() 333 0.0003893 0.00117 0.003479 0.01% MLMG:computeResOfCorrection() 1421 0.00324 0.003308 0.003442 0.01% FillPatchInterp(Fab) 130 0.001652 0.002039 0.002837 0.01% Castro::do_old_sources() 30 0.0004801 0.001557 0.0027 0.00% Amr::InitAmr() 1 0.002568 0.002577 0.002593 0.00% FabArrayBase::FB::FB() 131 0.0008747 0.001271 0.002447 0.00% MLMG::mgVcycle_down::0 333 0.002229 0.002251 0.002266 0.00% MLMG::mgVcycle_down::1 333 0.002035 0.002084 0.002166 0.00% MLMG::mgVcycle_down::2 333 0.001893 0.001935 0.002038 0.00% MLCellLinOp::solutionResidual() 530 0.001926 0.001945 0.00197 0.00% TagBoxArray::collate() 11 0.001037 0.00149 0.001827 0.00% Castro::subcycle_advance_ctu() 30 0.0001969 0.0005976 0.001773 0.00% Gravity::solve_phi_with_mlmg() 71 0.001571 0.001649 0.00177 0.00% Castro::clean_state() 254 0.001607 0.00165 0.001687 0.00% MLMG::mgVcycle_up::0 333 0.001523 0.001551 0.001582 0.00% OwnerMask() 11 0.001458 0.001495 0.001556 0.00% MLMG::mgVcycle_up::2 333 0.001331 0.001386 0.001503 0.00% MLMG::mgVcycle_up::1 333 0.001332 0.001372 0.001441 0.00% MLMG::MLResNormInf() 97 0.0008128 0.001157 0.001371 0.00% MLMG::mgVcycle_bottom 489 0.001267 0.001291 0.001341 0.00% MLMG::mgVcycle_down::3 211 0.001156 0.00121 0.001332 0.00% MLMG::mgVcycle_down::4 211 0.001073 0.001146 0.001294 0.00% makeSFC 243 0.001069 0.001101 0.00115 0.00% MLMG::mgVcycle_up::4 211 0.0007795 0.0008326 0.0009401 0.00% Amr::bldFineLevels() 1 0.0007335 0.0008027 0.0009387 0.00% TagBoxArray::mapPRD 11 0.0008558 0.000879 0.0009017 0.00% MLMG::mgVcycle_up::3 211 0.0007422 0.0007858 0.0008911 0.00% MLMG::computeResidual() 333 0.0007992 0.0008094 0.0008214 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007545 0.0007677 0.0007906 0.00% MLPoisson::define() 81 0.0006089 0.0006275 0.0006532 0.00% Amr::grid_places() 11 0.0004876 0.0005419 0.0006206 0.00% Amr::timeStep() 30 0.0004377 0.0004957 0.0006137 0.00% Castro::construct_new_source() 250 0.0005362 0.0005705 0.0005952 0.00% FabArrayBase::TheFPinfo() 130 0.0005084 0.0005233 0.0005376 0.00% DistributionMapping::Distribute() 245 0.0004839 0.0004937 0.0005012 0.00% Castro::enforce_speed_limit() 254 0.0003844 0.0003914 0.0003996 0.00% MLPoisson::prepareForSolve() 81 0.0003533 0.0003615 0.0003681 0.00% Castro::apply_source_to_state() 100 0.0003341 0.0003461 0.0003646 0.00% Castro::computeNewDt() 18 0.0001032 0.0001742 0.000362 0.00% MLMG::computeMLResidual() 97 0.0003069 0.0003128 0.0003284 0.00% Castro::construct_old_source() 150 0.0002841 0.0002937 0.0003108 0.00% MLLinOp::define() 81 0.0002851 0.0002928 0.0003001 0.00% MLMG::getGradSolution() 80 0.0002519 0.0002639 0.0002886 0.00% AmrLevel::AmrLevel(dm) 12 0.0002465 0.0002591 0.0002829 0.00% MLMG::miniCycle() 156 0.0002727 0.0002748 0.0002767 0.00% Castro::post_regrid() 22 0.0002205 0.0002361 0.0002528 0.00% ClusterList::intersect() 2 0 6.158e-05 0.0002463 0.00% Castro::advance() 30 0.0001962 0.0002064 0.0002222 0.00% FabArray::RecvLayoutMask() 21 0.0001928 0.0001976 0.000203 0.00% Gravity::swapTimeLevels() 30 0.0001723 0.0001843 0.0001929 0.00% Castro::check_for_nan() 60 0.0001712 0.0001771 0.0001815 0.00% Castro::errorEst() 11 0.0001193 0.0001279 0.0001384 0.00% Castro::avgDown(state_indx) 44 0.0001101 0.000112 0.0001156 0.00% FPinfo::FPinfo() 3 0.0001061 0.000108 0.0001111 0.00% Amr::FinalizeInit() 1 1.868e-05 4.104e-05 0.0001034 0.00% AmrMesh-cluster 2 0 2.57e-05 0.0001028 0.00% amrex::average_down_w_geom 44 8.915e-05 8.979e-05 9.045e-05 0.00% Gravity::solve_for_delta_phi 10 7.906e-05 8.274e-05 8.768e-05 0.00% Castro::create_source_corrector() 30 7.559e-05 7.979e-05 8.628e-05 0.00% Amr::writeSmallPlotFile() 1 7.064e-05 7.283e-05 7.585e-05 0.00% Castro::retry_advance_ctu() 30 5.456e-05 6.136e-05 7.045e-05 0.00% knapsack() 3 6.182e-05 6.306e-05 6.487e-05 0.00% Castro::avgDown() 11 5.496e-05 5.846e-05 6.083e-05 0.00% Amr::initSubcycle() 1 3.476e-05 4.89e-05 6.069e-05 0.00% Castro::gwstrain() 22 3.565e-05 4.018e-05 4.571e-05 0.00% BoxList::parallelComplementIn() 22 3.967e-05 4.2e-05 4.472e-05 0.00% BoxList::complementIn 22 3.65e-05 3.938e-05 4.268e-05 0.00% Gravity::set_mass_offset() 11 2.719e-05 3.196e-05 3.688e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.305e-05 3.493e-05 3.686e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.849e-05 3.051e-05 3.265e-05 0.00% ClusterList::chop() 2 0 5.369e-06 2.148e-05 0.00% MLMG::compResidual() 1 1.184e-05 1.255e-05 1.344e-05 0.00% Castro::computeInitialDt() 2 1.011e-05 1.168e-05 1.308e-05 0.00% Amr::InitializeInit() 1 5.497e-06 7.95e-06 1.22e-05 0.00% Amr::init() 1 5.237e-06 6.177e-06 7.417e-06 0.00% knapsack()swap 2 4.807e-06 5.256e-06 5.437e-06 0.00% Amr::initialInit() 1 3.613e-06 4.037e-06 4.632e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.53 54.53 54.53 100.00% Amr::coarseTimeStep() 10 51.59 51.59 51.59 94.61% Amr::timeStep() 30 51.43 51.45 51.51 94.47% Castro::advance() 30 36.22 36.22 36.22 66.42% Castro::subcycle_advance_ctu() 30 34.43 34.45 34.47 63.21% Castro::do_advance_ctu() 30 34.43 34.45 34.47 63.20% Castro::construct_ctu_hydro_source() 30 16.49 16.65 16.84 30.88% Gravity::actual_solve_with_mlmg() 81 13.04 13.04 13.05 23.93% MLMG::solve() 80 12.33 12.34 12.35 22.64% Castro::post_timestep() 30 12.09 12.11 12.17 22.32% Castro::clean_state() 254 10.73 10.9 11.03 20.23% MLMG::oneIter() 333 10.37 10.37 10.37 19.02% Gravity::solve_phi_with_mlmg() 71 9.815 9.846 9.904 18.16% Castro::reflux() 10 9.585 9.615 9.631 17.66% MLMG::mgVcycle() 489 9.084 9.087 9.092 16.67% Gravity::solve_for_phi() 60 8.151 8.174 8.226 15.08% MLCellLinOp::smooth() 5996 6.195 6.299 6.595 12.09% Castro::computeTemp() 257 6.149 6.274 6.369 11.68% Castro::reset_internal_energy() 257 5.689 5.806 5.9 10.82% Castro::construct_new_gravity() 30 4.959 4.964 4.969 9.11% Gravity::gravity_sync() 10 4.959 4.96 4.96 9.10% Castro::construct_old_gravity() 30 4.638 4.658 4.705 8.63% Castro::evaluate_source_change() 591 4.525 4.563 4.588 8.41% MLPoisson::Fsmooth() 11992 4.143 4.21 4.376 8.02% Gravity::solve_for_delta_phi 10 4.152 4.152 4.154 7.62% Castro::enforce_min_density() 254 3.8 3.874 3.954 7.25% MLMG::mgVcycle_down::0 333 3.877 3.884 3.891 7.14% Castro::do_new_sources() 50 3.269 3.309 3.333 6.11% FillPatchIterator::Initialize 723 3.256 3.27 3.288 6.03% Amr::regrid() 10 3.209 3.223 3.243 5.95% Castro::post_regrid() 22 2.991 3.02 3.056 5.60% MLMG::mgVcycle_up::0 333 2.654 2.846 2.915 5.35% MLCellLinOp::applyBC() 14630 2.645 2.725 2.877 5.28% FabArray::ParallelCopy() 5320 2.076 2.521 2.816 5.16% MultiFab::AddProduct() 4648 2.625 2.647 2.661 4.88% Castro::initialize_do_advance() 30 2.531 2.564 2.579 4.73% MLCellLinOp::apply() 2422 2.446 2.474 2.549 4.68% FabArray::setVal() 9464 2.315 2.354 2.396 4.39% Amr::init() 1 2.394 2.394 2.394 4.39% FillPatchSingleLevel 853 2.189 2.222 2.259 4.14% MLPoisson::Fapply() 2422 1.847 1.868 1.917 3.52% Amr::initialInit() 1 1.789 1.79 1.79 3.28% MLCellLinOp::solutionResidual() 530 1.717 1.729 1.733 3.18% MLCellLinOp::correctionResidual() 1660 1.592 1.618 1.692 3.10% Gravity::multilevel_solve_for_new_phi() 10 1.674 1.674 1.674 3.07% MultiFab::Subtract() 601 1.647 1.659 1.667 3.06% Gravity::actual_multilevel_solve() 10 1.665 1.665 1.666 3.05% Castro::derive() 397 1.627 1.631 1.634 3.00% MLMG:computeResOfCorrection() 1421 1.453 1.477 1.544 2.83% Castro::do_old_sources() 30 1.516 1.53 1.538 2.82% Amr::FinalizeInit() 1 1.333 1.379 1.497 2.75% FabArray::ParallelCopy_nowait() 5320 1.418 1.444 1.468 2.69% Castro::initialize_advance() 30 1.364 1.382 1.391 2.55% FabArray::ParallelCopy_finish() 5320 0.594 1.062 1.366 2.50% Castro::volWgtSum() 242 1.331 1.346 1.364 2.50% FabArray::FillBoundary() 13093 1.2 1.229 1.277 2.34% FillPatchTwoLevels 394 1.15 1.174 1.185 2.17% Castro::expand_state() 30 1.146 1.16 1.179 2.16% Gravity::fill_multipole_BCs() 41 1.097 1.122 1.173 2.15% FluxRegister::Reflux() 180 1.165 1.166 1.167 2.14% Amr::writePlotFile() 2 1.144 1.144 1.144 2.10% Castro::post_init() 2 0.9607 0.9927 1.022 1.87% Gravity::get_new_grav_vector() 52 0.9881 0.9927 0.9959 1.83% MLMG::addInterpCorrection() 1421 0.306 0.8162 0.9871 1.81% MLMG::computeResWithCrseSolFineCor() 78 0.9242 0.9246 0.9251 1.70% MultiFab::sum() 4648 0.8932 0.9004 0.9053 1.66% MLMG::computeResidual() 333 0.8969 0.8991 0.9017 1.65% Castro::normalize_species() 254 0.8514 0.8586 0.8677 1.59% MLMG::mgVcycle_down::1 333 0.6699 0.6969 0.7619 1.40% MultiFab::Xpay() 2190 0.7104 0.7188 0.7349 1.35% FillBoundary_nowait() 13093 0.684 0.6939 0.7027 1.29% MLCellLinOp::reflux() 116 0.6502 0.6512 0.6521 1.20% MLMG::mgVcycle_up::2 333 0.207 0.5301 0.6397 1.17% Castro::construct_new_source() 250 0.5994 0.6063 0.6133 1.12% Castro::construct_new_gravity_source() 50 0.5988 0.6057 0.6128 1.12% MLMG::computeMLResidual() 97 0.5781 0.5969 0.6069 1.11% FillBoundary_finish() 13093 0.4707 0.5034 0.5626 1.03% FillPatchInterp(Fab) 130 0.3714 0.4592 0.5462 1.00% CellConservativeLinear::interp() 130 0.3695 0.4571 0.5444 1.00% Gravity::get_old_grav_vector() 30 0.5234 0.5262 0.528 0.97% MLMG::mgVcycle_up::1 333 0.4588 0.4754 0.5248 0.96% Castro::estTimeStep() 69 0.2239 0.3385 0.5057 0.93% Amr::InitializeInit() 1 0.2923 0.4103 0.4567 0.84% Amr::defBaseLevel() 1 0.2923 0.4103 0.4567 0.84% Castro::initData() 3 0.2651 0.3758 0.4182 0.77% Castro::finalize_advance() 30 0.3864 0.3894 0.3916 0.72% MLPoisson::FFlux() 1043 0.3874 0.3882 0.3892 0.71% MLPoisson::define() 81 0.3654 0.3722 0.3858 0.71% StateDataPhysBCFunct::() 853 0.329 0.3305 0.333 0.61% amrex::average_down 1713 0.3005 0.3099 0.3326 0.61% StateData::FillBoundary(geom) 63 0.3203 0.3218 0.3237 0.59% MLMG::prepareForSolve() 80 0.3047 0.3101 0.3219 0.59% MLMG::mgVcycle_bottom 489 0.1601 0.1987 0.3138 0.58% Castro::apply_source_to_state() 100 0.2777 0.279 0.2796 0.51% MultiFab::Saxpy() 100 0.2773 0.2786 0.2792 0.51% MLMG::mgVcycle_down::2 333 0.2439 0.2515 0.2726 0.50% MLCellLinOp::defineAuxData() 81 0.2086 0.2168 0.2337 0.43% Amr::bldFineLevels() 1 0.1892 0.2057 0.2235 0.41% MLMG::getGradSolution() 80 0.214 0.2148 0.2156 0.40% MLCellLinOp::compGrad() 100 0.2137 0.2146 0.2153 0.39% Castro::computeNewDt() 18 0.1324 0.1831 0.2098 0.38% MLMG::mgVcycle_down::3 211 0.0328 0.0733 0.1932 0.35% VisMF::Write(FabArray) 4 0.163 0.1689 0.1806 0.33% Castro::computeInitialDt() 2 0.01605 0.06254 0.1806 0.33% MLMG::miniCycle() 156 0.1597 0.16 0.1603 0.29% Castro::init(old) 9 0.1505 0.1522 0.1536 0.28% MLMG::actualBottomSolve() 333 0.0003893 0.03865 0.1534 0.28% Amr::grid_places() 11 0.1467 0.1503 0.1517 0.28% AmrMesh::MakeNewGrids() 11 0.1461 0.1497 0.1512 0.28% MultiFab::Multiply() 164 0.1492 0.1494 0.1497 0.27% MLCGSolver::bicgstab 83 0 0.03682 0.1473 0.27% FabArray::mult() 294 0.1425 0.1439 0.1452 0.27% MLCellLinOp::defineBC() 81 0.1379 0.1389 0.1405 0.26% MLMG::ResNormInf() 450 0.1241 0.131 0.1371 0.25% MLMG::mgVcycle_up::3 211 0.02462 0.05277 0.136 0.25% Castro::construct_old_source() 150 0.1343 0.1352 0.136 0.25% Castro::construct_old_gravity_source() 30 0.134 0.1349 0.1357 0.25% FabArray::setDomainBndry() 853 0.1298 0.1316 0.1335 0.24% Castro::volProductSum() 22 0.121 0.1225 0.1251 0.23% BndryData::define() 123 0.1128 0.1135 0.115 0.21% Gravity::update_max_rhs() 20 0.04796 0.07882 0.1061 0.19% MLMG::computeResWithCrseCorFineCor() 78 0.1043 0.1045 0.1048 0.19% Gravity::GetCrsePhi() 40 0.08992 0.09435 0.1046 0.19% MLCellLinOp::updateSolBC() 99 0.08401 0.09169 0.0974 0.18% Castro::check_for_nan() 60 0.09292 0.09331 0.0938 0.17% MultiFab::contains_nan() 60 0.09275 0.09313 0.09362 0.17% Castro::errorEst() 11 0.08265 0.08762 0.09293 0.17% FabArrayBase::getCPC() 8152 0.06823 0.07322 0.08612 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08076 0.08208 0.08351 0.15% Gravity::test_level_grad_phi_curr() 20 0.08038 0.08127 0.08227 0.15% MultiFab::LinComb() 628 0.06302 0.0677 0.07866 0.14% MLMG::mgVcycle_down::4 211 0.03129 0.042 0.07243 0.13% MultiFab::max() 40 0.0137 0.04458 0.07178 0.13% MLCellLinOp::updateCorBC() 78 0.06291 0.06356 0.06399 0.12% Gravity::test_composite_phi() 1 0.06349 0.0635 0.06351 0.12% MLCellLinOp::setLevelBC() 102 0.05009 0.05888 0.06197 0.11% MLMG::mgVcycle_up::4 211 0.02473 0.03287 0.05615 0.10% Castro::apply_tagging_restrictions() 11 0.04414 0.04738 0.05039 0.09% MLMG::buildFineMask() 80 0.04677 0.04704 0.04733 0.09% Gravity::test_level_grad_phi_prev() 30 0.04588 0.04662 0.04731 0.09% MultiFab::norm0(mask) 57 0.04494 0.04516 0.0454 0.08% FabArrayBase::CPC::define() 2260 0.02751 0.03215 0.04417 0.08% MLMG::MLResNormInf() 97 0.04255 0.04295 0.04386 0.08% MultiFab::Copy() 100 0.03903 0.03914 0.03923 0.07% MLMG::interpCorrection_1 78 0.03466 0.03573 0.03732 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03516 0.03564 0.03632 0.07% MLPoisson::prepareForSolve() 81 0.02471 0.02565 0.02816 0.05% MLMG::MLRhsNormInf() 80 0.02752 0.02766 0.0279 0.05% FabArrayBase::getFB() 13093 0.02329 0.02449 0.02786 0.05% MLCellLinOp::prepareForSolve() 81 0.02435 0.02529 0.0278 0.05% TagBoxArray::mapPRD 11 0.005669 0.01562 0.02367 0.04% Gravity::swapTimeLevels() 30 0.02181 0.02257 0.02317 0.04% Castro::finalize_do_advance() 30 0.01647 0.01865 0.02181 0.04% CGSolver::sxay() 588 0 0.004714 0.01886 0.03% Castro::build_fine_mask() 163 0.01804 0.01817 0.01854 0.03% AmrLevel::AmrLevel(dm) 12 0.01503 0.01704 0.01839 0.03% MLLinOp::define() 81 0.01254 0.01586 0.01831 0.03% StateData::define() 48 0.01478 0.01678 0.01811 0.03% MLLinOp::defineGrids() 81 0.01225 0.01556 0.01803 0.03% MLMG::compResidual() 1 0.0139 0.01453 0.01538 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01392 0.01448 0.0152 0.03% Castro::avgDown() 11 0.01378 0.01407 0.01442 0.03% Castro::avgDown(state_indx) 44 0.01372 0.01401 0.01436 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003575 0.0143 0.03% amrex::average_down_w_geom 44 0.01361 0.0139 0.01425 0.03% Castro::swap_state_time_levels() 30 0.01303 0.01349 0.01403 0.03% MultiFab::Dot() 463 0 0.002696 0.01079 0.02% Castro::apply_problem_tags() 11 0.007581 0.007914 0.00825 0.02% MLLinOp::makeSubCommunicator() 81 0.002459 0.005604 0.008158 0.01% Castro::FluxRegFineAdd() 30 0.007301 0.007414 0.007611 0.01% Castro::enforce_consistent_e() 3 0.003729 0.005216 0.006833 0.01% AMRErrorTag::operator() 11 0.004877 0.005275 0.005742 0.01% FabArrayBase::TheFPinfo() 130 0.001394 0.002614 0.005612 0.01% FPinfo::FPinfo() 3 0.0008858 0.002091 0.0051 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0008754 0.001987 0.005047 0.01% DistributionMapping::KnapSackDoIt() 3 0.0007796 0.001983 0.004994 0.01% Amr::InitAmr() 1 0.002608 0.002626 0.002653 0.00% FabArrayBase::FB::FB() 131 0.0008747 0.001271 0.002447 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002322 0.002353 0.002431 0.00% TagBoxArray::collate() 11 0.001037 0.00149 0.001827 0.00% makeSFC 243 0.001559 0.001585 0.001641 0.00% OwnerMask() 11 0.001458 0.001495 0.001556 0.00% DistributionMapping::Distribute() 245 0.0004839 0.0004937 0.0005012 0.00% Castro::enforce_speed_limit() 254 0.0003844 0.0003914 0.0003996 0.00% AmrMesh-cluster 2 0 9.265e-05 0.0003706 0.00% ClusterList::intersect() 2 0 6.158e-05 0.0002463 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.046e-05 0.0001471 0.0002377 0.00% FabArray::RecvLayoutMask() 21 0.0001928 0.0001976 0.000203 0.00% BoxList::parallelComplementIn() 22 7.617e-05 8.138e-05 8.74e-05 0.00% Castro::create_source_corrector() 30 7.559e-05 7.979e-05 8.628e-05 0.00% Amr::writeSmallPlotFile() 1 7.064e-05 7.283e-05 7.585e-05 0.00% Castro::retry_advance_ctu() 30 5.456e-05 6.136e-05 7.045e-05 0.00% knapsack() 3 6.725e-05 6.832e-05 7.03e-05 0.00% Amr::initSubcycle() 1 3.476e-05 4.89e-05 6.069e-05 0.00% Castro::gwstrain() 22 3.565e-05 4.018e-05 4.571e-05 0.00% BoxList::complementIn 22 3.65e-05 3.938e-05 4.268e-05 0.00% Gravity::set_mass_offset() 11 2.719e-05 3.196e-05 3.688e-05 0.00% ClusterList::chop() 2 0 5.369e-06 2.148e-05 0.00% knapsack()swap 2 4.807e-06 5.256e-06 5.437e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-37-g3cc4a66759c9) finalized