MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-12-g806f2373b68e) initialized Starting run at 05:40:04 UTC on 2022-03-15. Successfully read inputs file ... Castro git describe: 22.02-5-g5116b7268 AMReX git describe: 22.03-12-g806f2373b Microphysics git describe: 22.03-6-g41c4af20 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.011114892 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.011214087 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.030105183 Gravity::fill_multipole_BCs() time = 0.02953621 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.601567373 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033265658 Gravity::solve_for_phi() time = 0.409941979 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -6.931137899e+22 ymom added: -5.666839779e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.143872763 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.483775691 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02721247 Gravity::solve_for_phi() time = 0.349521256 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.156991314 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08246826334 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008504603 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009619598 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.110134821 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045405973 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010236274 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01595202472 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008572679 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009126083 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107387364 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045252692 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010232516 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01455750248 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02786964 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010507091 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.152347113 Castro::reflux() at level 0 : time = 1.032587294 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 5.02250582 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009624675 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029609173 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031769541 Gravity::solve_for_phi() time = 0.399011565 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852869e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.135138218 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.453000931 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025594699 Gravity::solve_for_phi() time = 0.343626784 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.150323278 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08479355481 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008645196 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009538924 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107332393 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044514402 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010679797 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01620044481 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008386973 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009395693 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107876652 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045263054 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010297278 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01489978021 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028995926 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010066204 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809893e+28 ymom added: 8.089770255e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.14970627 Castro::reflux() at level 0 : time = 1.024263974 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.29718184 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009742638 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028673624 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031407466 Gravity::solve_for_phi() time = 0.39907707 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.69293902e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.135581731 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.448327063 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026924034 Gravity::solve_for_phi() time = 0.35122816 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.159328132 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08441907579 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008214499 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009206454 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107650541 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042748344 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010132339 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01632952373 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007918873 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009112165 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106882153 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042771641 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010224191 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01482060696 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02898401 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010034075 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342333e+27 ymom added: 5.311566494e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.147019106 Castro::reflux() at level 0 : time = 0.998895249 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.225676034 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009554362 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028627624 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02841034 Gravity::solve_for_phi() time = 0.376945145 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700669e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.130572787 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.442119629 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024504301 Gravity::solve_for_phi() time = 0.327367969 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.148637416 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08660490703 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008027747 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.008957878 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1068965 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04295572 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010144083 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01646107437 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008013045 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009106322 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107093325 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042889301 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.009958698 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01516558883 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028898441 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010033413 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860432e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.155295794 Castro::reflux() at level 0 : time = 0.965357738 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.061431963 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.010089263 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030039794 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032602187 Gravity::solve_for_phi() time = 0.385482422 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150483e+30 ymom added: 3.399803827e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.13256771 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.455346638 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024351536 Gravity::solve_for_phi() time = 0.327022517 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.146957292 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08594416174 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008282845 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009184536 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10711237 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042771383 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010125654 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01648935199 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008286188 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.00910255 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106923913 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042869694 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010155206 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0151260373 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028748986 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010078014 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277775e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.146617343 Castro::reflux() at level 0 : time = 0.940194179 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.086197308 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009499635 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028933261 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.042925403 Gravity::solve_for_phi() time = 0.394044442 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919308e+30 ymom added: 4.094511463e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.130754241 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.446473168 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028247361 Gravity::solve_for_phi() time = 0.330275034 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245022e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.148011148 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08576866644 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00804924 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009080788 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107590929 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044116908 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010107828 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01640276772 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008071008 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009055841 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107202283 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042898216 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010131801 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01515595762 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028861032 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010162652 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.148465058 Castro::reflux() at level 0 : time = 0.951982761 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.102608543 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009703971 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029111613 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027840451 Gravity::solve_for_phi() time = 0.376989778 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151128e+30 ymom added: 4.515687996e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.132107203 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.447262028 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024458076 Gravity::solve_for_phi() time = 0.326552237 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.14722896 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08639175924 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00809625 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009015605 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106963244 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042555535 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010151386 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01652949766 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008238273 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009153165 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10661441 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042782743 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010149541 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01517422384 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028834922 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009979328 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.145994892 Castro::reflux() at level 0 : time = 0.938542796 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.142216414 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009467786 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02881709 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029150118 Gravity::solve_for_phi() time = 0.379454801 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064088e+30 ymom added: 4.889542979e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.136548724 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.445481395 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02494346 Gravity::solve_for_phi() time = 0.373426853 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.153157498 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08487960633 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008042994 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009112908 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107980093 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042955769 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010015655 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01645297621 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008158888 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009134252 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106790615 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042809995 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.009939037 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01513387296 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028619773 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010007567 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907345e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.146658766 Castro::reflux() at level 0 : time = 0.937813495 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.164098618 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009432698 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02866428 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029214265 Gravity::solve_for_phi() time = 0.377533043 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036368e+30 ymom added: 5.530451715e+30 zmom added: 5.530356286e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.130991227 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.446794615 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024813756 Gravity::solve_for_phi() time = 0.373322835 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.153660723 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08505652264 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007959872 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009117859 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107797957 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043252595 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010155645 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01642681011 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008004924 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009092938 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107211532 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042705091 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.01010371 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01514638176 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028747369 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.009953272 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.1461988 Castro::reflux() at level 0 : time = 0.937609155 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.202766558 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009577995 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028524139 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028977691 Gravity::solve_for_phi() time = 0.377508763 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167175e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.13078722 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.45050744 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027338581 Gravity::solve_for_phi() time = 0.375436593 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.153171683 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08491128976 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007979196 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009017125 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107190769 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048487152 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010236744 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01612209794 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007937016 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009107818 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107568394 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048600289 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.00988009 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01482183331 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028643683 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009991692 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914869e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.146462704 Castro::reflux() at level 0 : time = 0.996611137 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.230600685 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.54494882 seconds Ending run at 05:40:58 UTC on 2022-03-15. Run time = 54.34120025 Run time without initialization = 52.08357964 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.34 ... 54.34 ... 54.34 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.5053 16.5687 16.6542 30.65% MLPoisson::Fsmooth() 11992 4.181 4.29 4.463 8.21% Castro::reset_internal_energy() 257 2.918 2.997 3.065 5.64% MultiFab::AddProduct() 4648 2.696 2.704 2.725 5.01% FabArray::setVal() 9464 2.306 2.327 2.347 4.32% MLPoisson::Fapply() 2422 1.873 1.889 1.921 3.54% MLCellLinOp::applyBC() 14630 1.483 1.55 1.713 3.15% MultiFab::Subtract() 601 1.64 1.646 1.663 3.06% FabArray::ParallelCopy_nowait() 5320 1.386 1.411 1.427 2.63% FabArray::ParallelCopy_finish() 5320 0.6054 1.077 1.297 2.39% Castro::enforce_min_density() 254 1.046 1.119 1.202 2.21% Gravity::fill_multipole_BCs() 41 1.062 1.089 1.135 2.09% Castro::derive() 397 0.9251 0.928 0.932 1.72% MultiFab::sum() 4648 0.8772 0.882 0.8915 1.64% FluxRegister::Reflux() 180 0.8212 0.8229 0.8248 1.52% Castro::reflux() 10 0.69 0.7092 0.7586 1.40% MultiFab::Xpay() 2190 0.7046 0.713 0.7247 1.33% FillBoundary_nowait() 13093 0.663 0.6822 0.6976 1.28% FillBoundary_finish() 13093 0.5271 0.5902 0.684 1.26% Castro::construct_new_gravity_source() 50 0.5962 0.6071 0.618 1.14% Castro::volWgtSum() 242 0.553 0.5588 0.5638 1.04% CellConservativeLinear::interp() 130 0.3679 0.4543 0.5396 0.99% Castro::normalize_species() 254 0.5077 0.5128 0.5174 0.95% Castro::computeTemp() 257 0.4693 0.471 0.4749 0.87% MLPoisson::FFlux() 1044 0.3867 0.3889 0.3907 0.72% Castro::finalize_advance() 30 0.3561 0.3596 0.3639 0.67% Castro::estTimeStep() 69 0.2284 0.2779 0.3588 0.66% Gravity::get_new_grav_vector() 52 0.3316 0.3339 0.3373 0.62% StateData::FillBoundary(geom) 63 0.3256 0.3271 0.3289 0.61% FillPatchSingleLevel 853 0.3242 0.3251 0.3265 0.60% amrex::average_down 1713 0.2774 0.2824 0.2905 0.53% MLMG::addInterpCorrection() 1421 0.2581 0.2633 0.2749 0.51% FillPatchIterator::Initialize 723 0.2564 0.2652 0.2741 0.50% MultiFab::Saxpy() 100 0.2707 0.2717 0.2733 0.50% MLMG::oneIter() 333 0.2132 0.2287 0.2733 0.50% Castro::post_timestep() 30 0.1985 0.2098 0.2212 0.41% Castro::do_advance_ctu() 30 0.2159 0.2166 0.2183 0.40% MLCellLinOp::reflux() 116 0.1775 0.1854 0.2075 0.38% Castro::expand_state() 30 0.1893 0.1911 0.1952 0.36% MLCellLinOp::defineAuxData() 81 0.174 0.1783 0.1857 0.34% VisMF::Write(FabArray) 4 0.1616 0.168 0.1807 0.33% MLCellLinOp::compGrad() 100 0.169 0.1706 0.1746 0.32% Gravity::get_old_grav_vector() 30 0.1645 0.1659 0.1677 0.31% MultiFab::min() 30 0.007472 0.09755 0.1611 0.30% FabArray::mult() 294 0.145 0.1458 0.1463 0.27% MultiFab::Multiply() 164 0.1436 0.1442 0.1448 0.27% Castro::construct_old_gravity_source() 30 0.133 0.1338 0.135 0.25% FabArray::setDomainBndry() 853 0.1273 0.1292 0.1322 0.24% Amr::writePlotFile() 2 0.115 0.1223 0.1293 0.24% MLMG::ResNormInf() 450 0.1011 0.1075 0.1161 0.21% MultiFab::contains_nan() 60 0.09252 0.09294 0.09327 0.17% BndryData::define() 123 0.08694 0.08784 0.08938 0.16% Castro::construct_old_gravity() 30 0.08642 0.08728 0.08797 0.16% Gravity::gravity_sync() 10 0.07173 0.07548 0.0856 0.16% MLMG::prepareForSolve() 80 0.08035 0.08089 0.08212 0.15% MultiFab::LinComb() 628 0.06408 0.06867 0.08071 0.15% Castro::evaluate_source_change() 591 0.07671 0.0778 0.07882 0.15% Gravity::test_level_grad_phi_curr() 20 0.07166 0.07178 0.07206 0.13% Castro::construct_new_gravity() 30 0.05482 0.0602 0.07193 0.13% Castro::initData() 3 0.05737 0.06087 0.06506 0.12% MLCellLinOp::updateSolBC() 99 0.05757 0.05805 0.05866 0.11% Castro::volProductSum() 22 0.0488 0.05274 0.05806 0.11% MLCGSolver::bicgstab 83 0 0.01412 0.05649 0.10% MultiFab::max() 40 0.01136 0.02303 0.05222 0.10% MultiFab::norm0(mask) 57 0.04697 0.04727 0.04749 0.09% MLCellLinOp::updateCorBC() 78 0.04517 0.04574 0.04632 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04521 0.04552 0.04603 0.08% Castro::initialize_do_advance() 30 0.03493 0.03948 0.04366 0.08% FabArrayBase::CPC::define() 2260 0.02774 0.03182 0.04276 0.08% FabArrayBase::getCPC() 8152 0.0411 0.04159 0.04203 0.08% MLCellLinOp::setLevelBC() 102 0.03977 0.04062 0.04132 0.08% Gravity::test_level_grad_phi_prev() 30 0.04038 0.04094 0.0413 0.08% MLMG::buildFineMask() 80 0.04024 0.04045 0.04053 0.07% Gravity::actual_solve_with_mlmg() 81 0.03705 0.03866 0.04037 0.07% MultiFab::Copy() 100 0.03907 0.03937 0.03968 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03695 0.03758 0.03872 0.07% AmrMesh::MakeNewGrids() 11 0.03425 0.03473 0.03504 0.06% FabArray::FillBoundary() 13093 0.03125 0.03209 0.03435 0.06% Gravity::solve_for_phi() 60 0.02655 0.03011 0.03399 0.06% MLCellLinOp::smooth() 5996 0.02632 0.02753 0.02895 0.05% MLCellLinOp::prepareForSolve() 81 0.02447 0.02567 0.02813 0.05% Castro::initialize_advance() 30 0.02523 0.02598 0.02629 0.05% Castro::init(old) 9 0.02616 0.02621 0.02626 0.05% FabArrayBase::getFB() 13093 0.02264 0.02341 0.02556 0.05% MLCellLinOp::defineBC() 81 0.02387 0.02422 0.02454 0.05% Gravity::update_max_rhs() 20 0.02388 0.02411 0.02421 0.04% MLMG::interpCorrection_1 78 0.02265 0.02278 0.02291 0.04% Castro::finalize_do_advance() 30 0.009445 0.01633 0.02203 0.04% Castro::apply_tagging_restrictions() 11 0.02091 0.02101 0.02111 0.04% Amr::defBaseLevel() 1 0.02022 0.02075 0.02096 0.04% FillPatchTwoLevels 394 0.01545 0.01695 0.01928 0.04% Castro::build_fine_mask() 153 0.01822 0.01844 0.0187 0.03% Castro::post_init() 2 0.0004642 0.006192 0.01849 0.03% StateData::define() 48 0.01442 0.01478 0.01497 0.03% FabArray::ParallelCopy() 5320 0.01421 0.01438 0.01479 0.03% StateDataPhysBCFunct::() 853 0.01018 0.01134 0.01371 0.03% Castro::swap_state_time_levels() 30 0.01307 0.01314 0.01327 0.02% MLMG::MLRhsNormInf() 80 0.01233 0.0124 0.01244 0.02% Gravity::actual_multilevel_solve() 10 0.01182 0.01211 0.01239 0.02% MultiFab::Dot() 463 0 0.002903 0.01161 0.02% MLMG::solve() 80 0.005556 0.008929 0.01138 0.02% Amr::regrid() 10 0.00992 0.0103 0.01126 0.02% Gravity::GetCrsePhi() 40 0.009517 0.009716 0.009919 0.02% MLCellLinOp::apply() 2422 0.005741 0.006775 0.009357 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008255 0.008606 0.008925 0.02% Castro::apply_problem_tags() 11 0.007488 0.007536 0.007664 0.01% MLLinOp::defineGrids() 81 0.006763 0.007243 0.007631 0.01% Castro::FluxRegFineAdd() 30 0.007108 0.007263 0.007452 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001793 0.007172 0.01% MLLinOp::makeSubCommunicator() 81 0.002157 0.00451 0.006867 0.01% Castro::enforce_consistent_e() 3 0.003482 0.005312 0.006505 0.01% Castro::do_new_sources() 50 0.0008454 0.003082 0.00631 0.01% MLCellLinOp::correctionResidual() 1660 0.004588 0.00497 0.005861 0.01% MLMG::MLResNormInf() 97 0.0003431 0.003769 0.005218 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.00511 0.005145 0.005195 0.01% AMRErrorTag::operator() 11 0.004717 0.004833 0.00497 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004872 0.004916 0.00496 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004859 0.004884 0.004899 0.01% CGSolver::sxay() 588 0 0.001191 0.004763 0.01% Castro::do_old_sources() 30 0.0004622 0.001795 0.004745 0.01% Gravity::test_composite_phi() 1 0.003848 0.004122 0.004453 0.01% MLMG::mgVcycle() 489 0.004068 0.00415 0.004328 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0001652 0.001971 0.003962 0.01% MLMG:computeResOfCorrection() 1421 0.003321 0.003418 0.00361 0.01% MLMG::actualBottomSolve() 333 0.000384 0.001137 0.003365 0.01% FillPatchInterp(Fab) 130 0.001755 0.002125 0.002991 0.01% main() 1 0.002579 0.002731 0.002835 0.01% FabArrayBase::FB::FB() 131 0.0008429 0.001243 0.002377 0.00% MLMG::mgVcycle_down::0 333 0.002231 0.002283 0.002325 0.00% MLMG::mgVcycle_down::1 333 0.002039 0.002095 0.002186 0.00% Castro::subcycle_advance_ctu() 30 0.0002014 0.0006564 0.002007 0.00% MLMG::mgVcycle_down::2 333 0.00186 0.001933 0.001999 0.00% MLCellLinOp::solutionResidual() 530 0.001946 0.001966 0.001982 0.00% Gravity::solve_phi_with_mlmg() 71 0.001645 0.001703 0.001831 0.00% Amr::InitAmr() 1 0.001676 0.00168 0.001687 0.00% OwnerMask() 11 0.001434 0.001534 0.001635 0.00% MLMG::mgVcycle_up::0 333 0.001512 0.001551 0.001586 0.00% Castro::clean_state() 254 0.001496 0.001545 0.001583 0.00% MLMG::mgVcycle_up::2 333 0.001302 0.001354 0.001448 0.00% TagBoxArray::collate() 11 0.0009909 0.001245 0.001432 0.00% MLMG::mgVcycle_up::1 333 0.001322 0.001362 0.001422 0.00% MLMG::mgVcycle_down::3 211 0.001171 0.001224 0.001324 0.00% MLMG::mgVcycle_bottom 489 0.001246 0.001272 0.001321 0.00% makeSFC 243 0.001037 0.001181 0.001311 0.00% MLMG::mgVcycle_down::4 211 0.001095 0.001151 0.001277 0.00% Amr::coarseTimeStep() 10 0.0008332 0.0009316 0.001006 0.00% Amr::bldFineLevels() 1 0.0007684 0.0008293 0.0008935 0.00% TagBoxArray::mapPRD 11 0.0008117 0.0008512 0.0008888 0.00% MLMG::mgVcycle_up::4 211 0.0007648 0.0008011 0.0008861 0.00% MLMG::mgVcycle_up::3 211 0.0007294 0.000773 0.0008619 0.00% MLMG::computeResidual() 333 0.0008376 0.0008454 0.0008536 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007549 0.0007987 0.0008334 0.00% Amr::timeStep() 30 0.0004552 0.0005236 0.0007006 0.00% MLPoisson::define() 81 0.0005735 0.0006362 0.0006778 0.00% Castro::construct_new_source() 250 0.000577 0.000597 0.0006204 0.00% Amr::grid_places() 11 0.0005061 0.0005639 0.0005945 0.00% FabArrayBase::TheFPinfo() 130 0.0004976 0.0005185 0.000533 0.00% DistributionMapping::Distribute() 245 0.0004866 0.0004978 0.0005141 0.00% Castro::enforce_speed_limit() 254 0.0003867 0.0004017 0.0004139 0.00% Castro::apply_source_to_state() 100 0.0003415 0.0003589 0.000371 0.00% Castro::computeNewDt() 18 0.0001143 0.0001845 0.0003695 0.00% MLPoisson::prepareForSolve() 81 0.0003191 0.0003422 0.0003589 0.00% MLMG::computeMLResidual() 97 0.0002959 0.0003121 0.0003296 0.00% MLLinOp::define() 81 0.000289 0.0003024 0.000321 0.00% Castro::construct_old_source() 150 0.0002713 0.0002827 0.0002908 0.00% AmrLevel::AmrLevel(dm) 12 0.0002553 0.0002643 0.000283 0.00% MLMG::getGradSolution() 80 0.0002586 0.0002729 0.0002823 0.00% MLMG::miniCycle() 156 0.0002643 0.0002688 0.0002728 0.00% Castro::post_regrid() 22 0.0002342 0.0002456 0.0002515 0.00% ClusterList::intersect() 2 0 5.534e-05 0.0002214 0.00% Castro::advance() 30 0.0001999 0.0002062 0.0002119 0.00% FabArray::RecvLayoutMask() 21 0.0001937 0.0001967 0.0001991 0.00% Gravity::swapTimeLevels() 30 0.000178 0.0001891 0.0001984 0.00% Castro::check_for_nan() 60 0.0001749 0.0001777 0.0001832 0.00% Castro::errorEst() 11 0.0001217 0.0001271 0.0001319 0.00% Castro::avgDown(state_indx) 44 0.0001121 0.0001162 0.0001188 0.00% FPinfo::FPinfo() 3 0.0001047 0.0001093 0.0001175 0.00% Amr::FinalizeInit() 1 2.437e-05 5.334e-05 0.0001167 0.00% AmrMesh-cluster 2 0 2.531e-05 0.0001012 0.00% Gravity::solve_for_delta_phi 10 7.894e-05 8.699e-05 9.68e-05 0.00% amrex::average_down_w_geom 44 8.849e-05 9.165e-05 9.48e-05 0.00% Castro::create_source_corrector() 30 8.057e-05 8.256e-05 8.338e-05 0.00% Amr::writeSmallPlotFile() 1 7.779e-05 7.987e-05 8.315e-05 0.00% Castro::retry_advance_ctu() 30 5.403e-05 6.056e-05 6.94e-05 0.00% knapsack() 3 6.073e-05 6.298e-05 6.732e-05 0.00% Castro::avgDown() 11 5.724e-05 6.055e-05 6.332e-05 0.00% Castro::gwstrain() 22 3.81e-05 4.198e-05 4.935e-05 0.00% BoxList::parallelComplementIn() 22 4.104e-05 4.176e-05 4.288e-05 0.00% Amr::initSubcycle() 1 3.508e-05 3.659e-05 4.023e-05 0.00% BoxList::complementIn 22 3.873e-05 3.924e-05 4.001e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.349e-05 3.597e-05 3.975e-05 0.00% Gravity::set_mass_offset() 11 2.965e-05 3.252e-05 3.647e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.878e-05 3.083e-05 3.357e-05 0.00% ClusterList::chop() 2 0 4.823e-06 1.929e-05 0.00% Castro::computeInitialDt() 2 1.169e-05 1.228e-05 1.268e-05 0.00% MLMG::compResidual() 1 1.188e-05 1.218e-05 1.248e-05 0.00% Amr::InitializeInit() 1 5.787e-06 7.321e-06 1.005e-05 0.00% Amr::init() 1 5.434e-06 6.139e-06 6.72e-06 0.00% knapsack()swap 2 4.652e-06 4.894e-06 5.095e-06 0.00% Amr::initialInit() 1 3.543e-06 4.341e-06 4.753e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.34 54.34 54.34 100.00% Amr::coarseTimeStep() 10 51.54 51.54 51.54 94.84% Amr::timeStep() 30 51.46 51.46 51.46 94.69% Castro::advance() 30 36.04 36.04 36.04 66.32% Castro::subcycle_advance_ctu() 30 34.27 34.28 34.28 63.08% Castro::do_advance_ctu() 30 34.27 34.28 34.28 63.08% Castro::construct_ctu_hydro_source() 30 16.51 16.57 16.65 30.65% Gravity::actual_solve_with_mlmg() 81 13.34 13.35 13.35 24.57% MLMG::solve() 80 12.63 12.64 12.64 23.26% Castro::post_timestep() 30 12.31 12.31 12.31 22.65% Castro::clean_state() 254 10.48 10.63 10.74 19.76% MLMG::oneIter() 333 10.6 10.61 10.64 19.58% Gravity::solve_phi_with_mlmg() 71 10 10.04 10.09 18.58% Castro::reflux() 10 9.705 9.716 9.724 17.89% MLMG::mgVcycle() 489 9.272 9.285 9.301 17.12% Gravity::solve_for_phi() 60 8.308 8.337 8.39 15.44% MLCellLinOp::smooth() 5996 6.352 6.471 6.785 12.49% Castro::computeTemp() 257 6.208 6.296 6.35 11.68% Castro::reset_internal_energy() 257 5.738 5.826 5.88 10.82% Gravity::gravity_sync() 10 5.088 5.088 5.089 9.36% Castro::construct_new_gravity() 30 5.054 5.068 5.085 9.36% Castro::construct_old_gravity() 30 4.703 4.733 4.781 8.80% Castro::evaluate_source_change() 591 4.572 4.588 4.631 8.52% MLPoisson::Fsmooth() 11992 4.181 4.29 4.463 8.21% Gravity::solve_for_delta_phi 10 4.262 4.263 4.263 7.84% Castro::enforce_min_density() 254 3.83 3.915 3.991 7.34% MLMG::mgVcycle_down::0 333 3.95 3.959 3.972 7.31% FillPatchIterator::Initialize 723 3.258 3.292 3.324 6.12% Castro::do_new_sources() 50 3.26 3.275 3.301 6.08% Amr::regrid() 10 3.139 3.167 3.178 5.85% MLCellLinOp::applyBC() 14630 2.751 2.86 3.041 5.60% Castro::post_regrid() 22 2.951 3.005 3.025 5.57% MLMG::mgVcycle_up::0 333 2.712 2.909 2.983 5.49% FabArray::ParallelCopy() 5320 2.096 2.552 2.77 5.10% MultiFab::AddProduct() 4648 2.696 2.704 2.725 5.01% MLCellLinOp::apply() 2422 2.486 2.532 2.607 4.80% Castro::initialize_do_advance() 30 2.475 2.518 2.537 4.67% FabArray::setVal() 9464 2.306 2.327 2.347 4.32% FillPatchSingleLevel 853 2.23 2.245 2.273 4.18% Amr::init() 1 2.256 2.256 2.256 4.15% MLPoisson::Fapply() 2422 1.873 1.889 1.921 3.54% MLCellLinOp::solutionResidual() 530 1.743 1.757 1.772 3.26% MLCellLinOp::correctionResidual() 1660 1.612 1.639 1.71 3.15% Gravity::multilevel_solve_for_new_phi() 10 1.703 1.703 1.703 3.13% Gravity::actual_multilevel_solve() 10 1.694 1.695 1.695 3.12% MultiFab::Subtract() 601 1.64 1.646 1.663 3.06% Amr::initialInit() 1 1.654 1.654 1.654 3.04% Castro::derive() 397 1.632 1.639 1.645 3.03% MLMG:computeResOfCorrection() 1421 1.474 1.495 1.55 2.85% Castro::do_old_sources() 30 1.489 1.505 1.521 2.80% FabArray::ParallelCopy_nowait() 5320 1.434 1.461 1.476 2.72% FabArray::FillBoundary() 13093 1.277 1.329 1.402 2.58% Castro::volWgtSum() 242 1.362 1.369 1.377 2.53% Castro::initialize_advance() 30 1.358 1.368 1.375 2.53% Amr::FinalizeInit() 1 1.284 1.31 1.366 2.51% FabArray::ParallelCopy_finish() 5320 0.6054 1.077 1.297 2.39% Castro::expand_state() 30 1.154 1.169 1.194 2.20% FillPatchTwoLevels 394 1.147 1.162 1.176 2.16% Gravity::fill_multipole_BCs() 41 1.099 1.126 1.172 2.16% FluxRegister::Reflux() 180 1.112 1.139 1.155 2.13% Amr::writePlotFile() 2 1.147 1.147 1.147 2.11% Gravity::get_new_grav_vector() 52 0.9988 1.003 1.01 1.86% Castro::post_init() 2 0.9718 0.9812 1.009 1.86% MLMG::addInterpCorrection() 1421 0.3057 0.8232 1 1.84% MLMG::computeResWithCrseSolFineCor() 78 0.9362 0.9417 0.9572 1.76% MLMG::computeResidual() 333 0.9011 0.9234 0.9318 1.71% MultiFab::sum() 4648 0.8772 0.882 0.8915 1.64% MLMG::mgVcycle_down::1 333 0.6886 0.7181 0.795 1.46% FillBoundary_nowait() 13093 0.6865 0.7069 0.7255 1.34% MultiFab::Xpay() 2190 0.7046 0.713 0.7247 1.33% MLCellLinOp::reflux() 116 0.6619 0.6701 0.6942 1.28% FillBoundary_finish() 13093 0.5271 0.5902 0.684 1.26% MLMG::mgVcycle_up::2 333 0.2124 0.5405 0.6525 1.20% MLMG::computeMLResidual() 97 0.5873 0.6056 0.6197 1.14% Castro::construct_new_source() 250 0.5968 0.6077 0.6186 1.14% Castro::construct_new_gravity_source() 50 0.5962 0.6071 0.618 1.14% FillPatchInterp(Fab) 130 0.3709 0.4564 0.5413 1.00% CellConservativeLinear::interp() 130 0.3679 0.4543 0.5396 0.99% MLMG::mgVcycle_up::1 333 0.4693 0.4869 0.5358 0.99% Gravity::get_old_grav_vector() 30 0.5241 0.5305 0.5356 0.99% Castro::normalize_species() 254 0.5077 0.5128 0.5174 0.95% Castro::finalize_advance() 30 0.3889 0.3948 0.4021 0.74% MLPoisson::define() 81 0.3729 0.3796 0.3912 0.72% MLPoisson::FFlux() 1044 0.3867 0.3889 0.3907 0.72% Amr::InitializeInit() 1 0.2873 0.3436 0.3701 0.68% Amr::defBaseLevel() 1 0.2873 0.3436 0.3701 0.68% Castro::estTimeStep() 69 0.2284 0.2779 0.3588 0.66% Castro::initData() 3 0.2598 0.3149 0.3442 0.63% StateDataPhysBCFunct::() 853 0.3359 0.3384 0.3416 0.63% amrex::average_down 1713 0.3014 0.3112 0.3328 0.61% StateData::FillBoundary(geom) 63 0.3256 0.3271 0.3289 0.61% MLMG::prepareForSolve() 80 0.3074 0.3127 0.3226 0.59% MLMG::mgVcycle_bottom 489 0.163 0.2026 0.3206 0.59% MLMG::mgVcycle_down::2 333 0.2493 0.2586 0.2828 0.52% Castro::apply_source_to_state() 100 0.271 0.2721 0.2737 0.50% MultiFab::Saxpy() 100 0.2707 0.2717 0.2733 0.50% MLCellLinOp::defineAuxData() 81 0.2158 0.2229 0.2381 0.44% MLMG::getGradSolution() 80 0.2193 0.2203 0.2218 0.41% MLCellLinOp::compGrad() 100 0.219 0.22 0.2215 0.41% MLMG::mgVcycle_down::3 211 0.03357 0.07432 0.1943 0.36% VisMF::Write(FabArray) 4 0.1616 0.168 0.1807 0.33% Castro::computeNewDt() 18 0.1356 0.1453 0.1725 0.32% Amr::bldFineLevels() 1 0.1602 0.1622 0.1637 0.30% MLMG::miniCycle() 156 0.1626 0.1628 0.1631 0.30% MultiFab::min() 30 0.007472 0.09755 0.1611 0.30% MLMG::actualBottomSolve() 333 0.000384 0.03975 0.1578 0.29% Castro::init(old) 9 0.1483 0.15 0.1525 0.28% MLCGSolver::bicgstab 83 0 0.03791 0.1517 0.28% MLMG::ResNormInf() 450 0.132 0.1383 0.1467 0.27% FabArray::mult() 294 0.145 0.1458 0.1463 0.27% MultiFab::Multiply() 164 0.1436 0.1442 0.1448 0.27% MLCellLinOp::defineBC() 81 0.1404 0.1415 0.1432 0.26% MLMG::mgVcycle_up::3 211 0.02513 0.05381 0.1381 0.25% Castro::construct_old_source() 150 0.1332 0.1341 0.1353 0.25% Castro::construct_old_gravity_source() 30 0.133 0.1338 0.135 0.25% FabArray::setDomainBndry() 853 0.1273 0.1292 0.1322 0.24% Castro::volProductSum() 22 0.1208 0.1247 0.1302 0.24% BndryData::define() 123 0.1153 0.1161 0.1179 0.22% Amr::grid_places() 11 0.1081 0.1085 0.1092 0.20% AmrMesh::MakeNewGrids() 11 0.1075 0.108 0.1086 0.20% MLMG::computeResWithCrseCorFineCor() 78 0.1032 0.1047 0.1053 0.19% Gravity::GetCrsePhi() 40 0.08991 0.09354 0.1011 0.19% Castro::computeInitialDt() 2 0.01582 0.04231 0.0986 0.18% Castro::check_for_nan() 60 0.0927 0.09312 0.09345 0.17% MultiFab::contains_nan() 60 0.09252 0.09294 0.09327 0.17% MLCellLinOp::updateSolBC() 99 0.08388 0.08813 0.09017 0.17% Gravity::update_max_rhs() 20 0.04577 0.05733 0.08634 0.16% FabArrayBase::getCPC() 8152 0.06905 0.07341 0.08479 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08123 0.08158 0.08223 0.15% Gravity::test_level_grad_phi_curr() 20 0.08126 0.08146 0.08165 0.15% MultiFab::LinComb() 628 0.06408 0.06867 0.08071 0.15% MLMG::mgVcycle_down::4 211 0.03216 0.04334 0.07438 0.14% MLCellLinOp::updateCorBC() 78 0.06279 0.06425 0.06516 0.12% MLCellLinOp::setLevelBC() 102 0.05067 0.05853 0.0613 0.11% Gravity::test_composite_phi() 1 0.06095 0.06096 0.06097 0.11% Castro::errorEst() 11 0.05878 0.05914 0.05945 0.11% MLMG::mgVcycle_up::4 211 0.02516 0.03358 0.0571 0.11% MLMG::interpCorrection_1 78 0.0298 0.04673 0.0548 0.10% MultiFab::max() 40 0.01136 0.02303 0.05222 0.10% MLMG::buildFineMask() 80 0.04994 0.05018 0.0503 0.09% MLMG::MLResNormInf() 97 0.04369 0.04709 0.04825 0.09% MultiFab::norm0(mask) 57 0.04697 0.04727 0.04749 0.09% Gravity::test_level_grad_phi_prev() 30 0.0459 0.04657 0.04707 0.09% FabArrayBase::CPC::define() 2260 0.02774 0.03182 0.04276 0.08% MultiFab::Copy() 100 0.03907 0.03937 0.03968 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03695 0.03758 0.03872 0.07% MLMG::MLRhsNormInf() 80 0.02877 0.02887 0.02896 0.05% MLPoisson::prepareForSolve() 81 0.02482 0.02601 0.02844 0.05% MLCellLinOp::prepareForSolve() 81 0.02447 0.02567 0.02813 0.05% FabArrayBase::getFB() 13093 0.02351 0.02465 0.02794 0.05% Gravity::swapTimeLevels() 30 0.02262 0.02295 0.02325 0.04% Castro::finalize_do_advance() 30 0.009445 0.01633 0.02203 0.04% Castro::apply_tagging_restrictions() 11 0.02091 0.02101 0.02111 0.04% CGSolver::sxay() 588 0 0.004957 0.01983 0.04% Castro::build_fine_mask() 153 0.01822 0.01844 0.0187 0.03% MLLinOp::define() 81 0.01151 0.01452 0.01744 0.03% MLLinOp::defineGrids() 81 0.01119 0.01422 0.01715 0.03% MLMG::compResidual() 1 0.01438 0.01474 0.01529 0.03% AmrLevel::AmrLevel(dm) 12 0.01471 0.01504 0.01523 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01421 0.01451 0.01505 0.03% StateData::define() 48 0.01442 0.01478 0.01497 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003639 0.01456 0.03% Castro::avgDown() 11 0.01413 0.01427 0.01448 0.03% Castro::avgDown(state_indx) 44 0.01406 0.0142 0.01442 0.03% amrex::average_down_w_geom 44 0.01395 0.01409 0.0143 0.03% Castro::swap_state_time_levels() 30 0.01307 0.01314 0.01327 0.02% MultiFab::Dot() 463 0 0.002903 0.01161 0.02% Castro::apply_problem_tags() 11 0.007488 0.007536 0.007664 0.01% Castro::FluxRegFineAdd() 30 0.007108 0.007263 0.007452 0.01% TagBoxArray::mapPRD 11 0.00621 0.006624 0.007346 0.01% MLLinOp::makeSubCommunicator() 81 0.002157 0.00451 0.006867 0.01% Castro::enforce_consistent_e() 3 0.003482 0.005312 0.006505 0.01% AMRErrorTag::operator() 11 0.004717 0.004833 0.00497 0.01% FabArrayBase::TheFPinfo() 130 0.0008506 0.002657 0.004672 0.01% FPinfo::FPinfo() 3 0.0003263 0.002139 0.004139 0.01% DistributionMapping::KnapSackDoIt() 3 0.0002199 0.00203 0.004021 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0001652 0.001971 0.003962 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002272 0.002469 0.00265 0.00% FabArrayBase::FB::FB() 131 0.0008429 0.001243 0.002377 0.00% makeSFC 243 0.001518 0.00167 0.001817 0.00% Amr::InitAmr() 1 0.001711 0.001717 0.001727 0.00% OwnerMask() 11 0.001434 0.001534 0.001635 0.00% TagBoxArray::collate() 11 0.0009909 0.001245 0.001432 0.00% DistributionMapping::Distribute() 245 0.0004866 0.0004978 0.0005141 0.00% Castro::enforce_speed_limit() 254 0.0003867 0.0004017 0.0004139 0.00% AmrMesh-cluster 2 0 8.547e-05 0.0003419 0.00% ClusterList::intersect() 2 0 5.534e-05 0.0002214 0.00% FabArray::RecvLayoutMask() 21 0.0001937 0.0001967 0.0001991 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.702e-05 8.398e-05 9.459e-05 0.00% Castro::create_source_corrector() 30 8.057e-05 8.256e-05 8.338e-05 0.00% Amr::writeSmallPlotFile() 1 7.779e-05 7.987e-05 8.315e-05 0.00% BoxList::parallelComplementIn() 22 8.032e-05 8.1e-05 8.289e-05 0.00% knapsack() 3 6.583e-05 6.787e-05 7.234e-05 0.00% Castro::retry_advance_ctu() 30 5.403e-05 6.056e-05 6.94e-05 0.00% Castro::gwstrain() 22 3.81e-05 4.198e-05 4.935e-05 0.00% Amr::initSubcycle() 1 3.508e-05 3.659e-05 4.023e-05 0.00% BoxList::complementIn 22 3.873e-05 3.924e-05 4.001e-05 0.00% Gravity::set_mass_offset() 11 2.965e-05 3.252e-05 3.647e-05 0.00% ClusterList::chop() 2 0 4.823e-06 1.929e-05 0.00% knapsack()swap 2 4.652e-06 4.894e-06 5.095e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-12-g806f2373b68e) finalized