MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.04-10-g1a5d8917fd49) initialized Starting run at 05:40:28 UTC on 2022-04-08. Successfully read inputs file ... Castro git describe: 22.04-2-gb74783602 AMReX git describe: 22.04-10-g1a5d8917f Microphysics git describe: 22.04-1-gef526ccd reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.016938696 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.018340879 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.031491687 Gravity::fill_multipole_BCs() time = 0.029142325 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.598592246 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028175881 Gravity::solve_for_phi() time = 0.398301388 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.084893439e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 2.748779069e+11 Castro::do_old_sources() time = 0.14853779 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441941105 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026206214 Gravity::solve_for_phi() time = 0.345548369 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.160467441 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08321684777 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008344645 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009398121 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108392149 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044142299 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010407936 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01606308425 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009415621 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009392707 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10708968 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043735203 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010360009 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01474972493 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028053662 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010201201 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.151517096 Castro::reflux() at level 0 : time = 1.02863018 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.98455564 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009652216 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028468423 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034036105 Gravity::solve_for_phi() time = 0.380679158 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852864e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.137307146 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.455740586 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025834303 Gravity::solve_for_phi() time = 0.333280776 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.157592477 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08459908144 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008641556 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.00967207 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10714191 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043123239 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010492768 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01621005329 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008552886 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009549169 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107457144 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043198927 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010505596 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01478789291 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030700609 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010164807 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770254e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.150341605 Castro::reflux() at level 0 : time = 1.023376805 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.305410141 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009820022 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02839446 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029445297 Gravity::solve_for_phi() time = 0.376308962 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.69293903e+30 ymom added: 2.692725481e+30 zmom added: 2.692687173e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.134784815 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.43704077 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028552285 Gravity::solve_for_phi() time = 0.333018383 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983741e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.157132174 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08568254101 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008346858 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.00938112 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106665966 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043284752 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010147326 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01627571189 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010012125 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009292718 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10682909 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045523047 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010337395 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01454738218 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.030283842 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.01024331 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655087e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342335e+27 ymom added: 5.311566493e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.152663282 Castro::reflux() at level 0 : time = 1.020606951 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.198198247 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009956433 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028640137 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03000575 Gravity::solve_for_phi() time = 0.375673189 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700657e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.134649745 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.432029113 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030875266 Gravity::solve_for_phi() time = 0.342529397 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.160776373 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08547330441 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010177412 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009581238 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107844031 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043407939 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010527282 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01600732648 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008603455 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009565518 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107110398 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043615178 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010559522 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01457528958 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029441966 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010408571 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390474e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.154250776 Castro::reflux() at level 0 : time = 0.978687258 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.172667256 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.00984537 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029203684 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030218276 Gravity::solve_for_phi() time = 0.377358811 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150492e+30 ymom added: 3.399803827e+30 zmom added: 3.399742172e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.135922777 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.432610252 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024879083 Gravity::solve_for_phi() time = 0.325519375 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.150781772 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08629833463 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008309284 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009216082 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106355946 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042653031 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010103658 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01646162446 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008461242 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009326604 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107580054 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043139123 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010300969 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01494524107 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028550906 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010129908 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277777e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.149519679 Castro::reflux() at level 0 : time = 0.93818867 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.071599199 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009922318 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028485912 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028351279 Gravity::solve_for_phi() time = 0.374908228 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.09491931e+30 ymom added: 4.09451135e+30 zmom added: 4.094439154e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.136966257 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.468975257 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027201381 Gravity::solve_for_phi() time = 0.335111082 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.29724502e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.155177013 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08482110251 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008552644 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009526569 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107320167 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04357164 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010506202 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01617217332 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008593923 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.00952425 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107773628 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04400735 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010515634 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01477257763 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029688069 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010378726 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.15351023 Castro::reflux() at level 0 : time = 0.964347536 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.196958783 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009941564 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028390155 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028254445 Gravity::solve_for_phi() time = 0.375344893 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151125e+30 ymom added: 4.515687996e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.134606795 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.49619309 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025323657 Gravity::solve_for_phi() time = 0.328752462 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752621e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.155463603 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08426194103 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008495378 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009574547 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108854367 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043446633 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010166504 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01610241374 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008201162 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009352579 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108532669 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043740027 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010530235 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01485791847 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028413347 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.01048069 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.149688662 Castro::reflux() at level 0 : time = 0.955416746 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.279137236 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009977729 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028263908 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030052125 Gravity::solve_for_phi() time = 0.376028326 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064072e+30 ymom added: 4.889542941e+30 zmom added: 4.889455521e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.134977129 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.456299326 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027496575 Gravity::solve_for_phi() time = 0.377900304 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.156793545 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08407286799 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008501301 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009319492 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10788127 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042742038 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010098001 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01631710847 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008346382 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009265811 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107277061 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042782392 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010122178 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01495259627 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02866226 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010333948 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907372e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.149500286 Castro::reflux() at level 0 : time = 0.939970031 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.262413466 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009919106 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028400908 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029312926 Gravity::solve_for_phi() time = 0.376037059 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036352e+30 ymom added: 5.530451715e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.13491117 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.432127914 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025096992 Gravity::solve_for_phi() time = 0.37165343 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170338e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.155403176 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08500014136 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008294908 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009290784 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107025001 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043026689 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010126721 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01633107582 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008373626 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.00920927 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107524374 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044605028 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.01051699 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01487147288 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028988351 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010247153 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.14983332 Castro::reflux() at level 0 : time = 0.939818665 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.185814861 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.00994514 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028734435 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029452793 Gravity::solve_for_phi() time = 0.376966531 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167183e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.136233513 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.432947838 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025099358 Gravity::solve_for_phi() time = 0.371160544 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.155294298 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08491777499 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008267735 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009325941 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107372582 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048600743 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010214594 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01598674836 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008203807 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009499688 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107222349 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048681727 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010312519 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01468942636 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028547747 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010054545 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914877e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.149491786 Castro::reflux() at level 0 : time = 0.995848528 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.292600995 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.545049126 seconds Ending run at 05:41:23 UTC on 2022-04-08. Run time = 54.7746886 Run time without initialization = 52.4216399 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.77 ... 54.77 ... 54.77 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.2363 16.4854 16.6355 30.37% MLPoisson::Fsmooth() 11992 4.19 4.25 4.392 8.02% Castro::reset_internal_energy() 257 2.984 3.073 3.168 5.78% MultiFab::AddProduct() 4648 2.619 2.644 2.671 4.88% FabArray::setVal() 9464 2.441 2.468 2.483 4.53% MLPoisson::Fapply() 2422 1.872 1.892 1.927 3.52% MLCellLinOp::applyBC() 14630 1.497 1.554 1.699 3.10% MultiFab::Subtract() 601 1.675 1.685 1.697 3.10% FabArray::ParallelCopy_nowait() 5320 1.379 1.399 1.411 2.58% FabArray::ParallelCopy_finish() 5320 0.6136 1.059 1.301 2.38% Castro::enforce_min_density() 254 1.043 1.108 1.22 2.23% Gravity::fill_multipole_BCs() 41 1.06 1.093 1.115 2.03% Castro::derive() 397 0.9248 0.9302 0.9349 1.71% MultiFab::sum() 4648 0.8824 0.8908 0.8973 1.64% Castro::normalize_species() 254 0.8091 0.8242 0.8374 1.53% FluxRegister::Reflux() 180 0.8168 0.8233 0.8294 1.51% MultiFab::Xpay() 2190 0.729 0.7369 0.749 1.37% Castro::reflux() 10 0.6899 0.6959 0.7043 1.29% FillBoundary_nowait() 13093 0.6647 0.6728 0.6892 1.26% Castro::construct_new_gravity_source() 50 0.5958 0.5985 0.6037 1.10% Castro::volWgtSum() 242 0.5224 0.5514 0.5808 1.06% FillBoundary_finish() 13093 0.5025 0.5395 0.5752 1.05% CellConservativeLinear::interp() 130 0.3676 0.4567 0.552 1.01% Castro::estTimeStep() 69 0.231 0.3933 0.5435 0.99% Castro::computeTemp() 257 0.4616 0.475 0.496 0.91% MultiFab::min() 30 0.007539 0.1628 0.4244 0.77% MLPoisson::FFlux() 1045 0.3875 0.3926 0.4049 0.74% Castro::finalize_advance() 30 0.3455 0.3543 0.3605 0.66% Gravity::get_new_grav_vector() 52 0.3333 0.3354 0.3372 0.62% FillPatchSingleLevel 853 0.3277 0.3293 0.3322 0.61% StateData::FillBoundary(geom) 63 0.3215 0.3238 0.3256 0.59% amrex::average_down 1713 0.2678 0.2731 0.2832 0.52% MultiFab::Saxpy() 100 0.2745 0.2764 0.2781 0.51% Castro::post_timestep() 30 0.0592 0.1281 0.2773 0.51% MLMG::addInterpCorrection() 1421 0.2604 0.2652 0.2757 0.50% FillPatchIterator::Initialize 723 0.2605 0.2655 0.2705 0.49% Castro::do_advance_ctu() 30 0.2178 0.218 0.2185 0.40% MLMG::oneIter() 333 0.2091 0.2106 0.2117 0.39% Castro::expand_state() 30 0.1924 0.1931 0.1944 0.35% MLCellLinOp::reflux() 116 0.1759 0.1806 0.192 0.35% MLCellLinOp::defineAuxData() 81 0.1753 0.1784 0.1846 0.34% VisMF::Write(FabArray) 4 0.1647 0.1695 0.1806 0.33% MLCellLinOp::compGrad() 100 0.172 0.1743 0.1766 0.32% Gravity::get_old_grav_vector() 30 0.1657 0.1666 0.1675 0.31% FabArray::mult() 294 0.143 0.1438 0.1445 0.26% MultiFab::Multiply() 164 0.1405 0.1409 0.1415 0.26% Castro::construct_old_gravity_source() 30 0.1371 0.1388 0.1396 0.25% FabArray::setDomainBndry() 853 0.1281 0.1297 0.1312 0.24% Amr::writePlotFile() 2 0.1174 0.1215 0.1261 0.23% MLMG::ResNormInf() 450 0.09558 0.1015 0.1085 0.20% MultiFab::contains_nan() 60 0.09381 0.09424 0.09444 0.17% BndryData::define() 123 0.08748 0.08925 0.09016 0.16% Castro::construct_old_gravity() 30 0.08668 0.08729 0.0884 0.16% MLMG::prepareForSolve() 80 0.07934 0.08143 0.08278 0.15% MultiFab::LinComb() 628 0.06417 0.06817 0.079 0.14% Castro::evaluate_source_change() 591 0.07621 0.07762 0.07866 0.14% Gravity::test_level_grad_phi_curr() 20 0.07234 0.0726 0.07282 0.13% Gravity::gravity_sync() 10 0.07098 0.07206 0.07273 0.13% MultiFab::max() 40 0.01247 0.02937 0.06963 0.13% Castro::initData() 3 0.0573 0.06301 0.06752 0.12% Castro::construct_new_gravity() 30 0.05377 0.05615 0.05856 0.11% MLCellLinOp::updateSolBC() 99 0.05671 0.05773 0.05854 0.11% MLCGSolver::bicgstab 83 0 0.01401 0.05605 0.10% Castro::volProductSum() 22 0.05228 0.05336 0.0549 0.10% Amr::coarseTimeStep() 10 0.001136 0.0375 0.04969 0.09% MultiFab::norm0(mask) 57 0.04705 0.04739 0.0477 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04533 0.04591 0.04677 0.09% MLCellLinOp::updateCorBC() 78 0.04484 0.04565 0.04643 0.08% Gravity::solve_for_phi() 60 0.02697 0.03186 0.04345 0.08% Castro::initialize_do_advance() 30 0.03436 0.03979 0.04328 0.08% FabArrayBase::CPC::define() 2260 0.02741 0.03185 0.04326 0.08% FabArrayBase::getCPC() 8152 0.04106 0.04172 0.0424 0.08% Gravity::test_level_grad_phi_prev() 30 0.04086 0.04125 0.04181 0.08% MLCellLinOp::setLevelBC() 102 0.0405 0.04115 0.04175 0.08% Gravity::actual_solve_with_mlmg() 81 0.03718 0.03951 0.04148 0.08% AmrMesh::MakeNewGrids() 11 0.03549 0.03758 0.04002 0.07% MultiFab::Copy() 100 0.03939 0.03962 0.03971 0.07% MLMG::buildFineMask() 80 0.03923 0.03934 0.03948 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03599 0.03648 0.03704 0.07% FabArray::FillBoundary() 13093 0.03085 0.0319 0.03431 0.06% MLCellLinOp::prepareForSolve() 81 0.02465 0.02565 0.02808 0.05% MLCellLinOp::smooth() 5996 0.02509 0.026 0.0268 0.05% Castro::init(old) 9 0.02629 0.02636 0.02643 0.05% Castro::initialize_advance() 30 0.02541 0.02581 0.02625 0.05% FabArrayBase::getFB() 13093 0.02234 0.02314 0.02539 0.05% MLCellLinOp::defineBC() 81 0.02389 0.02426 0.02451 0.04% Gravity::update_max_rhs() 20 0.02413 0.02429 0.02437 0.04% Castro::apply_tagging_restrictions() 11 0.02102 0.02249 0.02394 0.04% MLMG::interpCorrection_1 78 0.02286 0.02318 0.02345 0.04% Amr::defBaseLevel() 1 0.02069 0.02136 0.02327 0.04% StateDataPhysBCFunct::() 853 0.01835 0.02125 0.02259 0.04% Castro::build_fine_mask() 153 0.01869 0.01883 0.01899 0.03% Castro::finalize_do_advance() 30 0.01324 0.01521 0.01874 0.03% FillPatchTwoLevels 394 0.01509 0.01583 0.01666 0.03% StateData::define() 48 0.01473 0.01516 0.01632 0.03% FabArray::ParallelCopy() 5320 0.01395 0.01436 0.01476 0.03% Castro::swap_state_time_levels() 30 0.01307 0.01325 0.01365 0.02% MLMG::MLRhsNormInf() 80 0.01209 0.01213 0.01216 0.02% Gravity::actual_multilevel_solve() 10 0.0119 0.01201 0.01207 0.02% Amr::regrid() 10 0.009686 0.01007 0.01106 0.02% MultiFab::Dot() 463 0 0.002748 0.01099 0.02% Gravity::GetCrsePhi() 40 0.009615 0.009777 0.009925 0.02% MLCellLinOp::apply() 2422 0.005616 0.006541 0.009045 0.02% Castro::post_init() 2 0.0004284 0.005921 0.008964 0.02% Castro::apply_problem_tags() 11 0.00838 0.008483 0.00858 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008278 0.008331 0.008353 0.02% MLLinOp::defineGrids() 81 0.007355 0.007815 0.008183 0.01% Castro::do_new_sources() 50 0.0008313 0.002789 0.007491 0.01% Castro::FluxRegFineAdd() 30 0.00727 0.007398 0.007472 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001804 0.007214 0.01% Castro::enforce_consistent_e() 3 0.003446 0.004846 0.006899 0.01% MLLinOp::makeSubCommunicator() 81 0.002522 0.004913 0.006112 0.01% MLCellLinOp::correctionResidual() 1660 0.004616 0.004947 0.00583 0.01% MLMG::solve() 80 0.004014 0.004634 0.005758 0.01% AMRErrorTag::operator() 11 0.004777 0.005017 0.005226 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005111 0.005145 0.0052 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004983 0.005024 0.00509 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004898 0.004927 0.004965 0.01% CGSolver::sxay() 588 0 0.001187 0.004747 0.01% MLMG::mgVcycle() 489 0.003974 0.004107 0.004357 0.01% Gravity::test_composite_phi() 1 0.00374 0.003885 0.003948 0.01% Castro::do_old_sources() 30 0.0004867 0.001879 0.003836 0.01% MLMG:computeResOfCorrection() 1421 0.003273 0.003343 0.003482 0.01% MLMG::actualBottomSolve() 333 0.0003836 0.001158 0.003464 0.01% DistributionMapping::LeastUsedCPUs() 5 0.000171 0.00178 0.002938 0.01% FillPatchInterp(Fab) 130 0.001721 0.002086 0.002929 0.01% main() 1 0.002408 0.002681 0.002815 0.01% FabArrayBase::FB::FB() 131 0.0008497 0.001256 0.002386 0.00% MLMG::mgVcycle_down::0 333 0.002213 0.0023 0.002342 0.00% MLMG::mgVcycle_down::1 333 0.002042 0.002112 0.00219 0.00% MLMG::mgVcycle_down::2 333 0.001863 0.001949 0.002012 0.00% MLCellLinOp::solutionResidual() 530 0.001943 0.001961 0.002006 0.00% MLMG::MLResNormInf() 97 0.0006499 0.001415 0.001999 0.00% Amr::InitAmr() 1 0.001966 0.001971 0.001975 0.00% Castro::subcycle_advance_ctu() 30 0.0001823 0.0006223 0.001914 0.00% Gravity::solve_phi_with_mlmg() 71 0.001608 0.001712 0.001861 0.00% TagBoxArray::collate() 11 0.001385 0.001584 0.00173 0.00% MLMG::mgVcycle_up::0 333 0.001553 0.001596 0.001627 0.00% Castro::clean_state() 254 0.001566 0.001595 0.001625 0.00% OwnerMask() 11 0.001429 0.001542 0.001603 0.00% MLMG::mgVcycle_up::2 333 0.001348 0.001399 0.00148 0.00% MLMG::mgVcycle_up::1 333 0.001333 0.001376 0.001433 0.00% MLMG::mgVcycle_bottom 489 0.001278 0.0013 0.001324 0.00% MLMG::mgVcycle_down::3 211 0.001153 0.001208 0.0013 0.00% MLMG::mgVcycle_down::4 211 0.00108 0.001168 0.001281 0.00% makeSFC 243 0.001008 0.001159 0.001261 0.00% MLMG::mgVcycle_up::4 211 0.0007694 0.0008212 0.0009354 0.00% TagBoxArray::mapPRD 11 0.0008189 0.0008801 0.0009273 0.00% MLMG::mgVcycle_up::3 211 0.0007384 0.0007835 0.0008942 0.00% Amr::bldFineLevels() 1 0.0007597 0.0008359 0.0008769 0.00% MLLinOp::makeAgglomeratedDMap 81 0.000749 0.0008077 0.0008464 0.00% MLMG::computeResidual() 333 0.0008366 0.0008396 0.0008442 0.00% Amr::timeStep() 30 0.0004553 0.0005356 0.0007347 0.00% MLPoisson::define() 81 0.0005855 0.0006389 0.0006692 0.00% Amr::grid_places() 11 0.0004968 0.0005439 0.0006166 0.00% Castro::construct_new_source() 250 0.0005619 0.0005793 0.0005921 0.00% FabArrayBase::TheFPinfo() 130 0.0004974 0.0005233 0.0005472 0.00% Castro::computeNewDt() 18 0.0001113 0.000221 0.000538 0.00% DistributionMapping::Distribute() 245 0.0004858 0.000504 0.0005214 0.00% Castro::enforce_speed_limit() 254 0.0004017 0.0004125 0.0004227 0.00% MLPoisson::prepareForSolve() 81 0.0003511 0.0003739 0.000389 0.00% Castro::apply_source_to_state() 100 0.0003309 0.0003538 0.0003877 0.00% MLMG::getGradSolution() 80 0.0002505 0.0002754 0.0003261 0.00% MLMG::computeMLResidual() 97 0.0003035 0.0003097 0.0003191 0.00% AmrLevel::AmrLevel(dm) 12 0.000258 0.0002816 0.0003185 0.00% Castro::construct_old_source() 150 0.0002848 0.0002927 0.0003002 0.00% MLLinOp::define() 81 0.0002863 0.0002919 0.000298 0.00% MLMG::miniCycle() 156 0.000267 0.0002717 0.0002748 0.00% Castro::post_regrid() 22 0.0002287 0.0002408 0.0002613 0.00% Castro::advance() 30 0.0001954 0.0002172 0.0002612 0.00% ClusterList::intersect() 2 0 5.61e-05 0.0002244 0.00% Gravity::swapTimeLevels() 30 0.0001792 0.0001921 0.000208 0.00% FabArray::RecvLayoutMask() 21 0.0001983 0.0002009 0.0002042 0.00% Castro::check_for_nan() 60 0.0001797 0.0001891 0.0002 0.00% Amr::FinalizeInit() 1 1.902e-05 4.921e-05 0.000136 0.00% Castro::errorEst() 11 0.0001232 0.0001267 0.0001358 0.00% Castro::avgDown(state_indx) 44 0.0001149 0.0001189 0.0001236 0.00% FPinfo::FPinfo() 3 0.0001012 0.0001051 0.0001083 0.00% Castro::create_source_corrector() 30 7.97e-05 8.616e-05 0.000103 0.00% Castro::retry_advance_ctu() 30 5.64e-05 6.831e-05 0.0001007 0.00% AmrMesh-cluster 2 0 2.415e-05 9.66e-05 0.00% Gravity::solve_for_delta_phi 10 7.493e-05 8.567e-05 9.51e-05 0.00% amrex::average_down_w_geom 44 8.709e-05 8.941e-05 9.213e-05 0.00% Amr::writeSmallPlotFile() 1 7.227e-05 8.079e-05 8.991e-05 0.00% Castro::avgDown() 11 5.595e-05 5.891e-05 6.336e-05 0.00% knapsack() 3 5.918e-05 6.14e-05 6.329e-05 0.00% BoxList::parallelComplementIn() 22 4.018e-05 4.931e-05 5.828e-05 0.00% Castro::gwstrain() 22 3.616e-05 4.044e-05 4.888e-05 0.00% Amr::initSubcycle() 1 3.52e-05 3.968e-05 4.748e-05 0.00% Gravity::set_mass_offset() 11 2.492e-05 3.141e-05 4.348e-05 0.00% BoxList::complementIn 22 3.916e-05 4.029e-05 4.116e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.166e-05 3.303e-05 3.397e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.854e-05 3.013e-05 3.118e-05 0.00% ClusterList::chop() 2 0 5.255e-06 2.102e-05 0.00% Castro::computeInitialDt() 2 1.044e-05 1.181e-05 1.413e-05 0.00% MLMG::compResidual() 1 1.104e-05 1.21e-05 1.287e-05 0.00% Amr::InitializeInit() 1 5.875e-06 7.275e-06 9.574e-06 0.00% Amr::init() 1 5.427e-06 6.204e-06 7.273e-06 0.00% Amr::initialInit() 1 3.455e-06 4.335e-06 5.199e-06 0.00% knapsack()swap 2 4.793e-06 4.986e-06 5.156e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.77 54.77 54.77 100.00% Amr::coarseTimeStep() 10 51.87 51.87 51.87 94.70% Amr::timeStep() 30 51.62 51.66 51.8 94.56% Castro::advance() 30 36.21 36.21 36.21 66.10% Castro::subcycle_advance_ctu() 30 34.38 34.39 34.4 62.81% Castro::do_advance_ctu() 30 34.38 34.39 34.4 62.81% Castro::construct_ctu_hydro_source() 30 16.24 16.49 16.64 30.37% Gravity::actual_solve_with_mlmg() 81 13.25 13.26 13.26 24.21% MLMG::solve() 80 12.54 12.54 12.54 22.90% Castro::post_timestep() 30 12.26 12.31 12.44 22.72% Castro::clean_state() 254 10.87 11.05 11.2 20.45% MLMG::oneIter() 333 10.52 10.53 10.54 19.24% Gravity::solve_phi_with_mlmg() 71 9.91 9.956 9.992 18.24% Castro::reflux() 10 9.749 9.77 9.785 17.86% MLMG::mgVcycle() 489 9.198 9.209 9.221 16.83% Gravity::solve_for_phi() 60 8.218 8.253 8.284 15.12% MLCellLinOp::smooth() 5996 6.282 6.395 6.687 12.21% Castro::computeTemp() 257 6.268 6.4 6.499 11.87% Castro::reset_internal_energy() 257 5.806 5.925 6.003 10.96% Gravity::gravity_sync() 10 5.084 5.084 5.085 9.28% Castro::construct_new_gravity() 30 5.039 5.054 5.066 9.25% Castro::construct_old_gravity() 30 4.639 4.668 4.695 8.57% Castro::evaluate_source_change() 591 4.551 4.592 4.633 8.46% MLPoisson::Fsmooth() 11992 4.19 4.25 4.392 8.02% Gravity::solve_for_delta_phi 10 4.256 4.256 4.256 7.77% Castro::enforce_min_density() 254 3.838 3.923 4.013 7.33% MLMG::mgVcycle_down::0 333 3.92 3.928 3.936 7.18% Castro::do_new_sources() 50 3.303 3.348 3.385 6.18% FillPatchIterator::Initialize 723 3.263 3.29 3.301 6.03% Amr::regrid() 10 3.215 3.253 3.277 5.98% Castro::post_regrid() 22 3.018 3.064 3.088 5.64% MLCellLinOp::applyBC() 14630 2.72 2.8 2.986 5.45% MLMG::mgVcycle_up::0 333 2.686 2.885 2.955 5.40% FabArray::ParallelCopy() 5320 2.095 2.522 2.77 5.06% MultiFab::AddProduct() 4648 2.619 2.644 2.671 4.88% Castro::initialize_do_advance() 30 2.58 2.595 2.61 4.77% MLCellLinOp::apply() 2422 2.479 2.511 2.584 4.72% FabArray::setVal() 9464 2.441 2.468 2.483 4.53% Amr::init() 1 2.351 2.351 2.351 4.29% FillPatchSingleLevel 853 2.22 2.232 2.257 4.12% MLPoisson::Fapply() 2422 1.872 1.892 1.927 3.52% MLCellLinOp::solutionResidual() 530 1.74 1.754 1.767 3.23% Amr::initialInit() 1 1.752 1.752 1.752 3.20% MLCellLinOp::correctionResidual() 1660 1.62 1.646 1.718 3.14% Gravity::multilevel_solve_for_new_phi() 10 1.708 1.708 1.708 3.12% Gravity::actual_multilevel_solve() 10 1.699 1.699 1.699 3.10% MultiFab::Subtract() 601 1.675 1.685 1.697 3.10% Castro::derive() 397 1.628 1.638 1.648 3.01% MLMG:computeResOfCorrection() 1421 1.48 1.503 1.561 2.85% Castro::do_old_sources() 30 1.54 1.547 1.555 2.84% FabArray::ParallelCopy_nowait() 5320 1.427 1.449 1.466 2.68% Amr::FinalizeInit() 1 1.341 1.373 1.449 2.65% Castro::initialize_advance() 30 1.408 1.416 1.429 2.61% Castro::volWgtSum() 242 1.329 1.361 1.389 2.54% FabArray::FillBoundary() 13093 1.246 1.269 1.302 2.38% FabArray::ParallelCopy_finish() 5320 0.6136 1.059 1.301 2.38% FillPatchTwoLevels 394 1.164 1.182 1.195 2.18% Castro::expand_state() 30 1.163 1.176 1.184 2.16% Gravity::fill_multipole_BCs() 41 1.097 1.13 1.152 2.10% FluxRegister::Reflux() 180 1.142 1.143 1.145 2.09% Amr::writePlotFile() 2 1.144 1.144 1.144 2.09% Castro::post_init() 2 0.9804 0.9978 1.039 1.90% Gravity::get_new_grav_vector() 52 1 1.007 1.011 1.85% MLMG::addInterpCorrection() 1421 0.3062 0.8171 0.9889 1.81% MLMG::computeResWithCrseSolFineCor() 78 0.9601 0.9623 0.9643 1.76% MLMG::computeResidual() 333 0.9084 0.9098 0.9112 1.66% MultiFab::sum() 4648 0.8824 0.8908 0.8973 1.64% Castro::normalize_species() 254 0.8091 0.8242 0.8374 1.53% MLMG::mgVcycle_down::1 333 0.6844 0.7126 0.7903 1.44% MultiFab::Xpay() 2190 0.729 0.7369 0.749 1.37% FillBoundary_nowait() 13093 0.6889 0.6972 0.7125 1.30% MLCellLinOp::reflux() 116 0.6884 0.6889 0.6898 1.26% MLMG::mgVcycle_up::2 333 0.2087 0.5321 0.6411 1.17% MLMG::computeMLResidual() 97 0.5992 0.6139 0.6213 1.13% Castro::construct_new_source() 250 0.5964 0.5991 0.6043 1.10% Castro::construct_new_gravity_source() 50 0.5958 0.5985 0.6037 1.10% FillBoundary_finish() 13093 0.5025 0.5395 0.5752 1.05% FillPatchInterp(Fab) 130 0.3696 0.4588 0.5537 1.01% CellConservativeLinear::interp() 130 0.3676 0.4567 0.552 1.01% Castro::estTimeStep() 69 0.231 0.3933 0.5435 0.99% Gravity::get_old_grav_vector() 30 0.5288 0.5308 0.5325 0.97% MLMG::mgVcycle_up::1 333 0.4674 0.4842 0.5312 0.97% MultiFab::min() 30 0.007539 0.1628 0.4244 0.77% Amr::InitializeInit() 1 0.3022 0.3786 0.4109 0.75% Amr::defBaseLevel() 1 0.3022 0.3786 0.4109 0.75% MLPoisson::FFlux() 1045 0.3875 0.3926 0.4049 0.74% Castro::finalize_advance() 30 0.3924 0.3962 0.3983 0.73% MLPoisson::define() 81 0.3769 0.3813 0.3904 0.71% Castro::initData() 3 0.2748 0.3478 0.3822 0.70% StateDataPhysBCFunct::() 853 0.3427 0.345 0.3482 0.64% MLMG::prepareForSolve() 80 0.3131 0.3189 0.3293 0.60% StateData::FillBoundary(geom) 63 0.3215 0.3238 0.3256 0.59% amrex::average_down 1713 0.2917 0.3014 0.3241 0.59% MLMG::mgVcycle_bottom 489 0.1645 0.2038 0.3191 0.58% MLMG::mgVcycle_down::2 333 0.2477 0.2556 0.2787 0.51% Castro::apply_source_to_state() 100 0.2749 0.2767 0.2784 0.51% MultiFab::Saxpy() 100 0.2745 0.2764 0.2781 0.51% Castro::computeNewDt() 18 0.1332 0.2402 0.2772 0.51% MLCellLinOp::defineAuxData() 81 0.2167 0.2226 0.2365 0.43% Amr::bldFineLevels() 1 0.1801 0.2156 0.2339 0.43% MLMG::getGradSolution() 80 0.2187 0.2208 0.2232 0.41% MLCellLinOp::compGrad() 100 0.2185 0.2205 0.2228 0.41% MLMG::mgVcycle_down::3 211 0.0336 0.07381 0.1931 0.35% VisMF::Write(FabArray) 4 0.1647 0.1695 0.1806 0.33% MLMG::miniCycle() 156 0.1639 0.1647 0.1665 0.30% MLMG::actualBottomSolve() 333 0.0003836 0.03907 0.1551 0.28% Castro::init(old) 9 0.1495 0.1507 0.1519 0.28% MLCGSolver::bicgstab 83 0 0.03722 0.1489 0.27% FabArray::mult() 294 0.143 0.1438 0.1445 0.26% MLCellLinOp::defineBC() 81 0.1409 0.1425 0.1435 0.26% MultiFab::Multiply() 164 0.1405 0.1409 0.1415 0.26% Castro::construct_old_source() 150 0.1374 0.1391 0.1399 0.26% MLMG::ResNormInf() 450 0.1265 0.1324 0.1396 0.25% Castro::construct_old_gravity_source() 30 0.1371 0.1388 0.1396 0.25% MLMG::mgVcycle_up::3 211 0.02536 0.05338 0.1366 0.25% FabArray::setDomainBndry() 853 0.1281 0.1297 0.1312 0.24% Castro::computeInitialDt() 2 0.01894 0.0512 0.1276 0.23% Castro::volProductSum() 22 0.1236 0.1245 0.1264 0.23% Amr::grid_places() 11 0.1212 0.1227 0.1244 0.23% AmrMesh::MakeNewGrids() 11 0.1206 0.1222 0.1239 0.23% BndryData::define() 123 0.1152 0.117 0.1178 0.22% Gravity::GetCrsePhi() 40 0.08975 0.09737 0.106 0.19% MLMG::computeResWithCrseCorFineCor() 78 0.1044 0.1048 0.1052 0.19% Gravity::update_max_rhs() 20 0.04688 0.06375 0.1041 0.19% Castro::check_for_nan() 60 0.09399 0.09443 0.09463 0.17% MultiFab::contains_nan() 60 0.09381 0.09424 0.09444 0.17% MLCellLinOp::updateSolBC() 99 0.08485 0.08997 0.09321 0.17% FabArrayBase::getCPC() 8152 0.06847 0.07357 0.08565 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08217 0.08287 0.08385 0.15% Gravity::test_level_grad_phi_curr() 20 0.08174 0.08213 0.08247 0.15% MultiFab::LinComb() 628 0.06417 0.06817 0.079 0.14% MLMG::mgVcycle_down::4 211 0.03244 0.04294 0.07341 0.13% MultiFab::max() 40 0.01247 0.02937 0.06963 0.13% Castro::errorEst() 11 0.06043 0.063 0.06608 0.12% MLCellLinOp::updateCorBC() 78 0.06354 0.06386 0.06441 0.12% MLCellLinOp::setLevelBC() 102 0.05044 0.05801 0.06072 0.11% Gravity::test_composite_phi() 1 0.06036 0.0604 0.06042 0.11% MLMG::mgVcycle_up::4 211 0.02545 0.03341 0.05637 0.10% MLMG::buildFineMask() 80 0.049 0.0491 0.04922 0.09% MultiFab::norm0(mask) 57 0.04705 0.04739 0.0477 0.09% Gravity::test_level_grad_phi_prev() 30 0.04631 0.04684 0.04742 0.09% MLMG::MLResNormInf() 97 0.04416 0.04467 0.04514 0.08% FabArrayBase::CPC::define() 2260 0.02741 0.03185 0.04326 0.08% MLMG::interpCorrection_1 78 0.03277 0.03676 0.04059 0.07% MultiFab::Copy() 100 0.03939 0.03962 0.03971 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03599 0.03648 0.03704 0.07% MLMG::MLRhsNormInf() 80 0.02842 0.02854 0.02863 0.05% MLPoisson::prepareForSolve() 81 0.02504 0.02602 0.02843 0.05% MLCellLinOp::prepareForSolve() 81 0.02465 0.02565 0.02808 0.05% FabArrayBase::getFB() 13093 0.02321 0.0244 0.02778 0.05% Gravity::swapTimeLevels() 30 0.02392 0.02458 0.02629 0.05% Castro::apply_tagging_restrictions() 11 0.02102 0.02249 0.02394 0.04% TagBoxArray::mapPRD 11 0.007446 0.0133 0.01941 0.04% CGSolver::sxay() 588 0 0.004761 0.01904 0.03% Castro::build_fine_mask() 153 0.01869 0.01883 0.01899 0.03% Castro::finalize_do_advance() 30 0.01324 0.01521 0.01874 0.03% MLLinOp::define() 81 0.0124 0.01548 0.01692 0.03% MLLinOp::defineGrids() 81 0.01211 0.01519 0.01662 0.03% AmrLevel::AmrLevel(dm) 12 0.015 0.01544 0.0166 0.03% StateData::define() 48 0.01473 0.01516 0.01632 0.03% MLMG::compResidual() 1 0.01464 0.01488 0.015 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01422 0.01446 0.01498 0.03% Castro::avgDown() 11 0.01401 0.01421 0.01448 0.03% Castro::avgDown(state_indx) 44 0.01395 0.01415 0.01442 0.03% amrex::average_down_w_geom 44 0.01383 0.01404 0.0143 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003561 0.01424 0.03% Castro::swap_state_time_levels() 30 0.01307 0.01325 0.01365 0.02% MultiFab::Dot() 463 0 0.002748 0.01099 0.02% Castro::apply_problem_tags() 11 0.00838 0.008483 0.00858 0.02% Castro::FluxRegFineAdd() 30 0.00727 0.007398 0.007472 0.01% Castro::enforce_consistent_e() 3 0.003446 0.004846 0.006899 0.01% MLLinOp::makeSubCommunicator() 81 0.002522 0.004913 0.006112 0.01% AMRErrorTag::operator() 11 0.004777 0.005017 0.005226 0.01% FabArrayBase::TheFPinfo() 130 0.0007692 0.00234 0.003525 0.01% FPinfo::FPinfo() 3 0.000252 0.001817 0.002978 0.01% DistributionMapping::LeastUsedCPUs() 5 0.000171 0.00178 0.002938 0.01% DistributionMapping::KnapSackDoIt() 3 0.0001448 0.001712 0.002869 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002234 0.002462 0.00262 0.00% FabArrayBase::FB::FB() 131 0.0008497 0.001256 0.002386 0.00% Amr::InitAmr() 1 0.002001 0.002011 0.002018 0.00% makeSFC 243 0.001485 0.001654 0.001774 0.00% TagBoxArray::collate() 11 0.001385 0.001584 0.00173 0.00% OwnerMask() 11 0.001429 0.001542 0.001603 0.00% DistributionMapping::Distribute() 245 0.0004858 0.000504 0.0005214 0.00% Castro::enforce_speed_limit() 254 0.0004017 0.0004125 0.0004227 0.00% AmrMesh-cluster 2 0 8.55e-05 0.000342 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 0.0001664 0.0002066 0.0002316 0.00% ClusterList::intersect() 2 0 5.61e-05 0.0002244 0.00% FabArray::RecvLayoutMask() 21 0.0001983 0.0002009 0.0002042 0.00% Castro::create_source_corrector() 30 7.97e-05 8.616e-05 0.000103 0.00% Castro::retry_advance_ctu() 30 5.64e-05 6.831e-05 0.0001007 0.00% BoxList::parallelComplementIn() 22 7.933e-05 8.96e-05 9.902e-05 0.00% Amr::writeSmallPlotFile() 1 7.227e-05 8.079e-05 8.991e-05 0.00% knapsack() 3 6.398e-05 6.639e-05 6.833e-05 0.00% Castro::gwstrain() 22 3.616e-05 4.044e-05 4.888e-05 0.00% Amr::initSubcycle() 1 3.52e-05 3.968e-05 4.748e-05 0.00% Gravity::set_mass_offset() 11 2.492e-05 3.141e-05 4.348e-05 0.00% BoxList::complementIn 22 3.916e-05 4.029e-05 4.116e-05 0.00% ClusterList::chop() 2 0 5.255e-06 2.102e-05 0.00% knapsack()swap 2 4.793e-06 4.986e-06 5.156e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-10-g1a5d8917fd49) finalized