MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.01-9-gaa079d4dc93b) initialized Starting run at 17:57:19 UTC on 2022-01-06. Successfully read inputs file ... Castro git describe: 21.12-24-ga0d4c0dd6 AMReX git describe: 22.01-9-gaa079d4dc Microphysics git describe: 22.01-8-gef649336 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.021177695 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.022093909 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.0600039959 Gravity::fill_multipole_BCs() time = 0.05957698822 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 1.209321134 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.1050980091 Gravity::solve_for_phi() time = 1.003305674 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -8.096443045e+22 ymom added: -5.666839779e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.3173925877 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 3.803917408 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.07547688484 Gravity::solve_for_phi() time = 0.8432950974 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.3617460728 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.03411064855 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.02177357674 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.01927447319 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1736524105 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0789835453 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.0165116787 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.009330116021 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01495194435 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.01446604729 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1344146729 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.07845973969 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.01623153687 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.009345448701 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.0605905056 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.01731610298 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.3550503254 Castro::reflux() at level 0 : time = 2.296199083 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 11.35968759 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.019741188 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.0596601963 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0615632534 Gravity::solve_for_phi() time = 0.7915179729 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852869e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.2869391441 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 2.040853977 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03232455254 Gravity::solve_for_phi() time = 0.4157681465 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101199292e+28 ymom added: 1.101125523e+28 zmom added: 1.101116881e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.1736800671 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.05489756646 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01037716866 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.01121163368 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1219055653 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0614221096 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001809e+28 ymom added: 1.275021021e+28 zmom added: 1.274510426e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.01217675209 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01351835511 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01073241234 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467807e+31 ymom added: 3.121454861e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.01090455055 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1216261387 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.06191921234 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768467e+28 ymom added: 1.163458047e+28 zmom added: 1.162896552e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.01215815544 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01201371811 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.03327035904 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475417e+28 ymom added: 1.546170517e+28 zmom added: 1.545843603e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.01206851006 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628810511e+28 ymom added: 8.089768675e+28 zmom added: 8.082912527e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.171615839 Castro::reflux() at level 0 : time = 1.205367565 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525065e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560991e+31 TIME= 0.008996566361 ANG MOM X = 4.933486034e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295823e+37 TIME= 0.008996566361 ANG MOM Z = -9.979594573e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 7.86283155 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.020343274 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.05682063103 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0519528389 Gravity::solve_for_phi() time = 0.7889258862 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692938986e+30 ymom added: 2.692725443e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.2544760704 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 2.597448349 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.05458235741 Gravity::solve_for_phi() time = 0.7453203201 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044878e+28 ymom added: 1.370983822e+28 zmom added: 1.370959035e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.3494882584 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04555676187 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0194413662 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001923e+31 zmom added: 3.436999173e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.01427817345 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1307191849 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.07895159721 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212465516e+27 ymom added: 9.182902012e+27 zmom added: 9.178195544e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.01596593857 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01084936333 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0189807415 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838504e+31 zmom added: 3.43883481e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.01437902451 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1793949604 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.09249806404 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320462e+27 ymom added: 9.116586361e+27 zmom added: 9.111874121e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.02108573914 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.008123149964 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.0607085228 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743249e+28 ymom added: 1.049529313e+28 zmom added: 1.049432836e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.01209187508 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.53265498e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012347944e+27 ymom added: 5.31156648e+28 zmom added: 5.312402594e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.1743705273 Castro::reflux() at level 0 : time = 1.458756208 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.97822032e+30 TIME= 0.01418030222 YMOM = 2.581919617e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.317465053e+33 TIME= 0.01418030222 ANG MOM Y = 9.97006769e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193035e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 8.999399634 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.010933766 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.03274297714 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.04448676109 Gravity::solve_for_phi() time = 0.4946856499 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700652e+30 ymom added: 3.059418749e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.1556601524 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.702492476 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03064227104 Gravity::solve_for_phi() time = 0.4151778221 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123310703e+28 ymom added: -3.123356628e+28 zmom added: -3.123382981e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.1798131466 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.07194606908 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01020812988 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.78503132e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.01113533974 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.120970726 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.05835413933 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299519978e+27 ymom added: -7.337150261e+27 zmom added: -7.343110238e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.01189947128 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01377078694 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009637355804 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.78356389e+31 zmom added: 3.783558423e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.01068210602 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1215543747 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.05831170082 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452615e+27 ymom added: -8.124010289e+27 zmom added: -8.12991922e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.01210236549 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0122508849 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.03329944611 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722065e+27 ymom added: -7.641420872e+27 zmom added: -7.642279171e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.01199817657 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.471930455e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251862969e+28 ymom added: -2.445730928e+28 zmom added: -2.444392398e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.1691040993 Castro::reflux() at level 0 : time = 1.107790709 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.1895078e+31 TIME= 0.01988241166 YMOM = 2.873624697e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.875743128e+33 TIME= 0.01988241166 ANG MOM Y = 9.96051918e+37 TIME= 0.01988241166 ANG MOM Z = -9.960447916e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 6.031619634 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.011805062 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.03152704239 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03550815582 Gravity::solve_for_phi() time = 0.4777598381 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150536e+30 ymom added: 3.39980379e+30 zmom added: 3.399742021e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.1557354927 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.693443775 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02710008621 Gravity::solve_for_phi() time = 0.402684927 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593637e+29 ymom added: 1.218588779e+29 zmom added: 1.218591475e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.1760852337 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.07278130589 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01007986069 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239163e+31 zmom added: 4.160232962e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.01106190681 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1216111183 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.05853414536 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388802e+29 ymom added: 1.707927115e+29 zmom added: 1.707854531e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.01194238663 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01375282919 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009645700455 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.19445147e+31 ymom added: 4.194397705e+31 zmom added: 4.194390055e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.01082611084 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1207563877 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.05858445168 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323597e+29 ymom added: 1.708864164e+29 zmom added: 1.708792463e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.01223254204 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01219497715 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.03185510635 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476189e+29 ymom added: 1.687341246e+29 zmom added: 1.687333659e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.01195406914 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.434951883e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.48236191e+28 ymom added: 7.265279904e+28 zmom added: 7.267049202e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.2097425461 Castro::reflux() at level 0 : time = 1.14148736 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112799e+31 TIME= 0.02615473204 YMOM = 3.203255731e+31 TIME= 0.02615473204 ZMOM = 3.492493213e+31 TIME= 0.02615473204 ANG MOM X = 6.536286114e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532583e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246345e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 6.072431932 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.011005849 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.0367770195 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03250622749 Gravity::solve_for_phi() time = 0.6379551888 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919355e+30 ymom added: 4.094511576e+30 zmom added: 4.094439154e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.2781226635 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 3.296312094 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.08628869057 Gravity::solve_for_phi() time = 0.8637547493 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297250098e+27 ymom added: -5.29729681e+27 zmom added: -5.297329323e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.3555989265 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04090845758 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01818561554 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021094e+31 ymom added: 4.650958981e+31 zmom added: 4.6509504e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.02023768425 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2451980114 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.103751421 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464699e+28 ymom added: 3.459802469e+28 zmom added: 3.458916339e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.0221862793 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.007246541705 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01700305939 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.01963567734 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2450494766 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.103274107 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942336e+28 ymom added: 3.435270962e+28 zmom added: 3.434392248e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.0218398571 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.006764249991 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.06107020378 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534609e+28 ymom added: 2.962177876e+28 zmom added: 2.962127478e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.020403862 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648425e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.369344336e+29 ymom added: -1.047781841e+29 zmom added: -1.047573971e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.3528342247 Castro::reflux() at level 0 : time = 2.195542574 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.894853215e+31 TIME= 0.03305428447 YMOM = 3.579033276e+31 TIME= 0.03305428447 ZMOM = 3.868277543e+31 TIME= 0.03305428447 ANG MOM X = 7.382323584e+33 TIME= 0.03305428447 ANG MOM Y = 9.940156602e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681428e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 10.62775215 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.019727562 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.0596473217 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.09379076958 Gravity::solve_for_phi() time = 0.9793143272 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151173e+30 ymom added: 4.515687958e+30 zmom added: 4.515608887e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.3151736259 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 4.163757801 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.07811832428 Gravity::solve_for_phi() time = 0.8427095413 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.881717239e+28 ymom added: -2.881754047e+28 zmom added: -2.88173569e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.3533170223 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.03295448103 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.02444291115 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263317e+31 ymom added: 5.130179575e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.02065396309 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2406523228 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.09080410004 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427519e+29 ymom added: -1.979112033e+29 zmom added: -1.979218322e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.0221350193 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.007746632324 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.02261424065 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597336e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.01989841461 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1961288452 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.08143186569 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636776e+29 ymom added: -1.979323608e+29 zmom added: -1.979430499e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.0229165554 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.007682273927 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.06414699554 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068683e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.02160286903 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426685967e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129166e+29 ymom added: -1.425295633e+29 zmom added: -1.425073926e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.3578636646 Castro::reflux() at level 0 : time = 2.219136 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877368e+31 TIME= 0.04064379213 YMOM = 3.990103506e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.287046065e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081415e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507123e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 12.59779406 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.020864609 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.05941820145 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.07363677025 Gravity::solve_for_phi() time = 0.9392418861 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064111e+30 ymom added: 4.889542865e+30 zmom added: 4.889455596e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.3101222515 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 4.212022305 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.07941961288 Gravity::solve_for_phi() time = 0.9467930794 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649808e+29 ymom added: 1.113641814e+29 zmom added: 1.11364283e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.3607895374 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.03225607006 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0209839344 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168204e+31 ymom added: 5.55505767e+31 zmom added: 5.555042517e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.01928853989 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2399816513 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.1226751804 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348955e+29 ymom added: 2.639526858e+29 zmom added: 2.639400329e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.02206850052 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.007383122596 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.02192163467 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975183e+31 ymom added: 5.60784821e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.0203371048 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.2435626984 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.09289884567 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347816e+29 ymom added: 2.639526076e+29 zmom added: 2.639399405e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.02210426331 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.006971152754 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.06046175957 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897288e+29 ymom added: 2.604726875e+29 zmom added: 2.604719343e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.02108430862 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478414e+29 ymom added: 5.931870497e+27 zmom added: 5.953990486e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.3566045761 Castro::reflux() at level 0 : time = 2.173326015 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283684e+31 TIME= 0.04899225057 YMOM = 4.451571739e+31 TIME= 0.04899225057 ZMOM = 4.740838718e+31 TIME= 0.04899225057 ANG MOM X = 9.330678416e+33 TIME= 0.04899225057 ANG MOM Y = 9.919778287e+37 TIME= 0.04899225057 ANG MOM Z = -9.919178432e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 12.77524517 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.020716359 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.05910634995 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.06429839134 Gravity::solve_for_phi() time = 0.9260029793 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036601e+30 ymom added: 5.53045164e+30 zmom added: 5.530356588e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.3103306293 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 4.175743103 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.05907034874 Gravity::solve_for_phi() time = 0.9311778545 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061040268e+28 ymom added: -5.061165262e+28 zmom added: -5.061200323e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.3537168503 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.03263026595 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.02536511421 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075956e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.0196416378 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1690013409 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.07478165627 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845501162e+27 ymom added: 9.745937703e+27 zmom added: 9.730450513e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.01800227165 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.009158689191 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01334285736 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045056e+31 ymom added: 6.227881757e+31 zmom added: 6.227859048e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.01813983917 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1482009888 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.07813215256 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325071e+28 ymom added: 1.014449792e+28 zmom added: 1.012943963e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.01587963104 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.009284759575 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.06009697914 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392629997e+27 ymom added: 8.374293541e+27 zmom added: 8.373569506e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.01561188698 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450848e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.98808731e+29 ymom added: -1.060824736e+29 zmom added: -1.060602589e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.3465850353 Castro::reflux() at level 0 : time = 2.046629667 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418459e+31 TIME= 0.05817555484 YMOM = 4.967781719e+31 TIME= 0.05817555484 ZMOM = 5.25706579e+31 TIME= 0.05817555484 ANG MOM X = 1.03493669e+34 TIME= 0.05817555484 ANG MOM Y = 9.90986674e+37 TIME= 0.05817555484 ANG MOM Z = -9.90931435e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 12.12990712 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.016376711 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.0578289032 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.1148283482 Gravity::solve_for_phi() time = 0.6762363911 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167115e+30 ymom added: 5.887481737e+30 zmom added: 5.887368552e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.1563911438 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.753359556 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02988409996 Gravity::solve_for_phi() time = 0.4765815735 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950014e+29 ymom added: 1.951926997e+29 zmom added: 1.951930013e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.1741752625 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.06306639796 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01020693779 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.852691111e+31 ymom added: 6.852507497e+31 zmom added: 6.852482364e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.01111626625 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1248953342 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.06884360313 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.261869037e+29 ymom added: 6.260704036e+29 zmom added: 6.260523495e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.01236772537 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01301518059 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01007628441 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928492e+31 ymom added: 6.977721574e+31 zmom added: 6.977692833e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.0111823082 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1253418922 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.06813812256 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.244439612e+29 ymom added: 6.243280356e+29 zmom added: 6.243104125e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.01228260994 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01156880304 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.03192305565 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791128e+29 ymom added: 6.283560992e+29 zmom added: 6.283551442e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.01215338707 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769824e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765884229e+27 ymom added: 1.991202688e+29 zmom added: 1.991443892e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.170137167 Castro::reflux() at level 0 : time = 1.203753948 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025676e+31 TIME= 0.06827718955 YMOM = 5.550485414e+31 TIME= 0.06827718955 ZMOM = 5.839790188e+31 TIME= 0.06827718955 ANG MOM X = 1.14328374e+34 TIME= 0.06827718955 ANG MOM Y = 9.89950813e+37 TIME= 0.06827718955 ANG MOM Z = -9.898991319e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 7.105926822 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.815544019 seconds Ending run at 17:59:00 UTC on 2022-01-06. Run time = 100.7765644 Run time without initialization = 96.38199949 Average number of zones advanced per microsecond: 0.028 Average number of zones advanced per microsecond per rank: 0.007 TinyProfiler total time across processes [min...avg...max]: 100.8 ... 100.8 ... 100.8 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 29.5330 31.2421 32.7730 32.52% MLPoisson::Fsmooth() 11992 7.876 8.052 8.227 8.16% Castro::reset_internal_energy() 257 4.908 5.203 5.557 5.51% MultiFab::AddProduct() 4648 4.537 4.726 4.883 4.85% FabArray::setVal() 9416 4.017 4.13 4.222 4.19% MLPoisson::Fapply() 2421 3.812 3.941 4.065 4.03% MultiFab::min() 30 0.01062 1.587 3.371 3.34% FabArray::ParallelCopy_finish() 5320 1.43 2.375 2.981 2.96% MLCellLinOp::applyBC() 14629 2.647 2.764 2.946 2.92% MultiFab::Subtract() 601 2.656 2.752 2.813 2.79% FabArray::ParallelCopy_nowait() 5320 2.322 2.419 2.521 2.50% Castro::enforce_min_density() 254 1.635 1.842 2.172 2.16% Gravity::fill_multipole_BCs() 41 1.852 2.013 2.14 2.12% FillBoundary_finish() 13092 1.579 1.792 2.078 2.06% MultiFab::sum() 4648 1.561 1.619 1.66 1.65% Castro::derive() 397 1.493 1.548 1.643 1.63% FluxRegister::Reflux() 180 1.406 1.444 1.467 1.46% MultiFab::Xpay() 2190 1.246 1.278 1.315 1.31% FillBoundary_nowait() 13092 1.152 1.225 1.309 1.30% Castro::construct_new_gravity_source() 50 1.129 1.165 1.2 1.19% Castro::reflux() 10 1.04 1.067 1.113 1.10% Castro::normalize_species() 254 0.9731 1.01 1.033 1.03% Castro::estTimeStep() 69 0.3825 0.6659 0.9774 0.97% Castro::computeTemp() 257 0.8267 0.8374 0.8523 0.85% CellConservativeLinear::interp() 130 0.551 0.6851 0.8171 0.81% Castro::volWgtSum() 242 0.5646 0.6649 0.7965 0.79% Castro::post_timestep() 30 0.1278 0.4192 0.7488 0.74% FillPatchSingleLevel 853 0.5493 0.599 0.7317 0.73% MLPoisson::FFlux() 1016 0.6452 0.6602 0.6817 0.68% Gravity::get_new_grav_vector() 52 0.5806 0.5873 0.5959 0.59% Castro::finalize_advance() 30 0.5702 0.5823 0.5899 0.59% StateData::FillBoundary(geom) 63 0.4923 0.5027 0.5171 0.51% MLMG::addInterpCorrection() 1421 0.4479 0.4632 0.484 0.48% amrex::average_down 1713 0.4464 0.456 0.4688 0.47% MultiFab::Saxpy() 100 0.4381 0.4422 0.4464 0.44% Castro::do_advance_ctu() 30 0.3662 0.3809 0.3955 0.39% Amr::writePlotFile() 2 0.1927 0.2938 0.3596 0.36% MLMG::oneIter() 333 0.348 0.3519 0.3573 0.35% Castro::expand_state() 30 0.319 0.3275 0.335 0.33% MLCellLinOp::compGrad() 100 0.3176 0.3278 0.3341 0.33% MLCellLinOp::reflux() 116 0.3072 0.3141 0.325 0.32% Gravity::get_old_grav_vector() 30 0.284 0.3002 0.3088 0.31% FillPatchIterator::Initialize 723 0.2693 0.2848 0.3059 0.30% MLMG::ResNormInf() 450 0.2024 0.2354 0.2847 0.28% Castro::construct_old_gravity_source() 30 0.2575 0.2682 0.2801 0.28% MLCellLinOp::defineAuxData() 81 0.2471 0.2572 0.2638 0.26% MultiFab::Multiply() 164 0.2396 0.245 0.2507 0.25% VisMF::Write(FabArray) 4 0.1857 0.2127 0.2495 0.25% FabArray::mult() 294 0.2193 0.2261 0.2299 0.23% FabArray::setDomainBndry() 853 0.1997 0.2042 0.2102 0.21% FabArray::FillBoundary() 13092 0.1524 0.1587 0.1689 0.17% Castro::construct_old_gravity() 30 0.1523 0.1611 0.1665 0.17% MultiFab::contains_nan() 60 0.1453 0.1507 0.1544 0.15% Gravity::test_level_grad_phi_curr() 20 0.1423 0.1436 0.1447 0.14% Castro::evaluate_source_change() 591 0.1369 0.1403 0.1434 0.14% BndryData::define() 123 0.1325 0.1364 0.1406 0.14% MultiFab::LinComb() 627 0.1102 0.1204 0.1372 0.14% MLCellLinOp::smooth() 5996 0.1265 0.1293 0.1336 0.13% Castro::initData() 3 0.07921 0.1139 0.1257 0.12% Gravity::gravity_sync() 10 0.1088 0.1094 0.1108 0.11% Castro::construct_new_gravity() 30 0.09276 0.09689 0.104 0.10% MLMG::prepareForSolve() 80 0.1012 0.1024 0.1033 0.10% MultiFab::norm0(mask) 57 0.0909 0.09376 0.09748 0.10% MLCellLinOp::updateSolBC() 99 0.08658 0.08911 0.09421 0.09% MLCGSolver::bicgstab 83 0 0.02295 0.0918 0.09% FabArrayBase::getCPC() 8152 0.08312 0.08575 0.08796 0.09% Gravity::test_level_grad_phi_prev() 30 0.07882 0.08219 0.08392 0.08% Gravity::create_comp_minus_level_grad_phi() 10 0.07713 0.08104 0.08315 0.08% MultiFab::max() 40 0.03032 0.06458 0.08164 0.08% MLCellLinOp::updateCorBC() 78 0.06813 0.0707 0.07489 0.07% Castro::volProductSum() 22 0.05489 0.06356 0.07478 0.07% FabArrayBase::getFB() 13092 0.06362 0.06775 0.07384 0.07% StateDataPhysBCFunct::() 853 0.04617 0.05772 0.0705 0.07% MultiFab::Copy() 100 0.06857 0.0696 0.0703 0.07% FabArray::ParallelCopy() 5320 0.06526 0.06619 0.06682 0.07% Gravity::solve_for_phi() 60 0.04448 0.05216 0.06568 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.0609 0.06355 0.06549 0.06% MLCellLinOp::setLevelBC() 102 0.06078 0.0625 0.06529 0.06% MLMG::buildFineMask() 80 0.05887 0.06017 0.06287 0.06% FabArrayBase::CPC::define() 2260 0.04135 0.04774 0.06189 0.06% AmrMesh::MakeNewGrids() 11 0.05454 0.05811 0.06013 0.06% Gravity::actual_solve_with_mlmg() 81 0.04992 0.05297 0.0556 0.06% Castro::initialize_do_advance() 30 0.03452 0.03958 0.0459 0.05% MLCellLinOp::prepareForSolve() 81 0.03953 0.04113 0.04388 0.04% MLCellLinOp::apply() 2421 0.02676 0.03124 0.04252 0.04% Gravity::update_max_rhs() 20 0.04054 0.04134 0.04218 0.04% MLMG::solve() 80 0.01851 0.02861 0.04006 0.04% MLMG::interpCorrection_1 78 0.03639 0.03772 0.03968 0.04% Castro::init(old) 9 0.03507 0.03595 0.03707 0.04% Castro::apply_tagging_restrictions() 11 0.0344 0.03581 0.0365 0.04% MLCellLinOp::defineBC() 81 0.03345 0.03423 0.03511 0.03% Amr::defBaseLevel() 1 0.02762 0.02993 0.03105 0.03% Castro::initialize_advance() 30 0.02839 0.0295 0.03055 0.03% Castro::build_fine_mask() 153 0.02757 0.02847 0.02927 0.03% MLLinOp::makeSubCommunicator() 81 0.01224 0.01904 0.02726 0.03% FillPatchTwoLevels 394 0.02524 0.02594 0.02657 0.03% MLCellLinOp::correctionResidual() 1660 0.02061 0.02224 0.0252 0.03% Castro::finalize_do_advance() 30 0.003398 0.01371 0.02512 0.02% Gravity::actual_multilevel_solve() 10 0.0201 0.02062 0.02153 0.02% Amr::regrid() 10 0.01904 0.02032 0.02112 0.02% MLCGSolver::ParallelAllReduce 691 0 0.005207 0.02083 0.02% MLMG::MLRhsNormInf() 80 0.01934 0.01979 0.02012 0.02% CGSolver::sxay() 587 0 0.004908 0.01963 0.02% MultiFab::Dot() 463 0 0.004695 0.01878 0.02% Castro::do_new_sources() 50 0.003266 0.00838 0.01874 0.02% MLMG::mgVcycle() 489 0.0166 0.01703 0.01726 0.02% StateData::define() 48 0.01481 0.01632 0.01713 0.02% Castro::post_init() 2 0.0006618 0.01002 0.01679 0.02% Castro::swap_state_time_levels() 30 0.01283 0.01398 0.01466 0.01% DistributionMapping::LeastUsedCPUs() 5 0.005078 0.01 0.0133 0.01% MLMG:computeResOfCorrection() 1421 0.01252 0.01286 0.01315 0.01% Gravity::GetCrsePhi() 40 0.01072 0.01089 0.01107 0.01% Castro::do_old_sources() 30 0.001915 0.005674 0.01067 0.01% Castro::FluxRegFineAdd() 30 0.009466 0.009961 0.01063 0.01% MLMG::mgVcycle_down::0 333 0.009628 0.0101 0.01047 0.01% Gravity::multilevel_solve_for_new_phi() 10 0.0093 0.009869 0.01039 0.01% MLLinOp::defineGrids() 81 0.009114 0.009695 0.01028 0.01% FillPatchInterp(Fab) 130 0.003029 0.006408 0.01007 0.01% Castro::apply_problem_tags() 11 0.009261 0.009591 0.009752 0.01% MLMG::mgVcycle_down::1 333 0.008869 0.009214 0.009689 0.01% MLMG::actualBottomSolve() 333 0.001346 0.003452 0.009677 0.01% AMRErrorTag::operator() 11 0.00853 0.008747 0.009015 0.01% MLMG::mgVcycle_down::2 333 0.008353 0.008589 0.008933 0.01% MLCellLinOp::solutionResidual() 530 0.007916 0.008343 0.00885 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.00809 0.008415 0.008651 0.01% Castro::enforce_consistent_e() 3 0.008075 0.008354 0.008564 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.006907 0.007137 0.007552 0.01% Gravity::test_composite_phi() 1 0.006554 0.006956 0.007432 0.01% MLMG::mgVcycle_up::0 333 0.006461 0.006709 0.007047 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.006568 0.006711 0.006939 0.01% Castro::clean_state() 254 0.006303 0.006429 0.006604 0.01% MLMG::mgVcycle_up::1 333 0.00556 0.005788 0.005992 0.01% MLMG::mgVcycle_up::2 333 0.005588 0.00576 0.005927 0.01% MLMG::mgVcycle_bottom 489 0.005392 0.005511 0.005596 0.01% MLMG::mgVcycle_down::3 211 0.005084 0.005224 0.005321 0.01% MLMG::mgVcycle_down::4 211 0.005075 0.005196 0.005307 0.01% MLMG::MLResNormInf() 97 0.002837 0.004273 0.005169 0.01% MLMG::mgVcycle_up::4 211 0.003408 0.003502 0.00368 0.00% main() 1 0.003024 0.003468 0.003624 0.00% MLMG::mgVcycle_up::3 211 0.003311 0.003413 0.003614 0.00% Gravity::solve_phi_with_mlmg() 71 0.003159 0.003358 0.003559 0.00% FabArrayBase::FB::FB() 131 0.00136 0.001956 0.003442 0.00% MLMG::computeResidual() 333 0.003184 0.00326 0.003364 0.00% TagBoxArray::collate() 11 0.002281 0.002599 0.00331 0.00% makeSFC 243 0.002601 0.002693 0.002822 0.00% OwnerMask() 11 0.002142 0.002292 0.002504 0.00% Castro::subcycle_advance_ctu() 30 0.0004812 0.0009971 0.002476 0.00% Amr::bldFineLevels() 1 0.00158 0.002083 0.002449 0.00% Castro::construct_new_source() 250 0.001913 0.002027 0.002149 0.00% MLPoisson::define() 81 0.001694 0.001776 0.001921 0.00% MLLinOp::makeAgglomeratedDMap 81 0.001769 0.001793 0.00185 0.00% TagBoxArray::mapPRD 11 0.001329 0.001458 0.001641 0.00% Castro::enforce_speed_limit() 254 0.001327 0.001366 0.001402 0.00% MLMG::miniCycle() 156 0.001272 0.001316 0.001352 0.00% DistributionMapping::Distribute() 245 0.001294 0.001307 0.001323 0.00% Amr::InitAmr() 1 0.001241 0.001262 0.001284 0.00% MLMG::computeMLResidual() 97 0.00118 0.001221 0.001253 0.00% Amr::timeStep() 30 0.001033 0.001097 0.001228 0.00% FabArrayBase::TheFPinfo() 130 0.001051 0.001096 0.001146 0.00% Castro::apply_source_to_state() 100 0.001072 0.001107 0.001135 0.00% Castro::construct_old_source() 150 0.001048 0.001064 0.001092 0.00% MLMG::getGradSolution() 80 0.0009481 0.001014 0.001066 0.00% Amr::coarseTimeStep() 10 0.0007878 0.0008631 0.0009802 0.00% Amr::grid_places() 11 0.0008144 0.0008907 0.0009547 0.00% MLPoisson::prepareForSolve() 81 0.0009065 0.0009206 0.0009269 0.00% MLLinOp::define() 81 0.0007894 0.0008101 0.0008201 0.00% Castro::check_for_nan() 60 0.0006212 0.0006648 0.0007316 0.00% Castro::advance() 30 0.0006474 0.0006855 0.0007152 0.00% Gravity::swapTimeLevels() 30 0.0006069 0.0006173 0.0006287 0.00% Castro::computeNewDt() 18 0.0003313 0.0004075 0.0006279 0.00% Castro::post_regrid() 22 0.0005383 0.0005621 0.000618 0.00% AmrLevel::AmrLevel(dm) 12 0.0004947 0.000516 0.0005383 0.00% Castro::avgDown(state_indx) 44 0.0003856 0.0004057 0.0004381 0.00% Castro::errorEst() 11 0.0003434 0.0003845 0.0004302 0.00% amrex::average_down_w_geom 44 0.0003576 0.000368 0.0003775 0.00% FabArray::RecvLayoutMask() 21 0.0003124 0.0003183 0.0003278 0.00% ClusterList::intersect() 2 0 7.832e-05 0.0003133 0.00% Castro::avgDown() 11 0.0002303 0.0002398 0.0002491 0.00% Castro::create_source_corrector() 30 0.000214 0.0002236 0.0002407 0.00% FPinfo::FPinfo() 3 0.000159 0.0001897 0.0002164 0.00% AmrMesh-cluster 2 0 5.277e-05 0.0002111 0.00% Gravity::solve_for_delta_phi 10 0.0001483 0.0001785 0.0001909 0.00% BoxList::parallelComplementIn() 22 0.0001637 0.000173 0.0001874 0.00% Castro::retry_advance_ctu() 30 0.0001384 0.0001487 0.0001624 0.00% Amr::FinalizeInit() 1 5.892e-05 8.477e-05 0.000155 0.00% Castro::gwstrain() 22 0.0001117 0.0001187 0.0001348 0.00% BoxList::complementIn 22 9.871e-05 0.0001077 0.0001229 0.00% Gravity::set_mass_offset() 11 7.029e-05 8.83e-05 0.0001022 0.00% knapsack() 3 8.325e-05 9.166e-05 0.0001021 0.00% DistributionMapping::KnapSackDoIt() 3 6.475e-05 6.884e-05 7.396e-05 0.00% ClusterList::chop() 2 0 1.73e-05 6.921e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 5.571e-05 5.983e-05 6.658e-05 0.00% MLMG::compResidual() 1 3.833e-05 4.16e-05 4.583e-05 0.00% Castro::computeInitialDt() 2 2.783e-05 3.678e-05 4.15e-05 0.00% Amr::writeSmallPlotFile() 1 3.583e-05 3.656e-05 3.875e-05 0.00% Amr::initSubcycle() 1 2.333e-05 2.744e-05 2.954e-05 0.00% Amr::initialInit() 1 1.442e-05 1.716e-05 1.95e-05 0.00% Amr::init() 1 1.329e-05 1.499e-05 1.65e-05 0.00% Amr::InitializeInit() 1 1.233e-05 1.381e-05 1.533e-05 0.00% knapsack()swap 2 1.129e-05 1.236e-05 1.379e-05 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 100.8 100.8 100.8 100.00% Amr::coarseTimeStep() 10 95.56 95.56 95.56 94.83% Amr::timeStep() 30 95.43 95.43 95.43 94.69% Castro::advance() 30 68.74 68.75 68.75 68.22% Castro::subcycle_advance_ctu() 30 65.62 65.71 65.85 65.34% Castro::do_advance_ctu() 30 65.62 65.71 65.85 65.34% Castro::construct_ctu_hydro_source() 30 29.53 31.24 32.77 32.52% Gravity::actual_solve_with_mlmg() 81 25.6 25.61 25.61 25.41% MLMG::solve() 80 24.38 24.4 24.41 24.22% Castro::post_timestep() 30 20.85 20.86 20.86 20.70% MLMG::oneIter() 333 20.45 20.46 20.48 20.32% Gravity::solve_phi_with_mlmg() 71 19.54 19.74 19.92 19.77% Castro::clean_state() 254 17.68 18.57 19.51 19.36% MLMG::mgVcycle() 489 18.04 18.05 18.08 17.94% Castro::reflux() 10 16.62 16.82 17.04 16.91% Gravity::solve_for_phi() 60 16.02 16.22 16.38 16.26% MLCellLinOp::smooth() 5996 12.53 12.68 13.06 12.96% Castro::computeTemp() 257 10.49 10.96 11.47 11.39% Castro::reset_internal_energy() 257 9.659 10.12 10.62 10.54% Castro::construct_new_gravity() 30 9.576 9.629 9.671 9.60% Castro::construct_old_gravity() 30 9.088 9.221 9.324 9.25% Gravity::gravity_sync() 10 9.042 9.043 9.044 8.97% Castro::evaluate_source_change() 591 7.844 8.143 8.38 8.32% MLPoisson::Fsmooth() 11992 7.876 8.052 8.227 8.16% MLMG::mgVcycle_down::0 333 7.704 7.771 7.807 7.75% Gravity::solve_for_delta_phi 10 7.674 7.677 7.681 7.62% Castro::enforce_min_density() 254 6.345 6.738 7.174 7.12% MLCellLinOp::applyBC() 14629 5.725 5.934 6.183 6.13% FillPatchIterator::Initialize 723 5.615 5.808 6.066 6.02% Amr::regrid() 10 5.591 5.817 5.996 5.95% Castro::do_new_sources() 50 5.511 5.723 5.984 5.94% Castro::post_regrid() 22 5.305 5.544 5.742 5.70% MLMG::mgVcycle_up::0 333 5.231 5.541 5.657 5.61% FabArray::ParallelCopy() 5320 4.11 4.947 5.561 5.52% MLCellLinOp::apply() 2421 5.137 5.26 5.454 5.41% MultiFab::AddProduct() 4648 4.537 4.726 4.883 4.85% Castro::initialize_do_advance() 30 4.308 4.356 4.394 4.36% Amr::init() 1 4.393 4.393 4.393 4.36% FillPatchSingleLevel 853 4.137 4.247 4.368 4.33% FabArray::setVal() 9416 4.017 4.13 4.222 4.19% MLPoisson::Fapply() 2421 3.812 3.941 4.065 4.03% MLCellLinOp::solutionResidual() 530 3.48 3.528 3.559 3.53% Gravity::multilevel_solve_for_new_phi() 10 3.509 3.509 3.509 3.48% FabArray::FillBoundary() 13092 3.042 3.245 3.505 3.48% Gravity::actual_multilevel_solve() 10 3.499 3.499 3.5 3.47% MLCellLinOp::correctionResidual() 1660 3.241 3.317 3.475 3.45% MultiFab::min() 30 0.01062 1.587 3.371 3.34% MLMG:computeResOfCorrection() 1421 2.981 3.062 3.2 3.18% Amr::initialInit() 1 3.183 3.183 3.183 3.16% FabArray::ParallelCopy_finish() 5320 1.43 2.375 2.981 2.96% Castro::derive() 397 2.746 2.783 2.887 2.86% Castro::do_old_sources() 30 2.579 2.725 2.848 2.83% MultiFab::Subtract() 601 2.656 2.752 2.813 2.79% Amr::FinalizeInit() 1 2.622 2.639 2.647 2.63% FabArray::ParallelCopy_nowait() 5320 2.405 2.506 2.614 2.59% Castro::initialize_advance() 30 2.241 2.384 2.474 2.46% Gravity::fill_multipole_BCs() 41 1.914 2.075 2.201 2.18% FillPatchTwoLevels 394 2.062 2.118 2.169 2.15% Castro::expand_state() 30 1.891 1.973 2.124 2.11% Castro::post_init() 2 2.045 2.079 2.096 2.08% Castro::volWgtSum() 242 1.874 1.981 2.088 2.07% FillBoundary_finish() 13092 1.579 1.792 2.078 2.06% FluxRegister::Reflux() 180 2.014 2.022 2.029 2.01% Amr::writePlotFile() 2 2.025 2.025 2.025 2.01% MLMG::computeResidual() 333 1.806 1.845 1.864 1.85% MLMG::computeResWithCrseSolFineCor() 78 1.766 1.769 1.771 1.76% Gravity::get_new_grav_vector() 52 1.726 1.733 1.736 1.72% MLMG::addInterpCorrection() 1421 0.5486 1.378 1.661 1.65% MultiFab::sum() 4648 1.561 1.619 1.66 1.65% MLMG::mgVcycle_down::1 333 1.41 1.461 1.532 1.52% FillBoundary_nowait() 13092 1.23 1.295 1.374 1.36% MultiFab::Xpay() 2190 1.246 1.278 1.315 1.31% MLCellLinOp::reflux() 116 1.217 1.221 1.229 1.22% MLMG::computeMLResidual() 97 1.196 1.21 1.221 1.21% Castro::construct_new_source() 250 1.131 1.167 1.202 1.19% Castro::construct_new_gravity_source() 50 1.129 1.165 1.2 1.19% MLMG::mgVcycle_up::2 333 0.4101 0.9539 1.141 1.13% Castro::normalize_species() 254 0.9731 1.01 1.033 1.03% MLMG::mgVcycle_up::1 333 0.9326 0.9601 1.028 1.02% Castro::estTimeStep() 69 0.3825 0.6659 0.9774 0.97% Gravity::get_old_grav_vector() 30 0.9562 0.9609 0.9653 0.96% FillPatchInterp(Fab) 130 0.5611 0.6916 0.8203 0.81% CellConservativeLinear::interp() 130 0.551 0.6851 0.8171 0.81% MLPoisson::FFlux() 1016 0.6452 0.6602 0.6817 0.68% Castro::finalize_advance() 30 0.6433 0.6546 0.665 0.66% Castro::computeNewDt() 18 0.2262 0.3906 0.6117 0.61% MLMG::mgVcycle_bottom 489 0.2904 0.3695 0.6049 0.60% MLPoisson::define() 81 0.5901 0.597 0.6017 0.60% amrex::average_down 1713 0.509 0.5265 0.5665 0.56% StateDataPhysBCFunct::() 853 0.5549 0.5604 0.5633 0.56% Amr::InitializeInit() 1 0.5364 0.5438 0.5612 0.56% Amr::defBaseLevel() 1 0.5364 0.5438 0.5612 0.56% MLMG::mgVcycle_down::2 333 0.509 0.5241 0.5556 0.55% Castro::initData() 3 0.5175 0.5264 0.5466 0.54% StateData::FillBoundary(geom) 63 0.4923 0.5027 0.5171 0.51% MLMG::prepareForSolve() 80 0.4896 0.5 0.5113 0.51% Castro::apply_source_to_state() 100 0.4392 0.4433 0.4475 0.44% MultiFab::Saxpy() 100 0.4381 0.4422 0.4464 0.44% MLMG::getGradSolution() 80 0.4151 0.4227 0.4262 0.42% MLCellLinOp::compGrad() 100 0.414 0.4217 0.4251 0.42% MLCellLinOp::defineAuxData() 81 0.3282 0.3425 0.355 0.35% MLMG::ResNormInf() 450 0.2632 0.297 0.3446 0.34% MLMG::mgVcycle_down::3 211 0.09027 0.1536 0.3388 0.34% Amr::bldFineLevels() 1 0.3118 0.3169 0.3312 0.33% MLMG::actualBottomSolve() 333 0.001346 0.07981 0.3151 0.31% MLCGSolver::bicgstab 83 0 0.07524 0.3009 0.30% MLMG::miniCycle() 156 0.289 0.2896 0.2901 0.29% Castro::construct_old_source() 150 0.2585 0.2693 0.2812 0.28% Castro::construct_old_gravity_source() 30 0.2575 0.2682 0.2801 0.28% MultiFab::Multiply() 164 0.2396 0.245 0.2507 0.25% VisMF::Write(FabArray) 4 0.1857 0.2127 0.2495 0.25% Gravity::GetCrsePhi() 40 0.1617 0.2004 0.2491 0.25% MLMG::mgVcycle_up::3 211 0.06902 0.1155 0.2482 0.25% Castro::init(old) 9 0.2393 0.242 0.2442 0.24% FabArray::mult() 294 0.2193 0.2261 0.2299 0.23% MLCellLinOp::defineBC() 81 0.2124 0.2174 0.2244 0.22% FabArray::setDomainBndry() 853 0.1997 0.2042 0.2102 0.21% MLCellLinOp::updateSolBC() 99 0.175 0.186 0.1996 0.20% Amr::grid_places() 11 0.1927 0.1938 0.1951 0.19% AmrMesh::MakeNewGrids() 11 0.1919 0.1929 0.1942 0.19% BndryData::define() 123 0.177 0.1815 0.1881 0.19% Castro::volProductSum() 22 0.1737 0.179 0.1873 0.19% MLMG::computeResWithCrseCorFineCor() 78 0.1808 0.1819 0.1827 0.18% Gravity::test_level_grad_phi_curr() 20 0.1575 0.159 0.1605 0.16% Castro::check_for_nan() 60 0.146 0.1513 0.155 0.15% MultiFab::contains_nan() 60 0.1453 0.1507 0.1544 0.15% Gravity::create_comp_minus_level_grad_phi() 10 0.1394 0.1468 0.1505 0.15% FabArrayBase::getCPC() 8152 0.1245 0.1335 0.1479 0.15% MLMG::mgVcycle_down::4 211 0.08665 0.104 0.1474 0.15% Gravity::update_max_rhs() 20 0.08867 0.1221 0.138 0.14% MultiFab::LinComb() 627 0.1102 0.1204 0.1372 0.14% Gravity::test_composite_phi() 1 0.1245 0.1246 0.1246 0.12% MLMG::mgVcycle_up::4 211 0.06911 0.08229 0.1158 0.11% MLCellLinOp::updateCorBC() 78 0.1071 0.1091 0.1108 0.11% MLMG::interpCorrection_1 78 0.07064 0.093 0.109 0.11% MLCellLinOp::setLevelBC() 102 0.08871 0.09878 0.1051 0.10% Castro::errorEst() 11 0.09763 0.09856 0.1008 0.10% MultiFab::norm0(mask) 57 0.0909 0.09376 0.09748 0.10% Gravity::test_level_grad_phi_prev() 30 0.08737 0.0911 0.09305 0.09% MLMG::MLResNormInf() 97 0.0847 0.08605 0.08706 0.09% MultiFab::max() 40 0.03032 0.06458 0.08164 0.08% MLMG::buildFineMask() 80 0.07496 0.07645 0.0795 0.08% FabArrayBase::getFB() 13092 0.06498 0.06971 0.07728 0.08% MultiFab::Copy() 100 0.06857 0.0696 0.0703 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.0609 0.06355 0.06549 0.06% FabArrayBase::CPC::define() 2260 0.04135 0.04774 0.06189 0.06% Castro::computeInitialDt() 2 0.02987 0.0473 0.05462 0.05% MLMG::MLRhsNormInf() 80 0.05029 0.05191 0.0538 0.05% MLPoisson::prepareForSolve() 81 0.04045 0.04205 0.04481 0.04% CGSolver::sxay() 587 0 0.01111 0.04442 0.04% MLLinOp::define() 81 0.02782 0.03532 0.04433 0.04% MLCellLinOp::prepareForSolve() 81 0.03953 0.04113 0.04388 0.04% MLLinOp::defineGrids() 81 0.02703 0.03451 0.04351 0.04% Gravity::swapTimeLevels() 30 0.03892 0.04045 0.04214 0.04% MLMG::compResidual() 1 0.03279 0.03651 0.03961 0.04% Castro::apply_tagging_restrictions() 11 0.0344 0.03581 0.0365 0.04% MLCGSolver::ParallelAllReduce 691 0 0.008197 0.03279 0.03% Castro::build_fine_mask() 153 0.02757 0.02847 0.02927 0.03% MLLinOp::makeSubCommunicator() 81 0.01224 0.01904 0.02726 0.03% TagBoxArray::mapPRD 11 0.01891 0.02174 0.02624 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.02445 0.02518 0.02597 0.03% Castro::finalize_do_advance() 30 0.003398 0.01371 0.02512 0.02% Castro::avgDown() 11 0.02074 0.02214 0.02341 0.02% Castro::avgDown(state_indx) 44 0.0205 0.02191 0.02316 0.02% amrex::average_down_w_geom 44 0.02012 0.0215 0.02277 0.02% MultiFab::Dot() 463 0 0.004695 0.01878 0.02% AmrLevel::AmrLevel(dm) 12 0.0153 0.01684 0.01766 0.02% StateData::define() 48 0.01481 0.01632 0.01713 0.02% FabArrayBase::TheFPinfo() 130 0.006384 0.0114 0.0148 0.01% Castro::swap_state_time_levels() 30 0.01283 0.01398 0.01466 0.01% FPinfo::FPinfo() 3 0.005333 0.01031 0.01366 0.01% DistributionMapping::KnapSackDoIt() 3 0.00516 0.01012 0.01344 0.01% DistributionMapping::LeastUsedCPUs() 5 0.005078 0.01 0.0133 0.01% Castro::FluxRegFineAdd() 30 0.009466 0.009961 0.01063 0.01% Castro::apply_problem_tags() 11 0.009261 0.009591 0.009752 0.01% AMRErrorTag::operator() 11 0.00853 0.008747 0.009015 0.01% Castro::enforce_consistent_e() 3 0.008075 0.008354 0.008564 0.01% MLLinOp::makeAgglomeratedDMap 81 0.005665 0.005774 0.005975 0.01% makeSFC 243 0.003895 0.003982 0.004125 0.00% FabArrayBase::FB::FB() 131 0.00136 0.001956 0.003442 0.00% TagBoxArray::collate() 11 0.002281 0.002599 0.00331 0.00% OwnerMask() 11 0.002142 0.002292 0.002504 0.00% Castro::enforce_speed_limit() 254 0.001327 0.001366 0.001402 0.00% DistributionMapping::Distribute() 245 0.001294 0.001307 0.001323 0.00% Amr::InitAmr() 1 0.00127 0.001289 0.001311 0.00% AmrMesh-cluster 2 0 0.0001484 0.0005936 0.00% FabArray::RecvLayoutMask() 21 0.0003124 0.0003183 0.0003278 0.00% ClusterList::intersect() 2 0 7.832e-05 0.0003133 0.00% BoxList::parallelComplementIn() 22 0.0002703 0.0002806 0.0002902 0.00% Castro::create_source_corrector() 30 0.000214 0.0002236 0.0002407 0.00% Castro::retry_advance_ctu() 30 0.0001384 0.0001487 0.0001624 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 0.0001275 0.0001356 0.0001489 0.00% Castro::gwstrain() 22 0.0001117 0.0001187 0.0001348 0.00% BoxList::complementIn 22 9.871e-05 0.0001077 0.0001229 0.00% knapsack() 3 9.563e-05 0.000104 0.0001159 0.00% Gravity::set_mass_offset() 11 7.029e-05 8.83e-05 0.0001022 0.00% ClusterList::chop() 2 0 1.73e-05 6.921e-05 0.00% Amr::writeSmallPlotFile() 1 3.583e-05 3.656e-05 3.875e-05 0.00% Amr::initSubcycle() 1 2.333e-05 2.744e-05 2.954e-05 0.00% knapsack()swap 2 1.129e-05 1.236e-05 1.379e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.01-9-gaa079d4dc93b) finalized