MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-35-g3aafa306ad82) initialized Starting run at 05:40:29 UTC on 2022-03-31. Successfully read inputs file ... Castro git describe: 22.02-19-ga92ac477d AMReX git describe: 22.03-35-g3aafa306a Microphysics git describe: 22.03-14-g4f1304ed reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.012105884 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.014585488 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029960559 Gravity::fill_multipole_BCs() time = 0.028987205 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.59951491 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033211171 Gravity::solve_for_phi() time = 0.397708138 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.610899234e+22 ymom added: -5.666839779e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.140763424 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.469525522 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028928016 Gravity::solve_for_phi() time = 0.346765982 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.160087225 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08301871216 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008591082 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009569947 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108048572 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044070633 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.01055387 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01611344 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008451639 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009494546 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10681135 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045953931 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010404138 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0147268677 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028262123 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010155566 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.15168006 Castro::reflux() at level 0 : time = 1.024666517 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.991116762 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009677267 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028577067 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.03094947 Gravity::solve_for_phi() time = 0.396031777 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852864e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.13738422 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.474570619 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027431612 Gravity::solve_for_phi() time = 0.350400575 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.15955548 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08325286222 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008496214 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009531409 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10657596 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044262003 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010081643 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01617473503 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008147286 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009768839 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108023532 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044344904 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010167599 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01440180498 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.033010292 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010167092 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770255e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.149546583 Castro::reflux() at level 0 : time = 1.020315086 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.335789827 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009529929 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028863744 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030870285 Gravity::solve_for_phi() time = 0.375064821 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.69293902e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.133223066 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.447553838 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025512361 Gravity::solve_for_phi() time = 0.324288082 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.14852538 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.086092728 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009381226 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009182025 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105795111 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042579268 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010030655 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0162699361 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008319645 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009344447 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10603533 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04451031 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010075257 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01483597346 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029170448 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010189297 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342335e+27 ymom added: 5.311566494e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.14789653 Castro::reflux() at level 0 : time = 0.99013485 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.116471321 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009580349 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029095989 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030376209 Gravity::solve_for_phi() time = 0.374714743 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700674e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.134246607 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.456235423 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02527052 Gravity::solve_for_phi() time = 0.323951477 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.149142879 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08582640365 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008370459 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009253195 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10580244 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04276344 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010163912 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01638632338 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008374608 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009065115 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106386877 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042975731 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.01004345 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01510040165 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029347699 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.01025141 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860432e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.149916756 Castro::reflux() at level 0 : time = 0.94216885 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.076746217 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009756372 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028576213 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030027016 Gravity::solve_for_phi() time = 0.373137551 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150493e+30 ymom added: 3.39980379e+30 zmom added: 3.399742172e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.133543146 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.452561533 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024517926 Gravity::solve_for_phi() time = 0.322809662 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.149700022 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0860265233 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008413716 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009172884 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107003047 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042492371 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010145484 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01645983771 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008329373 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009123207 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106775498 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044310203 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.01008316 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0150038525 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028945783 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.009944541 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277775e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.147861719 Castro::reflux() at level 0 : time = 0.929816852 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.076470471 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009622318 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028443863 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029562287 Gravity::solve_for_phi() time = 0.374556318 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.09491932e+30 ymom added: 4.094511387e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.133767759 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.450540439 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025366072 Gravity::solve_for_phi() time = 0.32433351 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245022e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.148655647 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08608083902 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008149261 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009077954 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106656259 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042570043 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.01011555 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01648073128 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008375086 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009081895 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106282748 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042838666 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010203382 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01509976454 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028888376 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.009976571 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781792e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.150738504 Castro::reflux() at level 0 : time = 0.938023814 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.07760561 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009538439 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02933947 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030559295 Gravity::solve_for_phi() time = 0.375080243 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151117e+30 ymom added: 4.515687996e+30 zmom added: 4.515608887e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.13390834 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.444287568 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024946413 Gravity::solve_for_phi() time = 0.32418389 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752619e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.148151947 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08627995427 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008337117 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009140278 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106833646 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042451092 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010477527 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01629801007 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007948382 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009454293 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107282872 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043136709 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010436675 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01490479323 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028939209 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010173539 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.148822601 Castro::reflux() at level 0 : time = 0.936288877 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.127350284 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009578083 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02889235 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.036835731 Gravity::solve_for_phi() time = 0.383554456 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064078e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.13632988 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.459908428 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025337033 Gravity::solve_for_phi() time = 0.372681034 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642725e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.149644092 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08414951692 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008346243 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009123279 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105938585 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042829714 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.01000886 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01634586157 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008373952 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009079284 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106479381 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042775367 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.01024407 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01506549117 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028991674 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010100845 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478815e+29 ymom added: 5.931907363e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.148539981 Castro::reflux() at level 0 : time = 0.933912732 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.196701216 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009673246 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028561779 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029812321 Gravity::solve_for_phi() time = 0.374079697 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036366e+30 ymom added: 5.53045164e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.133122304 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.476326953 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025933575 Gravity::solve_for_phi() time = 0.378445926 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170339e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.154249947 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08378487249 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008162677 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009497881 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107194301 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043107127 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010338088 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01625955632 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007933635 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009594229 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107511661 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044612958 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010383051 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01480656024 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029463075 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.010415268 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.148844652 Castro::reflux() at level 0 : time = 0.949261796 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.248705058 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009697049 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028396166 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029168229 Gravity::solve_for_phi() time = 0.373885463 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167203e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.133190305 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.449841218 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025727318 Gravity::solve_for_phi() time = 0.370543012 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.149030527 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08480948617 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008416556 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009169909 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106434633 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04858367 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010040041 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01607490157 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008251938 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.00919916 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10609412 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048033135 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.009984113 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01483091189 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029573797 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010325741 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914869e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.151456674 Castro::reflux() at level 0 : time = 1.008687429 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.25549844 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.54790937 seconds Ending run at 05:41:23 UTC on 2022-03-31. Run time = 54.23956533 Run time without initialization = 52.03300547 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.24 ... 54.24 ... 54.24 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4887 16.5996 16.7169 30.82% MLPoisson::Fsmooth() 11992 4.184 4.252 4.391 8.09% Castro::reset_internal_energy() 257 2.944 2.999 3.071 5.66% MultiFab::AddProduct() 4648 2.672 2.677 2.681 4.94% FabArray::setVal() 9464 2.354 2.362 2.371 4.37% MLPoisson::Fapply() 2422 1.856 1.872 1.903 3.51% MLCellLinOp::applyBC() 14630 1.472 1.535 1.671 3.08% MultiFab::Subtract() 601 1.598 1.602 1.605 2.96% FabArray::ParallelCopy_nowait() 5320 1.376 1.389 1.403 2.59% FabArray::ParallelCopy_finish() 5320 0.6329 1.063 1.35 2.49% Castro::enforce_min_density() 254 1.048 1.082 1.15 2.12% Gravity::fill_multipole_BCs() 41 1.069 1.102 1.138 2.10% Castro::derive() 397 0.9259 0.9327 0.942 1.74% MultiFab::sum() 4648 0.8506 0.8525 0.8536 1.57% FluxRegister::Reflux() 180 0.8141 0.8282 0.8479 1.56% Castro::normalize_species() 254 0.7856 0.806 0.8193 1.51% MultiFab::Xpay() 2190 0.701 0.7056 0.7169 1.32% Castro::reflux() 10 0.6822 0.6851 0.6872 1.27% FillBoundary_nowait() 13093 0.6436 0.659 0.6766 1.25% FillBoundary_finish() 13093 0.4952 0.5526 0.6159 1.14% Castro::construct_new_gravity_source() 50 0.6005 0.6043 0.61 1.12% Castro::volWgtSum() 242 0.5232 0.5407 0.5577 1.03% CellConservativeLinear::interp() 130 0.366 0.4569 0.5505 1.02% Castro::computeTemp() 257 0.4617 0.4632 0.4647 0.86% MLPoisson::FFlux() 1042 0.3775 0.3788 0.3798 0.70% Castro::finalize_advance() 30 0.3545 0.3635 0.3722 0.69% Gravity::get_new_grav_vector() 52 0.3338 0.3358 0.3394 0.63% FillPatchSingleLevel 853 0.324 0.3289 0.3354 0.62% StateData::FillBoundary(geom) 63 0.3201 0.3226 0.3244 0.60% Castro::estTimeStep() 69 0.2273 0.2835 0.3212 0.59% amrex::average_down 1713 0.2774 0.2817 0.292 0.54% MLMG::addInterpCorrection() 1421 0.2579 0.2627 0.2731 0.50% MultiFab::Saxpy() 100 0.2694 0.2712 0.2721 0.50% FillPatchIterator::Initialize 723 0.2673 0.2694 0.2716 0.50% MultiFab::min() 30 0.007421 0.1299 0.2541 0.47% Castro::do_advance_ctu() 30 0.2199 0.2211 0.2218 0.41% MLMG::oneIter() 333 0.2061 0.2069 0.2077 0.38% Castro::expand_state() 30 0.1935 0.1943 0.1957 0.36% MLCellLinOp::defineAuxData() 81 0.1719 0.1773 0.1846 0.34% VisMF::Write(FabArray) 4 0.1617 0.1664 0.1759 0.32% MLCellLinOp::reflux() 116 0.171 0.1719 0.1732 0.32% MLCellLinOp::compGrad() 100 0.1714 0.1715 0.1718 0.32% Gravity::get_old_grav_vector() 30 0.1662 0.1671 0.1678 0.31% MultiFab::Multiply() 164 0.1423 0.1427 0.1434 0.26% FabArray::mult() 294 0.1371 0.1386 0.14 0.26% Castro::construct_old_gravity_source() 30 0.1358 0.1362 0.1365 0.25% Amr::writePlotFile() 2 0.1168 0.126 0.1325 0.24% FabArray::setDomainBndry() 853 0.1249 0.128 0.1317 0.24% Castro::post_timestep() 30 0.06337 0.08031 0.1028 0.19% MLMG::ResNormInf() 450 0.096 0.09846 0.1011 0.19% MultiFab::contains_nan() 60 0.09785 0.09837 0.09864 0.18% BndryData::define() 123 0.08797 0.0896 0.09129 0.17% Castro::construct_old_gravity() 30 0.08778 0.08872 0.09002 0.17% MLMG::prepareForSolve() 80 0.07925 0.08042 0.08135 0.15% MultiFab::LinComb() 628 0.06477 0.0689 0.07958 0.15% Castro::evaluate_source_change() 591 0.07663 0.07766 0.07826 0.14% Gravity::test_level_grad_phi_curr() 20 0.07129 0.07184 0.07266 0.13% Gravity::gravity_sync() 10 0.07046 0.07054 0.07062 0.13% Castro::initData() 3 0.05634 0.05851 0.06061 0.11% MLCellLinOp::updateSolBC() 99 0.05747 0.05797 0.05839 0.11% MLCGSolver::bicgstab 83 0 0.01406 0.05623 0.10% Castro::volProductSum() 22 0.04454 0.05015 0.05464 0.10% Castro::construct_new_gravity() 30 0.05208 0.05305 0.05391 0.10% MultiFab::norm0(mask) 57 0.04676 0.04739 0.04789 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04577 0.04618 0.04649 0.09% MLCellLinOp::updateCorBC() 78 0.04553 0.04588 0.04612 0.09% Gravity::actual_solve_with_mlmg() 81 0.03971 0.04164 0.04512 0.08% FabArrayBase::CPC::define() 2260 0.02776 0.03198 0.04354 0.08% MultiFab::max() 40 0.01349 0.02893 0.04272 0.08% Gravity::solve_for_phi() 60 0.02688 0.03333 0.04248 0.08% Castro::initialize_do_advance() 30 0.03789 0.04002 0.04191 0.08% FabArrayBase::getCPC() 8152 0.04156 0.04175 0.04189 0.08% Gravity::test_level_grad_phi_prev() 30 0.04049 0.04094 0.04139 0.08% MLCellLinOp::setLevelBC() 102 0.04039 0.04067 0.04082 0.08% MultiFab::Copy() 100 0.03989 0.04005 0.04018 0.07% MLMG::buildFineMask() 80 0.03815 0.03869 0.03949 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03545 0.03651 0.0372 0.07% AmrMesh::MakeNewGrids() 11 0.03411 0.03472 0.03573 0.07% FabArray::FillBoundary() 13093 0.03091 0.03206 0.03463 0.06% MLCellLinOp::prepareForSolve() 81 0.02468 0.02572 0.02808 0.05% Castro::post_init() 2 0.0007171 0.01483 0.02735 0.05% Castro::init(old) 9 0.02682 0.02689 0.02703 0.05% MLCellLinOp::smooth() 5996 0.02562 0.0262 0.0269 0.05% Castro::initialize_advance() 30 0.02512 0.02574 0.02637 0.05% FabArrayBase::getFB() 13093 0.02275 0.0235 0.02534 0.05% Gravity::update_max_rhs() 20 0.02405 0.02436 0.02456 0.05% MLCellLinOp::defineBC() 81 0.02387 0.02418 0.0245 0.05% Amr::defBaseLevel() 1 0.02108 0.02178 0.02369 0.04% MLMG::interpCorrection_1 78 0.02293 0.02299 0.02304 0.04% Castro::apply_tagging_restrictions() 11 0.02077 0.02116 0.02196 0.04% Castro::finalize_do_advance() 30 0.01561 0.01915 0.02163 0.04% StateData::define() 48 0.01502 0.01679 0.01925 0.04% FillPatchTwoLevels 394 0.01633 0.01766 0.01902 0.04% Castro::build_fine_mask() 153 0.0182 0.01827 0.01838 0.03% FabArray::ParallelCopy() 5320 0.01418 0.01441 0.01478 0.03% Castro::swap_state_time_levels() 30 0.0131 0.01353 0.01415 0.03% Gravity::actual_multilevel_solve() 10 0.01207 0.01218 0.01231 0.02% MLMG::MLRhsNormInf() 80 0.01213 0.01216 0.01219 0.02% Amr::regrid() 10 0.009687 0.01038 0.01107 0.02% StateDataPhysBCFunct::() 853 0.00933 0.00999 0.01098 0.02% MultiFab::Dot() 463 0 0.002698 0.01079 0.02% Gravity::GetCrsePhi() 40 0.009497 0.009659 0.009836 0.02% MLCellLinOp::apply() 2422 0.005699 0.006576 0.008964 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008331 0.00858 0.008859 0.02% Castro::apply_problem_tags() 11 0.00822 0.008303 0.008485 0.02% MLLinOp::makeSubCommunicator() 81 0.002652 0.00521 0.007958 0.01% Castro::FluxRegFineAdd() 30 0.007146 0.00727 0.007362 0.01% MLCGSolver::ParallelAllReduce 692 0 0.00181 0.00724 0.01% MLLinOp::defineGrids() 81 0.006854 0.007039 0.00717 0.01% MLMG::solve() 80 0.004858 0.005862 0.006461 0.01% Castro::do_new_sources() 50 0.0008697 0.002646 0.006216 0.01% MLCellLinOp::correctionResidual() 1660 0.0046 0.004942 0.005757 0.01% AMRErrorTag::operator() 11 0.004872 0.005132 0.005341 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005159 0.005204 0.005263 0.01% FillPatchInterp(Fab) 130 0.001731 0.002652 0.005216 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.00498 0.005001 0.005046 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004957 0.004972 0.005001 0.01% CGSolver::sxay() 588 0 0.001202 0.004809 0.01% MLMG::mgVcycle() 489 0.003954 0.004079 0.004296 0.01% main() 1 0.002534 0.003784 0.004248 0.01% Gravity::test_composite_phi() 1 0.003764 0.003892 0.004131 0.01% Castro::enforce_consistent_e() 3 0.00336 0.003625 0.003898 0.01% MLMG:computeResOfCorrection() 1421 0.003312 0.003363 0.003443 0.01% MLMG::actualBottomSolve() 333 0.0003888 0.001156 0.00344 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0004114 0.00119 0.002974 0.01% Castro::do_old_sources() 30 0.0004996 0.001264 0.002887 0.01% Amr::InitAmr() 1 0.002394 0.002419 0.002437 0.00% FabArrayBase::FB::FB() 131 0.000851 0.001264 0.00237 0.00% MLMG::mgVcycle_down::0 333 0.002266 0.002284 0.002312 0.00% MLMG::mgVcycle_down::1 333 0.002067 0.002105 0.00215 0.00% MLCellLinOp::solutionResidual() 530 0.001949 0.001981 0.002036 0.00% MLMG::mgVcycle_down::2 333 0.001903 0.00194 0.002 0.00% Castro::subcycle_advance_ctu() 30 0.0001917 0.0006429 0.001976 0.00% Gravity::solve_phi_with_mlmg() 71 0.001551 0.001652 0.00179 0.00% MLMG::mgVcycle_up::0 333 0.00157 0.001584 0.001598 0.00% Castro::clean_state() 254 0.001536 0.001561 0.001583 0.00% OwnerMask() 11 0.001447 0.001494 0.001575 0.00% MLMG::mgVcycle_up::2 333 0.001331 0.001376 0.001474 0.00% TagBoxArray::collate() 11 0.001183 0.001269 0.001453 0.00% MLMG::mgVcycle_up::1 333 0.001338 0.001362 0.001405 0.00% MLMG::mgVcycle_bottom 489 0.001298 0.001319 0.001353 0.00% MLMG::mgVcycle_down::3 211 0.001163 0.001207 0.001297 0.00% MLMG::mgVcycle_down::4 211 0.00111 0.001156 0.001257 0.00% makeSFC 243 0.00107 0.0011 0.001122 0.00% MLMG::mgVcycle_up::4 211 0.0007737 0.0008225 0.0009131 0.00% TagBoxArray::mapPRD 11 0.0008102 0.0008582 0.0008866 0.00% Amr::bldFineLevels() 1 0.0007783 0.0008205 0.0008841 0.00% MLMG::mgVcycle_up::3 211 0.00074 0.0007741 0.0008593 0.00% MLMG::computeResidual() 333 0.0008202 0.000837 0.0008526 0.00% Amr::coarseTimeStep() 10 0.0006781 0.0007339 0.0007906 0.00% MLLinOp::makeAgglomeratedDMap 81 0.000768 0.0007773 0.0007875 0.00% MLMG::MLResNormInf() 97 0.0004716 0.0006089 0.0007414 0.00% Amr::timeStep() 30 0.0004406 0.0005131 0.0006778 0.00% MLPoisson::define() 81 0.0005955 0.0006147 0.0006417 0.00% Amr::grid_places() 11 0.0004921 0.0005676 0.0006092 0.00% Castro::construct_new_source() 250 0.0005698 0.0005863 0.0006028 0.00% FabArrayBase::TheFPinfo() 130 0.0005239 0.0005343 0.00055 0.00% DistributionMapping::Distribute() 245 0.0004767 0.00049 0.0005052 0.00% Castro::enforce_speed_limit() 254 0.000409 0.0004168 0.0004232 0.00% Castro::apply_source_to_state() 100 0.0003446 0.0003549 0.0003689 0.00% Castro::computeNewDt() 18 0.0001111 0.0001767 0.0003585 0.00% MLPoisson::prepareForSolve() 81 0.0003386 0.0003457 0.0003582 0.00% MLMG::computeMLResidual() 97 0.0003056 0.0003111 0.0003199 0.00% MLLinOp::define() 81 0.000291 0.0002975 0.0003042 0.00% Castro::construct_old_source() 150 0.0002903 0.0002949 0.0002983 0.00% MLMG::miniCycle() 156 0.0002707 0.0002737 0.0002752 0.00% Castro::post_regrid() 22 0.0002465 0.0002536 0.0002645 0.00% AmrLevel::AmrLevel(dm) 12 0.0002488 0.0002578 0.0002644 0.00% MLMG::getGradSolution() 80 0.000254 0.0002593 0.0002625 0.00% ClusterList::intersect() 2 0 5.747e-05 0.0002299 0.00% Castro::advance() 30 0.0001972 0.0002095 0.000227 0.00% Gravity::swapTimeLevels() 30 0.000177 0.0001965 0.0002261 0.00% FabArray::RecvLayoutMask() 21 0.000194 0.0001972 0.0002026 0.00% Castro::check_for_nan() 60 0.0001837 0.0001886 0.0001931 0.00% Castro::errorEst() 11 0.0001213 0.0001276 0.0001318 0.00% Castro::avgDown(state_indx) 44 0.0001121 0.0001186 0.0001304 0.00% FPinfo::FPinfo() 3 9.914e-05 0.0001071 0.0001121 0.00% Amr::FinalizeInit() 1 2.117e-05 4.415e-05 0.0001059 0.00% AmrMesh-cluster 2 0 2.503e-05 0.0001001 0.00% Castro::create_source_corrector() 30 8.039e-05 8.745e-05 9.281e-05 0.00% amrex::average_down_w_geom 44 8.542e-05 8.911e-05 9.197e-05 0.00% Gravity::solve_for_delta_phi 10 7.638e-05 8.283e-05 8.567e-05 0.00% Amr::writeSmallPlotFile() 1 7.386e-05 7.44e-05 7.507e-05 0.00% knapsack() 3 5.78e-05 6.18e-05 6.543e-05 0.00% Castro::retry_advance_ctu() 30 5.94e-05 6.178e-05 6.509e-05 0.00% Castro::avgDown() 11 5.673e-05 5.903e-05 6.267e-05 0.00% Amr::initSubcycle() 1 3.647e-05 4.821e-05 5.996e-05 0.00% Gravity::set_mass_offset() 11 2.703e-05 3.474e-05 4.801e-05 0.00% Castro::gwstrain() 22 3.688e-05 4.188e-05 4.703e-05 0.00% BoxList::parallelComplementIn() 22 4.015e-05 4.254e-05 4.52e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.505e-05 3.767e-05 3.94e-05 0.00% BoxList::complementIn 22 3.762e-05 3.834e-05 3.922e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.842e-05 3.027e-05 3.175e-05 0.00% ClusterList::chop() 2 0 5.134e-06 2.054e-05 0.00% Amr::init() 1 5.705e-06 8.319e-06 1.5e-05 0.00% Castro::computeInitialDt() 2 1.192e-05 1.244e-05 1.325e-05 0.00% MLMG::compResidual() 1 1.179e-05 1.235e-05 1.292e-05 0.00% Amr::InitializeInit() 1 5.949e-06 7.081e-06 7.929e-06 0.00% Amr::initialInit() 1 4.168e-06 4.583e-06 5.126e-06 0.00% knapsack()swap 2 4.796e-06 4.951e-06 5.063e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.24 54.24 54.24 100.00% Amr::coarseTimeStep() 10 51.48 51.48 51.48 94.91% Amr::timeStep() 30 51.38 51.39 51.4 94.77% Castro::advance() 30 36.14 36.14 36.14 66.63% Castro::subcycle_advance_ctu() 30 34.34 34.35 34.36 63.34% Castro::do_advance_ctu() 30 34.34 34.35 34.36 63.34% Castro::construct_ctu_hydro_source() 30 16.49 16.6 16.72 30.82% Gravity::actual_solve_with_mlmg() 81 13.12 13.13 13.13 24.21% MLMG::solve() 80 12.41 12.42 12.42 22.91% Castro::post_timestep() 30 12.13 12.14 12.15 22.41% Castro::clean_state() 254 10.73 10.82 10.93 20.15% MLMG::oneIter() 333 10.44 10.45 10.45 19.27% Gravity::solve_phi_with_mlmg() 71 9.849 9.894 9.936 18.32% Castro::reflux() 10 9.643 9.657 9.674 17.84% MLMG::mgVcycle() 489 9.165 9.173 9.181 16.93% Gravity::solve_for_phi() 60 8.195 8.231 8.267 15.24% MLCellLinOp::smooth() 5996 6.281 6.388 6.682 12.32% Castro::computeTemp() 257 6.188 6.25 6.329 11.67% Castro::reset_internal_energy() 257 5.726 5.787 5.864 10.81% Gravity::gravity_sync() 10 5.015 5.017 5.02 9.25% Castro::construct_new_gravity() 30 5.017 5.018 5.019 9.25% Castro::construct_old_gravity() 30 4.634 4.668 4.7 8.67% Castro::evaluate_source_change() 591 4.539 4.546 4.55 8.39% MLPoisson::Fsmooth() 11992 4.184 4.252 4.391 8.09% Gravity::solve_for_delta_phi 10 4.193 4.193 4.195 7.73% MLMG::mgVcycle_down::0 333 3.904 3.91 3.914 7.22% Castro::enforce_min_density() 254 3.801 3.838 3.904 7.20% Castro::do_new_sources() 50 3.282 3.297 3.317 6.12% FillPatchIterator::Initialize 723 3.29 3.296 3.302 6.09% Amr::regrid() 10 3.165 3.19 3.215 5.93% Castro::post_regrid() 22 2.971 2.995 3.02 5.57% MLCellLinOp::applyBC() 14630 2.706 2.782 2.977 5.49% MLMG::mgVcycle_up::0 333 2.684 2.88 2.951 5.44% FabArray::ParallelCopy() 5320 2.106 2.517 2.792 5.15% MultiFab::AddProduct() 4648 2.672 2.677 2.681 4.94% Castro::initialize_do_advance() 30 2.531 2.56 2.588 4.77% MLCellLinOp::apply() 2422 2.451 2.483 2.554 4.71% FabArray::setVal() 9464 2.354 2.362 2.371 4.37% FillPatchSingleLevel 853 2.212 2.236 2.254 4.16% Amr::init() 1 2.204 2.204 2.204 4.06% MLPoisson::Fapply() 2422 1.856 1.872 1.903 3.51% MLCellLinOp::solutionResidual() 530 1.702 1.723 1.737 3.20% MLCellLinOp::correctionResidual() 1660 1.593 1.621 1.697 3.13% Gravity::multilevel_solve_for_new_phi() 10 1.67 1.67 1.67 3.08% Gravity::actual_multilevel_solve() 10 1.661 1.662 1.662 3.06% Castro::derive() 397 1.638 1.644 1.655 3.05% MultiFab::Subtract() 601 1.598 1.602 1.605 2.96% Amr::initialInit() 1 1.604 1.604 1.604 2.96% MLMG:computeResOfCorrection() 1421 1.455 1.479 1.537 2.83% Castro::do_old_sources() 30 1.513 1.522 1.535 2.83% FabArray::ParallelCopy_nowait() 5320 1.424 1.44 1.458 2.69% Castro::initialize_advance() 30 1.383 1.391 1.399 2.58% Castro::volWgtSum() 242 1.334 1.356 1.373 2.53% FabArray::ParallelCopy_finish() 5320 0.6329 1.063 1.35 2.49% FabArray::FillBoundary() 13093 1.227 1.268 1.322 2.44% Amr::FinalizeInit() 1 1.271 1.284 1.298 2.39% FillPatchTwoLevels 394 1.173 1.189 1.199 2.21% Castro::expand_state() 30 1.163 1.172 1.18 2.18% Gravity::fill_multipole_BCs() 41 1.105 1.138 1.174 2.16% FluxRegister::Reflux() 180 1.145 1.15 1.154 2.13% Amr::writePlotFile() 2 1.148 1.148 1.148 2.12% Gravity::get_new_grav_vector() 52 0.9949 0.9968 0.999 1.84% MLMG::addInterpCorrection() 1421 0.3035 0.8103 0.9842 1.81% Castro::post_init() 2 0.952 0.9683 0.9826 1.81% MLMG::computeResWithCrseSolFineCor() 78 0.9189 0.9194 0.9198 1.70% MLMG::computeResidual() 333 0.8928 0.8961 0.8993 1.66% MultiFab::sum() 4648 0.8506 0.8525 0.8536 1.57% Castro::normalize_species() 254 0.7856 0.806 0.8193 1.51% MLMG::mgVcycle_down::1 333 0.6793 0.7058 0.7817 1.44% MultiFab::Xpay() 2190 0.701 0.7056 0.7169 1.32% FillBoundary_nowait() 13093 0.6678 0.6837 0.7004 1.29% MLCellLinOp::reflux() 116 0.6439 0.6467 0.6492 1.20% MLMG::mgVcycle_up::2 333 0.2093 0.5292 0.6395 1.18% FillBoundary_finish() 13093 0.4952 0.5526 0.6159 1.14% Castro::construct_new_source() 250 0.6011 0.6049 0.6106 1.13% Castro::construct_new_gravity_source() 50 0.6005 0.6043 0.61 1.12% MLMG::computeMLResidual() 97 0.5804 0.5974 0.6089 1.12% FillPatchInterp(Fab) 130 0.3712 0.4596 0.5523 1.02% CellConservativeLinear::interp() 130 0.366 0.4569 0.5505 1.02% Gravity::get_old_grav_vector() 30 0.5259 0.5277 0.5314 0.98% MLMG::mgVcycle_up::1 333 0.4672 0.4833 0.5306 0.98% Castro::finalize_advance() 30 0.399 0.4007 0.4036 0.74% MLPoisson::define() 81 0.3722 0.3788 0.3895 0.72% MLPoisson::FFlux() 1042 0.3775 0.3788 0.3798 0.70% StateDataPhysBCFunct::() 853 0.3294 0.3326 0.3347 0.62% amrex::average_down 1713 0.3014 0.3101 0.3329 0.61% Amr::InitializeInit() 1 0.3055 0.3193 0.3326 0.61% Amr::defBaseLevel() 1 0.3055 0.3193 0.3326 0.61% StateData::FillBoundary(geom) 63 0.3201 0.3226 0.3244 0.60% MLMG::prepareForSolve() 80 0.3072 0.3128 0.3232 0.60% Castro::estTimeStep() 69 0.2273 0.2835 0.3212 0.59% MLMG::mgVcycle_bottom 489 0.1629 0.2013 0.3164 0.58% Castro::initData() 3 0.2663 0.2864 0.3065 0.57% MLMG::mgVcycle_down::2 333 0.2472 0.2554 0.2782 0.51% Castro::apply_source_to_state() 100 0.2698 0.2715 0.2724 0.50% MultiFab::Saxpy() 100 0.2694 0.2712 0.2721 0.50% MultiFab::min() 30 0.007421 0.1299 0.2541 0.47% MLCellLinOp::defineAuxData() 81 0.2124 0.2207 0.2355 0.43% MLMG::getGradSolution() 80 0.2165 0.2168 0.2173 0.40% MLCellLinOp::compGrad() 100 0.2162 0.2165 0.2171 0.40% Amr::bldFineLevels() 1 0.1694 0.1858 0.2024 0.37% MLMG::mgVcycle_down::3 211 0.03322 0.07379 0.1921 0.35% VisMF::Write(FabArray) 4 0.1617 0.1664 0.1759 0.32% Castro::computeNewDt() 18 0.1344 0.1601 0.1745 0.32% MLMG::miniCycle() 156 0.1624 0.1625 0.1626 0.30% Castro::init(old) 9 0.1537 0.1548 0.1564 0.29% MLMG::actualBottomSolve() 333 0.0003888 0.03877 0.1539 0.28% MLCGSolver::bicgstab 83 0 0.03694 0.1478 0.27% MLCellLinOp::defineBC() 81 0.1412 0.1426 0.1445 0.27% MultiFab::Multiply() 164 0.1423 0.1427 0.1434 0.26% FabArray::mult() 294 0.1371 0.1386 0.14 0.26% Castro::construct_old_source() 150 0.1361 0.1365 0.1368 0.25% Castro::construct_old_gravity_source() 30 0.1358 0.1362 0.1365 0.25% MLMG::mgVcycle_up::3 211 0.025 0.05337 0.1362 0.25% MLMG::ResNormInf() 450 0.127 0.1292 0.1321 0.24% FabArray::setDomainBndry() 853 0.1249 0.128 0.1317 0.24% Castro::volProductSum() 22 0.1168 0.1221 0.1269 0.23% BndryData::define() 123 0.1155 0.1172 0.1191 0.22% Amr::grid_places() 11 0.1124 0.1129 0.1135 0.21% AmrMesh::MakeNewGrids() 11 0.1118 0.1123 0.1129 0.21% MLMG::computeResWithCrseCorFineCor() 78 0.1041 0.1045 0.1047 0.19% Gravity::GetCrsePhi() 40 0.09018 0.09631 0.1041 0.19% Castro::check_for_nan() 60 0.09803 0.09856 0.09884 0.18% MultiFab::contains_nan() 60 0.09785 0.09837 0.09864 0.18% MLCellLinOp::updateSolBC() 99 0.08619 0.09188 0.09796 0.18% FabArrayBase::getCPC() 8152 0.0695 0.07373 0.08535 0.16% Gravity::test_level_grad_phi_curr() 20 0.08036 0.0811 0.0821 0.15% Gravity::create_comp_minus_level_grad_phi() 10 0.08077 0.08142 0.08191 0.15% MultiFab::LinComb() 628 0.06477 0.0689 0.07958 0.15% Gravity::update_max_rhs() 20 0.04771 0.06303 0.07706 0.14% MLMG::mgVcycle_down::4 211 0.0319 0.04285 0.07222 0.13% MLCellLinOp::updateCorBC() 78 0.06361 0.06409 0.06451 0.12% Castro::errorEst() 11 0.06009 0.06123 0.06322 0.12% MLCellLinOp::setLevelBC() 102 0.05 0.05776 0.06055 0.11% Gravity::test_composite_phi() 1 0.05884 0.05886 0.05887 0.11% MLMG::mgVcycle_up::4 211 0.02513 0.03344 0.0558 0.10% MLMG::buildFineMask() 80 0.04715 0.04775 0.04847 0.09% MultiFab::norm0(mask) 57 0.04676 0.04739 0.04789 0.09% Gravity::test_level_grad_phi_prev() 30 0.04571 0.04628 0.04684 0.09% MLMG::MLResNormInf() 97 0.04327 0.04352 0.04378 0.08% FabArrayBase::CPC::define() 2260 0.02776 0.03198 0.04354 0.08% Castro::computeInitialDt() 2 0.01625 0.02949 0.04319 0.08% MultiFab::max() 40 0.01349 0.02893 0.04272 0.08% MLMG::interpCorrection_1 78 0.03158 0.03612 0.04091 0.08% MultiFab::Copy() 100 0.03989 0.04005 0.04018 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03545 0.03651 0.0372 0.07% MLMG::MLRhsNormInf() 80 0.02855 0.0288 0.02905 0.05% MLPoisson::prepareForSolve() 81 0.02502 0.02607 0.02843 0.05% MLCellLinOp::prepareForSolve() 81 0.02468 0.02572 0.02808 0.05% FabArrayBase::getFB() 13093 0.02362 0.02477 0.02771 0.05% Gravity::swapTimeLevels() 30 0.02196 0.02299 0.02427 0.04% Castro::apply_tagging_restrictions() 11 0.02077 0.02116 0.02196 0.04% Castro::finalize_do_advance() 30 0.01561 0.01915 0.02163 0.04% AmrLevel::AmrLevel(dm) 12 0.01527 0.01704 0.01951 0.04% StateData::define() 48 0.01502 0.01679 0.01925 0.04% CGSolver::sxay() 588 0 0.004734 0.01894 0.03% Castro::build_fine_mask() 153 0.0182 0.01827 0.01838 0.03% MLLinOp::define() 81 0.01211 0.0149 0.01777 0.03% MLLinOp::defineGrids() 81 0.01182 0.01461 0.01746 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01456 0.01491 0.0155 0.03% MLMG::compResidual() 1 0.01347 0.01392 0.0145 0.03% Castro::avgDown() 11 0.01415 0.01432 0.01447 0.03% Castro::avgDown(state_indx) 44 0.01409 0.01426 0.01441 0.03% amrex::average_down_w_geom 44 0.01398 0.01415 0.01428 0.03% MLCGSolver::ParallelAllReduce 692 0 0.00354 0.01416 0.03% Castro::swap_state_time_levels() 30 0.0131 0.01353 0.01415 0.03% TagBoxArray::mapPRD 11 0.005916 0.008906 0.01128 0.02% MultiFab::Dot() 463 0 0.002698 0.01079 0.02% Castro::apply_problem_tags() 11 0.00822 0.008303 0.008485 0.02% MLLinOp::makeSubCommunicator() 81 0.002652 0.00521 0.007958 0.01% Castro::FluxRegFineAdd() 30 0.007146 0.00727 0.007362 0.01% AMRErrorTag::operator() 11 0.004872 0.005132 0.005341 0.01% Castro::enforce_consistent_e() 3 0.00336 0.003625 0.003898 0.01% FabArrayBase::TheFPinfo() 130 0.0009908 0.001825 0.003676 0.01% FPinfo::FPinfo() 3 0.0004409 0.001291 0.003152 0.01% DistributionMapping::KnapSackDoIt() 3 0.0003345 0.001184 0.00304 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0004114 0.00119 0.002974 0.01% Amr::InitAmr() 1 0.002431 0.002467 0.002497 0.00% MLLinOp::makeAgglomeratedDMap 81 0.002313 0.002357 0.002405 0.00% FabArrayBase::FB::FB() 131 0.000851 0.001264 0.00237 0.00% makeSFC 243 0.001538 0.00158 0.001617 0.00% OwnerMask() 11 0.001447 0.001494 0.001575 0.00% TagBoxArray::collate() 11 0.001183 0.001269 0.001453 0.00% DistributionMapping::Distribute() 245 0.0004767 0.00049 0.0005052 0.00% Castro::enforce_speed_limit() 254 0.000409 0.0004168 0.0004232 0.00% AmrMesh-cluster 2 0 8.764e-05 0.0003506 0.00% ClusterList::intersect() 2 0 5.747e-05 0.0002299 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 8.371e-05 0.0001517 0.0002232 0.00% FabArray::RecvLayoutMask() 21 0.000194 0.0001972 0.0002026 0.00% Castro::create_source_corrector() 30 8.039e-05 8.745e-05 9.281e-05 0.00% BoxList::parallelComplementIn() 22 7.778e-05 8.088e-05 8.442e-05 0.00% Amr::writeSmallPlotFile() 1 7.386e-05 7.44e-05 7.507e-05 0.00% knapsack() 3 6.259e-05 6.675e-05 7.046e-05 0.00% Castro::retry_advance_ctu() 30 5.94e-05 6.178e-05 6.509e-05 0.00% Amr::initSubcycle() 1 3.647e-05 4.821e-05 5.996e-05 0.00% Gravity::set_mass_offset() 11 2.703e-05 3.474e-05 4.801e-05 0.00% Castro::gwstrain() 22 3.688e-05 4.188e-05 4.703e-05 0.00% BoxList::complementIn 22 3.762e-05 3.834e-05 3.922e-05 0.00% ClusterList::chop() 2 0 5.134e-06 2.054e-05 0.00% knapsack()swap 2 4.796e-06 4.951e-06 5.063e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-35-g3aafa306ad82) finalized