MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-16-gdfb0e098df46) initialized Starting run at 05:40:10 UTC on 2022-03-17. Successfully read inputs file ... Castro git describe: 22.02-13-ga12efaab3 AMReX git describe: 22.03-16-gdfb0e098d Microphysics git describe: 22.03-8-g75721f58 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.01364551 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.016008765 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029768496 Gravity::fill_multipole_BCs() time = 0.028522198 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.594516893 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030419902 Gravity::solve_for_phi() time = 0.395086881 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.4409589e+22 ymom added: -4.911261142e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 2.748779069e+11 Castro::do_old_sources() time = 0.132773566 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.443162559 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026348737 Gravity::solve_for_phi() time = 0.341825383 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.153501494 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08470260416 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00910124 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009209091 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107560763 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044482746 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010060542 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01618402661 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008673584 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009142484 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106794516 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045458498 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.01012211 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01483145949 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029143869 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.009979201 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.14766288 Castro::reflux() at level 0 : time = 1.02398494 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.919625321 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009627407 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028390329 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032870562 Gravity::solve_for_phi() time = 0.380401965 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852864e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.131187476 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.445185225 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024969681 Gravity::solve_for_phi() time = 0.324670859 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125186e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.147621131 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0865478465 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008193002 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009189055 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106666902 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043191696 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.00994004 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01641852955 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008475679 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.008981405 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10708681 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043212867 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.009996998 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01500445296 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028638506 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.009937538 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770255e+28 zmom added: 8.082913463e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.146211831 Castro::reflux() at level 0 : time = 0.988024517 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.189364366 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009719122 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029656649 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029576868 Gravity::solve_for_phi() time = 0.375760842 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.69293903e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.130991325 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.440205941 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025879641 Gravity::solve_for_phi() time = 0.325571315 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.151800794 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08659481357 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008294936 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009065962 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108182175 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043106302 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010034377 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01640333159 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008235424 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.008927901 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106794865 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043027942 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010126502 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01506344723 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028464533 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.009926403 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342327e+27 ymom added: 5.311566493e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.147060934 Castro::reflux() at level 0 : time = 0.991395968 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.129418449 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009709507 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028804921 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030199816 Gravity::solve_for_phi() time = 0.377373754 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700662e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.131585499 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.455584432 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026090994 Gravity::solve_for_phi() time = 0.328443992 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.1465293 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08618495762 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008372925 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.008954424 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105869564 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044086903 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010015538 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01650002368 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008585673 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009121987 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106620653 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043229528 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.009983498 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01510032004 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028155414 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010167413 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.146053656 Castro::reflux() at level 0 : time = 0.928745334 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.069986403 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009894808 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028372584 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030934619 Gravity::solve_for_phi() time = 0.380079743 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150472e+30 ymom added: 3.399803827e+30 zmom added: 3.399742021e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.1299153 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.440735093 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025522542 Gravity::solve_for_phi() time = 0.332430568 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.152467315 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08630037193 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010437988 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009190726 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106369572 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.045056782 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010249181 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01617528378 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009154635 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.00926531 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107119057 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043295918 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010084226 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01492585529 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.0291404 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.009918743 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277775e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.145434644 Castro::reflux() at level 0 : time = 0.936164882 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.053406884 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009583595 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028576757 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030273948 Gravity::solve_for_phi() time = 0.376991918 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919318e+30 ymom added: 4.09451135e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.130516559 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.449319822 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026535025 Gravity::solve_for_phi() time = 0.326243481 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.29724502e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.147263431 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08648173505 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008421052 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009161422 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106839698 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044457247 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.009926246 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01638967837 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008342225 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009055683 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106262676 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042905903 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.009934179 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01511643097 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028555196 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010190994 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.146848418 Castro::reflux() at level 0 : time = 0.937964711 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.070037936 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009766149 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028581074 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029919433 Gravity::solve_for_phi() time = 0.376487472 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151137e+30 ymom added: 4.515687996e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.132766306 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.447360059 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025391917 Gravity::solve_for_phi() time = 0.326819446 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.146466208 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08643646464 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008330332 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009008925 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10799913 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044960661 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010056228 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01626379817 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008436619 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.008931227 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106840874 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043451622 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010124544 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01502838602 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028353027 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009877861 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.145312213 Castro::reflux() at level 0 : time = 0.927688832 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.132996768 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.00989392 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028158274 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0290016 Gravity::solve_for_phi() time = 0.37567278 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064099e+30 ymom added: 4.889542903e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.130411692 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.448603637 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025639527 Gravity::solve_for_phi() time = 0.372383741 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.145675139 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08535247018 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008566777 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.008947226 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106615098 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043152926 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.009982429 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0164814691 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009145897 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009136223 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106828493 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043071025 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.009948227 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01502697876 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028539461 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010042728 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907354e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.145628625 Castro::reflux() at level 0 : time = 0.929186941 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.164124865 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009684185 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02828652 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030022491 Gravity::solve_for_phi() time = 0.380740521 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036351e+30 ymom added: 5.53045164e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.134491503 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.472339553 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028977027 Gravity::solve_for_phi() time = 0.379553389 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043356e+28 ymom added: -5.061170339e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.150298627 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08405424797 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00828913 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009407939 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107405212 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044828581 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010425682 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01620715434 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00781642 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009410904 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107311847 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043395712 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010283153 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01493232805 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029507685 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.00996599 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.144853347 Castro::reflux() at level 0 : time = 0.934947977 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.226802153 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009774852 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028351012 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030012884 Gravity::solve_for_phi() time = 0.376310049 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167173e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.130535721 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.444427694 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024995941 Gravity::solve_for_phi() time = 0.371820687 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.146376017 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08533152379 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008586163 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.00898406 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106395347 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049313613 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.009917539 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01611793715 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008520904 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.00897181 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106806053 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048770489 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.009987399 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01480031016 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028566759 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009948046 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914871e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.146002424 Castro::reflux() at level 0 : time = 0.988916905 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.237189993 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.545961905 seconds Ending run at 05:41:03 UTC on 2022-03-17. Run time = 53.8603444 Run time without initialization = 51.69991707 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 53.86 ... 53.86 ... 53.86 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.5029 16.5642 16.6191 30.86% MLPoisson::Fsmooth() 11992 4.182 4.245 4.429 8.22% Castro::reset_internal_energy() 257 2.9 2.943 2.981 5.54% MultiFab::AddProduct() 4648 2.603 2.613 2.626 4.88% FabArray::setVal() 9464 2.301 2.324 2.358 4.38% MLPoisson::Fapply() 2422 1.852 1.872 1.918 3.56% MLCellLinOp::applyBC() 14630 1.465 1.535 1.713 3.18% MultiFab::Subtract() 601 1.662 1.669 1.68 3.12% FabArray::ParallelCopy_nowait() 5320 1.387 1.406 1.431 2.66% FabArray::ParallelCopy_finish() 5320 0.5185 1.045 1.334 2.48% Gravity::fill_multipole_BCs() 41 1.053 1.094 1.124 2.09% Castro::enforce_min_density() 254 1.029 1.056 1.108 2.06% Castro::derive() 397 0.922 0.9254 0.9302 1.73% MultiFab::sum() 4648 0.851 0.8554 0.8619 1.60% FluxRegister::Reflux() 180 0.8224 0.8254 0.8288 1.54% MultiFab::Xpay() 2190 0.7108 0.7189 0.7376 1.37% Castro::reflux() 10 0.6907 0.6959 0.7002 1.30% FillBoundary_nowait() 13093 0.6529 0.6609 0.6655 1.24% Castro::construct_new_gravity_source() 50 0.5967 0.6011 0.6089 1.13% CellConservativeLinear::interp() 130 0.3687 0.4561 0.5454 1.01% Castro::volWgtSum() 242 0.5096 0.5308 0.5447 1.01% FillBoundary_finish() 13093 0.4495 0.5035 0.543 1.01% Castro::estTimeStep() 69 0.2327 0.4196 0.5151 0.96% Castro::normalize_species() 254 0.5044 0.5068 0.5096 0.95% Castro::computeTemp() 257 0.4659 0.4687 0.4713 0.88% MLPoisson::FFlux() 1044 0.3896 0.3911 0.3923 0.73% Castro::finalize_advance() 30 0.3452 0.3537 0.3605 0.67% Gravity::get_new_grav_vector() 52 0.3286 0.3315 0.3374 0.63% StateData::FillBoundary(geom) 63 0.3238 0.3281 0.3321 0.62% FillPatchSingleLevel 853 0.3247 0.3269 0.3289 0.61% Castro::post_timestep() 30 0.05092 0.1318 0.2861 0.53% MLMG::addInterpCorrection() 1421 0.2668 0.2732 0.2855 0.53% amrex::average_down 1713 0.2678 0.2728 0.2844 0.53% MultiFab::Saxpy() 100 0.2733 0.2752 0.2777 0.52% FillPatchIterator::Initialize 723 0.2593 0.2638 0.2721 0.51% Castro::do_advance_ctu() 30 0.2155 0.2166 0.2179 0.40% MLMG::oneIter() 333 0.2109 0.2123 0.2131 0.40% Castro::expand_state() 30 0.1891 0.1898 0.1903 0.35% MLCellLinOp::defineAuxData() 81 0.174 0.1787 0.1877 0.35% MLCellLinOp::reflux() 116 0.1722 0.1743 0.1761 0.33% VisMF::Write(FabArray) 4 0.1623 0.1671 0.1724 0.32% MLCellLinOp::compGrad() 100 0.171 0.1716 0.1724 0.32% Gravity::get_old_grav_vector() 30 0.1635 0.1653 0.1678 0.31% MultiFab::min() 30 0.007002 0.07539 0.1494 0.28% MultiFab::Multiply() 164 0.1457 0.1461 0.1468 0.27% FabArray::mult() 294 0.137 0.1385 0.1402 0.26% Castro::construct_old_gravity_source() 30 0.1335 0.1339 0.1345 0.25% FabArray::setDomainBndry() 853 0.125 0.1272 0.131 0.24% Amr::writePlotFile() 2 0.1154 0.1239 0.1272 0.24% MLMG::ResNormInf() 450 0.09274 0.1009 0.1075 0.20% MultiFab::contains_nan() 60 0.09024 0.09063 0.09101 0.17% BndryData::define() 123 0.08843 0.08882 0.08949 0.17% Castro::construct_old_gravity() 30 0.08644 0.08711 0.08846 0.16% MultiFab::LinComb() 628 0.07131 0.07605 0.08752 0.16% MLMG::prepareForSolve() 80 0.07961 0.08118 0.08338 0.15% Castro::evaluate_source_change() 591 0.07742 0.07768 0.07833 0.15% Gravity::test_level_grad_phi_curr() 20 0.07093 0.07183 0.07267 0.13% Gravity::gravity_sync() 10 0.07137 0.0718 0.07257 0.13% Castro::initData() 3 0.05691 0.05898 0.062 0.12% MLCellLinOp::updateSolBC() 99 0.05721 0.05755 0.05805 0.11% MLCGSolver::bicgstab 83 0 0.01436 0.05745 0.11% Castro::construct_new_gravity() 30 0.054 0.05498 0.05705 0.11% Castro::volProductSum() 22 0.05034 0.05256 0.05513 0.10% MultiFab::norm0(mask) 57 0.04604 0.04633 0.04667 0.09% MLCellLinOp::updateCorBC() 78 0.04524 0.04554 0.046 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04498 0.04528 0.04565 0.08% FabArrayBase::CPC::define() 2260 0.02755 0.03183 0.04336 0.08% FabArrayBase::getCPC() 8152 0.04055 0.0411 0.04219 0.08% Gravity::actual_solve_with_mlmg() 81 0.0386 0.04038 0.04217 0.08% MLCellLinOp::setLevelBC() 102 0.04043 0.04074 0.04145 0.08% Castro::initialize_do_advance() 30 0.03698 0.0393 0.04134 0.08% Gravity::test_level_grad_phi_prev() 30 0.0404 0.04081 0.04129 0.08% MLMG::buildFineMask() 80 0.04059 0.04066 0.04072 0.08% Gravity::solve_for_phi() 60 0.02648 0.0308 0.03976 0.07% MultiFab::Copy() 100 0.03915 0.03934 0.03954 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03664 0.03709 0.03809 0.07% AmrMesh::MakeNewGrids() 11 0.03448 0.03538 0.03602 0.07% FabArray::FillBoundary() 13093 0.03087 0.03195 0.0348 0.06% Amr::coarseTimeStep() 10 0.001251 0.02398 0.0316 0.06% MLCellLinOp::smooth() 5996 0.02561 0.02653 0.02837 0.05% MLCellLinOp::prepareForSolve() 81 0.0243 0.0253 0.02797 0.05% Castro::initialize_advance() 30 0.02546 0.02609 0.02694 0.05% Castro::init(old) 9 0.02591 0.02615 0.02638 0.05% FabArrayBase::getFB() 13093 0.02261 0.02354 0.02603 0.05% Gravity::update_max_rhs() 20 0.02371 0.02425 0.02506 0.05% MLCellLinOp::defineBC() 81 0.02391 0.02413 0.02451 0.05% Amr::defBaseLevel() 1 0.0205 0.02141 0.02375 0.04% MLMG::interpCorrection_1 78 0.02279 0.0231 0.02344 0.04% Castro::apply_tagging_restrictions() 11 0.02085 0.02155 0.02242 0.04% MultiFab::max() 40 0.01264 0.01741 0.02209 0.04% FillPatchTwoLevels 394 0.01498 0.01691 0.02013 0.04% Castro::finalize_do_advance() 30 0.01222 0.01659 0.01925 0.04% Castro::build_fine_mask() 153 0.01811 0.01825 0.01837 0.03% StateData::define() 48 0.01464 0.01648 0.01776 0.03% FabArray::ParallelCopy() 5320 0.01417 0.01443 0.01501 0.03% Castro::swap_state_time_levels() 30 0.01311 0.01318 0.01327 0.02% Gravity::actual_multilevel_solve() 10 0.01195 0.01199 0.01203 0.02% MLMG::MLRhsNormInf() 80 0.01183 0.01188 0.01195 0.02% MultiFab::Dot() 463 0 0.002771 0.01108 0.02% Amr::regrid() 10 0.009501 0.01003 0.01101 0.02% Gravity::GetCrsePhi() 40 0.009511 0.009732 0.009938 0.02% StateDataPhysBCFunct::() 853 0.007615 0.008397 0.009622 0.02% Castro::post_init() 2 0.001088 0.006176 0.009504 0.02% MLCellLinOp::apply() 2422 0.005628 0.006537 0.009137 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008405 0.008521 0.008676 0.02% Castro::apply_problem_tags() 11 0.00753 0.007675 0.007899 0.01% MLLinOp::makeSubCommunicator() 81 0.002772 0.005251 0.007702 0.01% MLLinOp::defineGrids() 81 0.007104 0.007266 0.007512 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001877 0.007506 0.01% Castro::FluxRegFineAdd() 30 0.007054 0.007206 0.007381 0.01% MLMG::solve() 80 0.003108 0.00513 0.006426 0.01% MLCellLinOp::correctionResidual() 1660 0.004548 0.004887 0.00577 0.01% AMRErrorTag::operator() 11 0.004746 0.004994 0.005437 0.01% Castro::do_new_sources() 50 0.000858 0.002286 0.005186 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005077 0.005107 0.005152 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004902 0.004929 0.004974 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004866 0.004885 0.004907 0.01% CGSolver::sxay() 588 0 0.001155 0.004621 0.01% main() 1 0.002711 0.004077 0.004596 0.01% MLMG::mgVcycle() 489 0.003963 0.00408 0.00435 0.01% Gravity::test_composite_phi() 1 0.003715 0.003929 0.004126 0.01% Castro::enforce_consistent_e() 3 0.003498 0.003755 0.003997 0.01% MLMG:computeResOfCorrection() 1421 0.003329 0.003394 0.003572 0.01% MLMG::actualBottomSolve() 333 0.0003837 0.00115 0.003442 0.01% Castro::do_old_sources() 30 0.0004853 0.001277 0.003035 0.01% Amr::InitAmr() 1 0.002642 0.00265 0.002662 0.00% FabArrayBase::FB::FB() 131 0.0008404 0.001247 0.002409 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0002827 0.00132 0.002361 0.00% MLMG::mgVcycle_down::0 333 0.00222 0.002287 0.002337 0.00% MLMG::mgVcycle_down::1 333 0.002046 0.002108 0.002171 0.00% Castro::subcycle_advance_ctu() 30 0.0001972 0.0006594 0.002038 0.00% MLMG::mgVcycle_down::2 333 0.001897 0.001949 0.002021 0.00% MLCellLinOp::solutionResidual() 530 0.001931 0.001952 0.00199 0.00% FillPatchInterp(Fab) 130 0.001715 0.001833 0.001955 0.00% TagBoxArray::collate() 11 0.001087 0.001427 0.001844 0.00% Gravity::solve_phi_with_mlmg() 71 0.00159 0.001679 0.001826 0.00% MLMG::mgVcycle_up::0 333 0.001534 0.00157 0.001623 0.00% OwnerMask() 11 0.00143 0.001519 0.001619 0.00% Castro::clean_state() 254 0.001545 0.001556 0.001573 0.00% MLMG::mgVcycle_up::2 333 0.001323 0.001368 0.001488 0.00% MLMG::mgVcycle_up::1 333 0.001353 0.00138 0.00145 0.00% MLMG::mgVcycle_bottom 489 0.001263 0.001294 0.001332 0.00% MLMG::mgVcycle_down::3 211 0.001139 0.001202 0.001315 0.00% MLMG::mgVcycle_down::4 211 0.001103 0.001148 0.001271 0.00% makeSFC 243 0.001076 0.00117 0.001261 0.00% MLMG::MLResNormInf() 97 0.000468 0.0008613 0.001097 0.00% MLMG::mgVcycle_up::4 211 0.0007623 0.0008076 0.0009165 0.00% TagBoxArray::mapPRD 11 0.0008613 0.0008757 0.0008927 0.00% MLMG::mgVcycle_up::3 211 0.0007303 0.0007705 0.0008783 0.00% MLMG::computeResidual() 333 0.0008454 0.0008544 0.0008622 0.00% Amr::bldFineLevels() 1 0.0007614 0.000807 0.0008518 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007803 0.0008071 0.0008323 0.00% Amr::timeStep() 30 0.0004638 0.0005396 0.0007078 0.00% MLPoisson::define() 81 0.0005925 0.0006326 0.0006749 0.00% Castro::construct_new_source() 250 0.0005788 0.0005952 0.0006139 0.00% Amr::grid_places() 11 0.00052 0.0005612 0.0006079 0.00% FabArrayBase::TheFPinfo() 130 0.000514 0.0005392 0.0005816 0.00% DistributionMapping::Distribute() 245 0.0004919 0.0004967 0.0004996 0.00% Castro::enforce_speed_limit() 254 0.0003789 0.0003853 0.0003913 0.00% Castro::apply_source_to_state() 100 0.0003444 0.0003604 0.0003841 0.00% Castro::computeNewDt() 18 0.0001225 0.0001863 0.0003649 0.00% MLPoisson::prepareForSolve() 81 0.0003372 0.0003529 0.0003648 0.00% MLMG::computeMLResidual() 97 0.0003051 0.0003101 0.0003145 0.00% MLLinOp::define() 81 0.0002918 0.0002957 0.0002998 0.00% Castro::construct_old_source() 150 0.0002805 0.0002905 0.0002961 0.00% MLMG::miniCycle() 156 0.0002679 0.0002802 0.0002921 0.00% Castro::post_regrid() 22 0.0002392 0.0002549 0.0002664 0.00% MLMG::getGradSolution() 80 0.0002574 0.000262 0.0002648 0.00% AmrLevel::AmrLevel(dm) 12 0.00025 0.0002554 0.0002608 0.00% Castro::advance() 30 0.0002051 0.0002127 0.0002234 0.00% ClusterList::intersect() 2 0 5.437e-05 0.0002175 0.00% FabArray::RecvLayoutMask() 21 0.0001943 0.0001959 0.0001975 0.00% Castro::check_for_nan() 60 0.0001757 0.0001815 0.0001925 0.00% Gravity::swapTimeLevels() 30 0.0001864 0.0001867 0.000187 0.00% Castro::errorEst() 11 0.0001232 0.0001272 0.0001333 0.00% Castro::avgDown(state_indx) 44 0.0001109 0.0001177 0.0001273 0.00% FPinfo::FPinfo() 3 0.0001028 0.0001088 0.0001146 0.00% Amr::FinalizeInit() 1 1.988e-05 4.388e-05 0.0001119 0.00% amrex::average_down_w_geom 44 8.608e-05 9.176e-05 0.0001014 0.00% Gravity::solve_for_delta_phi 10 8.026e-05 8.669e-05 9.481e-05 0.00% AmrMesh-cluster 2 0 2.209e-05 8.834e-05 0.00% Amr::writeSmallPlotFile() 1 7.171e-05 7.585e-05 8.545e-05 0.00% Castro::create_source_corrector() 30 8.016e-05 8.24e-05 8.392e-05 0.00% Castro::retry_advance_ctu() 30 5.57e-05 6.051e-05 7.161e-05 0.00% knapsack() 3 6.087e-05 6.256e-05 6.502e-05 0.00% Castro::avgDown() 11 5.508e-05 5.759e-05 6.074e-05 0.00% Amr::initSubcycle() 1 3.465e-05 5.056e-05 6.031e-05 0.00% BoxList::parallelComplementIn() 22 4.096e-05 4.465e-05 5.184e-05 0.00% Gravity::set_mass_offset() 11 2.487e-05 3.287e-05 5.032e-05 0.00% Castro::gwstrain() 22 3.671e-05 3.994e-05 4.84e-05 0.00% BoxList::complementIn 22 3.95e-05 4.196e-05 4.676e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.218e-05 3.506e-05 3.936e-05 0.00% DistributionMapping::KnapSackDoIt() 3 3.059e-05 3.193e-05 3.404e-05 0.00% ClusterList::chop() 2 0 5.26e-06 2.104e-05 0.00% Castro::computeInitialDt() 2 1.143e-05 1.231e-05 1.33e-05 0.00% Amr::InitializeInit() 1 5.295e-06 9.305e-06 1.321e-05 0.00% MLMG::compResidual() 1 1.203e-05 1.241e-05 1.286e-05 0.00% Amr::init() 1 6.348e-06 7.491e-06 8.421e-06 0.00% knapsack()swap 2 5.019e-06 5.265e-06 5.659e-06 0.00% Amr::initialInit() 1 3.473e-06 4.335e-06 5.454e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 53.86 53.86 53.86 100.00% Amr::coarseTimeStep() 10 51.15 51.15 51.15 94.97% Amr::timeStep() 30 50.86 50.91 51.07 94.83% Castro::advance() 30 35.8 35.8 35.8 66.47% Castro::subcycle_advance_ctu() 30 34.05 34.06 34.08 63.27% Castro::do_advance_ctu() 30 34.05 34.06 34.07 63.27% Castro::construct_ctu_hydro_source() 30 16.5 16.56 16.62 30.86% Gravity::actual_solve_with_mlmg() 81 13.11 13.12 13.12 24.36% MLMG::solve() 80 12.4 12.41 12.41 23.04% Castro::post_timestep() 30 12 12.05 12.21 22.68% Castro::clean_state() 254 10.35 10.43 10.56 19.60% MLMG::oneIter() 333 10.42 10.43 10.43 19.36% Gravity::solve_phi_with_mlmg() 71 9.83 9.879 9.917 18.41% Castro::reflux() 10 9.556 9.57 9.587 17.80% MLMG::mgVcycle() 489 9.135 9.14 9.147 16.98% Gravity::solve_for_phi() 60 8.197 8.238 8.272 15.36% MLCellLinOp::smooth() 5996 6.234 6.342 6.647 12.34% Castro::computeTemp() 257 6.162 6.205 6.257 11.62% Castro::reset_internal_energy() 257 5.695 5.736 5.786 10.74% Gravity::gravity_sync() 10 5.024 5.024 5.024 9.33% Castro::construct_new_gravity() 30 5.013 5.019 5.021 9.32% Castro::construct_old_gravity() 30 4.644 4.678 4.701 8.73% Castro::evaluate_source_change() 591 4.45 4.469 4.493 8.34% MLPoisson::Fsmooth() 11992 4.182 4.245 4.429 8.22% Gravity::solve_for_delta_phi 10 4.205 4.205 4.205 7.81% MLMG::mgVcycle_down::0 333 3.879 3.889 3.902 7.24% Castro::enforce_min_density() 254 3.763 3.803 3.875 7.19% FillPatchIterator::Initialize 723 3.281 3.292 3.309 6.14% Castro::do_new_sources() 50 3.196 3.22 3.249 6.03% Amr::regrid() 10 3.095 3.113 3.136 5.82% Castro::post_regrid() 22 2.925 2.947 2.968 5.51% MLMG::mgVcycle_up::0 333 2.685 2.873 2.939 5.46% MLCellLinOp::applyBC() 14630 2.678 2.734 2.876 5.34% FabArray::ParallelCopy() 5320 2.02 2.515 2.798 5.19% MultiFab::AddProduct() 4648 2.603 2.613 2.626 4.88% MLCellLinOp::apply() 2422 2.448 2.477 2.552 4.74% Castro::initialize_do_advance() 30 2.464 2.485 2.508 4.66% FabArray::setVal() 9464 2.301 2.324 2.358 4.38% FillPatchSingleLevel 853 2.234 2.244 2.254 4.19% Amr::init() 1 2.157 2.157 2.157 4.01% MLPoisson::Fapply() 2422 1.852 1.872 1.918 3.56% MLCellLinOp::solutionResidual() 530 1.719 1.733 1.741 3.23% MLCellLinOp::correctionResidual() 1660 1.59 1.618 1.694 3.14% MultiFab::Subtract() 601 1.662 1.669 1.68 3.12% Gravity::multilevel_solve_for_new_phi() 10 1.646 1.646 1.646 3.06% Gravity::actual_multilevel_solve() 10 1.637 1.638 1.638 3.04% Castro::derive() 397 1.623 1.629 1.638 3.04% Amr::initialInit() 1 1.562 1.562 1.562 2.90% MLMG:computeResOfCorrection() 1421 1.454 1.479 1.544 2.87% Castro::do_old_sources() 30 1.474 1.484 1.498 2.78% FabArray::ParallelCopy_nowait() 5320 1.435 1.456 1.487 2.76% Castro::initialize_advance() 30 1.338 1.351 1.364 2.53% Castro::volWgtSum() 242 1.323 1.339 1.355 2.51% FabArray::ParallelCopy_finish() 5320 0.5185 1.045 1.334 2.48% Amr::FinalizeInit() 1 1.239 1.25 1.27 2.36% FabArray::FillBoundary() 13093 1.178 1.221 1.25 2.32% FillPatchTwoLevels 394 1.148 1.172 1.191 2.21% Castro::expand_state() 30 1.16 1.168 1.182 2.19% Gravity::fill_multipole_BCs() 41 1.09 1.131 1.161 2.16% Amr::writePlotFile() 2 1.141 1.141 1.141 2.12% FluxRegister::Reflux() 180 1.121 1.123 1.125 2.09% MLMG::addInterpCorrection() 1421 0.3163 0.8332 1.009 1.87% Gravity::get_new_grav_vector() 52 0.9942 0.9966 1.002 1.86% Castro::post_init() 2 0.9172 0.9218 0.9263 1.72% MLMG::computeResWithCrseSolFineCor() 78 0.9249 0.9254 0.9257 1.72% MLMG::computeResidual() 333 0.897 0.9008 0.9054 1.68% MultiFab::sum() 4648 0.851 0.8554 0.8619 1.60% MLMG::mgVcycle_down::1 333 0.6727 0.6982 0.7599 1.41% MultiFab::Xpay() 2190 0.7108 0.7189 0.7376 1.37% FillBoundary_nowait() 13093 0.6764 0.6856 0.6939 1.29% MLCellLinOp::reflux() 116 0.6546 0.6552 0.6562 1.22% MLMG::mgVcycle_up::2 333 0.2099 0.5372 0.6465 1.20% MLMG::computeMLResidual() 97 0.5819 0.602 0.6113 1.14% Castro::construct_new_source() 250 0.5972 0.6017 0.6095 1.13% Castro::construct_new_gravity_source() 50 0.5967 0.6011 0.6089 1.13% FillPatchInterp(Fab) 130 0.3707 0.4579 0.5472 1.02% CellConservativeLinear::interp() 130 0.3687 0.4561 0.5454 1.01% FillBoundary_finish() 13093 0.4495 0.5035 0.543 1.01% Gravity::get_old_grav_vector() 30 0.5254 0.53 0.5364 1.00% MLMG::mgVcycle_up::1 333 0.4648 0.4818 0.5318 0.99% Castro::estTimeStep() 69 0.2327 0.4196 0.5151 0.96% Castro::normalize_species() 254 0.5044 0.5068 0.5096 0.95% MLPoisson::define() 81 0.3735 0.3805 0.3946 0.73% Castro::finalize_advance() 30 0.3864 0.3895 0.3944 0.73% MLPoisson::FFlux() 1044 0.3896 0.3911 0.3923 0.73% Castro::computeNewDt() 18 0.131 0.2881 0.3492 0.65% StateDataPhysBCFunct::() 853 0.3318 0.3365 0.3417 0.63% StateData::FillBoundary(geom) 63 0.3238 0.3281 0.3321 0.62% MLMG::prepareForSolve() 80 0.3069 0.3127 0.3257 0.60% amrex::average_down 1713 0.2919 0.3008 0.3241 0.60% Amr::InitializeInit() 1 0.2924 0.3124 0.3233 0.60% Amr::defBaseLevel() 1 0.2924 0.3124 0.3232 0.60% MLMG::mgVcycle_bottom 489 0.1615 0.2009 0.3188 0.59% Castro::initData() 3 0.264 0.286 0.2947 0.55% Castro::apply_source_to_state() 100 0.2736 0.2756 0.2781 0.52% MultiFab::Saxpy() 100 0.2733 0.2752 0.2777 0.52% MLMG::mgVcycle_down::2 333 0.2457 0.2532 0.2734 0.51% MLCellLinOp::defineAuxData() 81 0.2151 0.2224 0.2391 0.44% MLMG::getGradSolution() 80 0.2169 0.2171 0.2175 0.40% MLCellLinOp::compGrad() 100 0.2166 0.2168 0.2172 0.40% MLMG::mgVcycle_down::3 211 0.03346 0.07351 0.1934 0.36% Amr::bldFineLevels() 1 0.1669 0.1702 0.176 0.33% VisMF::Write(FabArray) 4 0.1623 0.1671 0.1724 0.32% MLMG::miniCycle() 156 0.1611 0.1613 0.1615 0.30% MLMG::actualBottomSolve() 333 0.0003837 0.03958 0.1572 0.29% Castro::init(old) 9 0.1493 0.1506 0.1524 0.28% MLCGSolver::bicgstab 83 0 0.03775 0.151 0.28% MultiFab::min() 30 0.007002 0.07539 0.1494 0.28% MultiFab::Multiply() 164 0.1457 0.1461 0.1468 0.27% MLCellLinOp::defineBC() 81 0.1418 0.1422 0.1425 0.26% FabArray::mult() 294 0.137 0.1385 0.1402 0.26% MLMG::ResNormInf() 450 0.1231 0.131 0.1375 0.26% MLMG::mgVcycle_up::3 211 0.0252 0.05329 0.1375 0.26% Castro::construct_old_source() 150 0.1338 0.1342 0.1348 0.25% Castro::construct_old_gravity_source() 30 0.1335 0.1339 0.1345 0.25% FabArray::setDomainBndry() 853 0.125 0.1272 0.131 0.24% Castro::volProductSum() 22 0.1217 0.1244 0.1265 0.23% Amr::grid_places() 11 0.1148 0.1156 0.1175 0.22% BndryData::define() 123 0.1165 0.1169 0.1174 0.22% AmrMesh::MakeNewGrids() 11 0.1142 0.1151 0.1168 0.22% Gravity::GetCrsePhi() 40 0.09779 0.1044 0.1135 0.21% MLMG::computeResWithCrseCorFineCor() 78 0.1035 0.104 0.1045 0.19% MLCellLinOp::updateSolBC() 99 0.08355 0.09274 0.09774 0.18% Castro::check_for_nan() 60 0.09041 0.09081 0.09119 0.17% MultiFab::contains_nan() 60 0.09024 0.09063 0.09101 0.17% MultiFab::LinComb() 628 0.07131 0.07605 0.08752 0.16% FabArrayBase::getCPC() 8152 0.0681 0.07293 0.08555 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.0818 0.08228 0.08279 0.15% Gravity::test_level_grad_phi_curr() 20 0.07996 0.08102 0.08201 0.15% MLMG::mgVcycle_down::4 211 0.03224 0.04263 0.07369 0.14% MLCellLinOp::updateCorBC() 78 0.06331 0.06362 0.06396 0.12% Castro::errorEst() 11 0.05877 0.06078 0.06295 0.12% MLCellLinOp::setLevelBC() 102 0.05053 0.0586 0.06157 0.11% Gravity::test_composite_phi() 1 0.0585 0.05853 0.05855 0.11% MLMG::mgVcycle_up::4 211 0.0253 0.03323 0.05687 0.11% Gravity::update_max_rhs() 20 0.04746 0.05143 0.05615 0.10% Castro::computeInitialDt() 2 0.02041 0.03131 0.05138 0.10% MLMG::buildFineMask() 80 0.04996 0.05002 0.05009 0.09% Gravity::test_level_grad_phi_prev() 30 0.04569 0.0462 0.04685 0.09% MultiFab::norm0(mask) 57 0.04604 0.04633 0.04667 0.09% FabArrayBase::CPC::define() 2260 0.02755 0.03183 0.04336 0.08% MLMG::MLResNormInf() 97 0.04291 0.04305 0.04317 0.08% MultiFab::Copy() 100 0.03915 0.03934 0.03954 0.07% MLMG::interpCorrection_1 78 0.03217 0.03592 0.03826 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03664 0.03709 0.03809 0.07% FabArrayBase::getFB() 13093 0.02345 0.02478 0.02844 0.05% MLPoisson::prepareForSolve() 81 0.02465 0.02565 0.02831 0.05% MLMG::MLRhsNormInf() 80 0.0279 0.02807 0.02827 0.05% MLCellLinOp::prepareForSolve() 81 0.0243 0.0253 0.02797 0.05% Gravity::swapTimeLevels() 30 0.02254 0.02287 0.02317 0.04% Castro::apply_tagging_restrictions() 11 0.02085 0.02155 0.02242 0.04% MultiFab::max() 40 0.01264 0.01741 0.02209 0.04% CGSolver::sxay() 588 0 0.004824 0.01929 0.04% Castro::finalize_do_advance() 30 0.01222 0.01659 0.01925 0.04% Castro::build_fine_mask() 153 0.01811 0.01825 0.01837 0.03% MLLinOp::define() 81 0.01252 0.01528 0.01809 0.03% AmrLevel::AmrLevel(dm) 12 0.0149 0.01673 0.01801 0.03% MLLinOp::defineGrids() 81 0.01222 0.01498 0.0178 0.03% StateData::define() 48 0.01464 0.01648 0.01776 0.03% TagBoxArray::mapPRD 11 0.007298 0.01089 0.01524 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003644 0.01457 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01413 0.01433 0.01451 0.03% MLMG::compResidual() 1 0.01349 0.01385 0.01412 0.03% Castro::avgDown() 11 0.01364 0.01381 0.01398 0.03% Castro::avgDown(state_indx) 44 0.01358 0.01375 0.01392 0.03% amrex::average_down_w_geom 44 0.01345 0.01363 0.0138 0.03% Castro::swap_state_time_levels() 30 0.01311 0.01318 0.01327 0.02% MultiFab::Dot() 463 0 0.002771 0.01108 0.02% Castro::apply_problem_tags() 11 0.00753 0.007675 0.007899 0.01% MLLinOp::makeSubCommunicator() 81 0.002772 0.005251 0.007702 0.01% Castro::FluxRegFineAdd() 30 0.007054 0.007206 0.007381 0.01% AMRErrorTag::operator() 11 0.004746 0.004994 0.005437 0.01% Castro::enforce_consistent_e() 3 0.003498 0.003755 0.003997 0.01% FabArrayBase::TheFPinfo() 130 0.0008644 0.001963 0.002959 0.01% Amr::InitAmr() 1 0.002678 0.0027 0.002723 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002345 0.002465 0.002584 0.00% FPinfo::FPinfo() 3 0.0002828 0.001424 0.002416 0.00% FabArrayBase::FB::FB() 131 0.0008404 0.001247 0.002409 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0002827 0.00132 0.002361 0.00% DistributionMapping::KnapSackDoIt() 3 0.000174 0.001316 0.002307 0.00% TagBoxArray::collate() 11 0.001087 0.001427 0.001844 0.00% makeSFC 243 0.001565 0.001657 0.001751 0.00% OwnerMask() 11 0.00143 0.001519 0.001619 0.00% DistributionMapping::Distribute() 245 0.0004919 0.0004967 0.0004996 0.00% Castro::enforce_speed_limit() 254 0.0003789 0.0003853 0.0003913 0.00% AmrMesh-cluster 2 0 8.172e-05 0.0003269 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 7.337e-05 0.0001491 0.0002478 0.00% ClusterList::intersect() 2 0 5.437e-05 0.0002175 0.00% FabArray::RecvLayoutMask() 21 0.0001943 0.0001959 0.0001975 0.00% BoxList::parallelComplementIn() 22 8.171e-05 8.661e-05 9.86e-05 0.00% Amr::writeSmallPlotFile() 1 7.171e-05 7.585e-05 8.545e-05 0.00% Castro::create_source_corrector() 30 8.016e-05 8.24e-05 8.392e-05 0.00% Castro::retry_advance_ctu() 30 5.57e-05 6.051e-05 7.161e-05 0.00% knapsack() 3 6.603e-05 6.783e-05 7.068e-05 0.00% Amr::initSubcycle() 1 3.465e-05 5.056e-05 6.031e-05 0.00% Gravity::set_mass_offset() 11 2.487e-05 3.287e-05 5.032e-05 0.00% Castro::gwstrain() 22 3.671e-05 3.994e-05 4.84e-05 0.00% BoxList::complementIn 22 3.95e-05 4.196e-05 4.676e-05 0.00% ClusterList::chop() 2 0 5.26e-06 2.104e-05 0.00% knapsack()swap 2 5.019e-06 5.265e-06 5.659e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-16-gdfb0e098df46) finalized