MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.02-4-g212ffa61c165) initialized Starting run at 06:34:52 UTC on 2022-02-07. Successfully read inputs file ... Castro git describe: 22.02-1-g342411b81 AMReX git describe: 22.02-4-g212ffa61c Microphysics git describe: 22.02 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.012146548 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.014431144 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.030632911 Gravity::fill_multipole_BCs() time = 0.02930574 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.598852425 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.034411307 Gravity::solve_for_phi() time = 0.428805179 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.4409589e+22 ymom added: -4.911261142e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.134431265 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.439663803 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025855712 Gravity::solve_for_phi() time = 0.344950423 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.153563866 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08370515793 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008787278 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.011615007 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108132942 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04441616 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010578267 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01591627059 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008474505 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.009291643 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106802793 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044591999 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010087178 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01478947815 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028526189 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010128376 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.148667235 Castro::reflux() at level 0 : time = 1.033960411 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.954192287 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009934006 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.030112514 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032764796 Gravity::solve_for_phi() time = 0.383338579 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852864e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.135731083 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.461005094 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025540646 Gravity::solve_for_phi() time = 0.327526869 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.14596304 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08567865014 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008178714 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009120547 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103273602 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044093803 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010292427 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01661881724 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008001715 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009137497 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1026132 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042732698 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.00995389 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01522145385 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028754245 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010084014 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770253e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.146859863 Castro::reflux() at level 0 : time = 0.991992116 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.190239283 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.009743348 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028304366 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029618326 Gravity::solve_for_phi() time = 0.375911208 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939034e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.13099718 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.447450055 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025074462 Gravity::solve_for_phi() time = 0.325812979 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.147140287 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08663513092 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008310593 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.00913635 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102702841 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042379226 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010004315 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01682728397 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008076806 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009041184 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102322812 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042610623 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.009874775 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01541606371 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029059861 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.009904177 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342336e+27 ymom added: 5.311566493e+28 zmom added: 5.312402179e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.14620124 Castro::reflux() at level 0 : time = 0.989122006 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.087233221 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009854428 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028999679 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028154998 Gravity::solve_for_phi() time = 0.374350728 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700664e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.132671164 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441202542 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02442439 Gravity::solve_for_phi() time = 0.329400523 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.150483183 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0865970268 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008148669 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009070545 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102887849 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042440217 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.009840353 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01684186309 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008152993 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.00944001 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102349857 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04269832 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.009992129 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01539578745 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029047125 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.009861876 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.44439047e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.146279203 Castro::reflux() at level 0 : time = 0.932036826 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.045024063 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009760046 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02840108 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028713753 Gravity::solve_for_phi() time = 0.375233053 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150478e+30 ymom added: 3.39980379e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.169495996 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.462888705 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024683498 Gravity::solve_for_phi() time = 0.331433438 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.150119737 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0847033732 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008024229 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.008921166 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103298032 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04263016 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010170229 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01678864248 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008145624 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009088853 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102930033 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042859636 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010158929 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01537268654 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028837233 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.009950528 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277776e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.145818729 Castro::reflux() at level 0 : time = 0.925327297 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.081147878 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009777601 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029118912 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032855768 Gravity::solve_for_phi() time = 0.391277886 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919308e+30 ymom added: 4.094511463e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.135356323 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.439211176 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029977421 Gravity::solve_for_phi() time = 0.335200834 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245017e+27 ymom added: -5.297264713e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.153575036 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08579027384 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008126905 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009484259 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106976995 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042481345 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.009919947 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01643581628 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008139424 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.008946356 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102136749 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043070453 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010315002 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0153865798 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.0283701 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010032823 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.145195335 Castro::reflux() at level 0 : time = 0.925051417 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.052467412 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009805086 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028303176 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024949598 Gravity::solve_for_phi() time = 0.371762405 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151119e+30 ymom added: 4.515688034e+30 zmom added: 4.515609038e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.130696234 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.438951744 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029505957 Gravity::solve_for_phi() time = 0.330342956 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.881752621e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.151701889 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08669812967 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00810781 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009026233 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.1048259 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.051922163 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.016564353 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01531564883 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008658934 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009255089 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105961974 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043873426 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010072463 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01491234564 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028652895 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009858056 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.145488975 Castro::reflux() at level 0 : time = 0.926841159 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.108549928 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009875768 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028590355 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02761088 Gravity::solve_for_phi() time = 0.375131523 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064109e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.131136617 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.447367392 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024679722 Gravity::solve_for_phi() time = 0.371743254 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.14934797 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08529916827 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009481289 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009120505 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103746063 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043506644 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010188287 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01656417831 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008466401 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009184007 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106006869 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04383116 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010113461 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01502200851 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.032276179 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.00980058 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907354e+27 zmom added: 5.953997699e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.14545452 Castro::reflux() at level 0 : time = 0.941585989 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.148990023 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009659451 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028526054 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030346034 Gravity::solve_for_phi() time = 0.377402812 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036342e+30 ymom added: 5.530451791e+30 zmom added: 5.530356286e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.132236895 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.440899401 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024611151 Gravity::solve_for_phi() time = 0.374985013 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170338e+28 zmom added: -5.061201609e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.148600511 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08522391299 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008435401 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009179536 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105505209 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043652317 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010181771 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01645036809 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008459403 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009162279 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105706387 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04531979 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.010148995 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01497386277 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02926477 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.01014215 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.148138993 Castro::reflux() at level 0 : time = 0.945811394 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.184259636 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009851916 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029228108 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.032700955 Gravity::solve_for_phi() time = 0.387678845 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167201e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.132338227 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.467792474 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026674125 Gravity::solve_for_phi() time = 0.382191062 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.153677074 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08371968291 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008655867 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009231856 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106180116 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049727609 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010235277 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0160031942 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008408029 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.008967491 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102320674 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.047969204 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.00985183 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01508079331 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028635994 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009873524 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914882e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.144499551 Castro::reflux() at level 0 : time = 0.983541758 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.28587827 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.551176985 seconds Ending run at 06:35:46 UTC on 2022-02-07. Run time = 53.82629735 Run time without initialization = 51.66861296 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 53.82 ... 53.83 ... 53.83 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4005 16.5078 16.5721 30.79% MLPoisson::Fsmooth() 11992 4.147 4.214 4.356 8.09% Castro::reset_internal_energy() 257 2.911 2.966 3.037 5.64% MultiFab::AddProduct() 4648 2.63 2.635 2.636 4.90% FabArray::setVal() 9464 2.305 2.331 2.35 4.37% MLPoisson::Fapply() 2422 1.849 1.903 2 3.72% MLCellLinOp::applyBC() 14630 1.452 1.522 1.671 3.10% MultiFab::Subtract() 601 1.652 1.656 1.659 3.08% FabArray::ParallelCopy_nowait() 5320 1.369 1.383 1.405 2.61% FabArray::ParallelCopy_finish() 5320 0.5615 1.073 1.367 2.54% Castro::enforce_min_density() 254 1.022 1.084 1.179 2.19% Gravity::fill_multipole_BCs() 41 1.064 1.095 1.124 2.09% Castro::derive() 397 0.9137 0.9259 0.9369 1.74% MultiFab::sum() 4648 0.8386 0.8395 0.8402 1.56% FluxRegister::Reflux() 180 0.8206 0.8227 0.8255 1.53% MultiFab::Xpay() 2190 0.7396 0.7456 0.7575 1.41% Castro::reflux() 10 0.6937 0.696 0.6991 1.30% FillBoundary_finish() 13093 0.4701 0.5878 0.6683 1.24% FillBoundary_nowait() 13093 0.6339 0.646 0.6622 1.23% Castro::construct_new_gravity_source() 50 0.5969 0.6027 0.6083 1.13% Castro::normalize_species() 254 0.5073 0.519 0.5511 1.02% CellConservativeLinear::interp() 130 0.3698 0.4572 0.5457 1.01% Castro::volWgtSum() 242 0.5108 0.5209 0.5364 1.00% Castro::computeTemp() 257 0.4689 0.4702 0.4716 0.88% MLPoisson::FFlux() 1044 0.3936 0.3939 0.3942 0.73% Castro::estTimeStep() 69 0.2248 0.304 0.3857 0.72% Castro::finalize_advance() 30 0.3467 0.353 0.3616 0.67% Gravity::get_new_grav_vector() 52 0.3258 0.3293 0.3324 0.62% FillPatchSingleLevel 853 0.3255 0.3283 0.3311 0.62% StateData::FillBoundary(geom) 63 0.3231 0.3241 0.3258 0.61% MLMG::addInterpCorrection() 1421 0.2708 0.2767 0.2876 0.53% amrex::average_down 1713 0.2722 0.2764 0.2865 0.53% MultiFab::Saxpy() 100 0.2704 0.2723 0.2735 0.51% FillPatchIterator::Initialize 723 0.2562 0.2647 0.2696 0.50% Castro::do_advance_ctu() 30 0.2143 0.2149 0.2157 0.40% MLMG::oneIter() 333 0.2115 0.2122 0.2136 0.40% MultiFab::min() 30 0.008046 0.08443 0.1995 0.37% Castro::expand_state() 30 0.1891 0.1894 0.1897 0.35% MLCellLinOp::defineAuxData() 81 0.1698 0.1738 0.181 0.34% VisMF::Write(FabArray) 4 0.161 0.1658 0.1766 0.33% MLCellLinOp::reflux() 116 0.1709 0.1736 0.1758 0.33% MLCellLinOp::compGrad() 100 0.173 0.1738 0.1746 0.32% Gravity::get_old_grav_vector() 30 0.163 0.1639 0.1648 0.31% FabArray::mult() 294 0.144 0.145 0.1461 0.27% MultiFab::Multiply() 164 0.1452 0.1456 0.1459 0.27% MLMG::ResNormInf() 450 0.09187 0.1222 0.1391 0.26% Castro::construct_old_gravity_source() 30 0.1358 0.137 0.1391 0.26% Amr::writePlotFile() 2 0.1146 0.1273 0.1388 0.26% FabArray::setDomainBndry() 853 0.1321 0.1342 0.137 0.25% Castro::post_timestep() 30 0.05157 0.07719 0.1021 0.19% MultiFab::contains_nan() 60 0.09116 0.09151 0.09196 0.17% BndryData::define() 123 0.086 0.08711 0.08794 0.16% Castro::construct_old_gravity() 30 0.08564 0.08597 0.08642 0.16% MLMG::prepareForSolve() 80 0.08011 0.08165 0.0827 0.15% MultiFab::LinComb() 628 0.0647 0.06895 0.0801 0.15% Castro::evaluate_source_change() 591 0.07581 0.07713 0.07906 0.15% Gravity::gravity_sync() 10 0.07055 0.0714 0.07198 0.13% Gravity::test_level_grad_phi_curr() 20 0.07103 0.0714 0.07188 0.13% Castro::initData() 3 0.05845 0.06411 0.07123 0.13% Castro::construct_new_gravity() 30 0.05289 0.0559 0.06342 0.12% MLCellLinOp::updateSolBC() 99 0.05717 0.05747 0.05798 0.11% MLCGSolver::bicgstab 83 0 0.01379 0.05516 0.10% Castro::volProductSum() 22 0.04558 0.05052 0.05296 0.10% MultiFab::norm0(mask) 57 0.04594 0.04609 0.04616 0.09% MLCellLinOp::updateCorBC() 78 0.04537 0.04561 0.04593 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.04431 0.04486 0.0452 0.08% FabArrayBase::CPC::define() 2260 0.02768 0.03204 0.04379 0.08% Gravity::actual_solve_with_mlmg() 81 0.03695 0.04042 0.04304 0.08% Castro::initialize_do_advance() 30 0.03386 0.03887 0.04293 0.08% FabArrayBase::getCPC() 8152 0.04095 0.04143 0.0423 0.08% Gravity::test_level_grad_phi_prev() 30 0.04016 0.04063 0.04102 0.08% MLCellLinOp::setLevelBC() 102 0.04018 0.0406 0.04096 0.08% MLMG::buildFineMask() 80 0.03892 0.03908 0.03933 0.07% MultiFab::Copy() 100 0.03865 0.03882 0.0389 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03609 0.03674 0.03758 0.07% MultiFab::max() 40 0.01393 0.02362 0.03757 0.07% AmrMesh::MakeNewGrids() 11 0.03564 0.03638 0.03722 0.07% FabArray::FillBoundary() 13093 0.0308 0.03194 0.03426 0.06% Gravity::solve_for_phi() 60 0.0262 0.029 0.03419 0.06% MLCellLinOp::prepareForSolve() 81 0.02452 0.02558 0.02817 0.05% MLCellLinOp::smooth() 5996 0.02599 0.02689 0.02809 0.05% Castro::init(old) 9 0.02602 0.0261 0.02622 0.05% Castro::initialize_advance() 30 0.02546 0.0259 0.02618 0.05% FabArrayBase::getFB() 13093 0.02285 0.02378 0.0257 0.05% MLCellLinOp::defineBC() 81 0.02367 0.02401 0.02446 0.05% Amr::coarseTimeStep() 10 0.0008106 0.01829 0.02422 0.04% Gravity::update_max_rhs() 20 0.02363 0.02392 0.02412 0.04% Castro::post_init() 2 0.001063 0.01245 0.02399 0.04% MLMG::interpCorrection_1 78 0.02261 0.02299 0.02338 0.04% Amr::defBaseLevel() 1 0.0207 0.02201 0.02332 0.04% Castro::apply_tagging_restrictions() 11 0.02108 0.0213 0.02181 0.04% Castro::finalize_do_advance() 30 0.006877 0.01563 0.02048 0.04% Castro::build_fine_mask() 153 0.01838 0.01848 0.01867 0.03% FillPatchTwoLevels 394 0.01509 0.01606 0.01707 0.03% StateData::define() 48 0.01465 0.01551 0.01639 0.03% FabArray::ParallelCopy() 5320 0.01421 0.01443 0.01472 0.03% Castro::swap_state_time_levels() 30 0.01319 0.01345 0.01402 0.03% Castro::do_old_sources() 30 0.0004459 0.004194 0.01392 0.03% StateDataPhysBCFunct::() 853 0.01057 0.01112 0.0121 0.02% Gravity::actual_multilevel_solve() 10 0.01178 0.01196 0.01204 0.02% MLMG::MLRhsNormInf() 80 0.01172 0.01174 0.01178 0.02% MultiFab::Dot() 463 0 0.002766 0.01106 0.02% Amr::regrid() 10 0.009375 0.01005 0.01077 0.02% MLMG::solve() 80 0.003072 0.008109 0.01054 0.02% Gravity::GetCrsePhi() 40 0.009512 0.009689 0.009909 0.02% MLCellLinOp::apply() 2422 0.005777 0.006658 0.00914 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008274 0.008572 0.008872 0.02% MLLinOp::makeSubCommunicator() 81 0.002512 0.005325 0.008024 0.01% Castro::apply_problem_tags() 11 0.007617 0.007692 0.00785 0.01% Castro::FluxRegFineAdd() 30 0.00707 0.007231 0.007459 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001809 0.007235 0.01% MLLinOp::defineGrids() 81 0.006849 0.007003 0.00722 0.01% Castro::do_new_sources() 50 0.0007658 0.002492 0.00646 0.01% MLCellLinOp::correctionResidual() 1660 0.00465 0.004958 0.005776 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005067 0.005076 0.005092 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004853 0.004893 0.004951 0.01% AMRErrorTag::operator() 11 0.00475 0.004853 0.004921 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004831 0.004852 0.004883 0.01% CGSolver::sxay() 588 0 0.001177 0.00471 0.01% MLMG::mgVcycle() 489 0.004086 0.004208 0.004462 0.01% main() 1 0.002664 0.003928 0.004373 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0003575 0.002177 0.004242 0.01% Gravity::test_composite_phi() 1 0.003774 0.003903 0.004222 0.01% Castro::enforce_consistent_e() 3 0.003955 0.003987 0.004018 0.01% MLMG:computeResOfCorrection() 1421 0.003327 0.003453 0.003615 0.01% MLMG::actualBottomSolve() 333 0.0003907 0.001178 0.003516 0.01% FillPatchInterp(Fab) 130 0.00174 0.002081 0.002926 0.01% MLMG::MLResNormInf() 97 0.0007272 0.002219 0.002919 0.01% FabArrayBase::FB::FB() 131 0.0008566 0.001265 0.00246 0.00% MLMG::mgVcycle_down::0 333 0.002246 0.002291 0.002359 0.00% MLMG::mgVcycle_down::1 333 0.002039 0.002089 0.002118 0.00% MLCellLinOp::solutionResidual() 530 0.001938 0.001969 0.00201 0.00% Amr::InitAmr() 1 0.001975 0.001989 0.001996 0.00% MLMG::mgVcycle_down::2 333 0.001884 0.001933 0.001976 0.00% Castro::subcycle_advance_ctu() 30 0.0001757 0.0006151 0.001891 0.00% Gravity::solve_phi_with_mlmg() 71 0.001593 0.001671 0.001833 0.00% TagBoxArray::collate() 11 0.0009753 0.001373 0.001683 0.00% MLMG::mgVcycle_up::0 333 0.001534 0.001576 0.001624 0.00% Castro::clean_state() 254 0.001484 0.001542 0.001589 0.00% OwnerMask() 11 0.001435 0.001488 0.001574 0.00% MLMG::mgVcycle_up::2 333 0.001324 0.001375 0.001456 0.00% MLMG::mgVcycle_up::1 333 0.001363 0.001394 0.001453 0.00% MLMG::mgVcycle_bottom 489 0.001268 0.00129 0.001317 0.00% MLMG::mgVcycle_down::3 211 0.001142 0.001201 0.0013 0.00% MLMG::mgVcycle_down::4 211 0.001087 0.001144 0.001253 0.00% makeSFC 243 0.001082 0.001118 0.001144 0.00% Amr::bldFineLevels() 1 0.0007451 0.0008278 0.0008929 0.00% MLMG::mgVcycle_up::4 211 0.0007687 0.000809 0.0008919 0.00% TagBoxArray::mapPRD 11 0.0008171 0.000853 0.0008886 0.00% MLMG::computeResidual() 333 0.0008434 0.0008562 0.0008761 0.00% MLMG::mgVcycle_up::3 211 0.0007359 0.0007801 0.0008746 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007639 0.0007744 0.0007894 0.00% Amr::timeStep() 30 0.0004292 0.000511 0.0006711 0.00% MLPoisson::define() 81 0.000599 0.0006305 0.0006695 0.00% Castro::construct_new_source() 250 0.0005582 0.0005937 0.0006166 0.00% Amr::grid_places() 11 0.0004698 0.0005421 0.000614 0.00% FabArrayBase::TheFPinfo() 130 0.0004941 0.0005191 0.0005419 0.00% DistributionMapping::Distribute() 245 0.0004916 0.0004948 0.0004997 0.00% Castro::enforce_speed_limit() 254 0.0003816 0.0003998 0.0004149 0.00% Castro::apply_source_to_state() 100 0.000332 0.000354 0.0003805 0.00% Castro::computeNewDt() 18 0.0001115 0.0001804 0.0003634 0.00% MLPoisson::prepareForSolve() 81 0.0003333 0.0003444 0.0003584 0.00% MLMG::computeMLResidual() 97 0.0003014 0.0003097 0.0003202 0.00% Castro::construct_old_source() 150 0.0002841 0.0002951 0.0003061 0.00% MLLinOp::define() 81 0.0002841 0.0002915 0.0003 0.00% AmrLevel::AmrLevel(dm) 12 0.0002517 0.0002673 0.0002938 0.00% MLMG::miniCycle() 156 0.0002715 0.0002753 0.0002799 0.00% MLMG::getGradSolution() 80 0.0002521 0.000261 0.0002653 0.00% Castro::post_regrid() 22 0.0002402 0.0002445 0.0002493 0.00% ClusterList::intersect() 2 0 5.995e-05 0.0002398 0.00% Castro::advance() 30 0.0002016 0.0002103 0.0002281 0.00% Gravity::swapTimeLevels() 30 0.0001846 0.0001916 0.0002116 0.00% FabArray::RecvLayoutMask() 21 0.0001912 0.0001932 0.0001954 0.00% Castro::check_for_nan() 60 0.0001775 0.0001829 0.0001851 0.00% Castro::errorEst() 11 0.0001202 0.0001244 0.0001317 0.00% Castro::avgDown(state_indx) 44 0.0001088 0.0001125 0.0001153 0.00% FPinfo::FPinfo() 3 9.561e-05 0.0001058 0.0001135 0.00% AmrMesh-cluster 2 0 2.379e-05 9.514e-05 0.00% Gravity::solve_for_delta_phi 10 8.32e-05 8.598e-05 8.869e-05 0.00% amrex::average_down_w_geom 44 8.498e-05 8.703e-05 8.855e-05 0.00% Amr::FinalizeInit() 1 1.658e-05 3.628e-05 8.803e-05 0.00% Castro::create_source_corrector() 30 7.759e-05 8.192e-05 8.614e-05 0.00% Amr::writeSmallPlotFile() 1 7.221e-05 7.331e-05 7.374e-05 0.00% Castro::retry_advance_ctu() 30 5.419e-05 5.965e-05 7.072e-05 0.00% knapsack() 3 5.675e-05 6.125e-05 6.369e-05 0.00% Castro::avgDown() 11 5.246e-05 5.51e-05 5.854e-05 0.00% Castro::gwstrain() 22 3.586e-05 4.091e-05 4.823e-05 0.00% BoxList::parallelComplementIn() 22 4.108e-05 4.188e-05 4.259e-05 0.00% Amr::initSubcycle() 1 3.524e-05 3.782e-05 4.065e-05 0.00% Gravity::set_mass_offset() 11 2.279e-05 3.07e-05 4.041e-05 0.00% BoxList::complementIn 22 3.877e-05 3.954e-05 4.009e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 2.964e-05 3.277e-05 3.686e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.629e-05 2.93e-05 3.122e-05 0.00% ClusterList::chop() 2 0 5.095e-06 2.038e-05 0.00% MLMG::compResidual() 1 1.136e-05 1.181e-05 1.225e-05 0.00% Castro::computeInitialDt() 2 1.044e-05 1.121e-05 1.159e-05 0.00% Amr::InitializeInit() 1 5.203e-06 6.774e-06 1.042e-05 0.00% Amr::init() 1 4.908e-06 5.339e-06 5.892e-06 0.00% knapsack()swap 2 4.725e-06 4.945e-06 5.11e-06 0.00% Amr::initialInit() 1 3.452e-06 4.071e-06 4.725e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 53.82 53.83 53.83 100.00% Amr::coarseTimeStep() 10 51.11 51.11 51.11 94.96% Amr::timeStep() 30 50.97 50.98 51.04 94.82% Castro::advance() 30 35.91 35.91 35.91 66.71% Castro::subcycle_advance_ctu() 30 34.14 34.15 34.18 63.49% Castro::do_advance_ctu() 30 34.14 34.15 34.18 63.49% Castro::construct_ctu_hydro_source() 30 16.4 16.51 16.57 30.79% Gravity::actual_solve_with_mlmg() 81 13.22 13.22 13.22 24.56% MLMG::solve() 80 12.5 12.51 12.52 23.25% Castro::post_timestep() 30 11.99 12.01 12.06 22.41% Castro::clean_state() 254 10.37 10.49 10.65 19.78% MLMG::oneIter() 333 10.47 10.48 10.48 19.47% Gravity::solve_phi_with_mlmg() 71 9.923 9.959 9.997 18.57% Castro::reflux() 10 9.564 9.585 9.596 17.83% MLMG::mgVcycle() 489 9.167 9.175 9.181 17.06% Gravity::solve_for_phi() 60 8.268 8.298 8.334 15.48% MLCellLinOp::smooth() 5996 6.209 6.35 6.662 12.38% Castro::computeTemp() 257 6.164 6.222 6.296 11.70% Castro::reset_internal_energy() 257 5.695 5.752 5.826 10.82% Castro::construct_new_gravity() 30 5.036 5.046 5.055 9.39% Gravity::gravity_sync() 10 5.038 5.038 5.039 9.36% Castro::construct_old_gravity() 30 4.675 4.707 4.739 8.80% Castro::evaluate_source_change() 591 4.471 4.476 4.483 8.33% MLPoisson::Fsmooth() 11992 4.147 4.214 4.356 8.09% Gravity::solve_for_delta_phi 10 4.214 4.215 4.217 7.83% MLMG::mgVcycle_down::0 333 3.882 3.903 3.951 7.34% Castro::enforce_min_density() 254 3.764 3.83 3.922 7.29% FillPatchIterator::Initialize 723 3.274 3.317 3.353 6.23% Castro::do_new_sources() 50 3.192 3.236 3.274 6.08% Amr::regrid() 10 3.12 3.137 3.148 5.85% MLCellLinOp::applyBC() 14630 2.663 2.792 3.002 5.58% Castro::post_regrid() 22 2.924 2.944 2.962 5.50% MLMG::mgVcycle_up::0 333 2.664 2.864 2.934 5.45% FabArray::ParallelCopy() 5320 2.037 2.521 2.802 5.21% MultiFab::AddProduct() 4648 2.63 2.635 2.636 4.90% MLCellLinOp::apply() 2422 2.466 2.521 2.589 4.81% Castro::initialize_do_advance() 30 2.487 2.502 2.519 4.68% FabArray::setVal() 9464 2.305 2.331 2.35 4.37% FillPatchSingleLevel 853 2.24 2.26 2.281 4.24% Amr::init() 1 2.155 2.155 2.155 4.00% MLPoisson::Fapply() 2422 1.849 1.903 2 3.72% MLCellLinOp::solutionResidual() 530 1.718 1.758 1.818 3.38% MLCellLinOp::correctionResidual() 1660 1.624 1.66 1.718 3.19% Gravity::multilevel_solve_for_new_phi() 10 1.666 1.666 1.666 3.09% MultiFab::Subtract() 601 1.652 1.656 1.659 3.08% Gravity::actual_multilevel_solve() 10 1.657 1.657 1.657 3.08% Castro::derive() 397 1.621 1.633 1.647 3.06% Amr::initialInit() 1 1.556 1.556 1.556 2.89% Castro::do_old_sources() 30 1.491 1.515 1.55 2.88% MLMG:computeResOfCorrection() 1421 1.47 1.508 1.548 2.88% FabArray::ParallelCopy_nowait() 5320 1.417 1.434 1.461 2.71% Castro::initialize_advance() 30 1.344 1.36 1.371 2.55% FabArray::ParallelCopy_finish() 5320 0.5615 1.073 1.367 2.54% FabArray::FillBoundary() 13093 1.188 1.291 1.357 2.52% Castro::volWgtSum() 242 1.311 1.326 1.344 2.50% Amr::FinalizeInit() 1 1.229 1.236 1.26 2.34% FillPatchTwoLevels 394 1.161 1.179 1.192 2.21% Castro::expand_state() 30 1.16 1.171 1.179 2.19% Gravity::fill_multipole_BCs() 41 1.101 1.132 1.161 2.16% Amr::writePlotFile() 2 1.15 1.15 1.15 2.14% FluxRegister::Reflux() 180 1.119 1.121 1.123 2.09% Gravity::get_new_grav_vector() 52 0.996 1.002 1.007 1.87% MLMG::addInterpCorrection() 1421 0.3183 0.8281 1.002 1.86% Castro::post_init() 2 0.9309 0.9411 0.9535 1.77% MLMG::computeResWithCrseSolFineCor() 78 0.9442 0.9445 0.9447 1.76% MLMG::computeResidual() 333 0.9061 0.917 0.9439 1.75% MultiFab::sum() 4648 0.8386 0.8395 0.8402 1.56% MLMG::mgVcycle_down::1 333 0.6725 0.7343 0.8234 1.53% MultiFab::Xpay() 2190 0.7396 0.7456 0.7575 1.41% FillBoundary_nowait() 13093 0.6579 0.671 0.6865 1.28% MLCellLinOp::reflux() 116 0.6564 0.6662 0.6697 1.24% FillBoundary_finish() 13093 0.4701 0.5878 0.6683 1.24% MLMG::mgVcycle_up::2 333 0.2088 0.5294 0.6395 1.19% MLMG::computeMLResidual() 97 0.5953 0.6136 0.6208 1.15% Castro::construct_new_source() 250 0.5975 0.6033 0.6088 1.13% Castro::construct_new_gravity_source() 50 0.5969 0.6027 0.6083 1.13% Castro::normalize_species() 254 0.5073 0.519 0.5511 1.02% FillPatchInterp(Fab) 130 0.3717 0.4592 0.5474 1.02% CellConservativeLinear::interp() 130 0.3698 0.4572 0.5457 1.01% Gravity::get_old_grav_vector() 30 0.5191 0.5248 0.53 0.98% MLMG::mgVcycle_up::1 333 0.4649 0.4819 0.5296 0.98% Castro::finalize_advance() 30 0.388 0.3928 0.4017 0.75% MLPoisson::FFlux() 1044 0.3936 0.3939 0.3942 0.73% Castro::estTimeStep() 69 0.2248 0.304 0.3857 0.72% MLPoisson::define() 81 0.3684 0.3734 0.385 0.72% StateDataPhysBCFunct::() 853 0.3343 0.3352 0.3363 0.62% amrex::average_down 1713 0.2962 0.3052 0.3298 0.61% Amr::InitializeInit() 1 0.2966 0.3197 0.3275 0.61% Amr::defBaseLevel() 1 0.2965 0.3197 0.3275 0.61% StateData::FillBoundary(geom) 63 0.3231 0.3241 0.3258 0.61% MLMG::prepareForSolve() 80 0.3064 0.3118 0.3219 0.60% MLMG::mgVcycle_bottom 489 0.1603 0.1988 0.314 0.58% Castro::initData() 3 0.2692 0.2927 0.3025 0.56% MLMG::mgVcycle_down::2 333 0.2456 0.2578 0.2841 0.53% Castro::apply_source_to_state() 100 0.2708 0.2727 0.2738 0.51% MultiFab::Saxpy() 100 0.2704 0.2723 0.2735 0.51% MLCellLinOp::defineAuxData() 81 0.2108 0.2177 0.2328 0.43% MLMG::getGradSolution() 80 0.2189 0.2196 0.2205 0.41% MLCellLinOp::compGrad() 100 0.2187 0.2193 0.2202 0.41% MultiFab::min() 30 0.008046 0.08443 0.1995 0.37% Castro::computeNewDt() 18 0.1323 0.1763 0.1986 0.37% MLMG::mgVcycle_down::3 211 0.03318 0.07343 0.192 0.36% VisMF::Write(FabArray) 4 0.161 0.1658 0.1766 0.33% Amr::bldFineLevels() 1 0.1626 0.1716 0.1747 0.32% MLMG::ResNormInf() 450 0.1219 0.1522 0.1692 0.31% MLMG::miniCycle() 156 0.1599 0.16 0.1601 0.30% Castro::init(old) 9 0.151 0.1521 0.1539 0.29% MLMG::actualBottomSolve() 333 0.0003907 0.03877 0.1539 0.29% MLCGSolver::bicgstab 83 0 0.03692 0.1477 0.27% FabArray::mult() 294 0.144 0.145 0.1461 0.27% MultiFab::Multiply() 164 0.1452 0.1456 0.1459 0.27% MLCellLinOp::defineBC() 81 0.1391 0.1401 0.1412 0.26% Castro::construct_old_source() 150 0.1361 0.1373 0.1394 0.26% Castro::construct_old_gravity_source() 30 0.1358 0.137 0.1391 0.26% FabArray::setDomainBndry() 853 0.1321 0.1342 0.137 0.25% MLMG::mgVcycle_up::3 211 0.02487 0.05305 0.136 0.25% Castro::volProductSum() 22 0.1163 0.1219 0.1251 0.23% BndryData::define() 123 0.114 0.1149 0.116 0.22% Amr::grid_places() 11 0.1124 0.1131 0.115 0.21% AmrMesh::MakeNewGrids() 11 0.1118 0.1126 0.1144 0.21% Gravity::GetCrsePhi() 40 0.09028 0.09524 0.1045 0.19% MLMG::computeResWithCrseCorFineCor() 78 0.104 0.1042 0.1044 0.19% MLCellLinOp::updateSolBC() 99 0.08244 0.08872 0.09361 0.17% Castro::check_for_nan() 60 0.09134 0.0917 0.09215 0.17% MultiFab::contains_nan() 60 0.09116 0.09151 0.09196 0.17% FabArrayBase::getCPC() 8152 0.06879 0.07347 0.0861 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08084 0.08149 0.08187 0.15% Gravity::test_level_grad_phi_curr() 20 0.08063 0.08107 0.08161 0.15% MultiFab::LinComb() 628 0.0647 0.06895 0.0801 0.15% MLMG::mgVcycle_down::4 211 0.03188 0.04263 0.07275 0.14% Gravity::update_max_rhs() 20 0.04843 0.05785 0.07146 0.13% MLCellLinOp::updateCorBC() 78 0.06328 0.06357 0.06404 0.12% MLCellLinOp::setLevelBC() 102 0.05008 0.05812 0.06117 0.11% Castro::errorEst() 11 0.0589 0.05989 0.06075 0.11% Gravity::test_composite_phi() 1 0.05981 0.05981 0.05983 0.11% MLMG::mgVcycle_up::4 211 0.02492 0.03308 0.05587 0.10% MLMG::buildFineMask() 80 0.04836 0.04851 0.04877 0.09% Gravity::test_level_grad_phi_prev() 30 0.04572 0.04625 0.0467 0.09% Castro::computeInitialDt() 2 0.01574 0.02354 0.0467 0.09% MultiFab::norm0(mask) 57 0.04594 0.04609 0.04616 0.09% MLMG::MLResNormInf() 97 0.04273 0.04413 0.04468 0.08% FabArrayBase::CPC::define() 2260 0.02768 0.03204 0.04379 0.08% MultiFab::Copy() 100 0.03865 0.03882 0.0389 0.07% MLMG::interpCorrection_1 78 0.03205 0.03478 0.03828 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03609 0.03674 0.03758 0.07% MultiFab::max() 40 0.01393 0.02362 0.03757 0.07% MLPoisson::prepareForSolve() 81 0.02487 0.02592 0.02851 0.05% MLCellLinOp::prepareForSolve() 81 0.02452 0.02558 0.02817 0.05% FabArrayBase::getFB() 13093 0.02371 0.02505 0.02816 0.05% MLMG::MLRhsNormInf() 80 0.02778 0.02781 0.02786 0.05% Gravity::swapTimeLevels() 30 0.02182 0.02291 0.02362 0.04% Castro::apply_tagging_restrictions() 11 0.02108 0.0213 0.02181 0.04% Castro::finalize_do_advance() 30 0.006877 0.01563 0.02048 0.04% CGSolver::sxay() 588 0 0.004789 0.01915 0.04% Castro::build_fine_mask() 153 0.01838 0.01848 0.01867 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01584 0.01719 0.01804 0.03% MLLinOp::define() 81 0.01197 0.015 0.01782 0.03% MLLinOp::defineGrids() 81 0.01169 0.0147 0.01752 0.03% AmrLevel::AmrLevel(dm) 12 0.0149 0.01578 0.01665 0.03% StateData::define() 48 0.01465 0.01551 0.01639 0.03% MLMG::compResidual() 1 0.01413 0.01448 0.0149 0.03% Castro::avgDown() 11 0.01407 0.01433 0.01464 0.03% Castro::avgDown(state_indx) 44 0.01401 0.01428 0.01459 0.03% amrex::average_down_w_geom 44 0.0139 0.01416 0.01447 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003579 0.01431 0.03% Castro::swap_state_time_levels() 30 0.01319 0.01345 0.01402 0.03% TagBoxArray::mapPRD 11 0.006528 0.008451 0.01161 0.02% MultiFab::Dot() 463 0 0.002766 0.01106 0.02% MLLinOp::makeSubCommunicator() 81 0.002512 0.005325 0.008024 0.01% Castro::apply_problem_tags() 11 0.007617 0.007692 0.00785 0.01% Castro::FluxRegFineAdd() 30 0.00707 0.007231 0.007459 0.01% AMRErrorTag::operator() 11 0.00475 0.004853 0.004921 0.01% FabArrayBase::TheFPinfo() 130 0.001018 0.00284 0.004878 0.01% FPinfo::FPinfo() 3 0.0004759 0.002321 0.004364 0.01% DistributionMapping::KnapSackDoIt() 3 0.0003803 0.002215 0.004254 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0003575 0.002177 0.004242 0.01% Castro::enforce_consistent_e() 3 0.003955 0.003987 0.004018 0.01% FabArrayBase::FB::FB() 131 0.0008566 0.001265 0.00246 0.00% MLLinOp::makeAgglomeratedDMap 81 0.00233 0.002376 0.002416 0.00% Amr::InitAmr() 1 0.00201 0.002027 0.002036 0.00% TagBoxArray::collate() 11 0.0009753 0.001373 0.001683 0.00% makeSFC 243 0.001566 0.001602 0.001631 0.00% OwnerMask() 11 0.001435 0.001488 0.001574 0.00% DistributionMapping::Distribute() 245 0.0004916 0.0004948 0.0004997 0.00% Castro::enforce_speed_limit() 254 0.0003816 0.0003998 0.0004149 0.00% AmrMesh-cluster 2 0 8.883e-05 0.0003553 0.00% ClusterList::intersect() 2 0 5.995e-05 0.0002398 0.00% FabArray::RecvLayoutMask() 21 0.0001912 0.0001932 0.0001954 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.107e-05 0.0001005 0.0001347 0.00% Castro::create_source_corrector() 30 7.759e-05 8.192e-05 8.614e-05 0.00% BoxList::parallelComplementIn() 22 8.083e-05 8.142e-05 8.246e-05 0.00% Amr::writeSmallPlotFile() 1 7.221e-05 7.331e-05 7.374e-05 0.00% Castro::retry_advance_ctu() 30 5.419e-05 5.965e-05 7.072e-05 0.00% knapsack() 3 6.175e-05 6.619e-05 6.863e-05 0.00% Castro::gwstrain() 22 3.586e-05 4.091e-05 4.823e-05 0.00% Amr::initSubcycle() 1 3.524e-05 3.782e-05 4.065e-05 0.00% Gravity::set_mass_offset() 11 2.279e-05 3.07e-05 4.041e-05 0.00% BoxList::complementIn 22 3.877e-05 3.954e-05 4.009e-05 0.00% ClusterList::chop() 2 0 5.095e-06 2.038e-05 0.00% knapsack()swap 2 4.725e-06 4.945e-06 5.11e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.02-4-g212ffa61c165) finalized