MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.04-28-g56661522b4cd) initialized Starting run at 05:40:34 UTC on 2022-04-25. Successfully read inputs file ... Castro git describe: 22.04-28-g7e86dbe56 AMReX git describe: 22.04-28-g56661522b Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.014817628 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.014503336 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.030350711 Gravity::fill_multipole_BCs() time = 0.029183233 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.611235608 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030130818 Gravity::solve_for_phi() time = 0.397545298 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -7.971010894e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 3.435973837e+11 Castro::do_old_sources() time = 0.145631754 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.479241596 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026506727 Gravity::solve_for_phi() time = 0.333825906 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.162428873 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08243580845 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008005848 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009739411 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.108463809 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043396332 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.01054356 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01600782845 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007796158 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.00942249 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106964429 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.047312421 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010681609 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0144181829 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028741495 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.01032612 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.153028957 Castro::reflux() at level 0 : time = 1.015802261 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.992766114 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.012157563 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029584885 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02720039 Gravity::solve_for_phi() time = 0.379529639 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852864e+30 ymom added: 2.372403433e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.13855086 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.471580272 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025759964 Gravity::solve_for_phi() time = 0.323958384 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.149934843 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08476877369 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008216993 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009339111 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106346753 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042719512 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.00998949 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01649124866 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008051494 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009316822 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103178778 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044261223 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010111673 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01520500749 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027827738 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010114004 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770253e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.149180795 Castro::reflux() at level 0 : time = 0.989778698 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.235565193 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.011944091 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028578513 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028909718 Gravity::solve_for_phi() time = 0.372334458 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939025e+30 ymom added: 2.692725481e+30 zmom added: 2.692687173e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.133481219 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.431027004 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024714028 Gravity::solve_for_phi() time = 0.321921008 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.152270976 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08651101039 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008001338 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009135205 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106164667 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04414247 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.01028485 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01615846722 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008081818 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.009128273 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105832951 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042617143 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010242428 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01488367766 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027644412 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.010044001 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342329e+27 ymom added: 5.311566493e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.148870315 Castro::reflux() at level 0 : time = 0.985167122 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.102160878 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.011907611 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028526247 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028449486 Gravity::solve_for_phi() time = 0.37130825 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700658e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.133549577 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.44362376 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024893288 Gravity::solve_for_phi() time = 0.32360037 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.123378679e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.154482605 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08627925334 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007840183 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009498475 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106568661 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044586373 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010511552 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01621878514 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007969201 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009662575 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106376973 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043093452 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.01056282 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01492891437 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028778402 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.010355635 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860431e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.153069302 Castro::reflux() at level 0 : time = 0.949063109 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.096868159 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.012110079 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029201947 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031310822 Gravity::solve_for_phi() time = 0.38243609 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150478e+30 ymom added: 3.399803827e+30 zmom added: 3.399742021e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.135892793 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.484800756 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025175391 Gravity::solve_for_phi() time = 0.355205584 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591233e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.157036927 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08354606649 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008256034 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.009537682 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109138199 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043166134 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010596028 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0161516012 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.0083906 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009646069 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.104541705 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042452123 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010091314 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01507186169 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027556538 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010309687 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363473e+28 ymom added: 7.265277777e+28 zmom added: 7.267043463e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.149760809 Castro::reflux() at level 0 : time = 0.93781062 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.170066804 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.011843725 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028845172 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029013974 Gravity::solve_for_phi() time = 0.37207676 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919314e+30 ymom added: 4.094511463e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.133368006 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.435719871 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025162047 Gravity::solve_for_phi() time = 0.324274561 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245019e+27 ymom added: -5.297264731e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.154661281 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08638633862 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007632176 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009651629 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10625084 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04283704 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.010524657 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01628547146 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.007603977 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.009605209 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107067501 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043077783 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.010538503 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01486335824 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028609043 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.010326447 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.154576118 Castro::reflux() at level 0 : time = 0.955598385 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.103201601 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.012060964 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029143532 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029683726 Gravity::solve_for_phi() time = 0.37243677 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151113e+30 ymom added: 4.515687958e+30 zmom added: 4.515609113e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.134552835 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.432990299 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025486863 Gravity::solve_for_phi() time = 0.323209211 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735257e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.153483471 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08640306624 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008029048 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009222595 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.102112508 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042603246 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.010114604 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01676244814 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008228776 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.009628989 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.101591065 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042277922 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.010131015 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01535199885 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027851409 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.010161667 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295853e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.148596882 Castro::reflux() at level 0 : time = 0.926557723 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.107658826 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.011980981 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028847577 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030622866 Gravity::solve_for_phi() time = 0.373657698 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064091e+30 ymom added: 4.889542903e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.133725914 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.433592841 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024419929 Gravity::solve_for_phi() time = 0.368401357 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.153351131 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08521735989 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008275737 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.009237896 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103094825 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042473962 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.01006669 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01672815338 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008052711 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.009221066 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103441441 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042475283 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.0100574 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01528327859 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027860849 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.010039477 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907345e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.148908559 Castro::reflux() at level 0 : time = 0.924917829 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.172148412 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.012046974 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028804136 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029502725 Gravity::solve_for_phi() time = 0.372722204 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036349e+30 ymom added: 5.530451715e+30 zmom added: 5.530356437e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.133985896 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.438998709 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024486032 Gravity::solve_for_phi() time = 0.36796181 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.06117034e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.154255599 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08507366436 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008053339 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009209573 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105813241 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042596714 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.010502527 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01648816856 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008146192 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.00918989 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106403887 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042919188 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.009990133 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.015010661 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027779057 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.01001935 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.148396831 Castro::reflux() at level 0 : time = 0.926319367 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.186443941 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.011970716 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028827045 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.028897287 Gravity::solve_for_phi() time = 0.373197243 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167175e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.133200605 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.431835839 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025055647 Gravity::solve_for_phi() time = 0.367689461 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.153572194 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08530470786 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00817011 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009080385 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103074375 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048270008 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.010263483 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01633981622 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008283561 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009404428 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.103287537 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.049836771 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.01019301 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01484694528 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027764861 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.010006338 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914873e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.148393699 Castro::reflux() at level 0 : time = 0.981076352 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.228482859 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.548484932 seconds Ending run at 05:41:28 UTC on 2022-04-25. Run time = 54.09877431 Run time without initialization = 51.92745504 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.1 ... 54.1 ... 54.1 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4121 16.5382 16.5952 30.68% MLPoisson::Fsmooth() 11992 4.129 4.214 4.337 8.02% Castro::reset_internal_energy() 257 2.963 3.024 3.085 5.70% MultiFab::AddProduct() 4648 2.642 2.66 2.678 4.95% FabArray::setVal() 9464 2.283 2.295 2.303 4.26% MLPoisson::Fapply() 2422 1.826 1.848 1.872 3.46% MLCellLinOp::applyBC() 14630 1.467 1.534 1.68 3.10% MultiFab::Subtract() 601 1.649 1.66 1.668 3.08% FabArray::ParallelCopy_nowait() 5320 1.379 1.398 1.413 2.61% FabArray::ParallelCopy_finish() 5320 0.5781 1.013 1.241 2.29% Castro::enforce_min_density() 254 1.065 1.127 1.223 2.26% Gravity::fill_multipole_BCs() 41 1.067 1.082 1.097 2.03% Castro::derive() 397 0.9316 0.9438 0.9504 1.76% MultiFab::sum() 4648 0.8668 0.8723 0.8782 1.62% FluxRegister::Reflux() 180 0.8244 0.8381 0.8455 1.56% Castro::normalize_species() 254 0.7778 0.8042 0.8248 1.52% MultiFab::Xpay() 2190 0.723 0.7307 0.7393 1.37% FillBoundary_nowait() 13093 0.6451 0.6579 0.6676 1.23% Castro::reflux() 10 0.6396 0.6465 0.6528 1.21% Castro::construct_new_gravity_source() 50 0.5941 0.5996 0.6035 1.12% FillBoundary_finish() 13093 0.4335 0.5013 0.5789 1.07% Castro::volWgtSum() 242 0.474 0.5252 0.5588 1.03% CellConservativeLinear::interp() 130 0.3663 0.4562 0.5486 1.01% Castro::do_advance_ctu() 30 0.2765 0.3424 0.4766 0.88% Castro::computeTemp() 257 0.4577 0.4593 0.4599 0.85% MLPoisson::FFlux() 1044 0.3842 0.3869 0.3898 0.72% Castro::finalize_advance() 30 0.3528 0.3553 0.3561 0.66% Castro::estTimeStep() 69 0.2246 0.3037 0.3549 0.66% Gravity::get_new_grav_vector() 52 0.3343 0.3373 0.3388 0.63% FillPatchSingleLevel 853 0.3304 0.3334 0.3364 0.62% StateData::FillBoundary(geom) 63 0.3279 0.3297 0.3309 0.61% amrex::average_down 1713 0.2752 0.2802 0.289 0.53% MLMG::addInterpCorrection() 1421 0.266 0.2708 0.2809 0.52% MultiFab::Saxpy() 100 0.2731 0.2748 0.2769 0.51% FillPatchIterator::Initialize 723 0.2456 0.2578 0.2683 0.50% MLMG::oneIter() 333 0.2033 0.2052 0.2068 0.38% Castro::expand_state() 30 0.1952 0.1961 0.1971 0.36% Castro::post_timestep() 30 0.06181 0.114 0.1898 0.35% VisMF::Write(FabArray) 4 0.1615 0.1683 0.1825 0.34% MLCellLinOp::defineAuxData() 81 0.1701 0.1725 0.1786 0.33% MLCellLinOp::reflux() 116 0.1712 0.1724 0.1734 0.32% Gravity::get_old_grav_vector() 30 0.1672 0.1677 0.1681 0.31% MLCellLinOp::compGrad() 100 0.164 0.1657 0.1668 0.31% MultiFab::Multiply() 164 0.1426 0.1434 0.144 0.27% Castro::construct_old_gravity_source() 30 0.1359 0.1373 0.1407 0.26% FabArray::mult() 294 0.1363 0.1367 0.1373 0.25% FabArray::setDomainBndry() 853 0.129 0.1308 0.1327 0.25% Amr::writePlotFile() 2 0.1162 0.1241 0.1304 0.24% MLMG::ResNormInf() 450 0.09187 0.09958 0.1065 0.20% Castro::construct_old_gravity() 30 0.08869 0.08944 0.09009 0.17% MultiFab::contains_nan() 60 0.08935 0.08975 0.09004 0.17% BndryData::define() 123 0.08488 0.08699 0.08888 0.16% MLMG::prepareForSolve() 80 0.07925 0.08066 0.08172 0.15% MultiFab::LinComb() 628 0.0648 0.0689 0.07921 0.15% Castro::evaluate_source_change() 591 0.07631 0.07699 0.07755 0.14% Gravity::test_level_grad_phi_curr() 20 0.07368 0.07378 0.07387 0.14% Gravity::gravity_sync() 10 0.06989 0.07031 0.07087 0.13% Castro::construct_new_gravity() 30 0.05239 0.05546 0.06248 0.12% Castro::initData() 3 0.05676 0.05891 0.06146 0.11% MLCellLinOp::updateSolBC() 99 0.05741 0.05783 0.05815 0.11% MLCGSolver::bicgstab 83 0 0.01383 0.05532 0.10% Castro::volProductSum() 22 0.04512 0.04946 0.05246 0.10% Castro::post_init() 2 0.0004118 0.0197 0.0485 0.09% Castro::apply_tagging_restrictions() 11 0.046 0.04672 0.04807 0.09% MultiFab::norm0(mask) 57 0.04652 0.04703 0.04733 0.09% Gravity::create_comp_minus_level_grad_phi() 10 0.0462 0.04631 0.04646 0.09% MLCellLinOp::updateCorBC() 78 0.04545 0.04574 0.04598 0.08% FabArrayBase::CPC::define() 2260 0.02744 0.03185 0.04313 0.08% Gravity::test_level_grad_phi_prev() 30 0.04181 0.04218 0.0425 0.08% FabArrayBase::getCPC() 8152 0.04098 0.0415 0.04183 0.08% Gravity::actual_solve_with_mlmg() 81 0.03834 0.03994 0.0415 0.08% MultiFab::Copy() 100 0.04043 0.04076 0.04132 0.08% MLCellLinOp::setLevelBC() 102 0.04037 0.04064 0.0408 0.08% Gravity::solve_for_phi() 60 0.0272 0.03149 0.03921 0.07% MLMG::buildFineMask() 80 0.03724 0.03755 0.03789 0.07% AmrMesh::MakeNewGrids() 11 0.03404 0.03488 0.03594 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03488 0.03538 0.03587 0.07% Castro::initialize_do_advance() 30 0.03359 0.03415 0.03497 0.06% FabArray::FillBoundary() 13093 0.03056 0.03164 0.03341 0.06% MLCellLinOp::prepareForSolve() 81 0.02498 0.02583 0.02806 0.05% Castro::init(old) 9 0.0268 0.02696 0.02721 0.05% MLCellLinOp::smooth() 5996 0.02546 0.0264 0.02708 0.05% Castro::initialize_advance() 30 0.0255 0.02598 0.02684 0.05% FabArrayBase::getFB() 13093 0.02284 0.0237 0.02543 0.05% Gravity::update_max_rhs() 20 0.02463 0.02469 0.02476 0.05% MultiFab::max() 40 0.01181 0.01637 0.02462 0.05% MLCellLinOp::defineBC() 81 0.02395 0.02411 0.02423 0.04% MLMG::interpCorrection_1 78 0.02274 0.02292 0.02312 0.04% Amr::defBaseLevel() 1 0.02082 0.02097 0.02111 0.04% Castro::build_fine_mask() 163 0.0187 0.01883 0.01901 0.04% FillPatchTwoLevels 394 0.0152 0.01609 0.01667 0.03% Castro::finalize_do_advance() 30 0.004939 0.01263 0.01565 0.03% StateData::define() 48 0.01492 0.01505 0.01525 0.03% FabArray::ParallelCopy() 5320 0.01428 0.01461 0.01497 0.03% Castro::swap_state_time_levels() 30 0.01319 0.01345 0.01399 0.03% StateDataPhysBCFunct::() 853 0.008226 0.01086 0.01355 0.03% Gravity::actual_multilevel_solve() 10 0.01234 0.01245 0.01253 0.02% MLMG::MLRhsNormInf() 80 0.01191 0.01204 0.01234 0.02% MLMG::solve() 80 0.004636 0.008759 0.01126 0.02% Amr::regrid() 10 0.00975 0.0101 0.01107 0.02% MultiFab::Dot() 463 0 0.002667 0.01067 0.02% Gravity::GetCrsePhi() 40 0.009611 0.009677 0.009732 0.02% Amr::coarseTimeStep() 10 0.0009547 0.007319 0.00949 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008381 0.008638 0.008964 0.02% MLCellLinOp::apply() 2422 0.005653 0.006548 0.008891 0.02% MLLinOp::defineGrids() 81 0.007396 0.007613 0.007778 0.01% Castro::apply_problem_tags() 11 0.00753 0.007598 0.007776 0.01% Castro::FluxRegFineAdd() 30 0.007237 0.007379 0.00748 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001826 0.007303 0.01% Castro::do_old_sources() 30 0.0005 0.002387 0.006862 0.01% MLLinOp::makeSubCommunicator() 81 0.00266 0.00499 0.006781 0.01% Castro::do_new_sources() 50 0.0008257 0.003147 0.006681 0.01% MLCellLinOp::correctionResidual() 1660 0.004582 0.004989 0.005768 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005182 0.005238 0.005279 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004971 0.00503 0.005084 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.004909 0.004939 0.004998 0.01% AMRErrorTag::operator() 11 0.004647 0.004722 0.004845 0.01% CGSolver::sxay() 588 0 0.001189 0.004755 0.01% FillPatchInterp(Fab) 130 0.001737 0.002741 0.004742 0.01% Gravity::test_composite_phi() 1 0.003813 0.003958 0.004238 0.01% MLMG::mgVcycle() 489 0.00395 0.004077 0.00418 0.01% main() 1 0.002726 0.003784 0.004146 0.01% Castro::enforce_consistent_e() 3 0.003487 0.003855 0.003983 0.01% MLMG::actualBottomSolve() 333 0.0003898 0.001148 0.003393 0.01% MLMG:computeResOfCorrection() 1421 0.003176 0.003276 0.00333 0.01% FabArrayBase::FB::FB() 131 0.0008557 0.001252 0.002405 0.00% MLMG::mgVcycle_down::0 333 0.00222 0.002275 0.002328 0.00% MLMG::mgVcycle_down::1 333 0.002083 0.002125 0.002149 0.00% MLCellLinOp::solutionResidual() 530 0.001942 0.001982 0.002032 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001952 0.001092 0.002029 0.00% MLMG::mgVcycle_down::2 333 0.001912 0.001961 0.002016 0.00% Castro::subcycle_advance_ctu() 30 0.0001942 0.0006309 0.001932 0.00% Gravity::solve_phi_with_mlmg() 71 0.001641 0.001721 0.001886 0.00% TagBoxArray::collate() 11 0.0007435 0.001298 0.00174 0.00% Amr::InitAmr() 1 0.00173 0.001732 0.001733 0.00% Castro::clean_state() 254 0.001624 0.001654 0.001683 0.00% MLMG::mgVcycle_up::0 333 0.001521 0.001569 0.001607 0.00% OwnerMask() 11 0.00139 0.001466 0.001539 0.00% MLMG::mgVcycle_up::2 333 0.001364 0.001413 0.00145 0.00% MLMG::mgVcycle_up::1 333 0.001338 0.001376 0.001408 0.00% MLMG::mgVcycle_bottom 489 0.001286 0.001312 0.001329 0.00% MLMG::mgVcycle_down::3 211 0.001186 0.00123 0.001295 0.00% MLMG::mgVcycle_down::4 211 0.001114 0.001175 0.001267 0.00% MLMG::MLResNormInf() 97 0.0008071 0.0009587 0.001212 0.00% makeSFC 243 0.001058 0.001123 0.001165 0.00% MLMG::mgVcycle_up::4 211 0.0007758 0.0008335 0.0009292 0.00% TagBoxArray::mapPRD 11 0.0008202 0.0008677 0.000918 0.00% MLMG::mgVcycle_up::3 211 0.0007423 0.0007857 0.0008567 0.00% MLMG::computeResidual() 333 0.0008126 0.0008313 0.000851 0.00% Amr::bldFineLevels() 1 0.0007742 0.0008125 0.0008322 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007483 0.0007775 0.000795 0.00% Amr::timeStep() 30 0.0004595 0.0005405 0.000754 0.00% MLPoisson::define() 81 0.0006019 0.0006344 0.0006627 0.00% Amr::grid_places() 11 0.0004833 0.0005385 0.0006356 0.00% Castro::construct_new_source() 250 0.0005816 0.0005872 0.0005938 0.00% FabArrayBase::TheFPinfo() 130 0.0005142 0.0005233 0.0005306 0.00% DistributionMapping::Distribute() 245 0.0004776 0.0004895 0.0005004 0.00% Castro::computeNewDt() 18 0.0001151 0.0002005 0.0004477 0.00% Castro::enforce_speed_limit() 254 0.0003922 0.0004092 0.0004219 0.00% MLPoisson::prepareForSolve() 81 0.0003484 0.0003719 0.0003984 0.00% Castro::apply_source_to_state() 100 0.0003514 0.0003643 0.0003838 0.00% MLLinOp::define() 81 0.0002759 0.0003016 0.0003155 0.00% MLMG::computeMLResidual() 97 0.0002955 0.0003096 0.0003148 0.00% AmrLevel::AmrLevel(dm) 12 0.0002539 0.0002719 0.0003118 0.00% Castro::construct_old_source() 150 0.0002888 0.0002968 0.0003055 0.00% MLMG::miniCycle() 156 0.0002592 0.0002709 0.0002833 0.00% MLMG::getGradSolution() 80 0.0002605 0.0002628 0.0002644 0.00% Castro::post_regrid() 22 0.0002305 0.00024 0.0002491 0.00% Castro::advance() 30 0.0002144 0.0002214 0.0002314 0.00% ClusterList::intersect() 2 0 5.657e-05 0.0002263 0.00% FabArray::RecvLayoutMask() 21 0.0001961 0.0001999 0.0002032 0.00% Gravity::swapTimeLevels() 30 0.0001832 0.0001947 0.000203 0.00% Castro::check_for_nan() 60 0.0001815 0.0001862 0.0001916 0.00% Castro::errorEst() 11 0.0001213 0.0001276 0.0001325 0.00% Castro::avgDown(state_indx) 44 0.0001154 0.0001197 0.000127 0.00% FPinfo::FPinfo() 3 0.0001032 0.0001064 0.0001109 0.00% AmrMesh-cluster 2 0 2.557e-05 0.0001023 0.00% Amr::FinalizeInit() 1 1.737e-05 4.122e-05 9.585e-05 0.00% amrex::average_down_w_geom 44 8.848e-05 9.043e-05 9.264e-05 0.00% Gravity::solve_for_delta_phi 10 8.118e-05 8.586e-05 8.972e-05 0.00% Castro::create_source_corrector() 30 8.116e-05 8.462e-05 8.824e-05 0.00% Amr::writeSmallPlotFile() 1 7.377e-05 8.299e-05 8.715e-05 0.00% Castro::retry_advance_ctu() 30 4.857e-05 6.283e-05 8.625e-05 0.00% Castro::avgDown() 11 5.486e-05 6.456e-05 7.324e-05 0.00% knapsack() 3 5.926e-05 6.26e-05 6.503e-05 0.00% Castro::gwstrain() 22 3.707e-05 4.521e-05 5.7e-05 0.00% BoxList::parallelComplementIn() 22 4.021e-05 4.17e-05 4.286e-05 0.00% Gravity::set_mass_offset() 11 2.954e-05 3.607e-05 4.132e-05 0.00% BoxList::complementIn 22 3.833e-05 3.974e-05 4.055e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 2.848e-05 3.481e-05 4.001e-05 0.00% Amr::initSubcycle() 1 3.434e-05 3.545e-05 3.715e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.789e-05 3.043e-05 3.183e-05 0.00% ClusterList::chop() 2 0 5.217e-06 2.087e-05 0.00% MLMG::compResidual() 1 1.122e-05 1.202e-05 1.304e-05 0.00% Castro::computeInitialDt() 2 1.145e-05 1.191e-05 1.302e-05 0.00% Amr::InitializeInit() 1 5.747e-06 7.786e-06 1.079e-05 0.00% Amr::init() 1 6.003e-06 7.173e-06 7.818e-06 0.00% knapsack()swap 2 4.608e-06 4.916e-06 5.287e-06 0.00% Amr::initialInit() 1 4.177e-06 4.629e-06 4.963e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.1 54.1 54.1 100.00% Amr::coarseTimeStep() 10 51.38 51.38 51.38 94.97% Amr::timeStep() 30 51.23 51.25 51.3 94.83% Castro::advance() 30 36.02 36.02 36.02 66.58% Castro::subcycle_advance_ctu() 30 34.23 34.24 34.25 63.31% Castro::do_advance_ctu() 30 34.23 34.24 34.25 63.31% Castro::construct_ctu_hydro_source() 30 16.41 16.54 16.6 30.68% Gravity::actual_solve_with_mlmg() 81 13.01 13.02 13.02 24.06% MLMG::solve() 80 12.32 12.32 12.33 22.79% Castro::post_timestep() 30 12.07 12.09 12.15 22.45% Castro::clean_state() 254 10.84 10.92 11.01 20.35% MLMG::oneIter() 333 10.35 10.36 10.36 19.16% Gravity::solve_phi_with_mlmg() 71 9.784 9.806 9.829 18.17% Castro::reflux() 10 9.578 9.583 9.593 17.73% MLMG::mgVcycle() 489 9.079 9.09 9.101 16.82% Gravity::solve_for_phi() 60 8.158 8.173 8.192 15.14% MLCellLinOp::smooth() 5996 6.207 6.312 6.606 12.21% Castro::computeTemp() 257 6.239 6.288 6.332 11.70% Castro::reset_internal_energy() 257 5.78 5.829 5.872 10.86% Castro::construct_new_gravity() 30 4.992 4.996 5.003 9.25% Gravity::gravity_sync() 10 4.962 4.962 4.963 9.17% Castro::construct_old_gravity() 30 4.62 4.637 4.656 8.61% Castro::evaluate_source_change() 591 4.493 4.524 4.553 8.42% MLPoisson::Fsmooth() 11992 4.129 4.214 4.337 8.02% Gravity::solve_for_delta_phi 10 4.155 4.155 4.155 7.68% Castro::enforce_min_density() 254 3.852 3.9 3.977 7.35% MLMG::mgVcycle_down::0 333 3.865 3.878 3.894 7.20% Castro::do_new_sources() 50 3.298 3.321 3.356 6.20% FillPatchIterator::Initialize 723 3.264 3.281 3.294 6.09% Amr::regrid() 10 3.205 3.218 3.224 5.96% Castro::post_regrid() 22 2.996 3.009 3.016 5.57% MLCellLinOp::applyBC() 14630 2.629 2.73 2.948 5.45% MLMG::mgVcycle_up::0 333 2.657 2.856 2.928 5.41% FabArray::ParallelCopy() 5320 2.048 2.476 2.706 5.00% MultiFab::AddProduct() 4648 2.642 2.66 2.678 4.95% Castro::initialize_do_advance() 30 2.551 2.569 2.582 4.77% MLCellLinOp::apply() 2422 2.421 2.449 2.519 4.66% FabArray::setVal() 9464 2.283 2.295 2.303 4.26% FillPatchSingleLevel 853 2.215 2.239 2.255 4.17% Amr::init() 1 2.169 2.169 2.169 4.01% MLPoisson::Fapply() 2422 1.826 1.848 1.872 3.46% MLCellLinOp::solutionResidual() 530 1.699 1.717 1.728 3.19% MLCellLinOp::correctionResidual() 1660 1.585 1.611 1.683 3.11% Castro::derive() 397 1.652 1.665 1.671 3.09% MultiFab::Subtract() 601 1.649 1.66 1.668 3.08% Gravity::multilevel_solve_for_new_phi() 10 1.639 1.639 1.639 3.03% Gravity::actual_multilevel_solve() 10 1.63 1.63 1.631 3.01% Amr::initialInit() 1 1.558 1.558 1.558 2.88% Castro::do_old_sources() 30 1.529 1.535 1.541 2.85% MLMG:computeResOfCorrection() 1421 1.452 1.474 1.529 2.83% FabArray::ParallelCopy_nowait() 5320 1.426 1.448 1.461 2.70% Castro::initialize_advance() 30 1.383 1.387 1.39 2.57% Castro::volWgtSum() 242 1.29 1.348 1.386 2.56% FabArray::FillBoundary() 13093 1.157 1.216 1.285 2.38% Amr::FinalizeInit() 1 1.24 1.244 1.251 2.31% FabArray::ParallelCopy_finish() 5320 0.5781 1.013 1.241 2.29% FillPatchTwoLevels 394 1.157 1.177 1.191 2.20% Castro::expand_state() 30 1.153 1.167 1.18 2.18% Amr::writePlotFile() 2 1.16 1.16 1.16 2.14% FluxRegister::Reflux() 180 1.134 1.134 1.134 2.10% Gravity::fill_multipole_BCs() 41 1.095 1.111 1.126 2.08% Gravity::get_new_grav_vector() 52 0.9886 0.9936 0.9969 1.84% MLMG::addInterpCorrection() 1421 0.311 0.8146 0.9848 1.82% Castro::post_init() 2 0.9371 0.9398 0.9468 1.75% MLMG::computeResWithCrseSolFineCor() 78 0.915 0.9154 0.916 1.69% MLMG::computeResidual() 333 0.8934 0.8941 0.8953 1.65% MultiFab::sum() 4648 0.8668 0.8723 0.8782 1.62% Castro::normalize_species() 254 0.7778 0.8042 0.8248 1.52% MLMG::mgVcycle_down::1 333 0.6628 0.6984 0.7801 1.44% MultiFab::Xpay() 2190 0.723 0.7307 0.7393 1.37% FillBoundary_nowait() 13093 0.6729 0.6828 0.692 1.28% MLCellLinOp::reflux() 116 0.6462 0.6475 0.649 1.20% MLMG::mgVcycle_up::2 333 0.2075 0.5244 0.6319 1.17% Castro::construct_new_source() 250 0.5947 0.6002 0.6041 1.12% Castro::construct_new_gravity_source() 50 0.5941 0.5996 0.6035 1.12% MLMG::computeMLResidual() 97 0.5805 0.594 0.6012 1.11% FillBoundary_finish() 13093 0.4335 0.5013 0.5789 1.07% FillPatchInterp(Fab) 130 0.3711 0.459 0.5503 1.02% CellConservativeLinear::interp() 130 0.3663 0.4562 0.5486 1.01% Gravity::get_old_grav_vector() 30 0.5236 0.5252 0.5273 0.97% MLMG::mgVcycle_up::1 333 0.4603 0.4779 0.5252 0.97% Castro::finalize_advance() 30 0.3862 0.3886 0.3956 0.73% MLPoisson::FFlux() 1044 0.3842 0.3869 0.3898 0.72% MLPoisson::define() 81 0.3645 0.3709 0.3795 0.70% Castro::estTimeStep() 69 0.2246 0.3037 0.3549 0.66% StateDataPhysBCFunct::() 853 0.3381 0.3405 0.3424 0.63% StateData::FillBoundary(geom) 63 0.3279 0.3297 0.3309 0.61% amrex::average_down 1713 0.299 0.3086 0.3299 0.61% MLMG::prepareForSolve() 80 0.3043 0.3101 0.3187 0.59% Amr::InitializeInit() 1 0.3066 0.3138 0.3172 0.59% Amr::defBaseLevel() 1 0.3066 0.3137 0.3172 0.59% MLMG::mgVcycle_bottom 489 0.1603 0.1983 0.3118 0.58% Castro::initData() 3 0.2799 0.2869 0.29 0.54% Castro::apply_source_to_state() 100 0.2735 0.2752 0.2773 0.51% MultiFab::Saxpy() 100 0.2731 0.2748 0.2769 0.51% MLMG::mgVcycle_down::2 333 0.2424 0.2519 0.2761 0.51% MLCellLinOp::defineAuxData() 81 0.2106 0.2158 0.2294 0.42% MLMG::getGradSolution() 80 0.2107 0.2115 0.2121 0.39% MLCellLinOp::compGrad() 100 0.2104 0.2112 0.2118 0.39% Castro::computeNewDt() 18 0.1306 0.1804 0.2028 0.37% MLMG::mgVcycle_down::3 211 0.03355 0.07297 0.1902 0.35% VisMF::Write(FabArray) 4 0.1615 0.1683 0.1825 0.34% Amr::bldFineLevels() 1 0.1737 0.1799 0.1821 0.34% MLMG::miniCycle() 156 0.1598 0.16 0.1603 0.30% Castro::init(old) 9 0.1507 0.1526 0.1555 0.29% MLMG::actualBottomSolve() 333 0.0003898 0.03828 0.1519 0.28% MLCGSolver::bicgstab 83 0 0.03649 0.146 0.27% MultiFab::Multiply() 164 0.1426 0.1434 0.144 0.27% MLCellLinOp::defineBC() 81 0.1368 0.1392 0.1413 0.26% Castro::construct_old_source() 150 0.1362 0.1376 0.141 0.26% Castro::construct_old_gravity_source() 30 0.1359 0.1373 0.1407 0.26% Amr::grid_places() 11 0.1371 0.1374 0.1375 0.25% FabArray::mult() 294 0.1363 0.1367 0.1373 0.25% MLMG::ResNormInf() 450 0.1226 0.1302 0.1372 0.25% AmrMesh::MakeNewGrids() 11 0.1365 0.1368 0.137 0.25% MLMG::mgVcycle_up::3 211 0.02513 0.05284 0.1351 0.25% FabArray::setDomainBndry() 853 0.129 0.1308 0.1327 0.25% Castro::volProductSum() 22 0.1174 0.1223 0.1256 0.23% BndryData::define() 123 0.1115 0.1139 0.1161 0.21% MLMG::computeResWithCrseCorFineCor() 78 0.103 0.1034 0.1036 0.19% Gravity::GetCrsePhi() 40 0.09215 0.09492 0.1019 0.19% MLCellLinOp::updateSolBC() 99 0.08376 0.08673 0.09042 0.17% Castro::check_for_nan() 60 0.08953 0.08994 0.09023 0.17% MultiFab::contains_nan() 60 0.08935 0.08975 0.09004 0.17% Castro::errorEst() 11 0.08464 0.08575 0.08798 0.16% FabArrayBase::getCPC() 8152 0.06841 0.07334 0.08496 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08265 0.08287 0.08307 0.15% Gravity::test_level_grad_phi_curr() 20 0.08254 0.08276 0.08296 0.15% MultiFab::LinComb() 628 0.0648 0.0689 0.07921 0.15% MLMG::mgVcycle_down::4 211 0.03211 0.04233 0.07189 0.13% MLCellLinOp::updateCorBC() 78 0.06249 0.06309 0.06349 0.12% MLCellLinOp::setLevelBC() 102 0.0497 0.05757 0.06031 0.11% Gravity::test_composite_phi() 1 0.05894 0.05897 0.059 0.11% Gravity::update_max_rhs() 20 0.04618 0.05063 0.05894 0.11% MLMG::mgVcycle_up::4 211 0.02524 0.03299 0.05543 0.10% Castro::apply_tagging_restrictions() 11 0.046 0.04672 0.04807 0.09% Gravity::test_level_grad_phi_prev() 30 0.04696 0.04741 0.04779 0.09% MultiFab::norm0(mask) 57 0.04652 0.04703 0.04733 0.09% MLMG::buildFineMask() 80 0.04629 0.04667 0.04708 0.09% MLMG::MLResNormInf() 97 0.04349 0.04374 0.0441 0.08% FabArrayBase::CPC::define() 2260 0.02744 0.03185 0.04313 0.08% MultiFab::Copy() 100 0.04043 0.04076 0.04132 0.08% MLMG::interpCorrection_1 78 0.03022 0.0346 0.04 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03488 0.03538 0.03587 0.07% MLMG::MLRhsNormInf() 80 0.02819 0.02847 0.0289 0.05% MLPoisson::prepareForSolve() 81 0.02538 0.02621 0.02841 0.05% MLCellLinOp::prepareForSolve() 81 0.02498 0.02583 0.02806 0.05% FabArrayBase::getFB() 13093 0.02371 0.02495 0.02783 0.05% Castro::computeInitialDt() 2 0.01636 0.01984 0.02695 0.05% MultiFab::max() 40 0.01181 0.01637 0.02462 0.05% Gravity::swapTimeLevels() 30 0.02153 0.02246 0.02288 0.04% Castro::build_fine_mask() 163 0.0187 0.01883 0.01901 0.04% CGSolver::sxay() 588 0 0.004692 0.01877 0.03% MLLinOp::define() 81 0.01261 0.01529 0.01725 0.03% MLLinOp::defineGrids() 81 0.01233 0.01498 0.01693 0.03% Castro::finalize_do_advance() 30 0.004939 0.01263 0.01565 0.03% AmrLevel::AmrLevel(dm) 12 0.01517 0.01532 0.0155 0.03% StateData::define() 48 0.01492 0.01505 0.01525 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01421 0.01468 0.01495 0.03% Castro::avgDown() 11 0.01429 0.01448 0.01461 0.03% Castro::avgDown(state_indx) 44 0.01424 0.01442 0.01454 0.03% amrex::average_down_w_geom 44 0.01412 0.0143 0.01442 0.03% MLMG::compResidual() 1 0.0136 0.01383 0.01424 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003537 0.01415 0.03% Castro::swap_state_time_levels() 30 0.01319 0.01345 0.01399 0.03% MultiFab::Dot() 463 0 0.002667 0.01067 0.02% TagBoxArray::mapPRD 11 0.005731 0.008343 0.009543 0.02% Castro::apply_problem_tags() 11 0.00753 0.007598 0.007776 0.01% Castro::FluxRegFineAdd() 30 0.007237 0.007379 0.00748 0.01% MLLinOp::makeSubCommunicator() 81 0.00266 0.00499 0.006781 0.01% AMRErrorTag::operator() 11 0.004647 0.004722 0.004845 0.01% Castro::enforce_consistent_e() 3 0.003487 0.003855 0.003983 0.01% FabArrayBase::TheFPinfo() 130 0.0008808 0.001781 0.002706 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002276 0.002381 0.002447 0.00% FabArrayBase::FB::FB() 131 0.0008557 0.001252 0.002405 0.00% FPinfo::FPinfo() 3 0.0003621 0.001258 0.002192 0.00% DistributionMapping::KnapSackDoIt() 3 0.0002588 0.001151 0.002081 0.00% DistributionMapping::LeastUsedCPUs() 5 0.0001952 0.001092 0.002029 0.00% Amr::InitAmr() 1 0.001765 0.001767 0.001769 0.00% TagBoxArray::collate() 11 0.0007435 0.001298 0.00174 0.00% makeSFC 243 0.001527 0.001604 0.001652 0.00% OwnerMask() 11 0.00139 0.001466 0.001539 0.00% DistributionMapping::Distribute() 245 0.0004776 0.0004895 0.0005004 0.00% Castro::enforce_speed_limit() 254 0.0003922 0.0004092 0.0004219 0.00% AmrMesh-cluster 2 0 8.736e-05 0.0003494 0.00% ClusterList::intersect() 2 0 5.657e-05 0.0002263 0.00% FabArray::RecvLayoutMask() 21 0.0001961 0.0001999 0.0002032 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.778e-05 8.235e-05 9.905e-05 0.00% Castro::create_source_corrector() 30 8.116e-05 8.462e-05 8.824e-05 0.00% Amr::writeSmallPlotFile() 1 7.377e-05 8.299e-05 8.715e-05 0.00% Castro::retry_advance_ctu() 30 4.857e-05 6.283e-05 8.625e-05 0.00% BoxList::parallelComplementIn() 22 8.02e-05 8.144e-05 8.341e-05 0.00% knapsack() 3 6.387e-05 6.752e-05 7.031e-05 0.00% Castro::gwstrain() 22 3.707e-05 4.521e-05 5.7e-05 0.00% Gravity::set_mass_offset() 11 2.954e-05 3.607e-05 4.132e-05 0.00% BoxList::complementIn 22 3.833e-05 3.974e-05 4.055e-05 0.00% Amr::initSubcycle() 1 3.434e-05 3.545e-05 3.715e-05 0.00% ClusterList::chop() 2 0 5.217e-06 2.087e-05 0.00% knapsack()swap 2 4.608e-06 4.916e-06 5.287e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-28-g56661522b4cd) finalized