MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (22.03-16-gdfb0e098df46) initialized Starting run at 05:39:59 UTC on 2022-03-18. Successfully read inputs file ... Castro git describe: 22.02-13-ga12efaab3 AMReX git describe: 22.03-16-gdfb0e098d Microphysics git describe: 22.03-8-g75721f58 reading extern runtime parameters ... 1 Species: X Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.06058602935 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.06058602935 grid_places() time: 0.010876393 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data Now regridding at level lbase = 0 grid_places() time: 0.010634375 new finest: 1 Castro::numpts_1d at level 1 is 229 Initializing the data at level 1 Done initializing the level 1 data STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 Gravity::fill_multipole_BCs() time = 0.029826107 Gravity::fill_multipole_BCs() time = 0.029744034 ... norm of composite residual at level 0 2.61033581e-11 ... norm of composite residual at level 1 7.599698648e-12 TIME= 0 MASS = 1.989753521e+33 TIME= 0 XMOM = 1.989753521e+21 TIME= 0 YMOM = 1.989753521e+21 TIME= 0 ZMOM = 1.989753521e+21 TIME= 0 ANG MOM X = -2.216615442e+15 TIME= 0 ANG MOM Y = 3.025856e+15 TIME= 0 ANG MOM Z = -2.462906046e+14 TIME= 0 RHO*e = 2.895773303e+49 TIME= 0 RHO*K = 2984630281 TIME= 0 RHO*E = 2.895773303e+49 TIME= 0 RHO*PHI = -3.91341952e+50 TIME= 0 TOTAL ENERGY= -1.66713243e+50 INITIAL GRIDS Level 0 8 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 PLOTFILE: file = evrard_collapse_plt00000 Write plotfile time = 0.607699338 seconds ...estimated hydro-limited timestep at level 0: 0.05590573933 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05590573933 ...estimated hydro-limited timestep at level 1: 0.0214203961 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.0214203961 [Level 0 step 1] ADVANCE with dt = 0.00428407922  Beginning subcycle 1 starting at time 0 with dt = 0.00428407922 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.035425765 Gravity::solve_for_phi() time = 0.422072135 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -6.231145572e+22 ymom added: -5.289050461e+23 zmom added: 1.284483683e+24 eint added: 0 ener added: 2.748779069e+11 Castro::do_old_sources() time = 0.145017384 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.441299265 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026228607 Gravity::solve_for_phi() time = 0.343143188 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 5.346358727e+29 ymom added: 8.585755233e+29 zmom added: 7.937145924e+29 eint added: 0 ener added: 1.790339632e+45 Castro::do_new_sources() time = 0.153141955 ...estimated hydro-limited timestep at level 0: 0.05550178875 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05550178875  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08309812594 [Level 0 step 1] Advanced 262144 cells [Level 1 step 1] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.01138291 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: -5.896069765e+21 ymom added: -3.4237157e+22 zmom added: -9.444732966e+21 eint added: 0 ener added: 1.073741824e+10 Castro::do_old_sources() time = 0.009688488 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.109239758 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043922911 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.011027255e+31 ymom added: 2.256735648e+31 zmom added: 2.485913936e+31 eint added: 0 ener added: -3.651800928e+44 Castro::do_new_sources() time = 0.010127061 ...estimated hydro-limited timestep at level 1: 0.02123770166 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123770166  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01575731895 [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 0.00214203961  Beginning subcycle 1 starting at time 0.00214203961 with dt = 0.00214203961 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.010181798 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.022054509e+31 ymom added: 4.513471294e+31 zmom added: 4.971827876e+31 eint added: 0 ener added: -5.607048802e+43 Castro::do_old_sources() time = 0.00923454 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.11052503 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.047826483 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012362561e+31 ymom added: 2.258066817e+31 zmom added: 2.487244667e+31 eint added: 0 ener added: -2.551803723e+44 Castro::do_new_sources() time = 0.010524233 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01414353843 [Level 1 step 2] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.027968432 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.066626926e+30 ymom added: -8.390444686e+30 zmom added: -1.068222215e+31 eint added: 0 ener added: -2.551794271e+44 Castro::do_new_sources() time = 0.010122297 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.775153104e+31 ymom added: -7.477924724e+31 zmom added: -8.5974286e+31 eint added: 0 ener added: 1.76932959e+45 Castro::do_new_sources() time = 0.147547247 Castro::reflux() at level 0 : time = 1.026419669 TIME= 0.00428407922 MASS = 1.989753521e+33 TIME= 0.00428407922 XMOM = 3.910385891e+30 TIME= 0.00428407922 YMOM = 2.075078455e+31 TIME= 0.00428407922 ZMOM = 2.364293811e+31 TIME= 0.00428407922 ANG MOM X = 4.700449291e+33 TIME= 0.00428407922 ANG MOM Y = 9.989688798e+37 TIME= 0.00428407922 ANG MOM Z = -9.990140295e+37 TIME= 0.00428407922 RHO*e = 2.895756372e+49 TIME= 0.00428407922 RHO*K = 3.363093914e+45 TIME= 0.00428407922 RHO*E = 2.896092681e+49 TIME= 0.00428407922 RHO*PHI = -3.913480386e+50 TIME= 0.00428407922 TOTAL ENERGY= -1.667130925e+50 [STEP 1] Coarse TimeStep time: 4.979533238 [STEP 1] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 1 TIME = 0.00428407922 DT = 0.00428407922 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05480799595 ... but limiting to: 0.004712487142 = 1.1 * 0.00428407922 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02109657365 ... but limiting to: 0.002356243571 = 1.1 * 0.00214203961 Now regridding at level lbase = 0 grid_places() time: 0.009518885 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028900697 STEP = 1 TIME = 0.00428407922 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05480799595 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05480799595 ...estimated hydro-limited timestep at level 1: 0.02109657365 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02109657365 [Level 0 step 2] ADVANCE with dt = 0.004712487142  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.004712487142 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029800054 Gravity::solve_for_phi() time = 0.375208429 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.371852868e+30 ymom added: 2.372403395e+30 zmom added: 2.372523268e+30 eint added: 0 ener added: 5.330725725e+44 Castro::do_old_sources() time = 0.130929236 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.436425097 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024252953 Gravity::solve_for_phi() time = 0.325878513 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from new-time sources: mass added: 0 xmom added: 1.101198628e+28 ymom added: 1.101125187e+28 zmom added: 1.101119914e+28 eint added: 0 ener added: -2.735741878e+45 Castro::do_new_sources() time = 0.149469404 ...estimated hydro-limited timestep at level 0: 0.05448833866 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05448833866  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08654235236 [Level 0 step 2] Advanced 262144 cells [Level 1 step 3] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00428407922 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008447218 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.118911803e+31 ymom added: 3.118904821e+31 zmom added: 3.118903993e+31 eint added: 0 ener added: -1.225736713e+44 Castro::do_old_sources() time = 0.009119551 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106831324 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043274967 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.278001727e+28 ymom added: 1.275021091e+28 zmom added: 1.274510385e+28 eint added: 0 ener added: -1.438233139e+44 Castro::do_new_sources() time = 0.010062566 ...estimated hydro-limited timestep at level 1: 0.02108156047 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02108156047  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0163380873 [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 0.002356243571  Beginning subcycle 1 starting at time 0.00664032279 with dt = 0.002356243571 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008245818 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.121467806e+31 ymom added: 3.121454862e+31 zmom added: 3.121453015e+31 eint added: 0 ener added: -1.907178701e+44 Castro::do_old_sources() time = 0.009263079 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106126593 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044571409 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.166768461e+28 ymom added: 1.163457808e+28 zmom added: 1.162896413e+28 eint added: 0 ener added: -2.441141034e+44 Castro::do_new_sources() time = 0.010106257 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01504116542 [Level 1 step 4] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028729175 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.548475219e+28 ymom added: 1.546170283e+28 zmom added: 1.54584303e+28 eint added: 0 ener added: -2.441136692e+44 Castro::do_new_sources() time = 0.010074764 Contributions to the state from new-time sources: mass added: 0 xmom added: 5.628809892e+28 ymom added: 8.089770254e+28 zmom added: 8.082913462e+28 eint added: 0 ener added: -2.76027539e+45 Castro::do_new_sources() time = 0.145488107 Castro::reflux() at level 0 : time = 0.989636542 TIME= 0.008996566361 MASS = 1.989753521e+33 TIME= 0.008996566361 XMOM = 6.312525079e+30 TIME= 0.008996566361 YMOM = 2.315336532e+31 TIME= 0.008996566361 ZMOM = 2.604560999e+31 TIME= 0.008996566361 ANG MOM X = 4.933454583e+33 TIME= 0.008996566361 ANG MOM Y = 9.979295856e+37 TIME= 0.008996566361 ANG MOM Z = -9.97959465e+37 TIME= 0.008996566361 RHO*e = 2.894736415e+49 TIME= 0.008996566361 RHO*K = 1.309762253e+46 TIME= 0.008996566361 RHO*E = 2.896046177e+49 TIME= 0.008996566361 RHO*PHI = -3.913468288e+50 TIME= 0.008996566361 TOTAL ENERGY= -1.667129526e+50 [STEP 2] Coarse TimeStep time: 5.164785059 [STEP 2] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 2 TIME = 0.008996566361 DT = 0.004712487142 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05369959241 ... but limiting to: 0.005183735856 = 1.1 * 0.004712487142 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02099373321 ... but limiting to: 0.002591867928 = 1.1 * 0.002356243571 Now regridding at level lbase = 0 grid_places() time: 0.012917492 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.048650385 STEP = 2 TIME = 0.008996566361 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05369959241 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05369959241 ...estimated hydro-limited timestep at level 1: 0.02099373321 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02099373321 [Level 0 step 3] ADVANCE with dt = 0.005183735856  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.005183735856 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.051353811 Gravity::solve_for_phi() time = 0.453596449 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 2.692939012e+30 ymom added: 2.692725481e+30 zmom added: 2.692687248e+30 eint added: 0 ener added: 1.242137033e+45 Castro::do_old_sources() time = 0.132880477 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.456147631 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024788339 Gravity::solve_for_phi() time = 0.324099553 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.983180028e+45 ener added: 1.304247608e+40 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.371044469e+28 ymom added: 1.370983742e+28 zmom added: 1.370958055e+28 eint added: 0 ener added: -2.984483617e+45 Castro::do_new_sources() time = 0.14812552 ...estimated hydro-limited timestep at level 0: 0.05348050546 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05348050546  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08396395174 [Level 0 step 3] Advanced 262144 cells [Level 1 step 5] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.008996566361 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00836739 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.437021233e+31 ymom added: 3.437001922e+31 zmom added: 3.436999169e+31 eint added: 0 ener added: -2.795298752e+44 Castro::do_old_sources() time = 0.009051586 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106112722 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.04291857 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.212468666e+27 ymom added: 9.182905068e+27 zmom added: 9.178201669e+27 eint added: 0 ener added: -1.258225487e+44 Castro::do_new_sources() time = 0.010030476 ...estimated hydro-limited timestep at level 1: 0.02104482833 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02104482833  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0164495 [Level 1 step 5] Advanced 4096 cells [Level 1 step 6] ADVANCE with dt = 0.002591867928  Beginning subcycle 1 starting at time 0.01158843429 with dt = 0.002591867928 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008253596 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.438863726e+31 ymom added: 3.438838503e+31 zmom added: 3.438834809e+31 eint added: 0 ener added: -3.586278509e+44 Castro::do_old_sources() time = 0.008936819 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106478841 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044541025 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.146320754e+27 ymom added: 9.116586878e+27 zmom added: 9.111875334e+27 eint added: 0 ener added: -9.805426968e+43 Castro::do_new_sources() time = 0.010089373 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0149626424 [Level 1 step 6] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.029161071 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.050743344e+28 ymom added: 1.049529453e+28 zmom added: 1.049432849e+28 eint added: 0 ener added: -9.805264374e+43 Castro::do_new_sources() time = 0.009895276 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.002934709e+45 ener added: 4.532655088e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.012342325e+27 ymom added: 5.311566494e+28 zmom added: 5.31240218e+28 eint added: 0 ener added: -3.012866566e+45 Castro::do_new_sources() time = 0.145712951 Castro::reflux() at level 0 : time = 0.990408349 TIME= 0.01418030222 MASS = 1.989753521e+33 TIME= 0.01418030222 XMOM = 8.978220204e+30 TIME= 0.01418030222 YMOM = 2.581919613e+31 TIME= 0.01418030222 ZMOM = 2.871146309e+31 TIME= 0.01418030222 ANG MOM X = 5.313555639e+33 TIME= 0.01418030222 ANG MOM Y = 9.970067672e+37 TIME= 0.01418030222 ANG MOM Z = -9.970193008e+37 TIME= 0.01418030222 RHO*e = 2.892864847e+49 TIME= 0.01418030222 RHO*K = 3.209580769e+46 TIME= 0.01418030222 RHO*E = 2.896074405e+49 TIME= 0.01418030222 RHO*PHI = -3.913471194e+50 TIME= 0.01418030222 TOTAL ENERGY= -1.667128157e+50 [STEP 3] Coarse TimeStep time: 5.310132895 [STEP 3] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 3 TIME = 0.01418030222 DT = 0.005183735856 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05251524411 ... but limiting to: 0.005702109441 = 1.1 * 0.005183735856 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02112306399 ... but limiting to: 0.002851054721 = 1.1 * 0.002591867928 Now regridding at level lbase = 0 grid_places() time: 0.009754088 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028526127 STEP = 3 TIME = 0.01418030222 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05251524411 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05251524411 ...estimated hydro-limited timestep at level 1: 0.02112306399 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02112306399 [Level 0 step 4] ADVANCE with dt = 0.005702109441  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.005702109441 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025436006 Gravity::solve_for_phi() time = 0.376802447 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.602778546e+44 ener added: 3.592143584e+37 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.059700666e+30 ymom added: 3.059418787e+30 zmom added: 3.059367748e+30 eint added: 0 ener added: 2.1659935e+45 Castro::do_old_sources() time = 0.13379408 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.450606522 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.026171494 Gravity::solve_for_phi() time = 0.331353784 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.186088626e+45 ener added: 1.47338654e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -3.123308383e+28 ymom added: -3.123356461e+28 zmom added: -3.12337868e+28 eint added: 0 ener added: -3.182334147e+45 Castro::do_new_sources() time = 0.150854534 ...estimated hydro-limited timestep at level 0: 0.05241922426 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05241922426  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08587794602 [Level 0 step 4] Advanced 262144 cells [Level 1 step 7] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01418030222 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008502701 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.785061734e+31 ymom added: 3.785031321e+31 zmom added: 3.785027043e+31 eint added: 0 ener added: -4.79734184e+44 Castro::do_old_sources() time = 0.009401278 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106190881 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044366621 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.299520056e+27 ymom added: -7.337151562e+27 zmom added: -7.34310896e+27 eint added: 0 ener added: -9.567651815e+43 Castro::do_new_sources() time = 0.010279232 ...estimated hydro-limited timestep at level 1: 0.02123621933 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123621933  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01608936062 [Level 1 step 7] Advanced 4096 cells [Level 1 step 8] ADVANCE with dt = 0.002851054721  Beginning subcycle 1 starting at time 0.01703135694 with dt = 0.002851054721 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008545619 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 3.78360183e+31 ymom added: 3.783563891e+31 zmom added: 3.783558422e+31 eint added: 0 ener added: -5.705657399e+44 Castro::do_old_sources() time = 0.009169111 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10755338 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043789199 Contributions to the state from new-time sources: mass added: 0 xmom added: -8.086452835e+27 ymom added: -8.124011231e+27 zmom added: -8.129917879e+27 eint added: 0 ener added: -8.517077076e+43 Castro::do_new_sources() time = 0.010230184 ...estimated hydro-limited timestep at level 1: 0.02137361605 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361605  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01492054393 [Level 1 step 8] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.051400775 Contributions to the state from new-time sources: mass added: 0 xmom added: -7.628722784e+27 ymom added: -7.641423342e+27 zmom added: -7.64227511e+27 eint added: 0 ener added: -8.516976337e+43 Castro::do_new_sources() time = 0.009946518 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.205747681e+45 ener added: 8.47193049e+32 Contributions to the state from new-time sources: mass added: 0 xmom added: -9.251860432e+28 ymom added: -2.445730085e+28 zmom added: -2.444390472e+28 eint added: 0 ener added: -3.214368912e+45 Castro::do_new_sources() time = 0.145518161 Castro::reflux() at level 0 : time = 0.986397904 TIME= 0.01988241166 MASS = 1.989753521e+33 TIME= 0.01988241166 XMOM = 1.189507802e+31 TIME= 0.01988241166 YMOM = 2.87362472e+31 TIME= 0.01988241166 ZMOM = 3.162855697e+31 TIME= 0.01988241166 ANG MOM X = 5.869733548e+33 TIME= 0.01988241166 ANG MOM Y = 9.960519548e+37 TIME= 0.01988241166 ANG MOM Z = -9.9604481e+37 TIME= 0.01988241166 RHO*e = 2.890125083e+49 TIME= 0.01988241166 RHO*K = 6.065331387e+46 TIME= 0.01988241166 RHO*E = 2.896190365e+49 TIME= 0.01988241166 RHO*PHI = -3.913491424e+50 TIME= 0.01988241166 TOTAL ENERGY= -1.667126675e+50 [STEP 4] Coarse TimeStep time: 5.162589832 [STEP 4] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 4 TIME = 0.01988241166 DT = 0.005702109441 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05139001397 ... but limiting to: 0.006272320385 = 1.1 * 0.005702109441 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02137361606 ... but limiting to: 0.003136160193 = 1.1 * 0.002851054721 Now regridding at level lbase = 0 grid_places() time: 0.009606592 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.029172267 STEP = 4 TIME = 0.01988241166 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.05139001397 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05139001397 ...estimated hydro-limited timestep at level 1: 0.02137361606 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02137361606 [Level 0 step 5] ADVANCE with dt = 0.006272320385  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.006272320385 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027993874 Gravity::solve_for_phi() time = 0.372536754 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.040892494e+45 ener added: 1.151908461e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 3.400150475e+30 ymom added: 3.399803827e+30 zmom added: 3.399742097e+30 eint added: 0 ener added: 3.3553794e+45 Castro::do_old_sources() time = 0.129981695 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.435194498 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029167299 Gravity::solve_for_phi() time = 0.328289165 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.396043028e+45 ener added: 2.555388911e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.218593601e+29 ymom added: 1.218588724e+29 zmom added: 1.218591232e+29 eint added: 0 ener added: -3.384135011e+45 Castro::do_new_sources() time = 0.145916056 ...estimated hydro-limited timestep at level 0: 0.05143629182 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05143629182  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08693444692 [Level 0 step 5] Advanced 262144 cells [Level 1 step 9] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.01988241166 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008393684 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.160283694e+31 ymom added: 4.160239162e+31 zmom added: 4.160232963e+31 eint added: 0 ener added: -7.245473983e+44 Castro::do_old_sources() time = 0.008981502 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106321169 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043180889 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.708388831e+29 ymom added: 1.707927109e+29 zmom added: 1.707854478e+29 eint added: 0 ener added: -1.053758003e+44 Castro::do_new_sources() time = 0.010067828 ...estimated hydro-limited timestep at level 1: 0.02123904917 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02123904917  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01632882816 [Level 1 step 9] Advanced 4096 cells [Level 1 step 10] ADVANCE with dt = 0.003136160193  Beginning subcycle 1 starting at time 0.02301857185 with dt = 0.003136160193 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008451979 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.194451471e+31 ymom added: 4.194397705e+31 zmom added: 4.194390054e+31 eint added: 0 ener added: -8.265828599e+44 Castro::do_old_sources() time = 0.009256473 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107011372 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.044208797 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.709323551e+29 ymom added: 1.708864169e+29 zmom added: 1.708792455e+29 eint added: 0 ener added: -9.710075051e+43 Castro::do_new_sources() time = 0.010357034 ...estimated hydro-limited timestep at level 1: 0.02074215705 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215705  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01495724694 [Level 1 step 10] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02933863 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.687476137e+29 ymom added: 1.687341257e+29 zmom added: 1.687333644e+29 eint added: 0 ener added: -9.710091294e+43 Castro::do_new_sources() time = 0.010201831 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.415893266e+45 ener added: 1.43495189e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.482363474e+28 ymom added: 7.265277777e+28 zmom added: 7.267043465e+28 eint added: 0 ener added: -3.419701273e+45 Castro::do_new_sources() time = 0.148935325 Castro::reflux() at level 0 : time = 0.949336515 TIME= 0.02615473204 MASS = 1.989753522e+33 TIME= 0.02615473204 XMOM = 1.519112831e+31 TIME= 0.02615473204 YMOM = 3.203255753e+31 TIME= 0.02615473204 ZMOM = 3.492493228e+31 TIME= 0.02615473204 ANG MOM X = 6.537384167e+33 TIME= 0.02615473204 ANG MOM Y = 9.950532237e+37 TIME= 0.02615473204 ANG MOM Z = -9.950246329e+37 TIME= 0.02615473204 RHO*e = 2.886643003e+49 TIME= 0.02615473204 RHO*K = 9.771078204e+46 TIME= 0.02615473204 RHO*E = 2.896414008e+49 TIME= 0.02615473204 RHO*PHI = -3.913532869e+50 TIME= 0.02615473204 TOTAL ENERGY= -1.667125034e+50 [STEP 5] Coarse TimeStep time: 5.087698307 [STEP 5] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 5 TIME = 0.02615473204 DT = 0.006272320385 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0503991009 ... but limiting to: 0.006899552424 = 1.1 * 0.006272320385 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02074215713 ... but limiting to: 0.003449776212 = 1.1 * 0.003136160193 Now regridding at level lbase = 0 grid_places() time: 0.009839479 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.02927889 STEP = 5 TIME = 0.02615473204 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0503991009 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0503991009 ...estimated hydro-limited timestep at level 1: 0.02074215713 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02074215713 [Level 0 step 6] ADVANCE with dt = 0.006899552424  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.006899552424 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.033760369 Gravity::solve_for_phi() time = 0.390029551 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.259374261e+45 ener added: 2.437720008e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.094919311e+30 ymom added: 4.094511463e+30 zmom added: 4.094439078e+30 eint added: 0 ener added: 4.877102685e+45 Castro::do_old_sources() time = 0.138992457 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.469405275 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027985187 Gravity::solve_for_phi() time = 0.333309069 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.543029575e+45 ener added: 3.539426633e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.297245023e+27 ymom added: -5.297264722e+27 zmom added: -5.297303534e+27 eint added: 0 ener added: -3.5195857e+45 Castro::do_new_sources() time = 0.146114881 ...estimated hydro-limited timestep at level 0: 0.05060870329 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05060870329  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0848622469 [Level 0 step 6] Advanced 262144 cells [Level 1 step 11] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02615473204 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008336281 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.651021093e+31 ymom added: 4.650958981e+31 zmom added: 4.650950401e+31 eint added: 0 ener added: -1.017109063e+45 Castro::do_old_sources() time = 0.009069156 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106512291 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042895189 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.465464962e+28 ymom added: 3.459802414e+28 zmom added: 3.458916525e+28 eint added: 0 ener added: -1.114212579e+44 Castro::do_new_sources() time = 0.009939416 ...estimated hydro-limited timestep at level 1: 0.02032605328 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02032605328  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01649050837 [Level 1 step 11] Advanced 4096 cells [Level 1 step 12] ADVANCE with dt = 0.003449776212  Beginning subcycle 1 starting at time 0.02960450826 with dt = 0.003449776212 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00820305 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 4.657952023e+31 ymom added: 4.657878591e+31 zmom added: 4.657868236e+31 eint added: 0 ener added: -1.129824109e+45 Castro::do_old_sources() time = 0.008983531 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105490492 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042810284 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.440942249e+28 ymom added: 3.435270946e+28 zmom added: 3.434392302e+28 eint added: 0 ener added: -9.51962496e+43 Castro::do_new_sources() time = 0.009906557 ...estimated hydro-limited timestep at level 1: 0.02002398339 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398339  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0151343193 [Level 1 step 12] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.02830777 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.963534049e+28 ymom added: 2.962177519e+28 zmom added: 2.962127486e+28 eint added: 0 ener added: -9.519762675e+43 Castro::do_new_sources() time = 0.009864528 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.563839653e+45 ener added: 4.469648462e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.36934433e+29 ymom added: -1.047781791e+29 zmom added: -1.047573808e+29 eint added: 0 ener added: -3.558891025e+45 Castro::do_new_sources() time = 0.145693885 Castro::reflux() at level 0 : time = 0.927638214 TIME= 0.03305428447 MASS = 1.989753522e+33 TIME= 0.03305428447 XMOM = 1.89485326e+31 TIME= 0.03305428447 YMOM = 3.579033306e+31 TIME= 0.03305428447 ZMOM = 3.868277558e+31 TIME= 0.03305428447 ANG MOM X = 7.378990121e+33 TIME= 0.03305428447 ANG MOM Y = 9.940157189e+37 TIME= 0.03305428447 ANG MOM Z = -9.939681474e+37 TIME= 0.03305428447 RHO*e = 2.882573874e+49 TIME= 0.03305428447 RHO*K = 1.421374999e+47 TIME= 0.03305428447 RHO*E = 2.896787493e+49 TIME= 0.03305428447 RHO*PHI = -3.913604026e+50 TIME= 0.03305428447 TOTAL ENERGY= -1.667123264e+50 [STEP 6] Coarse TimeStep time: 5.165050157 [STEP 6] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 6 TIME = 0.03305428447 DT = 0.006899552424 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0496082288 ... but limiting to: 0.007589507666 = 1.1 * 0.006899552424 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.02002398347 ... but limiting to: 0.003794753833 = 1.1 * 0.003449776212 Now regridding at level lbase = 0 grid_places() time: 0.009556685 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028503092 STEP = 6 TIME = 0.03305428447 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.0496082288 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0496082288 ...estimated hydro-limited timestep at level 1: 0.02002398347 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02002398347 [Level 0 step 7] ADVANCE with dt = 0.007589507666  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.007589507666 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.031265187 Gravity::solve_for_phi() time = 0.375891368 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.523652406e+45 ener added: 6.460709099e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.516151129e+30 ymom added: 4.515688034e+30 zmom added: 4.515608962e+30 eint added: 0 ener added: 6.818039115e+45 Castro::do_old_sources() time = 0.130884181 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.473211921 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.025774417 Gravity::solve_for_phi() time = 0.325873438 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.683224138e+45 ener added: 4.554170287e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.88171598e+28 ymom added: -2.88175262e+28 zmom added: -2.881735255e+28 eint added: 0 ener added: -3.643616184e+45 Castro::do_new_sources() time = 0.149294374 ...estimated hydro-limited timestep at level 0: 0.05000304317 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05000304317  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08570983482 [Level 0 step 7] Advanced 262144 cells [Level 1 step 13] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.03305428447 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008323983 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.130263316e+31 ymom added: 5.130179573e+31 zmom added: 5.130168076e+31 eint added: 0 ener added: -1.361328518e+45 Castro::do_old_sources() time = 0.009016136 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106117994 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042828259 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978427521e+29 ymom added: -1.979112044e+29 zmom added: -1.979218324e+29 eint added: 0 ener added: -1.094447611e+44 Castro::do_new_sources() time = 0.009950692 ...estimated hydro-limited timestep at level 1: 0.01979873126 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01979873126  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.0164677364 [Level 1 step 13] Advanced 4096 cells [Level 1 step 14] ADVANCE with dt = 0.003794753833  Beginning subcycle 1 starting at time 0.0368490383 with dt = 0.003794753833 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008277373 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.090694766e+31 ymom added: 5.090597335e+31 zmom added: 5.09058371e+31 eint added: 0 ener added: -1.484432018e+45 Castro::do_old_sources() time = 0.00896214 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107248661 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043031069 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.978636747e+29 ymom added: -1.979323587e+29 zmom added: -1.979430506e+29 eint added: 0 ener added: -9.951114748e+43 Castro::do_new_sources() time = 0.009907615 ...estimated hydro-limited timestep at level 1: 0.01966866437 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866437  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01502321051 [Level 1 step 14] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028376331 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.026914926e+29 ymom added: -2.027068659e+29 zmom added: -2.027076586e+29 eint added: 0 ener added: -9.951456236e+43 Castro::do_new_sources() time = 0.009963968 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.705750985e+45 ener added: 6.426686072e+33 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.992129149e+29 ymom added: -1.425295852e+29 zmom added: -1.425074135e+29 eint added: 0 ener added: -3.686881027e+45 Castro::do_new_sources() time = 0.144866444 Castro::reflux() at level 0 : time = 0.924084732 TIME= 0.04064379213 MASS = 1.989753522e+33 TIME= 0.04064379213 XMOM = 2.305877433e+31 TIME= 0.04064379213 YMOM = 3.990103491e+31 TIME= 0.04064379213 ZMOM = 4.279358336e+31 TIME= 0.04064379213 ANG MOM X = 8.289727133e+33 TIME= 0.04064379213 ANG MOM Y = 9.930081261e+37 TIME= 0.04064379213 ANG MOM Z = -9.929507208e+37 TIME= 0.04064379213 RHO*e = 2.878050897e+49 TIME= 0.04064379213 RHO*K = 1.930355312e+47 TIME= 0.04064379213 RHO*E = 2.897354275e+49 TIME= 0.04064379213 RHO*PHI = -3.91371369e+50 TIME= 0.04064379213 TOTAL ENERGY= -1.667121417e+50 [STEP 7] Coarse TimeStep time: 5.149117892 [STEP 7] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 7 TIME = 0.04064379213 DT = 0.007589507666 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04906598706 ... but limiting to: 0.008348458433 = 1.1 * 0.007589507666 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01966866445 ... but limiting to: 0.004174229216 = 1.1 * 0.003794753833 Now regridding at level lbase = 0 grid_places() time: 0.009746786 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028823512 STEP = 7 TIME = 0.04064379213 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04906598706 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04906598706 ...estimated hydro-limited timestep at level 1: 0.01966866445 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01966866445 [Level 0 step 8] ADVANCE with dt = 0.008348458433  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.008348458433 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.029018791 Gravity::solve_for_phi() time = 0.374032984 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.843326129e+45 ener added: 1.196784553e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 4.890064068e+30 ymom added: 4.889542941e+30 zmom added: 4.889455672e+30 eint added: 0 ener added: 9.28935574e+45 Castro::do_old_sources() time = 0.129766907 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.434441182 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.027163515 Gravity::solve_for_phi() time = 0.371181435 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.807804942e+45 ener added: 5.529128472e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.113649844e+29 ymom added: 1.113641736e+29 zmom added: 1.113642724e+29 eint added: 0 ener added: -3.74742093e+45 Castro::do_new_sources() time = 0.15191889 ...estimated hydro-limited timestep at level 0: 0.04966831868 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04966831868  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08560273774 [Level 0 step 8] Advanced 262144 cells [Level 1 step 15] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04064379213 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008456212 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.555168203e+31 ymom added: 5.555057671e+31 zmom added: 5.555042516e+31 eint added: 0 ener added: -1.761688601e+45 Castro::do_old_sources() time = 0.008996808 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106551823 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043015767 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640348994e+29 ymom added: 2.639526848e+29 zmom added: 2.639400337e+29 eint added: 0 ener added: -1.220636541e+44 Castro::do_new_sources() time = 0.010041771 ...estimated hydro-limited timestep at level 1: 0.01961529572 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01961529572  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01644088784 [Level 1 step 15] Advanced 4096 cells [Level 1 step 16] ADVANCE with dt = 0.004174229216  Beginning subcycle 1 starting at time 0.04481802135 with dt = 0.004174229216 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.009833811 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 5.607975182e+31 ymom added: 5.607848211e+31 zmom added: 5.607830528e+31 eint added: 0 ener added: -1.894755864e+45 Castro::do_old_sources() time = 0.00902052 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106330979 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043033938 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.640347813e+29 ymom added: 2.639526055e+29 zmom added: 2.639399437e+29 eint added: 0 ener added: -1.127710123e+44 Castro::do_new_sources() time = 0.010080365 ...estimated hydro-limited timestep at level 1: 0.01964203565 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203565  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.014984279 [Level 1 step 16] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028546834 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.604897309e+29 ymom added: 2.604726866e+29 zmom added: 2.604719342e+29 eint added: 0 ener added: -1.127773425e+44 Castro::do_new_sources() time = 0.009875587 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.832324522e+45 ener added: 1.34483244e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -1.800478816e+29 ymom added: 5.931907363e+27 zmom added: 5.953997717e+27 eint added: 0 ener added: -3.794610698e+45 Castro::do_new_sources() time = 0.145204347 Castro::reflux() at level 0 : time = 0.925122092 TIME= 0.04899225057 MASS = 1.989753523e+33 TIME= 0.04899225057 XMOM = 2.767283688e+31 TIME= 0.04899225057 YMOM = 4.451571754e+31 TIME= 0.04899225057 ZMOM = 4.740838749e+31 TIME= 0.04899225057 ANG MOM X = 9.334315484e+33 TIME= 0.04899225057 ANG MOM Y = 9.919777922e+37 TIME= 0.04899225057 ANG MOM Z = -9.919179229e+37 TIME= 0.04899225057 RHO*e = 2.873200047e+49 TIME= 0.04899225057 RHO*K = 2.4968411e+47 TIME= 0.04899225057 RHO*E = 2.898168169e+49 TIME= 0.04899225057 RHO*PHI = -3.913872718e+50 TIME= 0.04899225057 TOTAL ENERGY= -1.667119542e+50 [STEP 8] Coarse TimeStep time: 5.152650427 [STEP 8] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 8 TIME = 0.04899225057 DT = 0.008348458433 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04881021812 ... but limiting to: 0.009183304276 = 1.1 * 0.008348458433 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01964203575 ... but limiting to: 0.004591652138 = 1.1 * 0.004174229216 Now regridding at level lbase = 0 grid_places() time: 0.009676326 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028695523 STEP = 8 TIME = 0.04899225057 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04881021812 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04881021812 ...estimated hydro-limited timestep at level 1: 0.01964203575 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01964203575 [Level 0 step 9] ADVANCE with dt = 0.009183304276  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.009183304276 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.030031643 Gravity::solve_for_phi() time = 0.384019911 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.230016482e+45 ener added: 2.67336214e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.531036354e+30 ymom added: 5.530451715e+30 zmom added: 5.530356286e+30 eint added: 0 ener added: 1.243072946e+46 Castro::do_old_sources() time = 0.133616728 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.469568409 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02902462 Gravity::solve_for_phi() time = 0.375184358 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.801177864e+45 ener added: 9.269592596e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: -5.061043355e+28 ymom added: -5.061170338e+28 zmom added: -5.061201607e+28 eint added: 0 ener added: -3.713539813e+45 Castro::do_new_sources() time = 0.152125145 ...estimated hydro-limited timestep at level 0: 0.04964067006 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04964067006  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08398483014 [Level 0 step 9] Advanced 262144 cells [Level 1 step 17] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.04899225057 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008418643 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.226075955e+31 ymom added: 6.225932574e+31 zmom added: 6.225912957e+31 eint added: 0 ener added: -2.22299059e+45 Castro::do_old_sources() time = 0.009112378 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.10658881 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.042911483 Contributions to the state from new-time sources: mass added: 0 xmom added: 9.845500448e+27 ymom added: 9.745936248e+27 zmom added: 9.730448294e+27 eint added: 0 ener added: -1.411879041e+44 Castro::do_new_sources() time = 0.009970719 ...estimated hydro-limited timestep at level 1: 0.01976191959 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01976191959  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01637260657 [Level 1 step 17] Advanced 4096 cells [Level 1 step 18] ADVANCE with dt = 0.004591652138  Beginning subcycle 1 starting at time 0.0535839027 with dt = 0.004591652138 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.00831736 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.228045055e+31 ymom added: 6.227881757e+31 zmom added: 6.227859047e+31 eint added: 0 ener added: -2.365499096e+45 Castro::do_old_sources() time = 0.009039524 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.107133328 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.043141145 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.024325722e+28 ymom added: 1.014449576e+28 zmom added: 1.012944325e+28 eint added: 0 ener added: -1.51531618e+44 Castro::do_new_sources() time = 0.009893082 ...estimated hydro-limited timestep at level 1: 0.01998148673 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148673  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01504148048 [Level 1 step 18] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028606241 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.392638854e+27 ymom added: 8.374295623e+27 zmom added: 8.373575114e+27 eint added: 0 ener added: -1.515437715e+44 Castro::do_new_sources() time = 0.009925521 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.826988035e+45 ener added: 1.546450844e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.988087176e+29 ymom added: -1.060824974e+29 zmom added: -1.06060218e+29 eint added: 0 ener added: -3.764219385e+45 Castro::do_new_sources() time = 0.145367829 Castro::reflux() at level 0 : time = 0.925380652 TIME= 0.05817555484 MASS = 1.989753524e+33 TIME= 0.05817555484 XMOM = 3.283418428e+31 TIME= 0.05817555484 YMOM = 4.967781779e+31 TIME= 0.05817555484 ZMOM = 5.25706585e+31 TIME= 0.05817555484 ANG MOM X = 1.034769196e+34 TIME= 0.05817555484 ANG MOM Y = 9.909866397e+37 TIME= 0.05817555484 ANG MOM Z = -9.909313923e+37 TIME= 0.05817555484 RHO*e = 2.868382492e+49 TIME= 0.05817555484 RHO*K = 3.092541753e+47 TIME= 0.05817555484 RHO*E = 2.899307545e+49 TIME= 0.05817555484 RHO*PHI = -3.914096821e+50 TIME= 0.05817555484 TOTAL ENERGY= -1.667117656e+50 [STEP 9] Coarse TimeStep time: 5.206194738 [STEP 9] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 9 TIME = 0.05817555484 DT = 0.009183304276 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.04897396301 ... but limiting to: 0.0101016347 = 1.1 * 0.009183304276 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.01998148684 ... but limiting to: 0.005050817352 = 1.1 * 0.004591652138 Now regridding at level lbase = 0 grid_places() time: 0.009698428 new finest: 1 Castro::numpts_1d at level 1 is 229 Gravity::fill_multipole_BCs() time = 0.028308772 STEP = 9 TIME = 0.05817555484 : REGRID with lbase = 0 Level 1 4 grids 4096 cells 0.1953125 % of domain smallest grid: 16 x 8 x 8 biggest grid: 16 x 8 x 8 ...estimated hydro-limited timestep at level 0: 0.04897396301 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.04897396301 ...estimated hydro-limited timestep at level 1: 0.01998148684 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.01998148684 [Level 0 step 10] ADVANCE with dt = 0.0101016347  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.0101016347 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.02967859 Gravity::solve_for_phi() time = 0.374068915 ... testing grad_phi_curr after doing single level solve Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.697825456e+45 ener added: 3.904513854e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.888167176e+30 ymom added: 5.887481813e+30 zmom added: 5.887368401e+30 eint added: 0 ener added: 1.642023425e+46 Castro::do_old_sources() time = 0.129571985 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 1.434005487 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.024789937 Gravity::solve_for_phi() time = 0.368476821 ... testing grad_phi_curr before adding comp_minus_level_grad_phi ... testing grad_phi_curr after adding comp_minus_level_grad_phi Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.888607568e+45 ener added: 1.392294877e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.951950066e+29 ymom added: 1.951927071e+29 zmom added: 1.951930104e+29 eint added: 0 ener added: -3.767122167e+45 Castro::do_new_sources() time = 0.145354975 ...estimated hydro-limited timestep at level 0: 0.05004315116 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05004315116  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.08585510626 [Level 0 step 10] Advanced 262144 cells [Level 1 step 19] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.05817555484 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008342071 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.85269111e+31 ymom added: 6.852507499e+31 zmom added: 6.852482363e+31 eint added: 0 ener added: -2.747909551e+45 Castro::do_old_sources() time = 0.009068359 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.106495801 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048785106 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.26186905e+29 ymom added: 6.260704001e+29 zmom added: 6.26052352e+29 eint added: 0 ener added: -1.729399923e+44 Castro::do_new_sources() time = 0.009894478 ...estimated hydro-limited timestep at level 1: 0.02027172362 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02027172362  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01605758639 [Level 1 step 19] Advanced 4096 cells [Level 1 step 20] ADVANCE with dt = 0.005050817352  Beginning subcycle 1 starting at time 0.06322637219 with dt = 0.005050817352 Estimated number of subcycles remaining: 1 ... old-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.008357306 ... testing grad_phi_curr after doing single level solve Contributions to the state from old-time sources: mass added: 0 xmom added: 6.977928491e+31 ymom added: 6.977721576e+31 zmom added: 6.97769283e+31 eint added: 0 ener added: -2.896114069e+45 Castro::do_old_sources() time = 0.009001675 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.105851782 ... new-time level Poisson gravity solve at level 1 Gravity::solve_for_phi() time = 0.048904142 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.24443966e+29 ymom added: 6.243280318e+29 zmom added: 6.243104212e+29 eint added: 0 ener added: -1.312896239e+44 Castro::do_new_sources() time = 0.010109604 ...estimated hydro-limited timestep at level 1: 0.02058512293 Castro::estTimeStep (hydro-limited) at level 1: estdt = 0.02058512293  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.01485791265 [Level 1 step 20] Advanced 4096 cells Gravity::fill_multipole_BCs() time = 0.028553014 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.283791174e+29 ymom added: 6.283560931e+29 zmom added: 6.283551525e+29 eint added: 0 ener added: -1.313073103e+44 Castro::do_new_sources() time = 0.009912867 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.913900779e+45 ener added: 3.093769837e+34 Contributions to the state from new-time sources: mass added: 0 xmom added: 7.765914874e+27 ymom added: 1.991202224e+29 zmom added: 1.991444428e+29 eint added: 0 ener added: -3.82094845e+45 Castro::do_new_sources() time = 0.145387454 Castro::reflux() at level 0 : time = 0.98120667 TIME= 0.06827718955 MASS = 1.989753525e+33 TIME= 0.06827718955 XMOM = 3.866025689e+31 TIME= 0.06827718955 YMOM = 5.550485369e+31 TIME= 0.06827718955 ZMOM = 5.839790128e+31 TIME= 0.06827718955 ANG MOM X = 1.142617852e+34 TIME= 0.06827718955 ANG MOM Y = 9.899508778e+37 TIME= 0.06827718955 ANG MOM Z = -9.898992427e+37 TIME= 0.06827718955 RHO*e = 2.863982189e+49 TIME= 0.06827718955 RHO*K = 3.688087383e+47 TIME= 0.06827718955 RHO*E = 2.900862504e+49 TIME= 0.06827718955 RHO*PHI = -3.914404093e+50 TIME= 0.06827718955 TOTAL ENERGY= -1.667115796e+50 [STEP 10] Coarse TimeStep time: 5.177995761 [STEP 10] FAB kilobyte spread across MPI nodes: [159029 ... 159029] STEP = 10 TIME = 0.06827718955 DT = 0.0101016347 PLOTFILE: file = evrard_collapse_plt00010 Write plotfile time = 0.553324876 seconds Ending run at 05:40:53 UTC on 2022-03-18. Run time = 54.15419265 Run time without initialization = 51.99275557 Average number of zones advanced per microsecond: 0.052 Average number of zones advanced per microsecond per rank: 0.013 TinyProfiler total time across processes [min...avg...max]: 54.15 ... 54.15 ... 54.15 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 30 16.4325 16.5355 16.6278 30.70% MLPoisson::Fsmooth() 11992 4.172 4.246 4.414 8.15% Castro::reset_internal_energy() 257 2.913 2.955 3.004 5.55% MultiFab::AddProduct() 4648 2.613 2.617 2.62 4.84% FabArray::setVal() 9464 2.311 2.333 2.361 4.36% MLPoisson::Fapply() 2422 1.86 1.882 1.923 3.55% MLCellLinOp::applyBC() 14630 1.47 1.537 1.71 3.16% MultiFab::Subtract() 601 1.67 1.675 1.678 3.10% FabArray::ParallelCopy_nowait() 5320 1.389 1.411 1.44 2.66% FabArray::ParallelCopy_finish() 5320 0.6062 1.091 1.427 2.63% Castro::enforce_min_density() 254 1.037 1.098 1.181 2.18% Gravity::fill_multipole_BCs() 41 1.125 1.149 1.18 2.18% Castro::derive() 397 0.923 0.9309 0.9355 1.73% MultiFab::sum() 4648 0.8549 0.8566 0.8584 1.59% FluxRegister::Reflux() 180 0.8202 0.8292 0.8425 1.56% MultiFab::Xpay() 2190 0.7141 0.7209 0.7365 1.36% Castro::reflux() 10 0.6932 0.7006 0.7066 1.30% FillBoundary_nowait() 13093 0.6529 0.6677 0.6733 1.24% Castro::construct_new_gravity_source() 50 0.6004 0.6054 0.6105 1.13% FillBoundary_finish() 13093 0.5089 0.5374 0.6079 1.12% Castro::volWgtSum() 242 0.4883 0.5329 0.5547 1.02% CellConservativeLinear::interp() 130 0.3692 0.4556 0.5434 1.00% Castro::normalize_species() 254 0.5068 0.5142 0.5344 0.99% Castro::estTimeStep() 69 0.2262 0.3892 0.4832 0.89% Castro::computeTemp() 257 0.4684 0.4701 0.4716 0.87% Castro::finalize_advance() 30 0.356 0.3686 0.3999 0.74% MLPoisson::FFlux() 1044 0.3889 0.3902 0.3908 0.72% Gravity::get_new_grav_vector() 52 0.3308 0.3343 0.3394 0.63% FillPatchSingleLevel 853 0.326 0.329 0.3326 0.61% StateData::FillBoundary(geom) 63 0.3276 0.3291 0.3303 0.61% MLMG::addInterpCorrection() 1421 0.2691 0.2737 0.2861 0.53% amrex::average_down 1713 0.2687 0.2731 0.2837 0.52% FillPatchIterator::Initialize 723 0.2575 0.2687 0.2804 0.52% MultiFab::Saxpy() 100 0.2749 0.2767 0.2789 0.52% MultiFab::min() 30 0.007039 0.1189 0.2202 0.41% Castro::post_timestep() 30 0.06395 0.1196 0.2199 0.41% Castro::do_advance_ctu() 30 0.2155 0.2165 0.2172 0.40% MLMG::oneIter() 333 0.2119 0.2129 0.2134 0.39% Castro::expand_state() 30 0.1902 0.1913 0.1933 0.36% MLCellLinOp::defineAuxData() 81 0.1752 0.1791 0.1887 0.35% VisMF::Write(FabArray) 4 0.1624 0.168 0.1782 0.33% MLCellLinOp::compGrad() 100 0.1715 0.1736 0.176 0.33% MLCellLinOp::reflux() 116 0.1713 0.1739 0.1757 0.32% Gravity::get_old_grav_vector() 30 0.1659 0.1674 0.17 0.31% MultiFab::Multiply() 164 0.1467 0.1476 0.1491 0.28% FabArray::mult() 294 0.1378 0.139 0.1399 0.26% Castro::construct_old_gravity_source() 30 0.1331 0.1354 0.1379 0.25% Amr::writePlotFile() 2 0.1151 0.1279 0.1358 0.25% FabArray::setDomainBndry() 853 0.1289 0.1297 0.1305 0.24% MLMG::ResNormInf() 450 0.1058 0.1091 0.1134 0.21% Castro::construct_old_gravity() 30 0.08679 0.08919 0.09214 0.17% MultiFab::contains_nan() 60 0.09094 0.09139 0.09189 0.17% BndryData::define() 123 0.08875 0.0894 0.09047 0.17% MultiFab::LinComb() 628 0.0718 0.07654 0.08826 0.16% MLMG::prepareForSolve() 80 0.08111 0.08199 0.08441 0.16% Castro::evaluate_source_change() 591 0.07708 0.0774 0.07798 0.14% Gravity::gravity_sync() 10 0.071 0.07207 0.07273 0.13% Gravity::test_level_grad_phi_curr() 20 0.071 0.07158 0.07211 0.13% Castro::initData() 3 0.05786 0.06387 0.07074 0.13% Castro::construct_new_gravity() 30 0.05343 0.0555 0.05915 0.11% MLCellLinOp::updateSolBC() 99 0.05683 0.05707 0.05747 0.11% MLCGSolver::bicgstab 83 0 0.01428 0.05712 0.11% Castro::volProductSum() 22 0.04842 0.05162 0.05406 0.10% Gravity::create_comp_minus_level_grad_phi() 10 0.04489 0.04655 0.04823 0.09% MultiFab::norm0(mask) 57 0.04603 0.04625 0.04638 0.09% MLCellLinOp::updateCorBC() 78 0.04488 0.04514 0.04536 0.08% Castro::initialize_do_advance() 30 0.0339 0.03812 0.04476 0.08% FabArrayBase::CPC::define() 2260 0.02761 0.03237 0.04352 0.08% FabArrayBase::getCPC() 8152 0.04091 0.04137 0.0422 0.08% Gravity::test_level_grad_phi_prev() 30 0.04052 0.04117 0.04168 0.08% Gravity::actual_solve_with_mlmg() 81 0.03704 0.03991 0.04143 0.08% MLCellLinOp::setLevelBC() 102 0.04025 0.04061 0.04103 0.08% MLMG::buildFineMask() 80 0.04035 0.04058 0.04101 0.08% MultiFab::Copy() 100 0.0392 0.03973 0.04032 0.07% Castro::post_init() 2 0.001402 0.01105 0.03884 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03646 0.03728 0.03834 0.07% Gravity::solve_for_phi() 60 0.02695 0.03114 0.03717 0.07% AmrMesh::MakeNewGrids() 11 0.0347 0.03493 0.03501 0.06% FabArray::FillBoundary() 13093 0.03093 0.03196 0.03433 0.06% MLCellLinOp::prepareForSolve() 81 0.02425 0.02553 0.02843 0.05% MLCellLinOp::smooth() 5996 0.02632 0.02695 0.02821 0.05% Castro::init(old) 9 0.02603 0.02629 0.0268 0.05% Castro::initialize_advance() 30 0.0257 0.02585 0.02604 0.05% Amr::defBaseLevel() 1 0.02089 0.02398 0.02582 0.05% FabArrayBase::getFB() 13093 0.0228 0.02358 0.02564 0.05% Gravity::update_max_rhs() 20 0.0239 0.02442 0.0248 0.05% MLCellLinOp::defineBC() 81 0.02372 0.02412 0.02469 0.05% MLMG::interpCorrection_1 78 0.02262 0.02273 0.02279 0.04% Castro::apply_tagging_restrictions() 11 0.02082 0.02117 0.02174 0.04% Castro::finalize_do_advance() 30 0.01278 0.01751 0.02105 0.04% MultiFab::max() 40 0.0129 0.01737 0.02065 0.04% FillPatchTwoLevels 394 0.01524 0.01737 0.01972 0.04% Castro::build_fine_mask() 153 0.01829 0.01834 0.01841 0.03% StateData::define() 48 0.01478 0.01662 0.01764 0.03% FabArray::ParallelCopy() 5320 0.01431 0.01452 0.01493 0.03% Castro::swap_state_time_levels() 30 0.01321 0.01348 0.01419 0.03% MLLinOp::makeSubCommunicator() 81 0.003095 0.008837 0.01314 0.02% MLMG::solve() 80 0.003771 0.008431 0.01266 0.02% Gravity::actual_multilevel_solve() 10 0.01214 0.01231 0.01254 0.02% MLMG::MLRhsNormInf() 80 0.01188 0.01209 0.01228 0.02% Amr::regrid() 10 0.009881 0.0104 0.01144 0.02% MultiFab::Dot() 463 0 0.00277 0.01108 0.02% StateDataPhysBCFunct::() 853 0.007991 0.009317 0.01076 0.02% Gravity::GetCrsePhi() 40 0.009527 0.00974 0.009997 0.02% MLCellLinOp::apply() 2422 0.005688 0.006609 0.009049 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.008315 0.008504 0.008961 0.02% Castro::apply_problem_tags() 11 0.007507 0.007557 0.007579 0.01% Castro::FluxRegFineAdd() 30 0.007167 0.00729 0.00745 0.01% MLLinOp::defineGrids() 81 0.006963 0.007051 0.007259 0.01% MLCGSolver::ParallelAllReduce 692 0 0.001804 0.007218 0.01% Castro::do_old_sources() 30 0.0004962 0.00312 0.007142 0.01% MLCellLinOp::correctionResidual() 1660 0.004615 0.004931 0.005692 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0003515 0.002009 0.005363 0.01% AMRErrorTag::operator() 11 0.004753 0.004987 0.005154 0.01% MLMG::computeResWithCrseSolFineCor() 78 0.005065 0.005074 0.005096 0.01% Castro::do_new_sources() 50 0.000862 0.00232 0.005084 0.01% Gravity::average_fine_ec_onto_crse_ec() 20 0.00489 0.00493 0.00496 0.01% MLMG::computeResWithCrseCorFineCor() 78 0.004857 0.004886 0.004934 0.01% CGSolver::sxay() 588 0 0.001185 0.004741 0.01% MLMG::mgVcycle() 489 0.003968 0.004099 0.004295 0.01% Gravity::test_composite_phi() 1 0.003793 0.003905 0.004001 0.01% Castro::enforce_consistent_e() 3 0.003454 0.003721 0.003986 0.01% MLMG:computeResOfCorrection() 1421 0.00327 0.003366 0.003525 0.01% MLMG::actualBottomSolve() 333 0.0003863 0.001162 0.003465 0.01% FillPatchInterp(Fab) 130 0.001715 0.002193 0.00341 0.01% main() 1 0.00275 0.002869 0.00299 0.01% Amr::InitAmr() 1 0.002638 0.002647 0.002667 0.00% FabArrayBase::FB::FB() 131 0.0008649 0.001251 0.002391 0.00% MLMG::mgVcycle_down::0 333 0.002236 0.002252 0.00227 0.00% MLMG::mgVcycle_down::1 333 0.002044 0.002081 0.00212 0.00% Castro::subcycle_advance_ctu() 30 0.000189 0.0006526 0.002002 0.00% MLMG::mgVcycle_down::2 333 0.001919 0.001935 0.001968 0.00% MLCellLinOp::solutionResidual() 530 0.001925 0.001945 0.001966 0.00% Gravity::solve_phi_with_mlmg() 71 0.001579 0.001678 0.001867 0.00% OwnerMask() 11 0.001473 0.001529 0.001601 0.00% MLMG::mgVcycle_up::0 333 0.001554 0.001566 0.001586 0.00% Castro::clean_state() 254 0.001518 0.001558 0.001577 0.00% TagBoxArray::collate() 11 0.001046 0.001342 0.001535 0.00% MLMG::mgVcycle_up::2 333 0.001343 0.001379 0.001457 0.00% MLMG::mgVcycle_up::1 333 0.001335 0.001374 0.001429 0.00% MLMG::mgVcycle_bottom 489 0.00129 0.0013 0.001316 0.00% MLMG::mgVcycle_down::3 211 0.001163 0.001206 0.00129 0.00% MLMG::mgVcycle_down::4 211 0.001108 0.001156 0.00127 0.00% makeSFC 243 0.001067 0.001108 0.001133 0.00% MLMG::MLResNormInf() 97 0.0006596 0.0007654 0.0009817 0.00% Amr::coarseTimeStep() 10 0.000581 0.000739 0.0009776 0.00% MLMG::mgVcycle_up::4 211 0.000765 0.0008099 0.0009035 0.00% TagBoxArray::mapPRD 11 0.0008285 0.0008601 0.0008866 0.00% Amr::bldFineLevels() 1 0.0007664 0.0008224 0.000873 0.00% MLMG::mgVcycle_up::3 211 0.0007314 0.000767 0.0008532 0.00% MLMG::computeResidual() 333 0.000836 0.0008416 0.0008459 0.00% MLLinOp::makeAgglomeratedDMap 81 0.0007664 0.0007874 0.0008013 0.00% Amr::timeStep() 30 0.0004522 0.000544 0.0007823 0.00% MLPoisson::define() 81 0.0006112 0.0006294 0.0006677 0.00% Amr::grid_places() 11 0.0004829 0.0005227 0.0006161 0.00% Castro::construct_new_source() 250 0.0005552 0.0005799 0.000594 0.00% FabArrayBase::TheFPinfo() 130 0.0005145 0.0005289 0.0005383 0.00% DistributionMapping::Distribute() 245 0.0004901 0.0004964 0.0005016 0.00% Castro::enforce_speed_limit() 254 0.0003795 0.0003986 0.0004179 0.00% Castro::computeNewDt() 18 0.0001164 0.0001837 0.0003804 0.00% Castro::apply_source_to_state() 100 0.0003321 0.0003496 0.0003674 0.00% MLPoisson::prepareForSolve() 81 0.000347 0.0003501 0.0003536 0.00% MLMG::computeMLResidual() 97 0.0003007 0.0003081 0.0003144 0.00% MLLinOp::define() 81 0.0002844 0.0002942 0.0003069 0.00% Castro::construct_old_source() 150 0.0002824 0.000291 0.0003057 0.00% MLMG::miniCycle() 156 0.0002683 0.0002717 0.0002774 0.00% Castro::post_regrid() 22 0.0002311 0.0002536 0.0002767 0.00% MLMG::getGradSolution() 80 0.0002519 0.000261 0.0002669 0.00% AmrLevel::AmrLevel(dm) 12 0.0002419 0.0002553 0.0002655 0.00% ClusterList::intersect() 2 0 5.957e-05 0.0002383 0.00% Castro::advance() 30 0.0002075 0.0002215 0.0002343 0.00% Castro::check_for_nan() 60 0.0001757 0.0001893 0.0002072 0.00% FabArray::RecvLayoutMask() 21 0.0001938 0.0001951 0.0001973 0.00% Gravity::swapTimeLevels() 30 0.0001868 0.0001893 0.000194 0.00% Castro::errorEst() 11 0.0001244 0.0001264 0.0001289 0.00% Castro::avgDown(state_indx) 44 0.0001122 0.0001152 0.0001181 0.00% FPinfo::FPinfo() 3 9.947e-05 0.000106 0.0001105 0.00% Amr::FinalizeInit() 1 1.774e-05 4.25e-05 0.0001102 0.00% AmrMesh-cluster 2 0 2.453e-05 9.812e-05 0.00% Castro::create_source_corrector() 30 8.304e-05 8.644e-05 9.55e-05 0.00% amrex::average_down_w_geom 44 8.612e-05 8.97e-05 9.294e-05 0.00% Gravity::solve_for_delta_phi 10 7.998e-05 8.312e-05 8.892e-05 0.00% Amr::writeSmallPlotFile() 1 7.438e-05 7.477e-05 7.519e-05 0.00% Castro::retry_advance_ctu() 30 5.587e-05 6.212e-05 7.388e-05 0.00% Castro::avgDown() 11 5.504e-05 6.039e-05 7.217e-05 0.00% knapsack() 3 6.088e-05 6.365e-05 6.603e-05 0.00% Amr::initSubcycle() 1 3.519e-05 4.868e-05 5.959e-05 0.00% Castro::gwstrain() 22 3.787e-05 4.334e-05 5.449e-05 0.00% BoxList::parallelComplementIn() 22 4.103e-05 4.196e-05 4.357e-05 0.00% BoxList::complementIn 22 3.964e-05 4.083e-05 4.303e-05 0.00% Gravity::set_mass_offset() 11 2.936e-05 3.529e-05 4.136e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.742e-05 3.146e-05 3.806e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.159e-05 3.466e-05 3.651e-05 0.00% ClusterList::chop() 2 0 4.991e-06 1.997e-05 0.00% Amr::InitializeInit() 1 5.555e-06 8.24e-06 1.355e-05 0.00% MLMG::compResidual() 1 1.168e-05 1.241e-05 1.308e-05 0.00% Castro::computeInitialDt() 2 1.159e-05 1.226e-05 1.265e-05 0.00% Amr::init() 1 5.601e-06 6.4e-06 7.408e-06 0.00% knapsack()swap 2 4.878e-06 5.119e-06 5.487e-06 0.00% Amr::initialInit() 1 3.529e-06 4.305e-06 5.331e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 54.15 54.15 54.15 100.00% Amr::coarseTimeStep() 10 51.44 51.44 51.44 94.98% Amr::timeStep() 30 51.21 51.25 51.36 94.84% Castro::advance() 30 36.02 36.02 36.02 66.52% Castro::subcycle_advance_ctu() 30 34.22 34.23 34.25 63.24% Castro::do_advance_ctu() 30 34.22 34.23 34.25 63.24% Castro::construct_ctu_hydro_source() 30 16.43 16.54 16.63 30.70% Gravity::actual_solve_with_mlmg() 81 13.18 13.19 13.19 24.36% MLMG::solve() 80 12.46 12.47 12.47 23.03% Castro::post_timestep() 30 12.05 12.09 12.2 22.53% Castro::clean_state() 254 10.42 10.5 10.63 19.62% MLMG::oneIter() 333 10.46 10.46 10.46 19.32% Gravity::solve_phi_with_mlmg() 71 9.969 10 10.04 18.55% Castro::reflux() 10 9.601 9.618 9.626 17.78% MLMG::mgVcycle() 489 9.178 9.183 9.187 16.96% Gravity::solve_for_phi() 60 8.299 8.326 8.364 15.44% MLCellLinOp::smooth() 5996 6.269 6.378 6.683 12.34% Castro::computeTemp() 257 6.166 6.221 6.264 11.57% Castro::reset_internal_energy() 257 5.698 5.751 5.794 10.70% Gravity::gravity_sync() 10 5.026 5.029 5.03 9.29% Castro::construct_new_gravity() 30 5.002 5.012 5.021 9.27% Castro::construct_old_gravity() 30 4.763 4.781 4.815 8.89% Castro::evaluate_source_change() 591 4.469 4.474 4.48 8.27% MLPoisson::Fsmooth() 11992 4.172 4.246 4.414 8.15% Gravity::solve_for_delta_phi 10 4.188 4.188 4.189 7.73% Castro::enforce_min_density() 254 3.787 3.85 3.935 7.27% MLMG::mgVcycle_down::0 333 3.9 3.905 3.909 7.22% FillPatchIterator::Initialize 723 3.304 3.323 3.349 6.18% Castro::do_new_sources() 50 3.208 3.228 3.252 6.01% Amr::regrid() 10 3.14 3.18 3.209 5.92% Castro::post_regrid() 22 2.942 2.983 3.011 5.56% MLMG::mgVcycle_up::0 333 2.693 2.883 2.952 5.45% MLCellLinOp::applyBC() 14630 2.7 2.778 2.939 5.43% FabArray::ParallelCopy() 5320 2.116 2.567 2.889 5.33% MultiFab::AddProduct() 4648 2.613 2.617 2.62 4.84% MLCellLinOp::apply() 2422 2.463 2.496 2.567 4.74% Castro::initialize_do_advance() 30 2.498 2.517 2.531 4.67% FabArray::setVal() 9464 2.311 2.333 2.361 4.36% FillPatchSingleLevel 853 2.236 2.266 2.298 4.24% Amr::init() 1 2.158 2.158 2.158 3.99% MLPoisson::Fapply() 2422 1.86 1.882 1.923 3.55% MLCellLinOp::solutionResidual() 530 1.728 1.745 1.759 3.25% MLCellLinOp::correctionResidual() 1660 1.602 1.627 1.697 3.13% Gravity::multilevel_solve_for_new_phi() 10 1.68 1.68 1.68 3.10% MultiFab::Subtract() 601 1.67 1.675 1.678 3.10% Gravity::actual_multilevel_solve() 10 1.671 1.671 1.671 3.09% Castro::derive() 397 1.64 1.647 1.652 3.05% Amr::initialInit() 1 1.55 1.55 1.55 2.86% MLMG:computeResOfCorrection() 1421 1.468 1.491 1.549 2.86% Castro::do_old_sources() 30 1.489 1.503 1.516 2.80% FabArray::ParallelCopy_nowait() 5320 1.437 1.461 1.495 2.76% FabArray::ParallelCopy_finish() 5320 0.6062 1.091 1.427 2.63% Castro::initialize_advance() 30 1.351 1.37 1.384 2.56% Castro::volWgtSum() 242 1.298 1.344 1.365 2.52% FabArray::FillBoundary() 13093 1.238 1.262 1.315 2.43% Amr::FinalizeInit() 1 1.224 1.227 1.23 2.27% Gravity::fill_multipole_BCs() 41 1.163 1.186 1.216 2.25% Castro::expand_state() 30 1.17 1.181 1.194 2.20% FillPatchTwoLevels 394 1.162 1.179 1.186 2.19% Amr::writePlotFile() 2 1.161 1.161 1.161 2.14% FluxRegister::Reflux() 180 1.138 1.142 1.146 2.12% Gravity::get_new_grav_vector() 52 0.9962 0.9986 1.004 1.85% MLMG::addInterpCorrection() 1421 0.3169 0.8278 1 1.85% Castro::post_init() 2 0.9419 0.9458 0.9502 1.75% MLMG::computeResWithCrseSolFineCor() 78 0.9201 0.9207 0.9211 1.70% MLMG::computeResidual() 333 0.9022 0.9083 0.9131 1.69% MultiFab::sum() 4648 0.8549 0.8566 0.8584 1.59% MLMG::mgVcycle_down::1 333 0.6809 0.7092 0.7794 1.44% MultiFab::Xpay() 2190 0.7141 0.7209 0.7365 1.36% FillBoundary_nowait() 13093 0.6766 0.6925 0.7013 1.30% MLCellLinOp::reflux() 116 0.6518 0.6529 0.6542 1.21% MLMG::mgVcycle_up::2 333 0.2121 0.5358 0.6459 1.19% MLMG::computeMLResidual() 97 0.5858 0.6064 0.6159 1.14% Castro::construct_new_source() 250 0.601 0.606 0.611 1.13% Castro::construct_new_gravity_source() 50 0.6004 0.6054 0.6105 1.13% FillBoundary_finish() 13093 0.5089 0.5374 0.6079 1.12% FillPatchInterp(Fab) 130 0.3714 0.4578 0.5452 1.01% CellConservativeLinear::interp() 130 0.3692 0.4556 0.5434 1.00% Gravity::get_old_grav_vector() 30 0.5312 0.5353 0.5389 1.00% MLMG::mgVcycle_up::1 333 0.4706 0.4873 0.5372 0.99% Castro::normalize_species() 254 0.5068 0.5142 0.5344 0.99% Castro::estTimeStep() 69 0.2262 0.3892 0.4832 0.89% Castro::finalize_advance() 30 0.4157 0.4209 0.4253 0.79% MLPoisson::define() 81 0.3794 0.3856 0.3975 0.73% MLPoisson::FFlux() 1044 0.3889 0.3902 0.3908 0.72% Castro::computeNewDt() 18 0.1311 0.2726 0.3464 0.64% StateDataPhysBCFunct::() 853 0.3356 0.3384 0.3411 0.63% StateData::FillBoundary(geom) 63 0.3276 0.3291 0.3303 0.61% MLMG::prepareForSolve() 80 0.3089 0.3153 0.3295 0.61% Amr::InitializeInit() 1 0.3198 0.3232 0.3265 0.60% Amr::defBaseLevel() 1 0.3198 0.3232 0.3265 0.60% amrex::average_down 1713 0.2925 0.3013 0.3243 0.60% MLMG::mgVcycle_bottom 489 0.161 0.2002 0.3173 0.59% Castro::initData() 3 0.2763 0.2868 0.2948 0.54% Castro::apply_source_to_state() 100 0.2752 0.277 0.2793 0.52% MultiFab::Saxpy() 100 0.2749 0.2767 0.2789 0.52% MLMG::mgVcycle_down::2 333 0.2476 0.2554 0.2765 0.51% MLCellLinOp::defineAuxData() 81 0.2168 0.2236 0.2407 0.44% MLMG::getGradSolution() 80 0.2178 0.22 0.2226 0.41% MLCellLinOp::compGrad() 100 0.2176 0.2197 0.2223 0.41% MultiFab::min() 30 0.007039 0.1189 0.2202 0.41% MLMG::mgVcycle_down::3 211 0.03322 0.0735 0.1922 0.35% VisMF::Write(FabArray) 4 0.1624 0.168 0.1782 0.33% Amr::bldFineLevels() 1 0.1593 0.164 0.168 0.31% MLMG::miniCycle() 156 0.1605 0.1608 0.1609 0.30% Castro::init(old) 9 0.1527 0.1547 0.1563 0.29% MLMG::actualBottomSolve() 333 0.0003863 0.03937 0.1563 0.29% MLCGSolver::bicgstab 83 0 0.03753 0.1501 0.28% MultiFab::Multiply() 164 0.1467 0.1476 0.1491 0.28% MLCellLinOp::defineBC() 81 0.1415 0.1429 0.1439 0.27% MLMG::ResNormInf() 450 0.1359 0.1393 0.1437 0.27% FabArray::mult() 294 0.1378 0.139 0.1399 0.26% Castro::construct_old_source() 150 0.1334 0.1357 0.1382 0.26% Castro::construct_old_gravity_source() 30 0.1331 0.1354 0.1379 0.25% MLMG::mgVcycle_up::3 211 0.02502 0.0533 0.1367 0.25% FabArray::setDomainBndry() 853 0.1289 0.1297 0.1305 0.24% Castro::volProductSum() 22 0.1202 0.1237 0.1262 0.23% BndryData::define() 123 0.1166 0.1176 0.1187 0.22% Gravity::GetCrsePhi() 40 0.09883 0.1037 0.1128 0.21% Amr::grid_places() 11 0.1115 0.1118 0.112 0.21% AmrMesh::MakeNewGrids() 11 0.1109 0.1113 0.1115 0.21% MLMG::computeResWithCrseCorFineCor() 78 0.1033 0.1035 0.1041 0.19% MLCellLinOp::updateSolBC() 99 0.08169 0.09317 0.09846 0.18% Castro::check_for_nan() 60 0.09115 0.09158 0.09208 0.17% MultiFab::contains_nan() 60 0.09094 0.09139 0.09189 0.17% MultiFab::LinComb() 628 0.0718 0.07654 0.08826 0.16% Gravity::create_comp_minus_level_grad_phi() 10 0.08158 0.0845 0.0874 0.16% FabArrayBase::getCPC() 8152 0.06854 0.07374 0.08571 0.16% Gravity::test_level_grad_phi_curr() 20 0.08006 0.08078 0.08147 0.15% MLMG::mgVcycle_down::4 211 0.03199 0.04274 0.07305 0.13% MLCellLinOp::updateCorBC() 78 0.06282 0.06313 0.06359 0.12% MLCellLinOp::setLevelBC() 102 0.05215 0.05944 0.06264 0.12% Castro::errorEst() 11 0.05895 0.06022 0.06128 0.11% Gravity::test_composite_phi() 1 0.06031 0.06035 0.06037 0.11% MLMG::mgVcycle_up::4 211 0.02514 0.0333 0.05631 0.10% Gravity::update_max_rhs() 20 0.04779 0.05173 0.055 0.10% MLMG::buildFineMask() 80 0.04974 0.05001 0.05049 0.09% Gravity::test_level_grad_phi_prev() 30 0.04579 0.04658 0.0471 0.09% MultiFab::norm0(mask) 57 0.04603 0.04625 0.04638 0.09% FabArrayBase::CPC::define() 2260 0.02761 0.03237 0.04352 0.08% MLMG::MLResNormInf() 97 0.04306 0.04322 0.0434 0.08% MultiFab::Copy() 100 0.0392 0.03973 0.04032 0.07% FabArray::setVal(val, thecmd, scomp, ncomp) 3362 0.03646 0.03728 0.03834 0.07% MLMG::interpCorrection_1 78 0.03168 0.03424 0.03623 0.07% MLPoisson::prepareForSolve() 81 0.0246 0.02588 0.02878 0.05% MLCellLinOp::prepareForSolve() 81 0.02425 0.02553 0.02843 0.05% MLMG::MLRhsNormInf() 80 0.02794 0.02819 0.02841 0.05% FabArrayBase::getFB() 13093 0.02367 0.02483 0.02803 0.05% Castro::computeInitialDt() 2 0.01676 0.02002 0.0233 0.04% Gravity::swapTimeLevels() 30 0.02206 0.02277 0.02319 0.04% MLLinOp::define() 81 0.01269 0.01857 0.02283 0.04% MLLinOp::defineGrids() 81 0.0124 0.01827 0.02254 0.04% Castro::apply_tagging_restrictions() 11 0.02082 0.02117 0.02174 0.04% Castro::finalize_do_advance() 30 0.01278 0.01751 0.02105 0.04% MultiFab::max() 40 0.0129 0.01737 0.02065 0.04% CGSolver::sxay() 588 0 0.004895 0.01958 0.04% Castro::build_fine_mask() 153 0.01829 0.01834 0.01841 0.03% AmrLevel::AmrLevel(dm) 12 0.01502 0.01688 0.0179 0.03% StateData::define() 48 0.01478 0.01662 0.01764 0.03% MLMG::compResidual() 1 0.01394 0.0143 0.01493 0.03% Gravity::average_fine_ec_onto_crse_ec() 20 0.01412 0.0145 0.01483 0.03% MLCGSolver::ParallelAllReduce 692 0 0.003578 0.01431 0.03% Castro::swap_state_time_levels() 30 0.01321 0.01348 0.01419 0.03% Castro::avgDown() 11 0.01347 0.01368 0.01389 0.03% Castro::avgDown(state_indx) 44 0.01342 0.01362 0.01384 0.03% amrex::average_down_w_geom 44 0.0133 0.0135 0.01372 0.03% MLLinOp::makeSubCommunicator() 81 0.003095 0.008837 0.01314 0.02% MultiFab::Dot() 463 0 0.00277 0.01108 0.02% TagBoxArray::mapPRD 11 0.006143 0.008254 0.009924 0.02% Castro::apply_problem_tags() 11 0.007507 0.007557 0.007579 0.01% Castro::FluxRegFineAdd() 30 0.007167 0.00729 0.00745 0.01% FabArrayBase::TheFPinfo() 130 0.001052 0.002643 0.005962 0.01% FPinfo::FPinfo() 3 0.0005242 0.002114 0.005427 0.01% DistributionMapping::LeastUsedCPUs() 5 0.0003515 0.002009 0.005363 0.01% DistributionMapping::KnapSackDoIt() 3 0.00042 0.002008 0.005317 0.01% AMRErrorTag::operator() 11 0.004753 0.004987 0.005154 0.01% Castro::enforce_consistent_e() 3 0.003454 0.003721 0.003986 0.01% Amr::InitAmr() 1 0.002673 0.002695 0.002727 0.01% MLLinOp::makeAgglomeratedDMap 81 0.002344 0.002383 0.002426 0.00% FabArrayBase::FB::FB() 131 0.0008649 0.001251 0.002391 0.00% makeSFC 243 0.001556 0.001595 0.001625 0.00% OwnerMask() 11 0.001473 0.001529 0.001601 0.00% TagBoxArray::collate() 11 0.001046 0.001342 0.001535 0.00% DistributionMapping::Distribute() 245 0.0004901 0.0004964 0.0005016 0.00% Castro::enforce_speed_limit() 254 0.0003795 0.0003986 0.0004179 0.00% AmrMesh-cluster 2 0 8.909e-05 0.0003564 0.00% ClusterList::intersect() 2 0 5.957e-05 0.0002383 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 6.954e-05 0.0001451 0.0002318 0.00% FabArray::RecvLayoutMask() 21 0.0001938 0.0001951 0.0001973 0.00% Castro::create_source_corrector() 30 8.304e-05 8.644e-05 9.55e-05 0.00% BoxList::parallelComplementIn() 22 8.067e-05 8.279e-05 8.66e-05 0.00% Amr::writeSmallPlotFile() 1 7.438e-05 7.477e-05 7.519e-05 0.00% Castro::retry_advance_ctu() 30 5.587e-05 6.212e-05 7.388e-05 0.00% knapsack() 3 6.575e-05 6.877e-05 7.152e-05 0.00% Amr::initSubcycle() 1 3.519e-05 4.868e-05 5.959e-05 0.00% Castro::gwstrain() 22 3.787e-05 4.334e-05 5.449e-05 0.00% BoxList::complementIn 22 3.964e-05 4.083e-05 4.303e-05 0.00% Gravity::set_mass_offset() 11 2.936e-05 3.529e-05 4.136e-05 0.00% ClusterList::chop() 2 0 4.991e-06 1.997e-05 0.00% knapsack()swap 2 4.878e-06 5.119e-06 5.487e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.03-16-gdfb0e098df46) finalized