MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (23.10-8-gfd2dfa282a30) initialized Starting run at 23:43:42 UTC on 2023-10-07. Successfully read inputs file ... Castro git describe: 23.10-18-gcdf58146c AMReX git describe: 23.10-8-gfd2dfa282 Microphysics git describe: 23.10-6-g657406dc reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Generated initial model for primary WD of mass 0.9 solar masses, central density 1.575e+07 g cm**-3, and radius 6.500e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.575e+07 g cm**-3, and radius 6.500e+08 cm. Generated binary orbit of distance 1.715e+09 cm = 1.147e-04 AU. The primary orbits the center of mass at distance -8.577e+08 cm = -5.733e-05 AU. The secondary orbits the center of mass at distance 8.577e+08 cm = 5.733e-05 AU. The initial orbital period is 28.882680 s. The initial orbital speed of the primary is -1.866e+08 cm/s. The initial orbital speed of the secondary is 1.866e+08 cm/s. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0344533514 ...hydro-limited CFL timestep constrained at (i,j) = (0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0344533514 Gravity::fill_multipole_BCs() time = 0.0006284290002 Gravity::multilevel_solve_for_new_phi() time = 0.087762321 Gravity::fill_multipole_BCs() time = 0.0007090300001 ... norm of composite residual at level 0 3.293007612e-11 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_2D_plt00000 Write plotfile time = 0.213828822 seconds ...estimated hydro-limited timestep at level 0: 0.0344533514 ...hydro-limited CFL timestep constrained at (i,j) = (0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0344533514 [Level 0 step 1] ADVANCE at time 0 with dt = 0.00344533514  Beginning subcycle 1 starting at time 0 with dt = 0.00344533514 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.012711979 on level 0 Castro::do_old_sources() time = 0.063221197 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.312936554 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.004082526 Gravity::solve_for_phi() time = 0.048152545 on level 0 Castro::construct_new_gravity() time = 0.050185607 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.852148875e+44 ener added: 8.050390976e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.157886458e+34 ymom added: 1.429966106e+28 zmom added: -8.13876632e+24 eint added: 0 ener added: -3.942800221e+44 Castro::do_new_sources() time = 0.069500522 on level 0 ...estimated hydro-limited timestep at level 0: 0.03440067896 ...hydro-limited CFL timestep constrained at (i,j) = (17,149) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03440067896  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04513534917 [Level 0 step 1] Advanced 32768 cells [STEP 1] Coarse TimeStep time: 0.78361183 [STEP 1] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 1 TIME = 0.00344533514 DT = 0.00344533514 ...estimated hydro-limited timestep at level 0: 0.03440067896 ...hydro-limited CFL timestep constrained at (i,j) = (17,149) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03440067896 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03440067896 ... but limiting to: 0.003789868654 = 1.1 * 0.00344533514 [Level 0 step 2] ADVANCE at time 0.00344533514 with dt = 0.003789868654  Beginning subcycle 1 starting at time 0.00344533514 with dt = 0.003789868654 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.012294319 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.666093945e+45 ener added: 9.294078544e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: -6.226333198e+39 ymom added: 3.388871247e+28 zmom added: -3.668134021e+25 eint added: 0 ener added: -1.521028076e+44 Castro::do_old_sources() time = 0.062535962 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323807882 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003514528 Gravity::solve_for_phi() time = 0.044332231 on level 0 Castro::construct_new_gravity() time = 0.046363813 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.227312158e+44 ener added: 8.777739313e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.553575082e+34 ymom added: 6.483902449e+27 zmom added: -3.130740648e+25 eint added: 0 ener added: -4.324693583e+44 Castro::do_new_sources() time = 0.067995507 on level 0 ...estimated hydro-limited timestep at level 0: 0.0343514185 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0343514185  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04481621705 [Level 0 step 2] Advanced 32768 cells [STEP 2] Coarse TimeStep time: 0.788087568 [STEP 2] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 2 TIME = 0.007235203794 DT = 0.003789868654 ...estimated hydro-limited timestep at level 0: 0.0343514185 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0343514185 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0343514185 ... but limiting to: 0.00416885552 = 1.1 * 0.003789868654 [Level 0 step 3] ADVANCE at time 0.007235203794 with dt = 0.00416885552  Beginning subcycle 1 starting at time 0.007235203794 with dt = 0.00416885552 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.017010929 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.048591568e+46 ener added: 2.347571222e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: -6.848932339e+39 ymom added: 5.154090421e+28 zmom added: -1.277949662e+26 eint added: 0 ener added: -3.506923787e+44 Castro::do_old_sources() time = 0.066880854 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.110554074e+46 ener added: 2.17510801e+38 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.331323935 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.004866734 Gravity::solve_for_phi() time = 0.049191661 on level 0 Castro::construct_new_gravity() time = 0.051231381 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.641969209e+44 ener added: 9.499339919e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.082832923e+34 ymom added: 8.983383528e+27 zmom added: -5.209024493e+25 eint added: 0 ener added: -4.746713298e+44 Castro::do_new_sources() time = 0.069345863 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 0 ener added: 2.111150263e+24 ...estimated hydro-limited timestep at level 0: 0.03429296936 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03429296936  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04404253268 [Level 0 step 3] Advanced 32768 cells [STEP 3] Coarse TimeStep time: 0.801317329 [STEP 3] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 3 TIME = 0.01140405931 DT = 0.00416885552 ...estimated hydro-limited timestep at level 0: 0.03429296936 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03429296936 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03429296936 ... but limiting to: 0.004585741072 = 1.1 * 0.00416885552 [Level 0 step 4] ADVANCE at time 0.01140405931 with dt = 0.004585741072  Beginning subcycle 1 starting at time 0.01140405931 with dt = 0.004585741072 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.033131654 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.268786308e+46 ener added: 4.457088243e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: -7.53377975e+39 ymom added: 7.645882514e+28 zmom added: -2.794359981e+26 eint added: 0 ener added: -6.067356848e+44 Castro::do_old_sources() time = 0.086970871 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.336095577e+46 ener added: 2.596627722e+40 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.35462013 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.004693416 Gravity::solve_for_phi() time = 0.049261864 on level 0 Castro::construct_new_gravity() time = 0.051861196 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.096959775e+44 ener added: 1.054047766e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.789939969e+34 ymom added: 1.236327224e+28 zmom added: -8.252293635e+25 eint added: 0 ener added: -5.212479354e+44 Castro::do_new_sources() time = 0.068597979 on level 0 ...estimated hydro-limited timestep at level 0: 0.03422891488 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03422891488  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04260055593 [Level 0 step 4] Advanced 32768 cells [STEP 4] Coarse TimeStep time: 0.82600633 [STEP 4] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 4 TIME = 0.01598980039 DT = 0.004585741072 ...estimated hydro-limited timestep at level 0: 0.03422891488 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03422891488 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03422891488 ... but limiting to: 0.005044315179 = 1.1 * 0.004585741072 [Level 0 step 5] ADVANCE at time 0.01598980039 with dt = 0.005044315179  Beginning subcycle 1 starting at time 0.01598980039 with dt = 0.005044315179 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006823496 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.53521568e+46 ener added: 1.293094119e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -8.287096347e+39 ymom added: 1.113044921e+29 zmom added: -5.228726818e+26 eint added: 0 ener added: -9.335355878e+44 Castro::do_old_sources() time = 0.060710966 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.608397137e+46 ener added: 7.283718243e+40 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32381297 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003075554 Gravity::solve_for_phi() time = 0.044243849 on level 0 Castro::construct_new_gravity() time = 0.046339472 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.592425705e+44 ener added: 1.219671963e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.733345694e+34 ymom added: 1.689554509e+28 zmom added: -1.266060119e+26 eint added: 0 ener added: -5.72502294e+44 Castro::do_new_sources() time = 0.066270535 on level 0 ...estimated hydro-limited timestep at level 0: 0.03415874475 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03415874475  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04534432599 [Level 0 step 5] Advanced 32768 cells [STEP 5] Coarse TimeStep time: 0.779416462 [STEP 5] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 5 TIME = 0.02103411556 DT = 0.005044315179 ...estimated hydro-limited timestep at level 0: 0.03415874475 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03415874475 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03415874475 ... but limiting to: 0.005548746697 = 1.1 * 0.005044315179 [Level 0 step 6] ADVANCE at time 0.02103411556 with dt = 0.005548746697  Beginning subcycle 1 starting at time 0.02103411556 with dt = 0.005548746697 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006450626 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.857585003e+46 ener added: 3.811488294e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -9.115723848e+39 ymom added: 1.596025284e+29 zmom added: -9.023261388e+26 eint added: 0 ener added: -1.347191781e+45 Castro::do_old_sources() time = 0.061040323 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.937277365e+46 ener added: 1.303300777e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.3231755 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003630814 Gravity::solve_for_phi() time = 0.045299909 on level 0 Castro::construct_new_gravity() time = 0.047405291 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.130173254e+44 ener added: 1.506511957e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.99124405e+34 ymom added: 2.302288289e+28 zmom added: -1.874307185e+26 eint added: 0 ener added: -6.291986952e+44 Castro::do_new_sources() time = 0.066751259 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.165519023e+27 ener added: 3.165519023e+27 ...estimated hydro-limited timestep at level 0: 0.03408190801 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03408190801  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04528638435 [Level 0 step 6] Advanced 32768 cells [STEP 6] Coarse TimeStep time: 0.780060437 [STEP 6] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 6 TIME = 0.02658286226 DT = 0.005548746697 ...estimated hydro-limited timestep at level 0: 0.03408190801 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03408190801 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03408190801 ... but limiting to: 0.006103621366 = 1.1 * 0.005548746697 [Level 0 step 7] ADVANCE at time 0.02658286226 with dt = 0.006103621366  Beginning subcycle 1 starting at time 0.02658286226 with dt = 0.006103621366 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006149362 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.247634481e+46 ener added: 1.094166189e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.002718642e+40 ymom added: 2.262137649e+29 zmom added: -1.475528412e+27 eint added: 0 ener added: -1.867160846e+45 Castro::do_old_sources() time = 0.060939837 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.334614234e+46 ener added: 2.008932648e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322510759 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.00301849 Gravity::solve_for_phi() time = 0.044461668 on level 0 Castro::construct_new_gravity() time = 0.046561119 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.715223113e+44 ener added: 1.935602462e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.665998014e+34 ymom added: 3.127600824e+28 zmom added: -2.693092458e+26 eint added: 0 ener added: -6.920498702e+44 Castro::do_new_sources() time = 0.067584547 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.058874161e+26 ener added: 2.058874161e+26 ...estimated hydro-limited timestep at level 0: 0.03399781106 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03399781106  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04530371016 [Level 0 step 7] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.029437081e+26 ener added: 1.029437081e+26 [STEP 7] Coarse TimeStep time: 0.780193367 [STEP 7] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 7 TIME = 0.03268648363 DT = 0.006103621366 ...estimated hydro-limited timestep at level 0: 0.03399781106 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03399781106 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03399781106 ... but limiting to: 0.006713983503 = 1.1 * 0.006103621366 [Level 0 step 8] ADVANCE at time 0.03268648363 with dt = 0.006713983503  Beginning subcycle 1 starting at time 0.03268648363 with dt = 0.006713983503 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006119054 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.719569143e+46 ener added: 2.45689612e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.102975842e+40 ymom added: 3.176430966e+29 zmom added: -2.318592665e+27 eint added: 0 ener added: -2.516944216e+45 Castro::do_old_sources() time = 0.061258076 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.814522155e+46 ener added: 2.871196082e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323129283 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003391029 Gravity::solve_for_phi() time = 0.053380959 on level 0 Castro::construct_new_gravity() time = 0.055415164 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.351792065e+44 ener added: 2.601920222e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.894281165e+34 ymom added: -1.563133231e+29 zmom added: -3.639419508e+26 eint added: 0 ener added: -7.624284882e+44 Castro::do_new_sources() time = 0.067261796 on level 0 ...estimated hydro-limited timestep at level 0: 0.03390581579 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03390581579  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04473943117 [Level 0 step 8] Advanced 32768 cells [STEP 8] Coarse TimeStep time: 0.78929997 [STEP 8] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 8 TIME = 0.03940046713 DT = 0.006713983503 ...estimated hydro-limited timestep at level 0: 0.03390581579 ...hydro-limited CFL timestep constrained at (i,j) = (127,255) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03390581579 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03390581579 ... but limiting to: 0.007385381853 = 1.1 * 0.006713983503 [Level 0 step 9] ADVANCE at time 0.03940046713 with dt = 0.007385381853  Beginning subcycle 1 starting at time 0.03940046713 with dt = 0.007385381853 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006775571 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.290572928e+46 ener added: 4.770064425e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.213253858e+40 ymom added: 5.518226906e+27 zmom added: -2.862243347e+27 eint added: 0 ener added: -3.324896951e+45 Castro::do_old_sources() time = 0.06230428 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.394702646e+46 ener added: 3.891308434e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32302585 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003291355 Gravity::solve_for_phi() time = 0.053280274 on level 0 Castro::construct_new_gravity() time = 0.055317398 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.114210031e+44 ener added: 3.042837982e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.18570484e+35 ymom added: -6.775289868e+27 zmom added: 2.542056282e+26 eint added: 0 ener added: -8.431483071e+44 Castro::do_new_sources() time = 0.067246254 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.313500604e+28 ener added: 3.313505316e+28 ...estimated hydro-limited timestep at level 0: 0.03375018831 ...hydro-limited CFL timestep constrained at (i,j) = (15,138) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03375018831  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04468205287 [Level 0 step 9] Advanced 32768 cells [STEP 9] Coarse TimeStep time: 0.790133083 [STEP 9] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 9 TIME = 0.04678584898 DT = 0.007385381853 ...estimated hydro-limited timestep at level 0: 0.03375018831 ...hydro-limited CFL timestep constrained at (i,j) = (15,138) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03375018831 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03375018831 ... but limiting to: 0.008123920038 = 1.1 * 0.007385381853 [Level 0 step 10] ADVANCE at time 0.04678584898 with dt = 0.008123920038  Beginning subcycle 1 starting at time 0.04678584898 with dt = 0.008123920038 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006092805 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.98143902e+46 ener added: 7.826666605e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.334553158e+40 ymom added: -8.835679325e+27 zmom added: -2.577644282e+27 eint added: 0 ener added: -4.325255969e+45 Castro::do_old_sources() time = 0.061504909 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.096148619e+46 ener added: 5.266798738e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.323334419 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003541413 Gravity::solve_for_phi() time = 0.05338718 on level 0 Castro::construct_new_gravity() time = 0.055420382 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.013551184e+44 ener added: 3.618905702e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.579888711e+35 ymom added: -9.499450099e+27 zmom added: 6.451957828e+26 eint added: 0 ener added: -9.389442901e+44 Castro::do_new_sources() time = 0.06740341 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.492683767e+27 ener added: 1.492683767e+27 ...estimated hydro-limited timestep at level 0: 0.03354343915 ...hydro-limited CFL timestep constrained at (i,j) = (15,138) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03354343915  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04469152954 [Level 0 step 10] Advanced 32768 cells [STEP 10] Coarse TimeStep time: 0.790026485 [STEP 10] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 10 TIME = 0.05490976902 DT = 0.008123920038 PLOTFILE: file = wdmerger_2D_plt00010 Write plotfile time = 0.174295204 seconds Ending run at 23:43:53 UTC on 2023-10-07. Run time = 11.45693883 Run time without initialization = 8.083757743 Average number of zones advanced per microsecond: 0.041 Average number of zones advanced per microsecond per rank: 0.003 TinyProfiler total time across processes [min...avg...max]: 11.46 ... 11.46 ... 11.46 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.6033 2.6509 2.7073 23.63% Amr::InitAmr() 1 2.051 2.053 2.053 17.92% Castro::computeTemp() 83 0.8208 0.8803 0.9096 7.94% Castro::initMFs() 1 0.8244 0.8419 0.866 7.56% amrex::Copy() 1029 0.7707 0.786 0.8001 6.98% Castro::normalize_species() 82 0.5918 0.6021 0.6165 5.38% MultiFab::AddProduct() 3440 0.5658 0.5763 0.5871 5.12% Castro::reset_internal_energy(Fab) 166 0.496 0.5066 0.5169 4.51% MultiFab::Subtract() 165 0.3641 0.3709 0.3776 3.30% FabArray::setVal() 4349 0.3145 0.3212 0.3274 2.86% Castro::estTimeStep() 21 0.1896 0.2323 0.2861 2.50% FabArray::ParallelCopy_finish() 753 0.01133 0.1795 0.2573 2.25% FabArray::sum() 3440 0.1817 0.1853 0.1887 1.65% MLPoisson::Fsmooth() 2496 0.129 0.141 0.1725 1.51% check_for_negative_density() 10 0.01756 0.08885 0.1385 1.21% AmrLevel::derive() 112 0.1262 0.1286 0.1314 1.15% Castro::reset_internal_energy(MultiFab) 83 0.02284 0.05261 0.1276 1.11% Castro::enforce_min_density() 82 0.01774 0.03509 0.07468 0.65% FabArray::ParallelCopy_nowait() 753 0.05666 0.06301 0.0678 0.59% FabArray::Saxpy() 120 0.06239 0.06349 0.06583 0.57% Amr::writePlotFile() 2 0.04391 0.06069 0.06547 0.57% Castro::construct_new_rotation_source() 10 0.05755 0.05886 0.06133 0.54% MLPoisson::Fapply() 407 0.03954 0.04189 0.04863 0.42% Castro::wd_update() 11 0.02388 0.03591 0.04669 0.41% MLCellLinOp::applyBC() 2914 0.02118 0.02597 0.04516 0.39% FillBoundary_nowait() 2602 0.02591 0.03578 0.04233 0.37% Castro::construct_new_gravity_source() 10 0.04018 0.04105 0.04187 0.37% FillBoundary_finish() 2602 0.02337 0.02998 0.04 0.35% Gravity::fill_multipole_BCs() 12 0.0064 0.02209 0.0371 0.32% VisMF::Write(FabArray) 2 0.01757 0.01929 0.03568 0.31% Castro::do_new_sources() 10 0.0002137 0.003245 0.02768 0.24% Castro::volInBoundary() 77 0.01869 0.01988 0.02719 0.24% FabArray::Xpay() 391 0.0216 0.02276 0.02613 0.23% MultiFab::contains_nan() 20 0.02369 0.02427 0.0253 0.22% Castro::construct_old_gravity() 10 0.0001898 0.003477 0.02394 0.21% Castro::construct_old_gravity_source() 10 0.02235 0.02286 0.02372 0.21% Castro::construct_old_rotation_source() 10 0.02239 0.0228 0.02327 0.20% MLMG::addInterpCorrection() 312 0.01359 0.01469 0.01766 0.15% Castro::evaluate_source_change() 185 0.01279 0.01331 0.01376 0.12% amrex::average_down 312 0.01016 0.0111 0.01369 0.12% StateData::FillBoundary(geom) 66 0.004785 0.006967 0.01287 0.11% Castro::construct_new_source() 60 0.01084 0.01103 0.01169 0.10% MLMG::ResNormInf() 63 0.002588 0.008113 0.01128 0.10% MLCellLinOp::defineAuxData() 12 0.009323 0.009868 0.01112 0.10% FillPatchIterator::Initialize 233 0.009532 0.00977 0.009956 0.09% MLCGSolver::bicgstab 3 0 0.0005566 0.008905 0.08% Castro::do_old_sources() 10 0.0002621 0.001877 0.008593 0.08% FabArray::FillBoundary() 2602 0.005776 0.00608 0.007403 0.06% FabArray::norminf() 106 0.004989 0.005653 0.006972 0.06% MLMG::prepareForSolve() 11 0.006375 0.006605 0.006957 0.06% Castro::construct_old_source() 60 0.006058 0.006198 0.006489 0.06% MultiFab::max() 11 0.001442 0.004264 0.006058 0.05% amrex::Add() 55 0.00571 0.005829 0.006054 0.05% MLMG::solve() 11 0.001497 0.003572 0.005633 0.05% MLCellLinOp::smooth() 1248 0.004656 0.004921 0.005586 0.05% FabArrayBase::getFB() 2602 0.004273 0.00447 0.005562 0.05% FabArray::mult() 44 0.004832 0.004951 0.0055 0.05% Castro::initData() 1 0.003341 0.003769 0.005415 0.05% FabArray::setDomainBndry() 233 0.002255 0.003008 0.005162 0.05% Gravity::actual_solve_with_mlmg() 12 0.0043 0.004507 0.005073 0.04% FabArrayBase::CPC::define() 365 0.001588 0.002274 0.004217 0.04% MLCellLinOp::compGrad() 11 0.003617 0.003691 0.004173 0.04% FabArrayBase::getCPC() 957 0.003675 0.003774 0.004019 0.04% Gravity::get_new_grav_vector() 11 0.00365 0.003729 0.00387 0.03% Gravity::applyMetricTerms() 11 0.002588 0.002699 0.00348 0.03% Gravity::get_old_grav_vector() 10 0.003193 0.003255 0.003321 0.03% AmrLevel::FillPatch() 233 0.002526 0.00263 0.002966 0.03% amrex::Dot() 57 0 0.0001558 0.002493 0.02% DistributionMapping::LeastUsedCPUs() 1 2.202e-05 0.0008278 0.002375 0.02% BndryData::define() 12 0.001983 0.002053 0.002256 0.02% MLCellLinOp::apply() 407 0.0008679 0.0009828 0.002185 0.02% FabArray::ParallelCopy() 753 0.001877 0.001963 0.00213 0.02% Castro::initialize_do_advance() 10 0.002019 0.002065 0.002128 0.02% MLCGSolver::ParallelAllReduce 75 0 0.0001189 0.001902 0.02% FabArray::LinComb() 28 0 9.523e-05 0.001524 0.01% MLCellLinOp::prepareForSolve() 12 0.001113 0.001184 0.00141 0.01% Gravity::solve_for_phi() 10 0.0004541 0.0006881 0.001396 0.01% MLLinOp::defineGrids() 12 0.001213 0.001288 0.001342 0.01% MLPoisson::normalize() 31 0 8.27e-05 0.001323 0.01% MLLinOp::makeSubCommunicator() 12 0.0002484 0.001043 0.001188 0.01% Castro::construct_new_gravity() 10 0.0001631 0.0004548 0.001144 0.01% MLCellLinOp::defineBC() 12 0.0009914 0.001035 0.001124 0.01% Gravity::update_max_rhs() 11 0.0009428 0.0009723 0.001097 0.01% StateData::define() 5 0.0008544 0.000986 0.001087 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 384 0.0008174 0.0009697 0.001082 0.01% Castro::initialize_advance() 10 0.0009696 0.001 0.001074 0.01% MLCellLinOp::correctionResidual() 315 0.000773 0.0008175 0.001001 0.01% FillPatchIterator::FillFromLevel0() 233 0.0008724 0.0009136 0.0009899 0.01% FabArrayBase::FB::FB() 46 0.0002093 0.0004821 0.0009572 0.01% Amr::coarseTimeStep() 10 0.0007978 0.0008761 0.0009406 0.01% main() 1 0.0007439 0.0008556 0.0009234 0.01% StateDataPhysBCFunct::() 233 0.0007619 0.0007946 0.0008532 0.01% Castro::buildMetrics() 1 0.0005483 0.0006355 0.000786 0.01% MLMG::mgVcycle() 52 0.0006677 0.0007014 0.0007679 0.01% FillPatchSingleLevel 233 0.0006496 0.0006785 0.0007209 0.01% MLMG:computeResOfCorrection() 312 0.0005719 0.0005998 0.0006489 0.01% MLCellLinOp::setLevelBC() 12 0.0003962 0.0004318 0.0005459 0.00% Castro::Castro() 1 0.0004365 0.0004545 0.0004966 0.00% MLMG::actualBottomSolve() 52 5.629e-05 8.465e-05 0.0004868 0.00% Castro::subcycle_advance_ctu() 10 6.564e-05 9.687e-05 0.0004857 0.00% Castro::clean_state() 82 0.0004111 0.0004351 0.0004769 0.00% Castro::swap_state_time_levels() 10 0.0004051 0.0004162 0.0004261 0.00% Castro::finalize_advance() 10 0.0002062 0.0002283 0.0004029 0.00% Castro::enforce_consistent_e() 1 0.0003671 0.0003763 0.0003842 0.00% MLMG::mgVcycle_down::2 52 0.0002623 0.0002901 0.0003288 0.00% MLMG::mgVcycle_down::1 52 0.0002791 0.0002869 0.0003131 0.00% MLMG::mgVcycle_down::0 52 0.0002795 0.0002887 0.000313 0.00% MLMG::mgVcycle_down::4 52 0.0002398 0.0002549 0.0003071 0.00% MLMG::mgVcycle_down::3 52 0.0002446 0.0002654 0.0003055 0.00% makeSFC 60 0.0002757 0.0002909 0.0003001 0.00% Castro::do_advance_ctu() 10 0.0002542 0.0002682 0.0002969 0.00% MLMG::mgVcycle_down::5 52 0.0002489 0.0002609 0.0002964 0.00% Castro::derive() 112 0.0002439 0.0002517 0.0002666 0.00% MLLinOp::makeAgglomeratedDMap 12 0.0002161 0.0002215 0.0002309 0.00% MLMG::mgVcycle_up::0 52 0.0001937 0.0002003 0.0002239 0.00% MLMG::mgVcycle_up::1 52 0.0001892 0.0002005 0.0002221 0.00% MLMG::mgVcycle_up::2 52 0.0001677 0.0001848 0.0002121 0.00% MLCellLinOp::solutionResidual() 64 0.000193 0.0001986 0.0002058 0.00% MLMG::mgVcycle_up::5 52 0.0001735 0.0001806 0.0002057 0.00% Castro::computeNewDt() 9 2.923e-05 4.302e-05 0.0001995 0.00% MLMG::mgVcycle_up::3 52 0.0001668 0.000175 0.0001962 0.00% MLMG::mgVcycle_up::4 52 0.0001678 0.000175 0.0001943 0.00% Amr::timeStep() 10 0.0001066 0.0001184 0.0001859 0.00% MLMG::oneIter() 52 0.0001637 0.0001681 0.0001833 0.00% Gravity::solve_phi_with_mlmg() 12 0.0001437 0.0001537 0.0001714 0.00% DistributionMapping::Distribute() 61 0.0001465 0.0001543 0.0001684 0.00% MLMG::compResidual() 1 0.0001563 0.0001603 0.0001667 0.00% Castro::finalize_do_advance() 10 9.63e-05 0.0001061 0.0001545 0.00% Amr::writeSmallPlotFile() 1 8.871e-05 9.897e-05 0.000133 0.00% Gravity::test_composite_phi() 1 9.455e-05 0.000101 0.0001317 0.00% Castro::advance() 10 6.848e-05 7.429e-05 0.0001297 0.00% Amr::defBaseLevel() 1 7.863e-05 9.786e-05 0.0001292 0.00% Castro::enforce_speed_limit() 82 0.000109 0.000115 0.0001275 0.00% MLMG::computeResidual() 52 9.872e-05 0.0001025 0.0001069 0.00% MLMG::mgVcycle_bottom 52 9.213e-05 9.634e-05 0.0001055 0.00% MLPoisson::define() 12 8.247e-05 9.219e-05 9.91e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 6.082e-05 7.04e-05 9.386e-05 0.00% Castro::check_for_nan() 20 5.075e-05 5.671e-05 7.135e-05 0.00% Castro::problem_post_timestep() 11 5.245e-05 5.842e-05 6.619e-05 0.00% Amr::initSubcycle() 1 4.453e-05 5.08e-05 6.26e-05 0.00% Castro::react_state() 20 5.444e-05 5.798e-05 6.187e-05 0.00% Castro::apply_source_to_state() 20 4.85e-05 5.099e-05 5.68e-05 0.00% MLLinOp::define() 12 4.79e-05 5.01e-05 5.583e-05 0.00% Castro::post_timestep() 10 4.273e-05 4.561e-05 5.273e-05 0.00% Amr::FinalizeInit() 1 8.133e-06 1.172e-05 5.194e-05 0.00% MLPoisson::prepareForSolve() 12 4.394e-05 4.676e-05 5.096e-05 0.00% Castro::create_source_corrector() 10 2.321e-05 2.641e-05 4.703e-05 0.00% Gravity::swapTimeLevels() 10 3.777e-05 3.996e-05 4.279e-05 0.00% Castro::retry_advance_ctu() 10 2.011e-05 2.309e-05 3.94e-05 0.00% AmrLevel::AmrLevel(dm) 1 2.878e-05 3.198e-05 3.614e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 2.964e-05 3.159e-05 3.527e-05 0.00% MLMG::computeMLResidual() 11 2.728e-05 2.993e-05 3.491e-05 0.00% Castro::expand_state() 10 2.64e-05 2.938e-05 3.31e-05 0.00% Castro::FluxRegCrseInit 10 1.463e-05 1.663e-05 3.189e-05 0.00% MLMG::getGradSolution() 11 2.476e-05 2.64e-05 2.991e-05 0.00% Gravity::set_mass_offset() 11 2.469e-05 2.64e-05 2.955e-05 0.00% Gravity::actual_multilevel_solve() 1 2.733e-05 2.811e-05 2.953e-05 0.00% Castro::FluxRegFineAdd() 10 1.093e-05 1.268e-05 2.814e-05 0.00% MLMG::MLRhsNormInf() 11 1.925e-05 2.048e-05 2.515e-05 0.00% MLMG::MLResNormInf() 11 2.02e-05 2.087e-05 2.161e-05 0.00% Castro::post_init() 1 1.133e-05 1.224e-05 1.599e-05 0.00% Castro::post_regrid() 1 9.527e-06 1.073e-05 1.581e-05 0.00% Castro::computeInitialDt() 2 8.562e-06 9.555e-06 1.38e-05 0.00% Amr::InitializeInit() 1 5.739e-06 6.919e-06 1.072e-05 0.00% Amr::initialInit() 1 3.093e-06 3.715e-06 8.674e-06 0.00% Amr::init() 1 4.774e-06 5.441e-06 6.092e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 11.46 11.46 11.46 100.00% Amr::coarseTimeStep() 10 8.083 8.083 8.083 70.55% Amr::timeStep() 10 7.82 7.82 7.82 68.26% Castro::advance() 10 7.339 7.339 7.339 64.06% Castro::subcycle_advance_ctu() 10 6.815 6.842 6.861 59.88% Castro::do_advance_ctu() 10 6.814 6.842 6.861 59.88% Castro::clean_state() 82 3.773 3.873 3.974 34.69% Castro::construct_ctu_hydro_source() 10 3.202 3.22 3.252 28.38% Castro::computeTemp() 83 2.38 2.448 2.511 21.92% Amr::InitAmr() 1 2.051 2.053 2.054 17.92% Castro::reset_internal_energy(MultiFab) 83 1.509 1.567 1.615 14.10% Amr::init() 1 1.319 1.32 1.322 11.53% Amr::initialInit() 1 1.105 1.106 1.107 9.67% Castro::evaluate_source_change() 185 0.9586 0.9768 0.9949 8.68% Amr::InitializeInit() 1 0.9053 0.934 0.9515 8.30% Amr::defBaseLevel() 1 0.9053 0.934 0.9515 8.30% Castro::enforce_min_density() 82 0.8258 0.8581 0.8964 7.82% Castro::Castro() 1 0.8284 0.8459 0.8699 7.59% Castro::initMFs() 1 0.8245 0.842 0.8661 7.56% amrex::Copy() 1029 0.7707 0.786 0.8001 6.98% Castro::initialize_do_advance() 10 0.6412 0.6594 0.6936 6.05% Castro::do_new_sources() 10 0.6339 0.6597 0.6778 5.92% Castro::do_old_sources() 10 0.6047 0.6134 0.642 5.60% Castro::normalize_species() 82 0.5918 0.6021 0.6165 5.38% MultiFab::AddProduct() 3440 0.5658 0.5763 0.5871 5.12% Gravity::solve_phi_with_mlmg() 12 0.5437 0.5598 0.5747 5.02% Gravity::actual_solve_with_mlmg() 12 0.5347 0.5355 0.5365 4.68% Castro::initialize_advance() 10 0.4754 0.4943 0.5213 4.55% Castro::reset_internal_energy(Fab) 166 0.496 0.5066 0.5169 4.51% Castro::construct_new_gravity() 10 0.4766 0.4918 0.5061 4.42% MLMG::solve() 11 0.5022 0.5047 0.5057 4.41% Gravity::solve_for_phi() 10 0.4552 0.4703 0.4851 4.23% Castro::post_timestep() 10 0.4807 0.4813 0.4814 4.20% MLMG::oneIter() 52 0.4335 0.4356 0.4389 3.83% MLMG::mgVcycle() 52 0.4275 0.4296 0.4329 3.78% AmrLevel::FillPatch() 233 0.2889 0.3428 0.4094 3.57% FabArray::ParallelCopy() 753 0.1504 0.3159 0.3907 3.41% Amr::writePlotFile() 2 0.3885 0.3885 0.3885 3.39% MultiFab::Subtract() 165 0.3641 0.3709 0.3776 3.30% FabArray::setVal() 4349 0.3145 0.3212 0.3274 2.86% Castro::derive() 112 0.2841 0.287 0.2902 2.53% AmrLevel::derive() 112 0.2838 0.2867 0.2899 2.53% FillPatchIterator::Initialize 233 0.1645 0.2199 0.2887 2.52% Castro::estTimeStep() 21 0.1896 0.2323 0.2861 2.50% MLCellLinOp::smooth() 1248 0.2076 0.2273 0.2781 2.43% FillPatchIterator::FillFromLevel0() 233 0.1494 0.2071 0.2768 2.42% FillPatchSingleLevel 233 0.1485 0.2062 0.2759 2.41% FabArray::ParallelCopy_finish() 753 0.01133 0.1795 0.2573 2.25% Amr::FinalizeInit() 1 0.1541 0.1718 0.2007 1.75% FabArray::sum() 3440 0.1817 0.1853 0.1887 1.65% MLPoisson::Fsmooth() 2496 0.129 0.141 0.1725 1.51% MLMG::mgVcycle_up::1 52 0.03283 0.1015 0.1707 1.49% Castro::construct_new_source() 60 0.1553 0.1583 0.1613 1.41% MLMG::addInterpCorrection() 312 0.02543 0.1277 0.1559 1.36% Castro::finalize_do_advance() 10 0.09277 0.1177 0.1426 1.24% FabArray::ParallelCopy_nowait() 753 0.1292 0.1345 0.1403 1.22% check_for_negative_density() 10 0.01756 0.08885 0.1385 1.21% MLCellLinOp::applyBC() 2914 0.08907 0.1028 0.1279 1.12% MLMG::mgVcycle_up::2 52 0.004523 0.04883 0.1175 1.03% Castro::expand_state() 10 0.08352 0.09665 0.1173 1.02% MLMG::mgVcycle_down::0 52 0.102 0.1029 0.1041 0.91% Castro::initData() 1 0.07408 0.08612 0.1037 0.91% Castro::post_init() 1 0.0999 0.1015 0.103 0.90% Castro::construct_old_gravity() 10 0.02084 0.05282 0.09846 0.86% Gravity::get_old_grav_vector() 10 0.01952 0.04935 0.09822 0.86% FabArray::FillBoundary() 2602 0.06462 0.07679 0.09346 0.82% Gravity::multilevel_solve_for_new_phi() 1 0.08771 0.08774 0.08778 0.77% Gravity::actual_multilevel_solve() 1 0.08764 0.08767 0.08771 0.77% MLMG::mgVcycle_up::3 52 0.004515 0.01022 0.07939 0.69% Castro::computeNewDt() 9 0.07886 0.0789 0.07909 0.69% MLMG::mgVcycle_up::0 52 0.07326 0.07484 0.07866 0.69% MLCellLinOp::apply() 407 0.0584 0.06334 0.07764 0.68% Castro::construct_old_source() 60 0.07423 0.07571 0.07706 0.67% FabArray::Saxpy() 120 0.06239 0.06349 0.06583 0.57% Castro::problem_post_timestep() 11 0.05099 0.05586 0.0655 0.57% Castro::wd_update() 11 0.05092 0.0558 0.06544 0.57% Castro::computeInitialDt() 2 0.01813 0.03585 0.06476 0.57% Castro::construct_new_rotation_source() 10 0.05755 0.05886 0.06133 0.54% MLCellLinOp::correctionResidual() 315 0.04283 0.04671 0.05778 0.50% MLMG:computeResOfCorrection() 312 0.0434 0.0472 0.05661 0.49% MLPoisson::Fapply() 407 0.03954 0.04189 0.04863 0.42% FillBoundary_nowait() 2602 0.03042 0.04073 0.04744 0.41% MLMG::mgVcycle_down::1 52 0.04159 0.04281 0.04481 0.39% Castro::post_regrid() 1 0.04167 0.04322 0.04479 0.39% MLCellLinOp::solutionResidual() 64 0.03671 0.03976 0.04222 0.37% Castro::construct_new_gravity_source() 10 0.04018 0.04105 0.04187 0.37% FillBoundary_finish() 2602 0.02337 0.02998 0.04 0.35% Gravity::fill_multipole_BCs() 12 0.007739 0.02341 0.03839 0.34% VisMF::Write(FabArray) 2 0.01757 0.01929 0.03568 0.31% MLMG::mgVcycle_bottom 52 0.0001488 0.002322 0.03485 0.30% MLMG::actualBottomSolve() 52 5.629e-05 0.002226 0.03475 0.30% MLCGSolver::bicgstab 3 0 0.002129 0.03406 0.30% MLMG::computeResidual() 52 0.02918 0.03047 0.03259 0.28% MLMG::mgVcycle_down::2 52 0.005257 0.01674 0.03022 0.26% Castro::volInBoundary() 77 0.01869 0.01988 0.02719 0.24% FabArray::Xpay() 391 0.0216 0.02276 0.02613 0.23% Castro::check_for_nan() 20 0.02374 0.02433 0.02536 0.22% MultiFab::contains_nan() 20 0.02369 0.02427 0.0253 0.22% MLMG::mgVcycle_down::3 52 0.00502 0.00757 0.02433 0.21% Castro::construct_old_gravity_source() 10 0.02235 0.02286 0.02372 0.21% Castro::construct_old_rotation_source() 10 0.02239 0.0228 0.02327 0.20% Gravity::get_new_grav_vector() 11 0.02094 0.02169 0.02263 0.20% MLPoisson::define() 12 0.019 0.02003 0.0224 0.20% amrex::average_down 312 0.01372 0.01623 0.02213 0.19% Castro::apply_source_to_state() 20 0.01569 0.01596 0.01704 0.15% Castro::react_state() 20 0.01589 0.01623 0.01665 0.15% MLCellLinOp::defineAuxData() 12 0.01208 0.01309 0.01557 0.14% MLMG::ResNormInf() 63 0.006886 0.01235 0.01546 0.13% MLMG::prepareForSolve() 11 0.0127 0.0134 0.01493 0.13% MLMG::mgVcycle_down::4 52 0.00499 0.00574 0.01466 0.13% StateDataPhysBCFunct::() 233 0.005553 0.007761 0.0137 0.12% StateData::FillBoundary(geom) 66 0.004785 0.006967 0.01287 0.11% Gravity::update_max_rhs() 11 0.009465 0.01126 0.01283 0.11% MLMG::mgVcycle_up::4 52 0.004527 0.005075 0.01143 0.10% MLMG::computeMLResidual() 11 0.006517 0.00859 0.01072 0.09% MLMG::mgVcycle_down::5 52 0.004989 0.005403 0.009769 0.09% MLMG::mgVcycle_up::5 52 0.00458 0.004929 0.008393 0.07% FabArrayBase::getCPC() 957 0.005321 0.006048 0.008155 0.07% FabArray::norminf() 106 0.004989 0.005653 0.006972 0.06% FabArrayBase::getFB() 2602 0.004511 0.004952 0.006519 0.06% MultiFab::max() 11 0.001442 0.004264 0.006058 0.05% amrex::Add() 55 0.00571 0.005829 0.006054 0.05% FabArray::mult() 44 0.004832 0.004951 0.0055 0.05% MLMG::getGradSolution() 11 0.0045 0.004616 0.005183 0.05% FabArray::setDomainBndry() 233 0.002255 0.003008 0.005162 0.05% MLCellLinOp::compGrad() 11 0.00447 0.004589 0.005154 0.04% Gravity::test_composite_phi() 1 0.004754 0.004793 0.004824 0.04% FabArrayBase::CPC::define() 365 0.001588 0.002274 0.004217 0.04% MLCellLinOp::defineBC() 12 0.003708 0.003807 0.004099 0.04% Gravity::applyMetricTerms() 11 0.002588 0.002699 0.00348 0.03% MLCGSolver::ParallelAllReduce 75 0 0.0002029 0.003246 0.03% MLLinOp::define() 12 0.002232 0.003037 0.003204 0.03% MLLinOp::defineGrids() 12 0.002179 0.002987 0.00315 0.03% Castro::finalize_advance() 10 0.002601 0.002694 0.003104 0.03% BndryData::define() 12 0.002657 0.002772 0.003007 0.03% amrex::Dot() 57 0 0.0001558 0.002493 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 6.395e-05 0.0008701 0.002421 0.02% DistributionMapping::LeastUsedCPUs() 1 2.202e-05 0.0008278 0.002375 0.02% MLMG::compResidual() 1 0.0009143 0.001193 0.001849 0.02% Gravity::swapTimeLevels() 10 0.001415 0.001453 0.001542 0.01% FabArray::LinComb() 28 0 9.523e-05 0.001524 0.01% MLPoisson::prepareForSolve() 12 0.00116 0.00123 0.001458 0.01% MLCellLinOp::prepareForSolve() 12 0.001113 0.001184 0.00141 0.01% MLPoisson::normalize() 31 0 8.27e-05 0.001323 0.01% MLLinOp::makeSubCommunicator() 12 0.0002484 0.001043 0.001188 0.01% AmrLevel::AmrLevel(dm) 1 0.0008882 0.001018 0.00112 0.01% StateData::define() 5 0.0008544 0.000986 0.001087 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 384 0.0008174 0.0009697 0.001082 0.01% FabArrayBase::FB::FB() 46 0.0002093 0.0004821 0.0009572 0.01% Castro::buildMetrics() 1 0.0006087 0.0006972 0.0008461 0.01% MLMG::MLResNormInf() 11 0.0007626 0.0007835 0.0008253 0.01% MLMG::MLRhsNormInf() 11 0.000737 0.0007548 0.0007699 0.01% MLLinOp::makeAgglomeratedDMap 12 0.0006399 0.0006561 0.000666 0.01% MLCellLinOp::setLevelBC() 12 0.0003962 0.0004318 0.0005459 0.00% makeSFC 60 0.0004191 0.0004346 0.0004422 0.00% Castro::swap_state_time_levels() 10 0.0004051 0.0004162 0.0004261 0.00% Castro::enforce_consistent_e() 1 0.0003671 0.0003763 0.0003842 0.00% DistributionMapping::Distribute() 61 0.0001465 0.0001543 0.0001684 0.00% Amr::writeSmallPlotFile() 1 8.871e-05 9.897e-05 0.000133 0.00% Castro::enforce_speed_limit() 82 0.000109 0.000115 0.0001275 0.00% Amr::initSubcycle() 1 4.453e-05 5.08e-05 6.26e-05 0.00% Castro::create_source_corrector() 10 2.321e-05 2.641e-05 4.703e-05 0.00% Castro::retry_advance_ctu() 10 2.011e-05 2.309e-05 3.94e-05 0.00% Castro::FluxRegCrseInit 10 1.463e-05 1.663e-05 3.189e-05 0.00% Gravity::set_mass_offset() 11 2.469e-05 2.64e-05 2.955e-05 0.00% Castro::FluxRegFineAdd() 10 1.093e-05 1.268e-05 2.814e-05 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 16 B 16 B 22 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.10-8-gfd2dfa282a30) finalized