Initializing AMReX (v2024-30-g6e18c4232a10)... MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (v2024-30-g6e18c4232a10) initialized Starting run at 07:51:10 UTC on 2024-03-22. Successfully read inputs file ... Castro git describe: 24.03-26-g5707c0c2f AMReX git describe: v2024-30-g6e18c4232 Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.045858827 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.044845448 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.396147943 Gravity::multilevel_solve_for_new_phi() time = 1.812339044 Gravity::fill_multipole_BCs() time = 0.377079788 ... norm of composite residual at level 0 3.509358608e-10 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.552510736 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.861416647 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.287624606e+47 ener added: 6.129070894e+49 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.44936293e+25 ymom added: -1.046793362e+26 zmom added: -4.133074948e+24 eint added: 0 ener added: -1.270533196e+50 Castro::do_old_sources() time = 2.382978979 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.00547245e+47 ener added: 1.651139801e+46 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 20.67202354 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.546026038 Gravity::multilevel_solve_for_new_phi() time = 1.554210274 Castro::construct_new_gravity() time = 1.666758586 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.440206272e+49 ener added: 2.911791643e+45 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.451207933e+26 ymom added: 1.108730185e+26 zmom added: -5.613112907e+26 eint added: 0 ener added: 1.260457978e+50 Castro::do_new_sources() time = 2.250556291 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.00947637e+27 ener added: 2.068773556e+27 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.02498696849 [Level 0 step 1] Advanced 884736 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.191111111e+26 ener added: 6.213783704e+26 Updating the rotational period from 30.54368673 s to 30.45939751 s. [STEP 1] Coarse TimeStep time: 37.49734717 [STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.031368615 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.407402078 Gravity::multilevel_solve_for_new_phi() time = 1.897721444 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.306135866e+46 ener added: 9.211440366e+51 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135286e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.849559407e+31 ener added: 2.785926976e+31  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.824784804 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.200514105e+40 ener added: 6.433158322e+33 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.533896722e+24 ymom added: 4.756222074e+26 zmom added: -2.8670017e+23 eint added: 0 ener added: -1.721443002e+45 Castro::do_old_sources() time = 2.017473814 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 22.04567213 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.147330623e+31 ener added: 1.147330701e+31 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503703704e+23 ener added: 6.281481481e+23 Castro::construct_old_gravity() time = 0.055472024 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.197253778e+40 ener added: 1.791685121e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.57365812e+22 ymom added: 1.593798688e+22 zmom added: 6.441804792e+21 eint added: 0 ener added: -2.586789965e+47 Castro::do_old_sources() time = 0.202092979 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.204912576e+51 ener added: 6.747117479e+48 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.902505417 on level 1 Castro::reflux() at level 0 : time = 2.239344833 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.43076248 Gravity::multilevel_solve_for_new_phi() time = 1.363135389 Castro::construct_new_gravity() time = 1.478578483 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.46375568e+41 ener added: 7.485558923e+35 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.861679586e+21 ymom added: -6.245616015e+21 zmom added: -1.245900444e+20 eint added: 0 ener added: -3.223710603e+41 Castro::do_new_sources() time = 2.057792133 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.149299259e+26 ener added: 4.592592593e+21 ...estimated hydro-limited timestep at level 0: 0.05461716025 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025 Castro::construct_new_gravity() time = 0.029120464 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.564837764e+47 ener added: 4.559472528e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.764881231e+18 ymom added: -1.360987807e+19 zmom added: -8.219114448e+19 eint added: 0 ener added: 2.564611685e+47 Castro::do_new_sources() time = 0.139953889 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.281889991e+29 ener added: 3.281888214e+29 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02246515985 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.057555556e+24 ener added: 5.917703704e+24 Updating the rotational period from 30.45939751 s to 30.52749735 s. [STEP 2] Coarse TimeStep time: 50.34529826 [STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008131491259 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.287037368e-07 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Now regridding at level lbase = 0 grid_places() time: 0.036983057 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.431011352 Gravity::multilevel_solve_for_new_phi() time = 0.558423721 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.687139894 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.083120164e+24 ymom added: 5.231862796e+26 zmom added: -3.157856713e+23 eint added: 0 ener added: -1.937110674e+45 Castro::do_old_sources() time = 2.049901292 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.56068036 on level 0 Castro::construct_old_gravity() time = 0.055483006 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.818691374e+40 ener added: 1.212217725e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 8.443982463e+22 ymom added: 5.017514388e+21 zmom added: 7.10314939e+21 eint added: 0 ener added: -2.344787748e+45 Castro::do_old_sources() time = 0.207309822 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.83673455e+48 ener added: 2.077900047e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.860479109 on level 1 Castro::reflux() at level 0 : time = 2.218938353 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.439298961 Gravity::multilevel_solve_for_new_phi() time = 0.991937424 Castro::construct_new_gravity() time = 1.104945442 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.106550538e+21 ymom added: -7.896156836e+21 zmom added: 1.108336323e+20 eint added: 0 ener added: -3.427512073e+41 Castro::do_new_sources() time = 1.997051989 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008131520194 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194 Castro::construct_new_gravity() time = 0.029007449 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.244373444e+43 ener added: 1.74625952e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: -6.818659671e+17 ymom added: 2.352230085e+19 zmom added: 9.539392741e+19 eint added: 0 ener added: 5.303047905e+43 Castro::do_new_sources() time = 0.144295285 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.490463796e+26 ener added: 1.495539352e+26 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02307042913 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.281481481e+24 ener added: 6.674962963e+24 Updating the rotational period from 30.52749735 s to 30.52751553 s. [STEP 3] Coarse TimeStep time: 47.38012066 [STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008130329735 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.564309766e-07 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Now regridding at level lbase = 0 grid_places() time: 0.031546625 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.410262205 Gravity::multilevel_solve_for_new_phi() time = 0.537328666 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.780280815 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.694655893e+24 ymom added: 5.755038681e+26 zmom added: -3.471622784e+23 eint added: 0 ener added: -2.130751807e+45 Castro::do_old_sources() time = 1.999326696 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.63997235 on level 0 Castro::construct_old_gravity() time = 0.032336684 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.150425349e+40 ener added: 1.373884257e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 9.201539824e+22 ymom added: 1.180591621e+22 zmom added: 8.023757211e+21 eint added: 0 ener added: -2.520808161e+45 Castro::do_old_sources() time = 0.196087902 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.318881554e+48 ener added: 1.675623034e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.759861518 on level 1 Castro::reflux() at level 0 : time = 2.173409592 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.42734564 Gravity::multilevel_solve_for_new_phi() time = 0.968563368 Castro::construct_new_gravity() time = 1.078925124 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.405071346e+21 ymom added: -9.735495453e+21 zmom added: -7.674479504e+18 eint added: 0 ener added: -3.723007452e+41 Castro::do_new_sources() time = 1.940777089 on level 0 ...estimated hydro-limited timestep at level 0: 0.000813036171 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171 Castro::construct_new_gravity() time = 0.029698344 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.983601425e+43 ener added: 1.617265925e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.598087137e+18 ymom added: -2.567952508e+19 zmom added: -1.336957926e+19 eint added: 0 ener added: 4.042918443e+43 Castro::do_new_sources() time = 0.139147871 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.942862037e+25 ener added: 2.885587963e+25 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02321372463 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.365462963e+23 ener added: 4.62962963e+19 Updating the rotational period from 30.52751553 s to 30.52751552 s. [STEP 4] Coarse TimeStep time: 47.05396012 [STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002506596503 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.863488975e-07 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Now regridding at level lbase = 0 grid_places() time: 0.031570351 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.409546406 Gravity::multilevel_solve_for_new_phi() time = 0.53579383 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.755023052 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.366517551e+24 ymom added: 6.330531998e+26 zmom added: -3.819056992e+23 eint added: 0 ener added: -2.343742535e+45 Castro::do_old_sources() time = 2.005246483 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.33783439 on level 0 Castro::construct_old_gravity() time = 0.047172877 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.560109532e+40 ener added: 1.662186973e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.013209959e+23 ymom added: 1.770887431e+22 zmom added: 8.796070504e+21 eint added: 0 ener added: -2.728291723e+45 Castro::do_old_sources() time = 0.193321829 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.05099824e+48 ener added: 1.448876286e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.960568119 on level 1 Castro::reflux() at level 0 : time = 2.181247991 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.417440859 Gravity::multilevel_solve_for_new_phi() time = 0.958696 Castro::construct_new_gravity() time = 1.07073777 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.799171514e+21 ymom added: -1.177853541e+22 zmom added: -4.924059364e+18 eint added: 0 ener added: -4.148475158e+41 Castro::do_new_sources() time = 1.934718621 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006828000901 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901 Castro::construct_new_gravity() time = 0.031426479 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.326552265e+43 ener added: 1.577214716e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.72682201e+18 ymom added: -2.54093091e+19 zmom added: -1.25233859e+19 eint added: 0 ener added: 3.390623254e+43 Castro::do_new_sources() time = 0.169147554 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.819509259e+24 ener added: 4.717583333e+24 ...estimated hydro-limited timestep at level 1: 7.169281148e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02330944802 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.94814634e+22 ener added: 2.962962963e+20 Updating the rotational period from 30.52751552 s to 30.52751551 s. [STEP 5] Coarse TimeStep time: 46.80411448 [STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.531526951 seconds Ending run at 07:55:12 UTC on 2024-03-22. Run time = 241.3203096 Run time without initialization = 229.6141737 Average number of zones advanced per microsecond: 0.022 Average number of zones advanced per microsecond per rank: 0.005 TinyProfiler total time across processes [min...avg...max]: 241.3 ... 241.3 ... 241.3 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 9 93.6037 103.5702 107.5840 44.58% Castro::computeTemp() 88 15.22 16.89 17.58 7.29% check_for_negative_density() 9 1.086 5.096 15.14 6.28% amrex::Copy() 679 12.67 14.16 14.81 6.14% MultiFab::AddProduct() 4205 10.46 11.57 12.08 5.00% Castro::normalize_species() 87 10.03 11.22 11.73 4.86% FabArray::ParallelCopy_finish() 830 1.699 4.206 10.76 4.46% Castro::reset_internal_energy(Fab) 1476 8.421 9.314 9.673 4.01% Castro::estTimeStep() 26 4.083 5.383 8.652 3.59% FabArray::setVal() 5070 6.776 7.603 7.949 3.29% MultiFab::Subtract() 175 6.782 7.558 7.892 3.27% Castro::reset_internal_energy(MultiFab) 88 3.288 4.077 4.872 2.02% Gravity::fill_multipole_BCs() 11 4.34 4.443 4.617 1.91% FabArray::sum() 4205 3.401 3.76 3.92 1.62% FluxRegister::Reflux() 24 2.938 3.265 3.409 1.41% Castro::enforce_min_density() 87 1.552 1.99 2.659 1.10% FabArray::ParallelCopy_nowait() 830 2.067 2.25 2.631 1.09% MLPoisson::Fsmooth() 1376 2.122 2.36 2.446 1.01% Castro::FluxRegCrseInit 9 1.472 1.645 1.775 0.74% Castro::wd_update() 6 0.5155 0.8776 1.743 0.72% Castro::reflux() 4 1.478 1.649 1.73 0.72% FillPatchInterp(MF) 30 1.229 1.338 1.455 0.60% Amr::InitAmr() 1 1.21 1.21 1.21 0.50% Castro::initMFs() 5 1.089 1.137 1.154 0.48% amrex::Add() 136 0.9905 1.099 1.144 0.47% Castro::construct_old_gravity_source() 18 0.8872 1.008 1.069 0.44% MLPoisson::Fapply() 318 0.9188 1.014 1.05 0.44% Castro::construct_new_gravity_source() 9 0.7719 0.8477 0.8957 0.37% FabArray::Saxpy() 182 0.7677 0.8485 0.8795 0.36% FillPatchIterator::Initialize 62 0.7425 0.8205 0.8774 0.36% FillBoundary_finish() 1553 0.2698 0.4433 0.8403 0.35% Castro::problem_post_timestep() 10 0.7152 0.7558 0.8336 0.35% Castro::volInBoundary() 42 0.6041 0.7122 0.781 0.32% VisMF::Write(FabArray) 3 0.5788 0.6638 0.721 0.30% StateData::FillBoundary(geom) 50 0.5799 0.5885 0.5985 0.25% Castro::construct_new_source() 63 0.5013 0.5402 0.56 0.23% MultiFab::max() 18 0.03648 0.2023 0.5383 0.22% MLCellLinOp::applyBC() 1742 0.3608 0.4231 0.4596 0.19% MultiFab::contains_nan() 18 0.3803 0.4238 0.4444 0.18% FabArray::Xpay() 283 0.3526 0.3901 0.4044 0.17% FillBoundary_nowait() 1553 0.3176 0.3626 0.392 0.16% Castro::initialize_do_advance() 9 0.2342 0.2632 0.2929 0.12% Amr::writePlotFile() 2 0.0789 0.1442 0.2594 0.11% FabArray::setDomainBndry() 92 0.1988 0.2196 0.2366 0.10% Castro::construct_old_source() 63 0.1856 0.2026 0.2155 0.09% amrex::average_down 233 0.2031 0.2087 0.2117 0.09% Castro::fill_hybrid_hydro_source() 27 0.1748 0.1915 0.2028 0.08% MLCellLinOp::defineAuxData() 11 0.1458 0.1586 0.1642 0.07% Castro::initData() 1 0.1201 0.1431 0.1583 0.07% MLPoisson::FFlux() 150 0.004569 0.04215 0.1546 0.06% MLCellLinOp::compGrad() 18 0.1291 0.1431 0.1496 0.06% FabArray::mult() 56 0.1177 0.131 0.1368 0.06% StateData::define() 25 0.1038 0.1181 0.124 0.05% MLMG::addInterpCorrection() 155 0.1074 0.1189 0.1234 0.05% Castro::evaluate_source_change() 193 0.1002 0.1109 0.116 0.05% Castro::swap_state_time_levels() 9 0.08346 0.0972 0.1091 0.05% Gravity::get_new_grav_vector() 10 0.08816 0.09595 0.1001 0.04% Castro::initialize_advance() 9 0.06672 0.08288 0.0986 0.04% Gravity::get_old_grav_vector() 9 0.07977 0.08858 0.09625 0.04% MLMG::prepareForSolve() 10 0.06167 0.06975 0.07738 0.03% MLCellLinOp::updateSolBC() 25 0.06676 0.06806 0.06975 0.03% Castro::apply_tagging_restrictions() 6 0.05535 0.05931 0.06781 0.03% MLMG::solve() 10 0.002966 0.04201 0.06388 0.03% FabArray::norminf(mask) 21 0.05538 0.06055 0.0631 0.03% AmrMesh::MakeNewGrids() 6 0.04728 0.05256 0.06053 0.03% AmrLevel::FillPatch() 62 0.0504 0.05465 0.05859 0.02% MLCellLinOp::updateCorBC() 17 0.04521 0.04592 0.04655 0.02% MLMG::ResNormInf() 54 0.005004 0.01795 0.04635 0.02% BndryData::define() 27 0.04243 0.04345 0.04504 0.02% FabArray::norminf() 147 0.04107 0.042 0.04338 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.02884 0.03403 0.0364 0.02% MLMG::MLResNormInf() 15 0.000107 0.02408 0.03487 0.01% MLCellLinOp::reflux() 30 0.004269 0.01164 0.0337 0.01% DistributionMapping::LeastUsedCPUs() 5 0.004555 0.01792 0.03326 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.0182 0.02131 0.02683 0.01% MLCellLinOp::defineBC() 11 0.02557 0.0259 0.02631 0.01% Castro::FluxRegFineAdd() 9 0.02561 0.02584 0.02596 0.01% MultiFab::Multiply() 8 0.02134 0.02378 0.02472 0.01% Castro::do_old_sources() 9 0.0005956 0.005512 0.02012 0.01% Castro::build_fine_mask() 44 0.01755 0.0186 0.01993 0.01% MLLinOp::makeSubCommunicator() 11 0.0006095 0.009004 0.01922 0.01% MLMG::interpCorrection_1 17 0.01841 0.01857 0.01885 0.01% FabArrayBase::CPC::define() 416 0.01302 0.01472 0.01784 0.01% FillPatchTwoLevels 31 0.01342 0.0157 0.01779 0.01% Castro::Castro() 5 0.0147 0.01643 0.01749 0.01% StateDataPhysBCFunct::() 95 0.003026 0.009904 0.01726 0.01% Castro::buildMetrics() 5 0.01478 0.01638 0.01708 0.01% Castro::linear_to_hybrid_momentum() 1 0.01391 0.01566 0.01632 0.01% Castro::do_new_sources() 9 0.0005683 0.004477 0.01606 0.01% Castro::construct_old_gravity() 9 0.0004299 0.005182 0.01477 0.01% AMRErrorTag::operator() 6 0.01038 0.01122 0.01276 0.01% MLCellLinOp::prepareForSolve() 11 0.01157 0.01176 0.01193 0.00% Castro::enforce_consistent_e() 1 0.009858 0.0104 0.01074 0.00% Castro::finalize_do_advance() 9 0.007483 0.009358 0.01043 0.00% Gravity::actual_multilevel_solve() 10 0.007621 0.009127 0.01036 0.00% FabArrayBase::getCPC() 1440 0.009807 0.01001 0.01019 0.00% Gravity::actual_solve_with_mlmg() 11 0.009115 0.009438 0.009782 0.00% Gravity::update_max_rhs() 10 0.007226 0.008574 0.009387 0.00% Castro::apply_problem_tags() 6 0.007348 0.00761 0.0082 0.00% average_down_faces 48 0.005605 0.005662 0.005725 0.00% MLCellLinOp::setLevelBC() 19 0.00364 0.004633 0.005597 0.00% FabArray::FillBoundary() 1553 0.004195 0.004399 0.004698 0.00% AmrLevel::derive() 6 0.003667 0.004157 0.004365 0.00% MLCellLinOp::smooth() 688 0.00383 0.003869 0.003902 0.00% MLCGSolver::bicgstab 7 0 0.0009371 0.003748 0.00% amrex::Dot() 115 0 0.0008916 0.003566 0.00% Gravity::test_composite_phi() 1 0.00252 0.003117 0.003515 0.00% FabArrayBase::getFB() 1553 0.0031 0.003225 0.003494 0.00% FabArrayBase::FB::FB() 19 0.002447 0.002822 0.003152 0.00% FabArray::ParallelCopy() 830 0.00293 0.002999 0.003076 0.00% Castro::construct_new_gravity() 9 0.0004754 0.001357 0.002426 0.00% main() 1 0.001507 0.001594 0.001701 0.00% MLLinOp::defineGrids() 11 0.001323 0.001415 0.001524 0.00% MLCellLinOp::apply() 318 0.0008939 0.001043 0.001454 0.00% Amr::regrid() 5 0.0009473 0.00109 0.001418 0.00% Castro::clean_state() 87 0.001199 0.001256 0.001304 0.00% TagBoxArray::collate() 6 0.0005567 0.0009683 0.001193 0.00% Amr::coarseTimeStep() 5 0.0005235 0.001004 0.001177 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0002745 0.001098 0.00% AmrLevel::FillCoarsePatch() 5 0.0009028 0.0009501 0.001007 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.000891 0.0008961 0.0009065 0.00% OwnerMask() 6 0.0007026 0.0008171 0.0009011 0.00% MLCellLinOp::correctionResidual() 189 0.0006658 0.0006778 0.0007064 0.00% MLMG::mgVcycle() 65 0.0005954 0.0006133 0.0006277 0.00% Castro::do_advance_ctu() 5 0.0004783 0.0005051 0.0005516 0.00% FillPatchSingleLevel 92 0.0005256 0.0005347 0.0005497 0.00% Amr::grid_places() 6 0.0003697 0.000439 0.0005251 0.00% FillPatchIterator::FillFromLevel0() 31 0.0004039 0.0004306 0.0004636 0.00% TagBoxArray::mapPRD 6 0.0004175 0.0004379 0.0004472 0.00% Castro::subcycle_advance_ctu() 5 6.783e-05 0.0001785 0.0004285 0.00% MLCellLinOp::solutionResidual() 72 0.0003471 0.0003651 0.0003936 0.00% MLMG:computeResOfCorrection() 155 0.0003854 0.0003895 0.0003934 0.00% Castro::finalize_advance() 9 0.0002907 0.0003393 0.0003816 0.00% MLMG::actualBottomSolve() 31 4.13e-05 0.0001266 0.0003742 0.00% MLMG::oneIter() 31 0.0003368 0.0003434 0.0003511 0.00% Castro::computeNewDt() 8 0.0001103 0.0001679 0.0003283 0.00% FillPatchIterator::FillFromTwoLevels() 31 0.0002839 0.0002952 0.0003052 0.00% MLMG::mgVcycle_down::0 31 0.0002796 0.0002871 0.0002948 0.00% Castro::enforce_speed_limit() 87 0.0002502 0.0002645 0.0002848 0.00% Amr::defBaseLevel() 1 0.0002357 0.0002512 0.0002714 0.00% Gravity::solve_phi_with_mlmg() 11 0.0002274 0.0002418 0.0002539 0.00% MLMG::mgVcycle_down::1 31 0.0002329 0.000237 0.0002396 0.00% Amr::timeStep() 9 0.0001814 0.0002055 0.0002257 0.00% Castro::post_regrid() 10 0.0001813 0.0002028 0.0002243 0.00% MLMG::mgVcycle_bottom 65 0.0002063 0.0002131 0.0002228 0.00% AmrLevel::AmrLevel(dm) 5 0.0001922 0.0002008 0.0002072 0.00% MLMG::mgVcycle_down::3 31 0.0001867 0.0001896 0.0001952 0.00% MLMG::mgVcycle_down::2 31 0.0001891 0.0001914 0.0001935 0.00% MLMG::mgVcycle_up::0 31 0.0001783 0.0001864 0.0001919 0.00% makeSFC 33 0.000159 0.0001719 0.0001879 0.00% FabArrayBase::TheFPinfo() 25 0.0001643 0.0001716 0.0001835 0.00% Castro::check_for_nan() 18 0.0001438 0.0001556 0.0001799 0.00% Amr::FinalizeInit() 1 3.173e-05 7.046e-05 0.0001779 0.00% MLMG::mgVcycle_down::4 31 0.0001603 0.0001671 0.0001777 0.00% Castro::react_state() 18 0.0001288 0.0001454 0.0001547 0.00% MLMG::mgVcycle_up::1 31 0.0001345 0.0001385 0.000143 0.00% MLMG::computeResWithCrseSolFineCor() 17 0.0001298 0.0001324 0.0001345 0.00% FPinfo::FPinfo() 3 0.0001012 0.0001203 0.0001332 0.00% MLMG::mgVcycle_up::2 31 0.0001273 0.0001295 0.0001314 0.00% MLMG::mgVcycle_up::3 31 0.0001201 0.0001242 0.0001261 0.00% MLMG::mgVcycle_up::4 31 0.0001129 0.0001169 0.0001238 0.00% DistributionMapping::Distribute() 35 0.0001076 0.0001138 0.0001221 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0001042 0.0001108 0.0001185 0.00% Castro::expand_state() 13 0.0001096 0.0001146 0.0001184 0.00% MLPoisson::define() 11 0.0001 0.0001053 0.0001152 0.00% Castro::errorEst() 6 0.0001041 0.0001075 0.0001127 0.00% FabArray::RecvLayoutMask() 8 9.415e-05 0.0001 0.0001122 0.00% Castro::apply_source_to_state() 18 0.0001045 0.0001063 0.0001097 0.00% Castro::advance() 5 7.927e-05 8.889e-05 0.0001074 0.00% Gravity::swapTimeLevels() 9 8.663e-05 9.547e-05 0.0001042 0.00% Amr::writeSmallPlotFile() 1 9.492e-05 9.733e-05 0.0001034 0.00% Castro::post_timestep() 9 7.294e-05 8.347e-05 9.181e-05 0.00% ClusterList::intersect() 1 0 2.242e-05 8.97e-05 0.00% MLMG::computeResidual() 31 8.443e-05 8.692e-05 8.949e-05 0.00% MLMG::computeMLResidual() 15 7.902e-05 8.215e-05 8.588e-05 0.00% MLLinOp::define() 11 5.609e-05 6.389e-05 7.505e-05 0.00% knapsack() 3 6.768e-05 6.95e-05 7.37e-05 0.00% Castro::create_source_corrector() 9 5.539e-05 6.169e-05 7.302e-05 0.00% Castro::avgDown(state_indx) 20 6.676e-05 6.818e-05 7.047e-05 0.00% MLMG::miniCycle() 34 6.668e-05 6.794e-05 7.029e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 6.003e-05 6.464e-05 6.648e-05 0.00% MLMG::getGradSolution() 10 6.096e-05 6.244e-05 6.44e-05 0.00% Amr::initSubcycle() 1 5.187e-05 5.348e-05 5.802e-05 0.00% Gravity::set_mass_offset() 6 3.206e-05 4.358e-05 5.686e-05 0.00% Castro::construct_new_hybrid_source() 9 5.009e-05 5.247e-05 5.465e-05 0.00% amrex::average_down_w_geom 20 5.05e-05 5.218e-05 5.381e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 4.463e-05 4.746e-05 5.035e-05 0.00% MLPoisson::prepareForSolve() 11 4.38e-05 4.678e-05 4.857e-05 0.00% Castro::init(old) 3 4.253e-05 4.436e-05 4.624e-05 0.00% AmrMesh-cluster 1 0 1.058e-05 4.232e-05 0.00% Castro::construct_old_hybrid_source() 9 3.702e-05 3.813e-05 3.913e-05 0.00% DistributionMapping::KnapSackDoIt() 3 2.853e-05 3.247e-05 3.471e-05 0.00% Castro::post_init() 1 2.927e-05 3.215e-05 3.45e-05 0.00% MLMG::MLRhsNormInf() 10 3.117e-05 3.188e-05 3.247e-05 0.00% Castro::avgDown() 4 2.968e-05 3.047e-05 3.104e-05 0.00% MLMG::compResidual() 1 2.594e-05 2.708e-05 2.785e-05 0.00% BoxList::parallelComplementIn() 12 2.425e-05 2.593e-05 2.777e-05 0.00% Amr::bldFineLevels() 1 2.287e-05 2.42e-05 2.644e-05 0.00% Castro::construct_old_rotation_source() 9 2.218e-05 2.347e-05 2.515e-05 0.00% BoxList::complementIn 12 2.159e-05 2.284e-05 2.508e-05 0.00% Castro::retry_advance_ctu() 5 2.079e-05 2.272e-05 2.402e-05 0.00% Castro::construct_new_rotation_source() 9 2.106e-05 2.222e-05 2.348e-05 0.00% Castro::computeInitialDt() 2 1.618e-05 1.898e-05 2.281e-05 0.00% Castro::derive() 6 1.83e-05 2.002e-05 2.096e-05 0.00% Amr::InitializeInit() 1 7.72e-06 1.396e-05 2.048e-05 0.00% Castro::init() 1 1.604e-05 1.693e-05 1.818e-05 0.00% ClusterList::chop() 1 0 2.619e-06 1.048e-05 0.00% Amr::init() 1 6.54e-06 7.484e-06 8.137e-06 0.00% Amr::initialInit() 1 4.685e-06 5.878e-06 7.022e-06 0.00% knapsack()swap 1 3.693e-06 3.962e-06 4.26e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 241.3 241.3 241.3 100.00% Amr::coarseTimeStep() 5 229.1 229.1 229.1 94.93% Amr::timeStep() 9 227.7 227.7 227.7 94.37% Castro::advance() 5 200.6 200.6 200.6 83.13% Castro::subcycle_advance_ctu() 5 192.1 192.5 193.4 80.13% Castro::do_advance_ctu() 5 192.1 192.5 193.4 80.13% Castro::construct_ctu_hydro_source() 9 118.5 118.6 118.7 49.17% Castro::clean_state() 87 71.39 80.04 83.65 34.66% Castro::computeTemp() 88 45.58 50.99 53.29 22.08% Castro::reset_internal_energy(MultiFab) 88 30.36 34.1 35.7 14.80% Castro::evaluate_source_change() 193 17.49 19.35 20.18 8.36% Castro::enforce_min_density() 87 16.56 18.69 19.74 8.18% Castro::post_regrid() 10 15.87 17.39 18.02 7.47% Amr::regrid() 5 15.69 17.1 17.68 7.33% Castro::initialize_do_advance() 9 14.72 14.99 15.17 6.29% check_for_negative_density() 9 1.086 5.096 15.14 6.28% amrex::Copy() 679 12.67 14.16 14.81 6.14% AmrLevel::FillPatch() 62 8.009 9.591 14.04 5.82% FabArray::ParallelCopy() 830 4.052 6.521 12.96 5.37% FillPatchIterator::Initialize 62 6.33 7.961 12.58 5.21% MultiFab::AddProduct() 4205 10.46 11.57 12.08 5.00% Castro::normalize_species() 87 10.03 11.22 11.73 4.86% Gravity::solve_phi_with_mlmg() 11 11.21 11.32 11.49 4.76% Castro::do_old_sources() 9 11.15 11.19 11.25 4.66% Gravity::multilevel_solve_for_new_phi() 10 10.91 11.01 11.17 4.63% Gravity::actual_multilevel_solve() 10 10.88 10.98 11.14 4.62% Castro::do_new_sources() 9 9.38 10.35 10.77 4.46% FabArray::ParallelCopy_finish() 830 1.699 4.206 10.76 4.46% FillPatchSingleLevel 92 4.056 5.771 10.5 4.35% Amr::init() 1 10.5 10.5 10.5 4.35% FillPatchIterator::FillFromLevel0() 31 3.738 5.384 10.06 4.17% Amr::initialInit() 1 9.942 9.943 9.943 4.12% Castro::post_timestep() 9 9.894 9.895 9.896 4.10% Castro::reset_internal_energy(Fab) 1476 8.421 9.314 9.673 4.01% Castro::reflux() 4 8.756 8.768 8.774 3.64% Castro::estTimeStep() 26 4.083 5.383 8.652 3.59% Castro::initialize_advance() 9 7.24 8.138 8.495 3.52% FabArray::setVal() 5070 6.776 7.603 7.949 3.29% MultiFab::Subtract() 175 6.782 7.558 7.892 3.27% Gravity::actual_solve_with_mlmg() 11 6.768 6.776 6.784 2.81% Castro::construct_new_gravity() 9 6.27 6.365 6.518 2.70% Castro::expand_state() 13 5.052 5.502 6.5 2.69% Amr::FinalizeInit() 1 5.925 6.052 6.417 2.66% MLMG::solve() 10 6.271 6.28 6.298 2.61% MLMG::oneIter() 31 5.071 5.089 5.096 2.11% Gravity::fill_multipole_BCs() 11 4.421 4.52 4.689 1.94% MLMG::mgVcycle() 65 4.254 4.283 4.295 1.78% FluxRegister::Reflux() 24 4.272 4.286 4.294 1.78% Castro::construct_old_gravity() 9 0.7166 1.69 4.077 1.69% Gravity::get_old_grav_vector() 9 0.7115 1.685 4.077 1.69% Amr::InitializeInit() 1 3.526 3.89 4.018 1.66% Amr::defBaseLevel() 1 3.526 3.89 4.017 1.66% FabArray::sum() 4205 3.401 3.76 3.92 1.62% Castro::computeNewDt() 8 2.225 2.697 3.882 1.61% Castro::finalize_do_advance() 9 1.357 2.063 3.781 1.57% Castro::problem_post_timestep() 10 2.659 3.022 3.78 1.57% MLCellLinOp::smooth() 688 3.224 3.243 3.262 1.35% Castro::post_init() 1 2.613 2.784 3.117 1.29% Castro::FluxRegCrseInit 9 1.824 2.126 2.812 1.17% FabArray::ParallelCopy_nowait() 830 2.127 2.312 2.695 1.12% Castro::initData() 1 2.201 2.452 2.552 1.06% MLPoisson::Fsmooth() 1376 2.122 2.36 2.446 1.01% Castro::wd_update() 6 1.226 1.59 2.348 0.97% Castro::construct_new_source() 63 1.847 2.011 2.097 0.87% MLMG::mgVcycle_down::0 31 1.887 1.949 1.975 0.82% Amr::bldFineLevels() 1 1.285 1.513 1.64 0.68% MLCellLinOp::applyBC() 1742 1.091 1.239 1.604 0.66% FillPatchIterator::FillFromTwoLevels() 31 1.494 1.538 1.576 0.65% FillPatchTwoLevels 31 1.494 1.538 1.576 0.65% FillPatchInterp(MF) 30 1.229 1.338 1.455 0.60% Castro::Castro() 5 1.292 1.393 1.444 0.60% MLMG::mgVcycle_up::0 31 1.364 1.39 1.401 0.58% MLCellLinOp::apply() 318 1.285 1.309 1.327 0.55% FabArray::FillBoundary() 1553 0.6311 0.8163 1.243 0.52% Amr::InitAmr() 1 1.21 1.21 1.21 0.50% Castro::initMFs() 5 1.093 1.142 1.16 0.48% amrex::Add() 136 0.9905 1.099 1.144 0.47% Castro::construct_old_source() 63 0.9193 1.03 1.101 0.46% Amr::writePlotFile() 2 1.084 1.085 1.085 0.45% Castro::construct_old_gravity_source() 18 0.8872 1.008 1.069 0.44% MLPoisson::Fapply() 318 0.9188 1.014 1.05 0.44% MLCellLinOp::solutionResidual() 72 0.9748 1.021 1.04 0.43% Castro::computeInitialDt() 2 0.506 0.6331 0.9977 0.41% Castro::construct_new_gravity_source() 9 0.7719 0.8477 0.8957 0.37% FabArray::Saxpy() 182 0.7677 0.8485 0.8795 0.36% FillBoundary_finish() 1553 0.2698 0.4433 0.8403 0.35% MLCellLinOp::correctionResidual() 189 0.8012 0.8091 0.8146 0.34% Gravity::get_new_grav_vector() 10 0.7781 0.786 0.7946 0.33% Castro::volInBoundary() 42 0.6041 0.7123 0.7811 0.32% VisMF::Write(FabArray) 3 0.5788 0.6638 0.721 0.30% MLMG:computeResOfCorrection() 155 0.6552 0.6848 0.6978 0.29% StateDataPhysBCFunct::() 95 0.583 0.5984 0.614 0.25% StateData::FillBoundary(geom) 50 0.5799 0.5885 0.5985 0.25% Gravity::update_max_rhs() 10 0.09622 0.2611 0.5914 0.25% MLMG::computeResWithCrseSolFineCor() 17 0.5682 0.5689 0.5706 0.24% MultiFab::max() 18 0.03648 0.2023 0.5383 0.22% MLMG::computeMLResidual() 15 0.4099 0.4376 0.4983 0.21% Castro::init() 1 0.4724 0.4774 0.481 0.20% AmrLevel::FillCoarsePatch() 5 0.4723 0.4774 0.481 0.20% Castro::check_for_nan() 18 0.3804 0.424 0.4445 0.18% MultiFab::contains_nan() 18 0.3803 0.4238 0.4444 0.18% Gravity::test_composite_phi() 1 0.4176 0.4188 0.4223 0.18% amrex::average_down 233 0.2808 0.3628 0.4101 0.17% FabArray::Xpay() 283 0.3526 0.3901 0.4044 0.17% FillBoundary_nowait() 1553 0.3231 0.3686 0.3983 0.17% MLMG::mgVcycle_down::1 31 0.3055 0.3298 0.385 0.16% Castro::init(old) 3 0.3596 0.3608 0.3621 0.15% MLMG::computeResidual() 31 0.3473 0.3554 0.3613 0.15% MLCellLinOp::reflux() 30 0.1731 0.2251 0.3605 0.15% Castro::apply_source_to_state() 18 0.3059 0.3391 0.3539 0.15% MLPoisson::define() 11 0.2772 0.2837 0.2899 0.12% Castro::react_state() 18 0.2015 0.2323 0.2457 0.10% FabArray::setDomainBndry() 92 0.1988 0.2196 0.2366 0.10% Amr::grid_places() 6 0.2221 0.2222 0.2223 0.09% AmrMesh::MakeNewGrids() 6 0.2216 0.2218 0.2219 0.09% MLMG::prepareForSolve() 10 0.2073 0.2151 0.2199 0.09% MLMG::mgVcycle_up::1 31 0.2145 0.2177 0.2197 0.09% Castro::fill_hybrid_hydro_source() 27 0.1748 0.1915 0.2028 0.08% MLCellLinOp::defineAuxData() 11 0.1713 0.1867 0.1957 0.08% MLMG::addInterpCorrection() 155 0.1278 0.1649 0.1825 0.08% MLMG::getGradSolution() 10 0.1742 0.1777 0.1798 0.07% MLCellLinOp::compGrad() 18 0.1741 0.1777 0.1797 0.07% MLMG::mgVcycle_bottom 65 0.1497 0.157 0.1781 0.07% MLPoisson::FFlux() 150 0.004569 0.04215 0.1546 0.06% MLMG::miniCycle() 34 0.1498 0.15 0.1501 0.06% Castro::errorEst() 6 0.1197 0.1269 0.1432 0.06% FabArray::mult() 56 0.1177 0.131 0.1368 0.06% Castro::construct_new_hybrid_source() 9 0.1178 0.1282 0.136 0.06% Castro::avgDown() 4 0.1206 0.1298 0.1355 0.06% Castro::avgDown(state_indx) 20 0.1205 0.1298 0.1354 0.06% amrex::average_down_w_geom 20 0.1205 0.1297 0.1354 0.06% AmrLevel::AmrLevel(dm) 5 0.104 0.1183 0.1242 0.05% StateData::define() 25 0.1038 0.1181 0.124 0.05% MLMG::ResNormInf() 54 0.07823 0.08857 0.1112 0.05% Castro::swap_state_time_levels() 9 0.08346 0.0972 0.1091 0.05% MLCellLinOp::updateSolBC() 25 0.07649 0.08197 0.09229 0.04% MLMG::computeResWithCrseCorFineCor() 17 0.08572 0.08661 0.08872 0.04% MLCellLinOp::defineBC() 11 0.08468 0.08602 0.08709 0.04% MLMG::mgVcycle_down::2 31 0.07121 0.07415 0.08162 0.03% MLMG::mgVcycle_up::3 31 0.02537 0.06494 0.07835 0.03% MLMG::MLResNormInf() 15 0.04342 0.06668 0.07471 0.03% Castro::apply_tagging_restrictions() 6 0.05535 0.05931 0.06781 0.03% Castro::construct_old_hybrid_source() 9 0.05702 0.06347 0.06682 0.03% FabArray::norminf(mask) 21 0.05538 0.06055 0.0631 0.03% BndryData::define() 27 0.05744 0.05897 0.06029 0.02% MLMG::interpCorrection_1 17 0.02608 0.03497 0.05688 0.02% Castro::derive() 6 0.04646 0.0486 0.05438 0.02% AmrLevel::derive() 6 0.04644 0.04858 0.05435 0.02% MLMG::mgVcycle_up::2 31 0.05084 0.05188 0.05267 0.02% MLCellLinOp::updateCorBC() 17 0.04898 0.05017 0.05105 0.02% Castro::buildMetrics() 5 0.03674 0.04188 0.04555 0.02% FabArray::norminf() 147 0.04107 0.042 0.04338 0.02% TagBoxArray::mapPRD 6 0.01558 0.0287 0.04135 0.02% Gravity::swapTimeLevels() 9 0.02787 0.03447 0.03787 0.02% MLMG::mgVcycle_down::3 31 0.03098 0.03265 0.03598 0.01% FabArrayBase::TheFPinfo() 25 0.004927 0.01825 0.03354 0.01% FPinfo::FPinfo() 3 0.004744 0.01807 0.03337 0.01% DistributionMapping::LeastUsedCPUs() 5 0.004555 0.01792 0.03326 0.01% DistributionMapping::KnapSackDoIt() 3 0.004622 0.01795 0.03325 0.01% MLMG::MLRhsNormInf() 10 0.02645 0.02838 0.02985 0.01% MLMG::actualBottomSolve() 31 4.13e-05 0.007056 0.02809 0.01% FabArrayBase::getCPC() 1440 0.0231 0.02473 0.02781 0.01% MLCGSolver::bicgstab 7 0 0.00684 0.02736 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.0182 0.02131 0.02683 0.01% Castro::FluxRegFineAdd() 9 0.02561 0.02584 0.02596 0.01% MultiFab::Multiply() 8 0.02134 0.02378 0.02472 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.0195 0.02053 0.02126 0.01% MLLinOp::define() 11 0.002347 0.01086 0.02112 0.01% MLLinOp::defineGrids() 11 0.002291 0.0108 0.02106 0.01% MLMG::compResidual() 1 0.01859 0.02021 0.02093 0.01% Castro::build_fine_mask() 44 0.01755 0.0186 0.01993 0.01% MLLinOp::makeSubCommunicator() 11 0.0006095 0.009004 0.01922 0.01% MLMG::mgVcycle_down::4 31 0.005246 0.008664 0.01846 0.01% FabArrayBase::CPC::define() 416 0.01302 0.01472 0.01784 0.01% Castro::linear_to_hybrid_momentum() 1 0.01391 0.01566 0.01632 0.01% MLMG::mgVcycle_up::4 31 0.004264 0.006747 0.01379 0.01% AMRErrorTag::operator() 6 0.01038 0.01122 0.01276 0.01% MLPoisson::prepareForSolve() 11 0.01162 0.01181 0.01197 0.00% MLCellLinOp::prepareForSolve() 11 0.01157 0.01176 0.01193 0.00% average_down_faces 48 0.008828 0.009964 0.01074 0.00% Castro::enforce_consistent_e() 1 0.009858 0.0104 0.01074 0.00% Castro::apply_problem_tags() 6 0.007348 0.00761 0.0082 0.00% FabArrayBase::getFB() 1553 0.005547 0.006047 0.006473 0.00% MLCellLinOp::setLevelBC() 19 0.00364 0.004633 0.005597 0.00% amrex::Dot() 115 0 0.0008916 0.003566 0.00% FabArrayBase::FB::FB() 19 0.002447 0.002822 0.003152 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0007455 0.002982 0.00% TagBoxArray::collate() 6 0.0005567 0.0009683 0.001193 0.00% OwnerMask() 6 0.0007026 0.0008171 0.0009011 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0003588 0.0003815 0.0004067 0.00% Castro::finalize_advance() 9 0.0002907 0.0003393 0.0003816 0.00% makeSFC 33 0.0002546 0.0002707 0.0002882 0.00% Castro::enforce_speed_limit() 87 0.0002502 0.0002645 0.0002848 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 0.0001144 0.0001363 0.0001785 0.00% AmrMesh-cluster 1 0 3.562e-05 0.0001425 0.00% DistributionMapping::Distribute() 35 0.0001076 0.0001138 0.0001221 0.00% FabArray::RecvLayoutMask() 8 9.415e-05 0.0001 0.0001122 0.00% Amr::writeSmallPlotFile() 1 9.492e-05 9.733e-05 0.0001034 0.00% ClusterList::intersect() 1 0 2.242e-05 8.97e-05 0.00% knapsack() 3 7.147e-05 7.346e-05 7.781e-05 0.00% Castro::create_source_corrector() 9 5.539e-05 6.169e-05 7.302e-05 0.00% Amr::initSubcycle() 1 5.187e-05 5.348e-05 5.802e-05 0.00% Gravity::set_mass_offset() 6 3.206e-05 4.358e-05 5.686e-05 0.00% BoxList::parallelComplementIn() 12 4.634e-05 4.877e-05 5.285e-05 0.00% Castro::construct_old_rotation_source() 9 2.218e-05 2.347e-05 2.515e-05 0.00% BoxList::complementIn 12 2.159e-05 2.284e-05 2.508e-05 0.00% Castro::retry_advance_ctu() 5 2.079e-05 2.272e-05 2.402e-05 0.00% Castro::construct_new_rotation_source() 9 2.106e-05 2.222e-05 2.348e-05 0.00% ClusterList::chop() 1 0 2.619e-06 1.048e-05 0.00% knapsack()swap 1 3.693e-06 3.962e-06 4.26e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-30-g6e18c4232a10) finalized