Initializing AMReX (24.04-8-g2cd72a3bbaeb)... MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (24.04-8-g2cd72a3bbaeb) initialized Starting run at 07:09:45 UTC on 2024-04-08. Successfully read inputs file ... Castro git describe: 24.04-11-g2407e8176 AMReX git describe: 24.04-8-g2cd72a3bb Microphysics git describe: 24.04-4-ge5fecb7a reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.035170213 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.031074203 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.38008411 Gravity::multilevel_solve_for_new_phi() time = 1.873199128 Gravity::fill_multipole_BCs() time = 0.376094692 ... norm of composite residual at level 0 3.509358608e-10 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.583758759 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.584005663 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.287624606e+47 ener added: 6.129070894e+49 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.44936293e+25 ymom added: -1.046793351e+26 zmom added: -4.133074948e+24 eint added: 0 ener added: -1.270533196e+50 Castro::do_old_sources() time = 2.687929052 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.00547245e+47 ener added: 1.651139801e+46 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.27963109 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.483885634 Gravity::multilevel_solve_for_new_phi() time = 1.533818121 Castro::construct_new_gravity() time = 1.653296997 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.440206272e+49 ener added: 2.911791643e+45 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.451207927e+26 ymom added: 1.108730191e+26 zmom added: -5.613112907e+26 eint added: 0 ener added: 1.260457978e+50 Castro::do_new_sources() time = 2.374578706 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.00947637e+27 ener added: 2.068773556e+27 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.02437067605 [Level 0 step 1] Advanced 884736 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.191111111e+26 ener added: 6.213783704e+26 Updating the rotational period from 30.54368673 s to 30.45939751 s. [STEP 1] Coarse TimeStep time: 38.59695491 [STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.036928866 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.415912323 Gravity::multilevel_solve_for_new_phi() time = 1.987484251 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.306135866e+46 ener added: 9.211440366e+51 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135286e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.849559407e+31 ener added: 2.785926976e+31  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.467239918 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.200514105e+40 ener added: 6.433158322e+33 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.533896722e+24 ymom added: 4.756222074e+26 zmom added: -2.8670017e+23 eint added: 0 ener added: -1.721443002e+45 Castro::do_old_sources() time = 2.331732044 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.941741 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.147330623e+31 ener added: 1.147330701e+31 Castro::construct_old_gravity() time = 0.038317484 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503703704e+23 ener added: 6.281481481e+23 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.197253778e+40 ener added: 1.791685121e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.57162542e+22 ymom added: 1.475739526e+22 zmom added: 6.441948907e+21 eint added: 0 ener added: -2.586789965e+47 Castro::do_old_sources() time = 0.212768937 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.204912576e+51 ener added: 6.747117479e+48 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.844810998 on level 1 Castro::reflux() at level 0 : time = 2.349525065 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.433843689 Gravity::multilevel_solve_for_new_phi() time = 1.410020531 Castro::construct_new_gravity() time = 1.530044397 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.46375568e+41 ener added: 7.485558923e+35 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.861679586e+21 ymom added: -6.245616015e+21 zmom added: -1.245900444e+20 eint added: 0 ener added: -3.223710603e+41 Castro::do_new_sources() time = 2.086128279 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.149299259e+26 ener added: 4.592592593e+21 ...estimated hydro-limited timestep at level 0: 0.05461716025 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025 Castro::construct_new_gravity() time = 0.030619491 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.564837764e+47 ener added: 4.559472528e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.764827561e+18 ymom added: -1.360987807e+19 zmom added: -8.21911451e+19 eint added: 0 ener added: 2.564611685e+47 Castro::do_new_sources() time = 0.143450813 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.281889991e+29 ener added: 3.281888214e+29 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02226851508 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.057555556e+24 ener added: 5.917703704e+24 Updating the rotational period from 30.45939751 s to 30.52749735 s. [STEP 2] Coarse TimeStep time: 51.10798191 [STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008131491259 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.287037368e-07 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Now regridding at level lbase = 0 grid_places() time: 0.032242193 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.404170152 Gravity::multilevel_solve_for_new_phi() time = 0.536511933 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.416601489 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.083120164e+24 ymom added: 5.231862796e+26 zmom added: -3.157856713e+23 eint added: 0 ener added: -1.937110674e+45 Castro::do_old_sources() time = 2.521003889 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 22.19483837 on level 0 Castro::construct_old_gravity() time = 0.03544338 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.818691374e+40 ener added: 1.212217725e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 8.443208519e+22 ymom added: 4.132070673e+21 zmom added: 7.103005275e+21 eint added: 0 ener added: -2.344787748e+45 Castro::do_old_sources() time = 0.203356255 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.83673455e+48 ener added: 2.077900047e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.855338692 on level 1 Castro::reflux() at level 0 : time = 2.353468091 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.428060299 Gravity::multilevel_solve_for_new_phi() time = 0.986153725 Castro::construct_new_gravity() time = 1.098222054 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.106550538e+21 ymom added: -7.896156836e+21 zmom added: 1.108336323e+20 eint added: 0 ener added: -3.427512073e+41 Castro::do_new_sources() time = 2.104477912 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008131520194 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194 Castro::construct_new_gravity() time = 0.029736924 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.244373444e+43 ener added: 1.74625952e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: -6.817150763e+17 ymom added: 2.350879005e+19 zmom added: 9.539392006e+19 eint added: 0 ener added: 5.303047905e+43 Castro::do_new_sources() time = 0.141080531 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.490463796e+26 ener added: 1.495539352e+26 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02242646718 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.281481481e+24 ener added: 6.674962963e+24 Updating the rotational period from 30.52749735 s to 30.52751553 s. [STEP 3] Coarse TimeStep time: 48.76502156 [STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008130329735 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.564309766e-07 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Now regridding at level lbase = 0 grid_places() time: 0.032159452 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.414453126 Gravity::multilevel_solve_for_new_phi() time = 0.546135566 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.370468638 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.694655893e+24 ymom added: 5.755038681e+26 zmom added: -3.471622784e+23 eint added: 0 ener added: -2.130751807e+45 Castro::do_old_sources() time = 2.405581654 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.88512193 on level 0 Castro::construct_old_gravity() time = 0.029456793 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.150425349e+40 ener added: 1.373884257e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 9.198276178e+22 ymom added: 1.239621202e+22 zmom added: 8.024045442e+21 eint added: 0 ener added: -2.520808161e+45 Castro::do_old_sources() time = 0.198944063 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.318881554e+48 ener added: 1.675623034e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.872938318 on level 1 Castro::reflux() at level 0 : time = 2.348264151 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.434246122 Gravity::multilevel_solve_for_new_phi() time = 0.994385914 Castro::construct_new_gravity() time = 1.112666249 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.405071346e+21 ymom added: -9.735495453e+21 zmom added: -7.674479504e+18 eint added: 0 ener added: -3.723007452e+41 Castro::do_new_sources() time = 2.084717986 on level 0 ...estimated hydro-limited timestep at level 0: 0.000813036171 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171 Castro::construct_new_gravity() time = 0.029832531 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.983601425e+43 ener added: 1.617265925e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.598895467e+18 ymom added: -2.568853227e+19 zmom added: -1.336956331e+19 eint added: 0 ener added: 4.042918443e+43 Castro::do_new_sources() time = 0.144090845 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.942862037e+25 ener added: 2.885587963e+25 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02267038803 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.365462963e+23 ener added: 4.62962963e+19 Updating the rotational period from 30.52751553 s to 30.52751552 s. [STEP 4] Coarse TimeStep time: 48.21757151 [STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002506596503 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.863488975e-07 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Now regridding at level lbase = 0 grid_places() time: 0.032478878 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.414842984 Gravity::multilevel_solve_for_new_phi() time = 0.546301779 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.506140941 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.366517551e+24 ymom added: 6.330531998e+26 zmom added: -3.819056992e+23 eint added: 0 ener added: -2.343742535e+45 Castro::do_old_sources() time = 2.367327843 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.93557455 on level 0 Castro::construct_old_gravity() time = 0.029411796 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.560109532e+40 ener added: 1.662186973e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.013496117e+23 ymom added: 1.770887431e+22 zmom added: 8.796070504e+21 eint added: 0 ener added: -2.728291723e+45 Castro::do_old_sources() time = 0.198480475 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.05099824e+48 ener added: 1.448876286e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.853392242 on level 1 Castro::reflux() at level 0 : time = 2.331823457 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.434955504 Gravity::multilevel_solve_for_new_phi() time = 0.994808155 Castro::construct_new_gravity() time = 1.109038972 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.799171515e+21 ymom added: -1.177853541e+22 zmom added: -4.924059364e+18 eint added: 0 ener added: -4.148475158e+41 Castro::do_new_sources() time = 2.11212767 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006828000901 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901 Castro::construct_new_gravity() time = 0.029757605 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.326552265e+43 ener added: 1.577214716e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.726536205e+18 ymom added: -2.54093091e+19 zmom added: -1.252338618e+19 eint added: 0 ener added: 3.390623254e+43 Castro::do_new_sources() time = 0.143414852 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.819509259e+24 ener added: 4.717583333e+24 ...estimated hydro-limited timestep at level 1: 7.169281148e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02262985932 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.94814634e+22 ener added: 2.962962963e+20 Updating the rotational period from 30.52751552 s to 30.52751551 s. [STEP 5] Coarse TimeStep time: 48.32193754 [STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.555651162 seconds Ending run at 07:13:53 UTC on 2024-04-08. Run time = 247.5922043 Run time without initialization = 235.5670853 Average number of zones advanced per microsecond: 0.021 Average number of zones advanced per microsecond per rank: 0.005 TinyProfiler total time across processes [min...avg...max]: 247.6 ... 247.6 ... 247.6 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 9 96.3025 105.5570 109.8996 44.39% Castro::computeTemp() 88 14.93 16.78 17.52 7.08% amrex::Copy() 679 13.16 14.59 15.2 6.14% check_for_negative_density() 9 0.3264 4.69 13.93 5.63% MultiFab::AddProduct() 4205 10.7 11.94 12.38 5.00% Castro::normalize_species() 87 10.22 11.41 11.86 4.79% FabArray::ParallelCopy_finish() 830 1.526 4.657 11.27 4.55% Castro::reset_internal_energy(Fab) 1476 8.574 9.552 9.932 4.01% Castro::estTimeStep() 26 4.168 5.735 9.052 3.66% FabArray::setVal() 5070 7.021 7.795 8.079 3.26% MultiFab::Subtract() 175 6.94 7.732 8.017 3.24% Castro::reset_internal_energy(MultiFab) 88 3.975 4.488 5.041 2.04% Gravity::fill_multipole_BCs() 11 4.322 4.405 4.541 1.83% FabArray::sum() 4205 3.403 3.789 3.934 1.59% FluxRegister::Reflux() 24 3.065 3.417 3.589 1.45% FabArray::ParallelCopy_nowait() 830 2.126 2.328 2.751 1.11% MLPoisson::Fsmooth() 1376 2.157 2.426 2.52 1.02% Castro::enforce_min_density() 87 1.685 1.99 2.346 0.95% Castro::reflux() 4 1.584 1.756 1.848 0.75% Castro::FluxRegCrseInit 9 1.548 1.74 1.833 0.74% Castro::wd_update() 6 0.5257 0.9394 1.714 0.69% FillPatchInterp(MF) 30 1.246 1.337 1.438 0.58% Castro::construct_old_gravity_source() 18 1.147 1.277 1.418 0.57% Castro::construct_new_gravity_source() 9 1.082 1.177 1.307 0.53% Amr::InitAmr() 1 1.251 1.251 1.251 0.51% Castro::initMFs() 5 1.07 1.133 1.196 0.48% amrex::Add() 136 1.009 1.132 1.178 0.48% MLPoisson::Fapply() 318 0.8995 1.008 1.054 0.43% Castro::problem_post_timestep() 10 0.8299 0.9432 1.034 0.42% FillPatchIterator::Initialize 62 0.8567 0.9314 0.9922 0.40% FillBoundary_finish() 1553 0.3538 0.5231 0.9681 0.39% Castro::volInBoundary() 42 0.8346 0.8389 0.8447 0.34% FabArray::Saxpy() 182 0.7113 0.7948 0.8247 0.33% VisMF::Write(FabArray) 3 0.6089 0.6853 0.7423 0.30% StateData::FillBoundary(geom) 50 0.6141 0.6351 0.6637 0.27% Castro::construct_new_source() 63 0.4963 0.5478 0.5751 0.23% MLCellLinOp::applyBC() 1742 0.3832 0.4544 0.4967 0.20% MultiFab::contains_nan() 18 0.3996 0.4415 0.4594 0.19% FillBoundary_nowait() 1553 0.35 0.4123 0.4564 0.18% MultiFab::max() 18 0.02233 0.1734 0.4344 0.18% FabArray::Xpay() 283 0.3601 0.4044 0.4203 0.17% Castro::initialize_do_advance() 9 0.2613 0.2916 0.3096 0.13% Amr::writePlotFile() 2 0.08949 0.1687 0.2826 0.11% FabArray::setDomainBndry() 92 0.2138 0.2365 0.2615 0.11% Castro::construct_old_source() 63 0.2135 0.2357 0.2484 0.10% amrex::average_down 233 0.2033 0.2124 0.2167 0.09% Castro::fill_hybrid_hydro_source() 27 0.1667 0.1858 0.1927 0.08% Castro::initData() 1 0.1339 0.1509 0.1758 0.07% MLCellLinOp::defineAuxData() 11 0.1551 0.169 0.1745 0.07% MLPoisson::FFlux() 150 0.004809 0.04195 0.1532 0.06% MLCellLinOp::compGrad() 18 0.1262 0.1399 0.145 0.06% StateData::define() 25 0.1198 0.1306 0.1419 0.06% MLMG::addInterpCorrection() 155 0.1111 0.1263 0.1323 0.05% FabArray::mult() 56 0.1129 0.126 0.1313 0.05% Castro::evaluate_source_change() 193 0.111 0.1184 0.1228 0.05% Castro::swap_state_time_levels() 9 0.0948 0.1025 0.1169 0.05% Gravity::get_new_grav_vector() 10 0.08836 0.0974 0.1011 0.04% Castro::initialize_advance() 9 0.07606 0.08912 0.09761 0.04% Gravity::get_old_grav_vector() 9 0.07981 0.09028 0.09705 0.04% MLMG::prepareForSolve() 10 0.07031 0.07315 0.07572 0.03% Castro::do_old_sources() 9 0.000668 0.02544 0.07471 0.03% MLCellLinOp::updateSolBC() 25 0.06728 0.06799 0.06936 0.03% MLMG::solve() 10 0.0004085 0.04249 0.06793 0.03% FabArray::norminf(mask) 21 0.05568 0.06249 0.06521 0.03% AmrMesh::MakeNewGrids() 6 0.04867 0.05164 0.05873 0.02% Castro::apply_tagging_restrictions() 6 0.04739 0.05347 0.05597 0.02% AmrLevel::FillPatch() 62 0.04832 0.05142 0.05562 0.02% MLMG::ResNormInf() 54 0.006415 0.01987 0.04833 0.02% MLCellLinOp::updateCorBC() 17 0.04591 0.04644 0.04766 0.02% BndryData::define() 27 0.04396 0.04491 0.04571 0.02% FabArray::norminf() 147 0.03761 0.04034 0.04419 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.03444 0.03671 0.03911 0.02% MLCellLinOp::reflux() 30 0.004599 0.01286 0.03745 0.02% MLMG::MLResNormInf() 15 0.0001082 0.02424 0.03546 0.01% Castro::FluxRegFineAdd() 9 0.0322 0.03351 0.03457 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.0203 0.02372 0.02938 0.01% Castro::build_fine_mask() 44 0.01759 0.02102 0.02856 0.01% MLCellLinOp::defineBC() 11 0.02603 0.02654 0.02702 0.01% MultiFab::Multiply() 8 0.02227 0.02474 0.02562 0.01% Castro::buildMetrics() 5 0.01657 0.01791 0.01924 0.01% Castro::Castro() 5 0.0168 0.01824 0.01903 0.01% MLMG::interpCorrection_1 17 0.01888 0.01894 0.01903 0.01% MLLinOp::makeSubCommunicator() 11 0.0006384 0.008016 0.01895 0.01% FabArrayBase::CPC::define() 416 0.01338 0.01514 0.01842 0.01% Castro::linear_to_hybrid_momentum() 1 0.0139 0.01585 0.01711 0.01% FillPatchTwoLevels 31 0.01384 0.01441 0.01477 0.01% MLCellLinOp::prepareForSolve() 11 0.01186 0.01206 0.01226 0.00% FabArrayBase::getCPC() 1440 0.01061 0.011 0.01145 0.00% Gravity::actual_multilevel_solve() 10 0.008661 0.01012 0.01135 0.00% Castro::enforce_consistent_e() 1 0.009265 0.01057 0.01117 0.00% Gravity::actual_solve_with_mlmg() 11 0.01064 0.0109 0.01114 0.00% Gravity::update_max_rhs() 10 0.008352 0.009689 0.01069 0.00% AMRErrorTag::operator() 6 0.008748 0.009844 0.01022 0.00% Castro::finalize_do_advance() 9 0.008617 0.009257 0.009617 0.00% Castro::apply_problem_tags() 6 0.006868 0.007724 0.008054 0.00% DistributionMapping::LeastUsedCPUs() 5 0.000826 0.005173 0.007677 0.00% Castro::do_new_sources() 9 0.0006502 0.002363 0.007437 0.00% StateDataPhysBCFunct::() 95 0.002443 0.005043 0.007399 0.00% average_down_faces 48 0.005951 0.006067 0.006257 0.00% AmrLevel::derive() 6 0.003864 0.004891 0.005952 0.00% MLCellLinOp::setLevelBC() 19 0.004243 0.005084 0.005647 0.00% FabArray::FillBoundary() 1553 0.004576 0.004734 0.004935 0.00% Gravity::test_composite_phi() 1 0.002245 0.002959 0.004396 0.00% MLCellLinOp::smooth() 688 0.004079 0.00424 0.004387 0.00% MLCGSolver::bicgstab 7 0 0.0009845 0.003938 0.00% amrex::Dot() 115 0 0.0009564 0.003826 0.00% FabArrayBase::getFB() 1553 0.003122 0.003329 0.003577 0.00% FabArray::ParallelCopy() 830 0.003042 0.003114 0.003279 0.00% FabArrayBase::FB::FB() 19 0.002693 0.002908 0.003134 0.00% main() 1 0.001812 0.001822 0.001831 0.00% MLLinOp::defineGrids() 11 0.001333 0.001523 0.001695 0.00% Castro::construct_old_gravity() 9 0.0004284 0.0009421 0.00163 0.00% MLCellLinOp::apply() 318 0.0009647 0.001132 0.001573 0.00% Amr::regrid() 5 0.001136 0.001277 0.00157 0.00% Castro::clean_state() 87 0.001343 0.001413 0.001455 0.00% TagBoxArray::collate() 6 0.0004399 0.0009547 0.001251 0.00% Amr::coarseTimeStep() 5 0.000508 0.0009936 0.001168 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0002882 0.001153 0.00% Castro::construct_new_gravity() 9 0.0004525 0.0006595 0.001082 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0009658 0.0009778 0.0009983 0.00% AmrLevel::FillCoarsePatch() 5 0.0009369 0.0009602 0.0009821 0.00% OwnerMask() 6 0.0007683 0.0008517 0.0009351 0.00% MLCellLinOp::correctionResidual() 189 0.0007331 0.0007627 0.0008069 0.00% MLMG::mgVcycle() 65 0.0006362 0.0006494 0.0006669 0.00% Castro::do_advance_ctu() 5 0.0005674 0.0006083 0.000654 0.00% FillPatchSingleLevel 92 0.0005824 0.0005949 0.0006167 0.00% Amr::grid_places() 6 0.0004614 0.0005339 0.0006014 0.00% Castro::finalize_advance() 9 0.0003937 0.0004576 0.0005188 0.00% FillPatchIterator::FillFromLevel0() 31 0.0004339 0.0004556 0.0004965 0.00% TagBoxArray::mapPRD 6 0.0004658 0.0004773 0.0004913 0.00% MLMG:computeResOfCorrection() 155 0.0004212 0.0004351 0.0004672 0.00% MLMG::oneIter() 31 0.0003692 0.0003905 0.0004215 0.00% Castro::subcycle_advance_ctu() 5 0.0001101 0.0001944 0.0004213 0.00% MLCellLinOp::solutionResidual() 72 0.0003698 0.0003869 0.0004016 0.00% MLMG::actualBottomSolve() 31 4.385e-05 0.0001241 0.0003628 0.00% FillPatchIterator::FillFromTwoLevels() 31 0.0003368 0.0003384 0.0003412 0.00% MLMG::mgVcycle_down::0 31 0.0002883 0.0003095 0.0003343 0.00% Castro::enforce_speed_limit() 87 0.0002843 0.0002978 0.0003092 0.00% Gravity::solve_phi_with_mlmg() 11 0.0002483 0.000266 0.0002958 0.00% Castro::post_regrid() 10 0.0002214 0.0002486 0.000286 0.00% Amr::timeStep() 9 0.0002212 0.0002446 0.0002857 0.00% MLMG::mgVcycle_down::1 31 0.0002513 0.0002704 0.0002813 0.00% Amr::defBaseLevel() 1 0.0002449 0.0002611 0.0002766 0.00% MLMG::mgVcycle_bottom 65 0.0002165 0.0002307 0.0002502 0.00% Castro::computeNewDt() 8 0.0001331 0.000166 0.0002349 0.00% MLMG::mgVcycle_up::0 31 0.000193 0.0002053 0.0002334 0.00% AmrLevel::AmrLevel(dm) 5 0.0001988 0.0002068 0.000224 0.00% MLMG::mgVcycle_down::2 31 0.0002011 0.0002117 0.000218 0.00% makeSFC 33 0.0001497 0.0001796 0.0002177 0.00% MLMG::mgVcycle_down::3 31 0.0002014 0.0002087 0.0002152 0.00% FabArrayBase::TheFPinfo() 25 0.0001816 0.0001853 0.0001885 0.00% MLMG::mgVcycle_down::4 31 0.0001801 0.000182 0.0001858 0.00% Castro::check_for_nan() 18 0.0001439 0.0001516 0.0001627 0.00% MLMG::mgVcycle_up::1 31 0.0001521 0.0001547 0.0001602 0.00% Castro::react_state() 18 0.0001257 0.0001376 0.0001543 0.00% MLMG::mgVcycle_up::2 31 0.0001381 0.0001442 0.000152 0.00% MLMG::computeResWithCrseSolFineCor() 17 0.0001394 0.0001444 0.000149 0.00% MLMG::mgVcycle_up::3 31 0.0001338 0.0001371 0.0001433 0.00% FPinfo::FPinfo() 3 0.0001143 0.0001243 0.0001368 0.00% Castro::advance() 5 8.515e-05 0.0001037 0.000134 0.00% Castro::expand_state() 13 0.0001186 0.0001259 0.0001338 0.00% MLMG::mgVcycle_up::4 31 0.0001222 0.0001269 0.0001305 0.00% Castro::apply_source_to_state() 18 0.0001164 0.0001214 0.0001278 0.00% Castro::errorEst() 6 0.000114 0.0001212 0.000126 0.00% DistributionMapping::Distribute() 35 0.000109 0.0001189 0.0001259 0.00% MLPoisson::define() 11 0.0001044 0.0001123 0.0001207 0.00% FabArray::RecvLayoutMask() 8 0.0001105 0.0001142 0.0001185 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0001046 0.0001112 0.000118 0.00% Amr::writeSmallPlotFile() 1 9.414e-05 0.0001032 0.0001174 0.00% Amr::FinalizeInit() 1 4.618e-05 6.716e-05 0.0001085 0.00% Gravity::swapTimeLevels() 9 9.739e-05 0.0001008 0.0001066 0.00% MLMG::computeResidual() 31 9.251e-05 9.912e-05 0.0001049 0.00% Castro::post_timestep() 9 8.18e-05 9.112e-05 0.0001025 0.00% MLMG::computeMLResidual() 15 8.414e-05 8.873e-05 9.197e-05 0.00% Castro::avgDown(state_indx) 20 7.95e-05 8.238e-05 8.541e-05 0.00% ClusterList::intersect() 1 0 2.131e-05 8.524e-05 0.00% Castro::create_source_corrector() 9 6.001e-05 6.808e-05 8.068e-05 0.00% MLMG::miniCycle() 34 7.004e-05 7.454e-05 7.932e-05 0.00% knapsack() 3 6.302e-05 7.213e-05 7.772e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 7.216e-05 7.328e-05 7.462e-05 0.00% amrex::average_down_w_geom 20 5.568e-05 6.315e-05 7.267e-05 0.00% MLLinOp::define() 11 6.617e-05 6.884e-05 7.217e-05 0.00% Gravity::set_mass_offset() 6 4.715e-05 5.836e-05 7.011e-05 0.00% MLMG::getGradSolution() 10 5.856e-05 6.433e-05 6.734e-05 0.00% Castro::construct_new_hybrid_source() 9 5.035e-05 5.292e-05 5.757e-05 0.00% Amr::initSubcycle() 1 4.938e-05 5.19e-05 5.34e-05 0.00% MLPoisson::prepareForSolve() 11 4.346e-05 4.732e-05 5.199e-05 0.00% Castro::init(old) 3 4.608e-05 4.915e-05 5.112e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 4.267e-05 4.428e-05 4.807e-05 0.00% Castro::retry_advance_ctu() 5 2.35e-05 3.173e-05 4.716e-05 0.00% AmrMesh-cluster 1 0 1.066e-05 4.264e-05 0.00% Castro::construct_new_rotation_source() 9 2.297e-05 2.828e-05 4.229e-05 0.00% Castro::construct_old_hybrid_source() 9 3.951e-05 4.035e-05 4.155e-05 0.00% MLMG::MLRhsNormInf() 10 3.184e-05 3.417e-05 3.771e-05 0.00% Castro::post_init() 1 2.842e-05 3.173e-05 3.658e-05 0.00% Castro::avgDown() 4 3.082e-05 3.347e-05 3.655e-05 0.00% BoxList::complementIn 12 2.442e-05 2.961e-05 3.641e-05 0.00% DistributionMapping::KnapSackDoIt() 3 3.04e-05 3.267e-05 3.502e-05 0.00% BoxList::parallelComplementIn() 12 2.724e-05 3.109e-05 3.452e-05 0.00% MLMG::compResidual() 1 2.668e-05 2.92e-05 3.182e-05 0.00% Amr::bldFineLevels() 1 2.246e-05 2.638e-05 3.006e-05 0.00% Castro::construct_old_rotation_source() 9 2.277e-05 2.435e-05 2.62e-05 0.00% Castro::computeInitialDt() 2 1.99e-05 2.246e-05 2.535e-05 0.00% Castro::derive() 6 2.07e-05 2.247e-05 2.497e-05 0.00% Castro::init() 1 1.633e-05 1.774e-05 1.911e-05 0.00% Amr::InitializeInit() 1 7.921e-06 1.062e-05 1.527e-05 0.00% Amr::init() 1 7.328e-06 9.216e-06 1.192e-05 0.00% ClusterList::chop() 1 0 2.785e-06 1.114e-05 0.00% Amr::initialInit() 1 4.948e-06 6.533e-06 8.021e-06 0.00% knapsack()swap 1 3.388e-06 3.89e-06 4.364e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 247.6 247.6 247.6 100.00% Amr::coarseTimeStep() 5 235 235 235 94.92% Amr::timeStep() 9 233.6 233.6 233.6 94.36% Castro::advance() 5 205.3 205.3 205.3 82.90% Castro::subcycle_advance_ctu() 5 196.5 196.8 197.7 79.86% Castro::do_advance_ctu() 5 196.5 196.8 197.7 79.86% Castro::construct_ctu_hydro_source() 9 120.5 120.6 120.6 48.71% Castro::clean_state() 87 73.11 81.75 85.47 34.52% Castro::computeTemp() 88 46.62 52.07 54.38 21.97% Castro::reset_internal_energy(MultiFab) 88 31.69 35.29 36.87 14.89% Castro::evaluate_source_change() 193 17.79 19.83 20.58 8.31% Castro::enforce_min_density() 87 17.08 19.17 20.18 8.15% Castro::post_regrid() 10 16.33 17.83 18.41 7.43% Amr::regrid() 5 16.1 17.5 18.05 7.29% Castro::initialize_do_advance() 9 15.09 15.38 15.64 6.32% amrex::Copy() 679 13.16 14.59 15.2 6.14% AmrLevel::FillPatch() 62 8.475 10.12 14.47 5.85% check_for_negative_density() 9 0.3264 4.69 13.93 5.63% FabArray::ParallelCopy() 830 4.345 7.051 13.57 5.48% Castro::do_old_sources() 9 11.44 11.87 13.13 5.30% FillPatchIterator::Initialize 62 6.757 8.456 12.98 5.24% MultiFab::AddProduct() 4205 10.7 11.94 12.38 5.00% Castro::normalize_species() 87 10.22 11.41 11.86 4.79% Gravity::solve_phi_with_mlmg() 11 11.49 11.58 11.71 4.73% Gravity::multilevel_solve_for_new_phi() 10 11.2 11.28 11.4 4.61% Gravity::actual_multilevel_solve() 10 11.16 11.25 11.37 4.59% Castro::do_new_sources() 9 9.74 10.78 11.33 4.58% FabArray::ParallelCopy_finish() 830 1.526 4.657 11.27 4.55% FillPatchSingleLevel 92 4.36 6.155 10.8 4.36% Amr::init() 1 10.77 10.77 10.77 4.35% Castro::post_timestep() 9 10.74 10.74 10.74 4.34% FillPatchIterator::FillFromLevel0() 31 3.993 5.748 10.35 4.18% Amr::initialInit() 1 10.19 10.19 10.19 4.12% Castro::reset_internal_energy(Fab) 1476 8.574 9.552 9.932 4.01% Castro::reflux() 4 9.286 9.348 9.382 3.79% Castro::estTimeStep() 26 4.168 5.735 9.052 3.66% Castro::initialize_advance() 9 7.529 8.409 8.766 3.54% FabArray::setVal() 5070 7.021 7.795 8.079 3.26% MultiFab::Subtract() 175 6.94 7.732 8.017 3.24% Gravity::actual_solve_with_mlmg() 11 7.068 7.075 7.081 2.86% Castro::expand_state() 13 5.383 5.832 6.726 2.72% Castro::construct_new_gravity() 9 6.436 6.509 6.622 2.67% MLMG::solve() 10 6.553 6.562 6.58 2.66% Amr::FinalizeInit() 1 5.976 6.205 6.46 2.61% MLMG::oneIter() 31 5.319 5.341 5.352 2.16% Gravity::fill_multipole_BCs() 11 4.404 4.487 4.614 1.86% FluxRegister::Reflux() 24 4.518 4.531 4.539 1.83% MLMG::mgVcycle() 65 4.47 4.501 4.513 1.82% Castro::problem_post_timestep() 10 3.246 3.653 4.428 1.79% Amr::InitializeInit() 1 3.73 3.984 4.213 1.70% Amr::defBaseLevel() 1 3.73 3.984 4.213 1.70% Castro::finalize_do_advance() 9 1.394 2.295 4.127 1.67% FabArray::sum() 4205 3.403 3.789 3.934 1.59% Castro::computeNewDt() 8 2.263 2.7 3.929 1.59% MLCellLinOp::smooth() 688 3.393 3.425 3.457 1.40% Castro::post_init() 1 2.653 2.806 3.071 1.24% Castro::FluxRegCrseInit 9 1.904 2.268 3.018 1.22% FabArray::ParallelCopy_nowait() 830 2.188 2.391 2.816 1.14% Castro::initData() 1 2.334 2.563 2.71 1.09% Castro::wd_update() 6 1.371 1.778 2.554 1.03% MLPoisson::Fsmooth() 1376 2.157 2.426 2.52 1.02% Castro::construct_new_source() 63 2.169 2.329 2.497 1.01% Castro::construct_old_gravity() 9 0.6965 1.309 2.474 1.00% Gravity::get_old_grav_vector() 9 0.6949 1.308 2.474 1.00% MLMG::mgVcycle_down::0 31 1.955 2.031 2.072 0.84% MLCellLinOp::applyBC() 1742 1.241 1.401 1.819 0.73% Amr::bldFineLevels() 1 1.314 1.483 1.594 0.64% FillPatchIterator::FillFromTwoLevels() 31 1.511 1.541 1.565 0.63% FillPatchTwoLevels 31 1.511 1.541 1.564 0.63% MLMG::mgVcycle_up::0 31 1.433 1.462 1.472 0.59% Castro::Castro() 5 1.306 1.37 1.441 0.58% FillPatchInterp(MF) 30 1.246 1.337 1.438 0.58% FabArray::FillBoundary() 1553 0.7542 0.9463 1.436 0.58% Castro::construct_old_gravity_source() 18 1.147 1.277 1.418 0.57% MLCellLinOp::apply() 318 1.317 1.344 1.366 0.55% Castro::construct_new_gravity_source() 9 1.082 1.177 1.307 0.53% Amr::InitAmr() 1 1.251 1.251 1.251 0.51% Castro::initMFs() 5 1.077 1.139 1.201 0.49% amrex::Add() 136 1.009 1.132 1.178 0.48% Amr::writePlotFile() 2 1.14 1.14 1.14 0.46% Castro::construct_old_source() 63 0.963 1.076 1.125 0.45% MLCellLinOp::solutionResidual() 72 0.9971 1.047 1.071 0.43% MLPoisson::Fapply() 318 0.8995 1.008 1.054 0.43% Castro::computeInitialDt() 2 0.521 0.7498 1.005 0.41% FillBoundary_finish() 1553 0.3538 0.5231 0.9681 0.39% MLCellLinOp::correctionResidual() 189 0.8305 0.8374 0.8493 0.34% Castro::volInBoundary() 42 0.8347 0.8389 0.8448 0.34% FabArray::Saxpy() 182 0.7113 0.7948 0.8247 0.33% Gravity::get_new_grav_vector() 10 0.7939 0.8052 0.817 0.33% VisMF::Write(FabArray) 3 0.6089 0.6853 0.7423 0.30% MLMG:computeResOfCorrection() 155 0.6712 0.7087 0.7333 0.30% StateDataPhysBCFunct::() 95 0.6166 0.6402 0.6708 0.27% StateData::FillBoundary(geom) 50 0.6141 0.6351 0.6637 0.27% MLMG::computeResWithCrseSolFineCor() 17 0.5877 0.5906 0.5937 0.24% MLMG::computeMLResidual() 15 0.4214 0.4437 0.5003 0.20% Gravity::update_max_rhs() 10 0.08411 0.2353 0.4979 0.20% Castro::init() 1 0.4839 0.4858 0.4871 0.20% AmrLevel::FillCoarsePatch() 5 0.4838 0.4857 0.4871 0.20% FillBoundary_nowait() 1553 0.3562 0.4185 0.4628 0.19% Castro::check_for_nan() 18 0.3998 0.4417 0.4596 0.19% MultiFab::contains_nan() 18 0.3996 0.4415 0.4594 0.19% MultiFab::max() 18 0.02233 0.1734 0.4344 0.18% MLMG::mgVcycle_down::1 31 0.3215 0.3599 0.4293 0.17% Gravity::test_composite_phi() 1 0.4187 0.4199 0.4222 0.17% FabArray::Xpay() 283 0.3601 0.4044 0.4203 0.17% amrex::average_down 233 0.2898 0.3675 0.4083 0.16% MLCellLinOp::reflux() 30 0.1816 0.2335 0.3708 0.15% MLMG::computeResidual() 31 0.3625 0.3658 0.3703 0.15% Castro::init(old) 3 0.3635 0.3654 0.3676 0.15% Castro::apply_source_to_state() 18 0.2861 0.3183 0.3304 0.13% MLPoisson::define() 11 0.293 0.2996 0.3083 0.12% FabArray::setDomainBndry() 92 0.2138 0.2365 0.2615 0.11% Castro::react_state() 18 0.2164 0.2399 0.2523 0.10% MLMG::mgVcycle_up::1 31 0.2315 0.2354 0.2371 0.10% MLMG::prepareForSolve() 10 0.2234 0.2258 0.229 0.09% MLCellLinOp::defineAuxData() 11 0.183 0.1999 0.2083 0.08% Amr::grid_places() 6 0.2 0.2 0.2001 0.08% AmrMesh::MakeNewGrids() 6 0.1994 0.1995 0.1996 0.08% MLMG::addInterpCorrection() 155 0.1375 0.1739 0.1936 0.08% Castro::fill_hybrid_hydro_source() 27 0.1667 0.1858 0.1927 0.08% MLMG::mgVcycle_bottom 65 0.1603 0.1677 0.1895 0.08% MLMG::getGradSolution() 10 0.1738 0.1771 0.1788 0.07% MLCellLinOp::compGrad() 18 0.1737 0.177 0.1787 0.07% MLMG::miniCycle() 34 0.1595 0.1602 0.1606 0.06% MLPoisson::FFlux() 150 0.004809 0.04195 0.1532 0.06% AmrLevel::AmrLevel(dm) 5 0.12 0.1308 0.1421 0.06% StateData::define() 25 0.1198 0.1306 0.1419 0.06% FabArray::mult() 56 0.1129 0.126 0.1313 0.05% Castro::avgDown() 4 0.1261 0.1285 0.1301 0.05% Castro::avgDown(state_indx) 20 0.1261 0.1285 0.1301 0.05% amrex::average_down_w_geom 20 0.126 0.1284 0.13 0.05% Castro::construct_new_hybrid_source() 9 0.1103 0.1236 0.1284 0.05% Castro::errorEst() 6 0.1054 0.1186 0.1237 0.05% Castro::swap_state_time_levels() 9 0.0948 0.1025 0.1169 0.05% MLMG::ResNormInf() 54 0.08095 0.09047 0.1108 0.04% MLCellLinOp::updateSolBC() 25 0.07805 0.0859 0.09742 0.04% MLMG::computeResWithCrseCorFineCor() 17 0.08823 0.08911 0.09075 0.04% MLCellLinOp::defineBC() 11 0.08868 0.08959 0.09035 0.04% MLMG::mgVcycle_up::3 31 0.0264 0.06727 0.08117 0.03% MLMG::mgVcycle_down::2 31 0.07078 0.07366 0.08101 0.03% MLMG::MLResNormInf() 15 0.04464 0.06763 0.07597 0.03% FabArray::norminf(mask) 21 0.05568 0.06249 0.06521 0.03% Castro::construct_old_hybrid_source() 9 0.05648 0.06238 0.06458 0.03% BndryData::define() 27 0.06038 0.06181 0.06313 0.03% MLMG::interpCorrection_1 17 0.02782 0.03706 0.06035 0.02% Castro::apply_tagging_restrictions() 6 0.04739 0.05347 0.05597 0.02% MLMG::mgVcycle_up::2 31 0.05472 0.05517 0.05551 0.02% MLCellLinOp::updateCorBC() 17 0.05025 0.0512 0.05219 0.02% Castro::derive() 6 0.04232 0.04745 0.05031 0.02% AmrLevel::derive() 6 0.04229 0.04743 0.05029 0.02% Castro::buildMetrics() 5 0.03878 0.04329 0.04841 0.02% FabArray::norminf() 147 0.03761 0.04034 0.04419 0.02% MLMG::mgVcycle_down::3 31 0.03172 0.0328 0.03564 0.01% Gravity::swapTimeLevels() 9 0.03151 0.03382 0.03543 0.01% Castro::FluxRegFineAdd() 9 0.0322 0.03351 0.03457 0.01% TagBoxArray::mapPRD 6 0.004207 0.01672 0.03393 0.01% MLMG::actualBottomSolve() 31 4.385e-05 0.007574 0.03016 0.01% FabArrayBase::getCPC() 1440 0.02413 0.02614 0.02963 0.01% MLMG::MLRhsNormInf() 10 0.02544 0.02839 0.02956 0.01% MLCGSolver::bicgstab 7 0 0.007354 0.02942 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.0203 0.02372 0.02938 0.01% Castro::build_fine_mask() 44 0.01759 0.02102 0.02856 0.01% MultiFab::Multiply() 8 0.02227 0.02474 0.02562 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.02089 0.02156 0.02264 0.01% MLMG::compResidual() 1 0.01875 0.02041 0.02155 0.01% MLLinOp::define() 11 0.002391 0.01001 0.02117 0.01% MLLinOp::defineGrids() 11 0.002325 0.009937 0.0211 0.01% MLMG::mgVcycle_down::4 31 0.006156 0.00947 0.01919 0.01% MLLinOp::makeSubCommunicator() 11 0.0006384 0.008016 0.01895 0.01% FabArrayBase::CPC::define() 416 0.01338 0.01514 0.01842 0.01% Castro::linear_to_hybrid_momentum() 1 0.0139 0.01585 0.01711 0.01% MLMG::mgVcycle_up::4 31 0.004993 0.007351 0.01431 0.01% MLPoisson::prepareForSolve() 11 0.01192 0.0121 0.01231 0.00% MLCellLinOp::prepareForSolve() 11 0.01186 0.01206 0.01226 0.00% Castro::enforce_consistent_e() 1 0.009265 0.01057 0.01117 0.00% average_down_faces 48 0.009289 0.01033 0.01099 0.00% AMRErrorTag::operator() 6 0.008748 0.009844 0.01022 0.00% FabArrayBase::TheFPinfo() 25 0.001174 0.005533 0.008071 0.00% Castro::apply_problem_tags() 6 0.006868 0.007724 0.008054 0.00% FPinfo::FPinfo() 3 0.0009852 0.005348 0.007886 0.00% DistributionMapping::KnapSackDoIt() 3 0.000871 0.005223 0.00775 0.00% DistributionMapping::LeastUsedCPUs() 5 0.000826 0.005173 0.007677 0.00% FabArrayBase::getFB() 1553 0.005815 0.006237 0.006526 0.00% MLCellLinOp::setLevelBC() 19 0.004243 0.005084 0.005647 0.00% amrex::Dot() 115 0 0.0009564 0.003826 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0007957 0.003183 0.00% FabArrayBase::FB::FB() 19 0.002693 0.002908 0.003134 0.00% TagBoxArray::collate() 6 0.0004399 0.0009547 0.001251 0.00% OwnerMask() 6 0.0007683 0.0008517 0.0009351 0.00% Castro::finalize_advance() 9 0.0003937 0.0004576 0.0005188 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0003531 0.0003983 0.0004498 0.00% makeSFC 33 0.0002485 0.0002871 0.0003318 0.00% Castro::enforce_speed_limit() 87 0.0002843 0.0002978 0.0003092 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 9.997e-05 0.0001138 0.0001492 0.00% AmrMesh-cluster 1 0 3.476e-05 0.000139 0.00% DistributionMapping::Distribute() 35 0.000109 0.0001189 0.0001259 0.00% FabArray::RecvLayoutMask() 8 0.0001105 0.0001142 0.0001185 0.00% Amr::writeSmallPlotFile() 1 9.414e-05 0.0001032 0.0001174 0.00% ClusterList::intersect() 1 0 2.131e-05 8.524e-05 0.00% knapsack() 3 6.641e-05 7.602e-05 8.208e-05 0.00% Castro::create_source_corrector() 9 6.001e-05 6.808e-05 8.068e-05 0.00% Gravity::set_mass_offset() 6 4.715e-05 5.836e-05 7.011e-05 0.00% BoxList::parallelComplementIn() 12 5.392e-05 6.07e-05 6.949e-05 0.00% Amr::initSubcycle() 1 4.938e-05 5.19e-05 5.34e-05 0.00% Castro::retry_advance_ctu() 5 2.35e-05 3.173e-05 4.716e-05 0.00% Castro::construct_new_rotation_source() 9 2.297e-05 2.828e-05 4.229e-05 0.00% BoxList::complementIn 12 2.442e-05 2.961e-05 3.641e-05 0.00% Castro::construct_old_rotation_source() 9 2.277e-05 2.435e-05 2.62e-05 0.00% ClusterList::chop() 1 0 2.785e-06 1.114e-05 0.00% knapsack()swap 1 3.388e-06 3.89e-06 4.364e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-8-g2cd72a3bbaeb) finalized