Initializing AMReX (24.04-14-g6c6247554f27)... MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (24.04-14-g6c6247554f27) initialized Starting run at 07:51:11 UTC on 2024-04-11. Successfully read inputs file ... Castro git describe: 24.04-13-g88d497647 AMReX git describe: 24.04-14-g6c6247554 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.031421506 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.030655761 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.357826025 Gravity::multilevel_solve_for_new_phi() time = 1.723313606 Gravity::fill_multipole_BCs() time = 0.360067382 ... norm of composite residual at level 0 3.509358608e-10 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.536575729 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.554354349 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.287624606e+47 ener added: 6.129070894e+49 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.449362757e+25 ymom added: -1.046793351e+26 zmom added: -4.133074948e+24 eint added: 0 ener added: -1.270533196e+50 Castro::do_old_sources() time = 2.682193878 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.00547245e+47 ener added: 1.651139801e+46 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.77116326 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.778521908 Gravity::multilevel_solve_for_new_phi() time = 1.803902382 Castro::construct_new_gravity() time = 1.921554089 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.440206272e+49 ener added: 2.911791643e+45 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.451207922e+26 ymom added: 1.108730191e+26 zmom added: -5.613112907e+26 eint added: 0 ener added: 1.260457978e+50 Castro::do_new_sources() time = 2.288538976 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.00947637e+27 ener added: 2.068773556e+27 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.02414323786 [Level 0 step 1] Advanced 884736 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.191111111e+26 ener added: 6.213783704e+26 Updating the rotational period from 30.54368673 s to 30.45939751 s. [STEP 1] Coarse TimeStep time: 38.73024536 [STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.031877935 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.408665414 Gravity::multilevel_solve_for_new_phi() time = 1.929518984 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.306135866e+46 ener added: 9.211440366e+51 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135286e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.849559407e+31 ener added: 2.785926976e+31  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.530374418 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.200514105e+40 ener added: 6.433158322e+33 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.533896722e+24 ymom added: 4.756222074e+26 zmom added: -2.8670017e+23 eint added: 0 ener added: -1.721443002e+45 Castro::do_old_sources() time = 2.41780315 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 22.05295752 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.147330623e+31 ener added: 1.147330701e+31 Castro::construct_old_gravity() time = 0.031721355 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503703704e+23 ener added: 6.281481481e+23 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.197253778e+40 ener added: 1.791685121e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.574830857e+22 ymom added: 1.534769107e+22 zmom added: 6.441804792e+21 eint added: 0 ener added: -2.586789965e+47 Castro::do_old_sources() time = 0.194929327 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.204912576e+51 ener added: 6.747117479e+48 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.875821563 on level 1 Castro::reflux() at level 0 : time = 2.462780835 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.432949719 Gravity::multilevel_solve_for_new_phi() time = 1.425425303 Castro::construct_new_gravity() time = 1.544936585 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.46375568e+41 ener added: 7.485558923e+35 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.861679586e+21 ymom added: -6.245616015e+21 zmom added: -1.245900444e+20 eint added: 0 ener added: -3.223710603e+41 Castro::do_new_sources() time = 2.089855953 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.149299259e+26 ener added: 4.592592593e+21 ...estimated hydro-limited timestep at level 0: 0.05461716025 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025 Castro::construct_new_gravity() time = 0.030169832 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.564837764e+47 ener added: 4.559472528e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.764827544e+18 ymom added: -1.361438167e+19 zmom added: -8.219114448e+19 eint added: 0 ener added: 2.564611685e+47 Castro::do_new_sources() time = 0.140031846 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.281889991e+29 ener added: 3.281888214e+29 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.0221649277 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.057555556e+24 ener added: 5.917703704e+24 Updating the rotational period from 30.45939751 s to 30.52749735 s. [STEP 2] Coarse TimeStep time: 51.05075651 [STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008131491259 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.287037368e-07 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Now regridding at level lbase = 0 grid_places() time: 0.031967503 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.401545296 Gravity::multilevel_solve_for_new_phi() time = 0.533289307 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.429890556 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.083120164e+24 ymom added: 5.231862796e+26 zmom added: -3.157856713e+23 eint added: 0 ener added: -1.937110674e+45 Castro::do_old_sources() time = 2.42054328 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 22.15191083 on level 0 Castro::construct_old_gravity() time = 0.030091954 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.818691374e+40 ener added: 1.212217725e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 8.443509585e+22 ymom added: 3.836922767e+21 zmom added: 7.103293505e+21 eint added: 0 ener added: -2.344787748e+45 Castro::do_old_sources() time = 0.200817392 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.83673455e+48 ener added: 2.077900047e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.908043448 on level 1 Castro::reflux() at level 0 : time = 2.421494457 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.443857437 Gravity::multilevel_solve_for_new_phi() time = 1.014009361 Castro::construct_new_gravity() time = 1.12692782 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.106550538e+21 ymom added: -7.896156836e+21 zmom added: 1.108336323e+20 eint added: 0 ener added: -3.427512073e+41 Castro::do_new_sources() time = 1.999213184 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008131520194 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194 Castro::construct_new_gravity() time = 0.029568457 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.244373444e+43 ener added: 1.74625952e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: -6.815313548e+17 ymom added: 2.351329365e+19 zmom added: 9.539392989e+19 eint added: 0 ener added: 5.303047905e+43 Castro::do_new_sources() time = 0.139648428 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.490463796e+26 ener added: 1.495539352e+26 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02253210633 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.281481481e+24 ener added: 6.674962963e+24 Updating the rotational period from 30.52749735 s to 30.52751553 s. [STEP 3] Coarse TimeStep time: 48.38003713 [STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008130329735 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.564309766e-07 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Now regridding at level lbase = 0 grid_places() time: 0.031778877 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.401881932 Gravity::multilevel_solve_for_new_phi() time = 0.534988137 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.438462952 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.694655893e+24 ymom added: 5.755038681e+26 zmom added: -3.471622784e+23 eint added: 0 ener added: -2.130751807e+45 Castro::do_old_sources() time = 2.425302921 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.98494003 on level 0 Castro::construct_old_gravity() time = 0.030465048 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.150425349e+40 ener added: 1.373884257e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 9.199931702e+22 ymom added: 1.239621202e+22 zmom added: 8.023757211e+21 eint added: 0 ener added: -2.520808161e+45 Castro::do_old_sources() time = 0.198965591 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.318881554e+48 ener added: 1.675623034e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.986242972 on level 1 Castro::reflux() at level 0 : time = 2.428727933 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.438559982 Gravity::multilevel_solve_for_new_phi() time = 1.024538428 Castro::construct_new_gravity() time = 1.142676586 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.405071347e+21 ymom added: -9.735495453e+21 zmom added: -7.674479504e+18 eint added: 0 ener added: -3.723007452e+41 Castro::do_new_sources() time = 2.100537522 on level 0 ...estimated hydro-limited timestep at level 0: 0.000813036171 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171 Castro::construct_new_gravity() time = 0.030960332 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.983601425e+43 ener added: 1.617265925e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.598866605e+18 ymom added: -2.567952508e+19 zmom added: -1.336958063e+19 eint added: 0 ener added: 4.042918443e+43 Castro::do_new_sources() time = 0.144374866 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.942862037e+25 ener added: 2.885587963e+25 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02250357898 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.365462963e+23 ener added: 4.62962963e+19 Updating the rotational period from 30.52751553 s to 30.52751552 s. [STEP 4] Coarse TimeStep time: 48.47593839 [STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002506596503 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.863488975e-07 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Now regridding at level lbase = 0 grid_places() time: 0.032759148 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.410701615 Gravity::multilevel_solve_for_new_phi() time = 0.546178657 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.442089839 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.366517551e+24 ymom added: 6.330531998e+26 zmom added: -3.819056992e+23 eint added: 0 ener added: -2.343742535e+45 Castro::do_old_sources() time = 2.476758358 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 22.57653082 on level 0 Castro::construct_old_gravity() time = 0.031088595 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.560109532e+40 ener added: 1.662186973e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.013454493e+23 ymom added: 1.770887431e+22 zmom added: 8.796070504e+21 eint added: 0 ener added: -2.728291723e+45 Castro::do_old_sources() time = 0.198366139 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.05099824e+48 ener added: 1.448876286e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.956090208 on level 1 Castro::reflux() at level 0 : time = 2.434781972 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.431201247 Gravity::multilevel_solve_for_new_phi() time = 0.999313058 Castro::construct_new_gravity() time = 1.111506667 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.799171515e+21 ymom added: -1.177853541e+22 zmom added: -4.924059364e+18 eint added: 0 ener added: -4.148475158e+41 Castro::do_new_sources() time = 2.012150204 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006828000901 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901 Castro::construct_new_gravity() time = 0.030368629 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.326552265e+43 ener added: 1.577214716e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.726536205e+18 ymom added: -2.54093091e+19 zmom added: -1.252337587e+19 eint added: 0 ener added: 3.390623254e+43 Castro::do_new_sources() time = 0.142217509 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.819509259e+24 ener added: 4.717583333e+24 ...estimated hydro-limited timestep at level 1: 7.169281148e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02222008823 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.94814634e+22 ener added: 2.962962963e+20 Updating the rotational period from 30.52751552 s to 30.52751551 s. [STEP 5] Coarse TimeStep time: 49.06444535 [STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.561332948 seconds Ending run at 07:55:18 UTC on 2024-04-11. Run time = 247.5881316 Run time without initialization = 236.2649412 Average number of zones advanced per microsecond: 0.021 Average number of zones advanced per microsecond per rank: 0.005 TinyProfiler total time across processes [min...avg...max]: 247.6 ... 247.6 ... 247.6 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 9 96.8482 106.9873 111.1072 44.88% Castro::computeTemp() 88 14.65 16.48 17.24 6.96% amrex::Copy() 679 12.84 14.41 15.06 6.08% check_for_negative_density() 9 0.3066 4.455 14.59 5.89% FabArray::ParallelCopy_finish() 830 1.514 5.006 12.46 5.03% MultiFab::AddProduct() 4205 10.61 11.82 12.27 4.96% Castro::normalize_species() 87 10.3 11.49 12.06 4.87% Castro::reset_internal_energy(Fab) 1476 8.169 9.172 9.584 3.87% Castro::estTimeStep() 26 3.984 5.552 9.296 3.75% FabArray::setVal() 5070 7.246 8.136 8.478 3.42% MultiFab::Subtract() 175 6.743 7.604 7.949 3.21% Castro::reset_internal_energy(MultiFab) 88 3.372 4.255 4.859 1.96% Gravity::fill_multipole_BCs() 11 4.241 4.441 4.792 1.94% FabArray::sum() 4205 3.538 3.94 4.082 1.65% FluxRegister::Reflux() 24 2.963 3.46 3.632 1.47% FabArray::ParallelCopy_nowait() 830 2.165 2.33 2.776 1.12% MLPoisson::Fsmooth() 1376 2.127 2.362 2.463 0.99% Castro::enforce_min_density() 87 1.532 2.037 2.463 0.99% Castro::FluxRegCrseInit 9 1.511 1.792 1.911 0.77% Castro::reflux() 4 1.521 1.781 1.909 0.77% Castro::wd_update() 6 0.5637 0.9609 1.813 0.73% FillPatchInterp(MF) 30 1.242 1.365 1.478 0.60% amrex::Add() 136 1.044 1.168 1.241 0.50% Amr::InitAmr() 1 1.17 1.17 1.17 0.47% Castro::initMFs() 5 1.109 1.122 1.138 0.46% MLPoisson::Fapply() 318 0.8853 1.014 1.111 0.45% Castro::construct_old_gravity_source() 18 0.9026 1.027 1.097 0.44% FillPatchIterator::Initialize 62 0.7661 0.9265 0.9947 0.40% Castro::volInBoundary() 42 0.8442 0.913 0.9673 0.39% Castro::problem_post_timestep() 10 0.838 0.8735 0.96 0.39% Castro::construct_new_gravity_source() 9 0.8168 0.9115 0.9574 0.39% FillBoundary_finish() 1553 0.311 0.4855 0.8836 0.36% FabArray::Saxpy() 182 0.7008 0.7907 0.8267 0.33% VisMF::Write(FabArray) 3 0.5863 0.6835 0.7203 0.29% StateData::FillBoundary(geom) 50 0.5787 0.6112 0.6433 0.26% Castro::construct_new_source() 63 0.4817 0.54 0.5669 0.23% MLCellLinOp::applyBC() 1742 0.37 0.4442 0.4899 0.20% FillBoundary_nowait() 1553 0.3332 0.406 0.4773 0.19% MultiFab::max() 18 0.03344 0.1623 0.4753 0.19% MultiFab::contains_nan() 18 0.3874 0.4338 0.4543 0.18% FabArray::Xpay() 283 0.3367 0.3765 0.3907 0.16% Castro::initialize_do_advance() 9 0.2333 0.2813 0.3203 0.13% FabArray::setDomainBndry() 92 0.203 0.241 0.2733 0.11% Amr::writePlotFile() 2 0.08813 0.1386 0.2692 0.11% Castro::construct_old_source() 63 0.2042 0.2321 0.2479 0.10% amrex::average_down 233 0.1947 0.2032 0.2064 0.08% Castro::fill_hybrid_hydro_source() 27 0.1659 0.1865 0.1953 0.08% MLCellLinOp::defineAuxData() 11 0.1547 0.17 0.1765 0.07% Castro::initData() 1 0.1174 0.1459 0.1604 0.06% MLPoisson::FFlux() 148 0.004783 0.04258 0.1557 0.06% MLCellLinOp::compGrad() 18 0.125 0.1395 0.1454 0.06% StateData::define() 25 0.1084 0.1239 0.1394 0.06% Castro::swap_state_time_levels() 9 0.08432 0.1015 0.1373 0.06% FabArray::mult() 56 0.1149 0.1295 0.1353 0.05% MLMG::addInterpCorrection() 155 0.1039 0.1168 0.122 0.05% Castro::evaluate_source_change() 193 0.1026 0.1152 0.1206 0.05% Castro::initialize_advance() 9 0.06813 0.08574 0.1112 0.04% Gravity::get_new_grav_vector() 10 0.08901 0.0971 0.1032 0.04% Gravity::get_old_grav_vector() 9 0.07643 0.08726 0.09375 0.04% MLMG::prepareForSolve() 10 0.0609 0.07161 0.07679 0.03% MLCellLinOp::updateSolBC() 25 0.06745 0.0687 0.07096 0.03% MLMG::solve() 10 0.00156 0.04375 0.07014 0.03% AmrLevel::FillPatch() 62 0.05641 0.06456 0.06901 0.03% FabArray::norminf(mask) 21 0.05448 0.06193 0.06623 0.03% MLMG::ResNormInf() 54 0.001763 0.02527 0.05844 0.02% Castro::apply_tagging_restrictions() 6 0.04782 0.05333 0.05554 0.02% AmrMesh::MakeNewGrids() 6 0.04693 0.04835 0.05223 0.02% MLCellLinOp::updateCorBC() 17 0.04562 0.04594 0.04632 0.02% BndryData::define() 27 0.04337 0.0447 0.04562 0.02% FabArray::norminf() 147 0.03828 0.04014 0.04312 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.02876 0.03333 0.03719 0.02% MLMG::MLResNormInf() 15 0.0001168 0.02521 0.03685 0.01% MLCellLinOp::reflux() 30 0.004418 0.01227 0.03494 0.01% Castro::FluxRegFineAdd() 9 0.03129 0.03303 0.03431 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.02041 0.024 0.02946 0.01% MultiFab::Multiply() 8 0.02201 0.02534 0.02714 0.01% MLCellLinOp::defineBC() 11 0.0264 0.02672 0.02713 0.01% Castro::do_old_sources() 9 0.0005546 0.007298 0.02576 0.01% MLLinOp::makeSubCommunicator() 11 0.000661 0.009934 0.02189 0.01% Castro::build_fine_mask() 44 0.01732 0.01879 0.02059 0.01% Castro::enforce_consistent_e() 1 0.009054 0.01268 0.02029 0.01% Castro::Castro() 5 0.01472 0.01707 0.02003 0.01% Castro::buildMetrics() 5 0.01512 0.01737 0.01998 0.01% Castro::do_new_sources() 9 0.0005638 0.005271 0.01899 0.01% MLMG::interpCorrection_1 17 0.01862 0.01874 0.01887 0.01% FabArrayBase::CPC::define() 416 0.0131 0.01486 0.0183 0.01% Castro::linear_to_hybrid_momentum() 1 0.01362 0.01534 0.01603 0.01% FillPatchTwoLevels 31 0.01301 0.0135 0.01428 0.01% Castro::finalize_do_advance() 9 0.0108 0.01142 0.01239 0.01% MLCellLinOp::prepareForSolve() 11 0.01175 0.01202 0.01224 0.00% FabArrayBase::getCPC() 1440 0.009782 0.01065 0.0113 0.00% Gravity::actual_solve_with_mlmg() 11 0.00992 0.01064 0.01108 0.00% Gravity::actual_multilevel_solve() 10 0.007865 0.009326 0.01055 0.00% AMRErrorTag::operator() 6 0.008822 0.009972 0.01049 0.00% Gravity::update_max_rhs() 10 0.007363 0.008817 0.01029 0.00% StateDataPhysBCFunct::() 95 0.002521 0.006303 0.008993 0.00% Castro::apply_problem_tags() 6 0.006953 0.007834 0.008181 0.00% average_down_faces 48 0.005776 0.006003 0.006278 0.00% MLCellLinOp::setLevelBC() 19 0.003974 0.005155 0.006116 0.00% FabArray::FillBoundary() 1553 0.004252 0.004492 0.004919 0.00% AmrLevel::derive() 6 0.00371 0.004334 0.004583 0.00% MLCellLinOp::smooth() 688 0.003911 0.004032 0.004191 0.00% DistributionMapping::LeastUsedCPUs() 5 0.00104 0.002555 0.003965 0.00% MLCGSolver::bicgstab 7 0 0.0009807 0.003923 0.00% FabArrayBase::getFB() 1553 0.003076 0.003242 0.003636 0.00% amrex::Dot() 115 0 0.0008933 0.003573 0.00% FabArray::ParallelCopy() 830 0.002991 0.003106 0.00324 0.00% FabArrayBase::FB::FB() 19 0.002444 0.002801 0.003132 0.00% Gravity::test_composite_phi() 1 0.002172 0.002454 0.002615 0.00% main() 1 0.001553 0.001782 0.001922 0.00% Amr::coarseTimeStep() 5 0.0006182 0.001353 0.00162 0.00% Amr::regrid() 5 0.0009707 0.001237 0.001602 0.00% MLLinOp::defineGrids() 11 0.001407 0.001487 0.001556 0.00% MLCellLinOp::apply() 318 0.0009203 0.001089 0.001534 0.00% Castro::clean_state() 87 0.001205 0.001345 0.001419 0.00% TagBoxArray::collate() 6 0.0004004 0.000956 0.001353 0.00% AmrLevel::FillCoarsePatch() 5 0.0009507 0.001026 0.001175 0.00% Castro::construct_old_gravity() 9 0.0003754 0.0006147 0.001164 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0002794 0.001118 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0009369 0.0009683 0.0009871 0.00% Castro::construct_new_gravity() 9 0.0004685 0.0006138 0.0009726 0.00% OwnerMask() 6 0.0007752 0.0008638 0.0009264 0.00% MLCellLinOp::correctionResidual() 189 0.0006901 0.0007169 0.0007368 0.00% MLMG::mgVcycle() 65 0.0006126 0.0006241 0.0006389 0.00% Castro::do_advance_ctu() 5 0.0005131 0.00054 0.0005771 0.00% FillPatchSingleLevel 92 0.0005655 0.0005712 0.0005757 0.00% Amr::grid_places() 6 0.000514 0.0005247 0.0005437 0.00% Castro::finalize_advance() 9 0.0003508 0.0004216 0.000484 0.00% TagBoxArray::mapPRD 6 0.0004477 0.0004709 0.0004819 0.00% FillPatchIterator::FillFromLevel0() 31 0.000417 0.0004342 0.0004515 0.00% Castro::subcycle_advance_ctu() 5 7.938e-05 0.0001757 0.0004181 0.00% MLMG:computeResOfCorrection() 155 0.0003824 0.0003966 0.0004162 0.00% MLMG::oneIter() 31 0.0003553 0.0003705 0.0003917 0.00% MLCellLinOp::solutionResidual() 72 0.0003582 0.000366 0.0003864 0.00% MLMG::actualBottomSolve() 31 3.862e-05 0.0001259 0.0003816 0.00% FillPatchIterator::FillFromTwoLevels() 31 0.0003056 0.0003191 0.0003293 0.00% MLMG::mgVcycle_down::0 31 0.0002798 0.0002975 0.0003177 0.00% Castro::check_for_nan() 18 0.0001253 0.0001835 0.0002922 0.00% Castro::computeNewDt() 8 0.0001192 0.0001638 0.0002903 0.00% Castro::enforce_speed_limit() 87 0.0002397 0.0002623 0.0002754 0.00% Gravity::solve_phi_with_mlmg() 11 0.000229 0.0002521 0.0002664 0.00% MLMG::mgVcycle_down::1 31 0.0002364 0.0002507 0.0002645 0.00% Amr::timeStep() 9 0.0001942 0.0002147 0.0002563 0.00% Amr::defBaseLevel() 1 0.0002423 0.0002445 0.0002474 0.00% Castro::post_regrid() 10 0.0001929 0.0002165 0.0002352 0.00% MLMG::mgVcycle_bottom 65 0.0002106 0.0002222 0.0002304 0.00% MLMG::mgVcycle_up::0 31 0.0001872 0.0001944 0.0002092 0.00% MLMG::mgVcycle_down::3 31 0.0001958 0.0002007 0.0002077 0.00% MLMG::mgVcycle_down::2 31 0.0001981 0.0002005 0.0002031 0.00% makeSFC 33 0.0001689 0.0001784 0.0001945 0.00% AmrLevel::AmrLevel(dm) 5 0.0001818 0.0001869 0.00019 0.00% FabArrayBase::TheFPinfo() 25 0.0001765 0.0001826 0.0001861 0.00% MLMG::mgVcycle_down::4 31 0.0001761 0.0001796 0.000185 0.00% Amr::FinalizeInit() 1 2.514e-05 6.158e-05 0.000165 0.00% Castro::advance() 5 8.959e-05 0.0001133 0.0001566 0.00% MLMG::computeResWithCrseSolFineCor() 17 0.0001403 0.0001439 0.0001501 0.00% MLMG::mgVcycle_up::1 31 0.0001376 0.0001426 0.0001498 0.00% Castro::expand_state() 13 0.0001236 0.0001296 0.0001364 0.00% Castro::react_state() 18 0.0001088 0.0001236 0.0001346 0.00% MLMG::mgVcycle_up::2 31 0.0001308 0.0001331 0.0001345 0.00% FPinfo::FPinfo() 3 0.0001179 0.0001245 0.0001322 0.00% FabArray::RecvLayoutMask() 8 0.0001081 0.0001151 0.0001316 0.00% MLMG::mgVcycle_up::3 31 0.0001243 0.000128 0.0001316 0.00% MLMG::mgVcycle_up::4 31 0.0001139 0.0001209 0.0001301 0.00% Castro::errorEst() 6 0.0001052 0.0001191 0.0001298 0.00% Castro::apply_source_to_state() 18 0.0001025 0.0001137 0.000126 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0001065 0.0001113 0.0001179 0.00% Gravity::swapTimeLevels() 9 8.234e-05 9.643e-05 0.0001173 0.00% DistributionMapping::Distribute() 35 0.0001075 0.0001116 0.0001148 0.00% Amr::writeSmallPlotFile() 1 9.412e-05 0.0001045 0.000109 0.00% MLPoisson::define() 11 0.0001046 0.0001057 0.0001077 0.00% MLMG::computeResidual() 31 8.537e-05 9.136e-05 0.0001028 0.00% Castro::post_timestep() 9 8.42e-05 8.813e-05 9.533e-05 0.00% MLMG::computeMLResidual() 15 8.549e-05 8.833e-05 8.952e-05 0.00% ClusterList::intersect() 1 0 2.195e-05 8.781e-05 0.00% MLMG::miniCycle() 34 6.831e-05 7.607e-05 8.581e-05 0.00% Castro::avgDown(state_indx) 20 7.028e-05 7.893e-05 8.474e-05 0.00% MLMG::getGradSolution() 10 6.057e-05 6.888e-05 7.646e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 6.648e-05 6.971e-05 7.351e-05 0.00% knapsack() 3 6.613e-05 6.92e-05 7.35e-05 0.00% MLLinOp::define() 11 6.374e-05 6.741e-05 7.016e-05 0.00% amrex::average_down_w_geom 20 4.778e-05 5.693e-05 6.862e-05 0.00% Amr::initSubcycle() 1 5.104e-05 5.541e-05 6.777e-05 0.00% Castro::create_source_corrector() 9 5.93e-05 6.236e-05 6.687e-05 0.00% Gravity::set_mass_offset() 6 4.053e-05 5.37e-05 6.067e-05 0.00% Castro::construct_new_hybrid_source() 9 4.749e-05 5.096e-05 5.405e-05 0.00% MLPoisson::prepareForSolve() 11 4.91e-05 4.951e-05 4.99e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 3.864e-05 4.377e-05 4.981e-05 0.00% Castro::init(old) 3 4.734e-05 4.825e-05 4.917e-05 0.00% Castro::avgDown() 4 3.064e-05 3.711e-05 4.862e-05 0.00% AmrMesh-cluster 1 0 1.085e-05 4.34e-05 0.00% Castro::construct_old_hybrid_source() 9 3.358e-05 3.823e-05 4.119e-05 0.00% MLMG::MLRhsNormInf() 10 3.34e-05 3.509e-05 3.726e-05 0.00% DistributionMapping::KnapSackDoIt() 3 3.129e-05 3.233e-05 3.411e-05 0.00% MLMG::compResidual() 1 2.655e-05 2.823e-05 3.083e-05 0.00% BoxList::parallelComplementIn() 12 2.526e-05 2.664e-05 2.788e-05 0.00% Castro::construct_old_rotation_source() 9 2.121e-05 2.47e-05 2.745e-05 0.00% Castro::post_init() 1 1.993e-05 2.354e-05 2.677e-05 0.00% Castro::retry_advance_ctu() 5 2.334e-05 2.401e-05 2.566e-05 0.00% Castro::construct_new_rotation_source() 9 2.114e-05 2.294e-05 2.557e-05 0.00% BoxList::complementIn 12 2.208e-05 2.338e-05 2.45e-05 0.00% Castro::derive() 6 1.813e-05 2.102e-05 2.406e-05 0.00% Castro::computeInitialDt() 2 1.43e-05 1.791e-05 2.281e-05 0.00% Amr::bldFineLevels() 1 1.628e-05 1.948e-05 2.276e-05 0.00% Castro::init() 1 1.582e-05 1.66e-05 1.833e-05 0.00% Amr::InitializeInit() 1 6.929e-06 9.028e-06 1.317e-05 0.00% ClusterList::chop() 1 0 3.073e-06 1.229e-05 0.00% Amr::init() 1 5.818e-06 6.889e-06 9.903e-06 0.00% Amr::initialInit() 1 4.346e-06 5.749e-06 6.77e-06 0.00% knapsack()swap 1 3.572e-06 4.064e-06 4.547e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 247.6 247.6 247.6 100.00% Amr::coarseTimeStep() 5 235.7 235.7 235.7 95.20% Amr::timeStep() 9 234.4 234.4 234.4 94.66% Castro::advance() 5 206.7 206.7 206.7 83.48% Castro::subcycle_advance_ctu() 5 197.9 198.4 199.3 80.49% Castro::do_advance_ctu() 5 197.9 198.4 199.3 80.49% Castro::construct_ctu_hydro_source() 9 121.8 122 122.2 49.36% Castro::clean_state() 87 71.57 80.95 85 34.33% Castro::computeTemp() 88 45.02 51.05 53.67 21.68% Castro::reset_internal_energy(MultiFab) 88 30.36 34.58 36.44 14.72% Castro::evaluate_source_change() 193 18 20.06 20.79 8.40% Castro::enforce_min_density() 87 17.02 19.27 20.42 8.25% Castro::post_regrid() 10 15.79 17.32 17.94 7.25% Amr::regrid() 5 15.72 17.12 17.69 7.14% Castro::initialize_do_advance() 9 15.16 15.48 15.65 6.32% AmrLevel::FillPatch() 62 8.475 10.36 15.07 6.08% amrex::Copy() 679 12.84 14.41 15.06 6.08% FabArray::ParallelCopy() 830 4.359 7.4 14.7 5.94% check_for_negative_density() 9 0.3066 4.455 14.59 5.89% FillPatchIterator::Initialize 62 6.763 8.714 13.6 5.49% Castro::do_old_sources() 9 11.36 11.86 13.22 5.34% FabArray::ParallelCopy_finish() 830 1.514 5.006 12.46 5.03% MultiFab::AddProduct() 4205 10.61 11.82 12.27 4.96% Castro::normalize_species() 87 10.3 11.49 12.06 4.87% Gravity::solve_phi_with_mlmg() 11 11.28 11.48 11.83 4.78% Gravity::multilevel_solve_for_new_phi() 10 11.01 11.2 11.53 4.66% FillPatchSingleLevel 92 4.333 6.387 11.51 4.65% Gravity::actual_multilevel_solve() 10 10.97 11.16 11.5 4.65% FillPatchIterator::FillFromLevel0() 31 3.956 5.996 11.07 4.47% Castro::do_new_sources() 9 9.232 10.49 11.05 4.46% Castro::post_timestep() 9 10.37 10.37 10.37 4.19% Amr::init() 1 10.15 10.15 10.15 4.10% Castro::reflux() 4 9.543 9.629 9.741 3.93% Amr::initialInit() 1 9.615 9.615 9.616 3.88% Castro::reset_internal_energy(Fab) 1476 8.169 9.172 9.584 3.87% Castro::estTimeStep() 26 3.984 5.552 9.296 3.75% Castro::initialize_advance() 9 7.403 8.314 8.748 3.53% FabArray::setVal() 5070 7.246 8.136 8.478 3.42% MultiFab::Subtract() 175 6.743 7.604 7.949 3.21% Castro::expand_state() 13 5.547 5.992 6.971 2.82% Castro::construct_new_gravity() 9 6.469 6.647 6.967 2.81% Gravity::actual_solve_with_mlmg() 11 6.931 6.94 6.948 2.81% MLMG::solve() 10 6.41 6.424 6.446 2.60% Amr::FinalizeInit() 1 5.552 5.706 6.063 2.45% MLMG::oneIter() 31 5.168 5.189 5.197 2.10% Gravity::fill_multipole_BCs() 11 4.327 4.521 4.863 1.96% FluxRegister::Reflux() 24 4.646 4.662 4.669 1.89% Castro::finalize_do_advance() 9 1.35 2.273 4.437 1.79% MLMG::mgVcycle() 65 4.315 4.347 4.362 1.76% Castro::problem_post_timestep() 10 3.068 3.452 4.235 1.71% FabArray::sum() 4205 3.538 3.94 4.082 1.65% Amr::InitializeInit() 1 3.552 3.909 4.064 1.64% Amr::defBaseLevel() 1 3.552 3.909 4.064 1.64% Castro::computeNewDt() 8 2.154 2.645 3.867 1.56% MLCellLinOp::smooth() 688 3.269 3.312 3.346 1.35% Castro::FluxRegCrseInit 9 1.969 2.322 2.997 1.21% Castro::post_init() 1 2.474 2.602 2.909 1.18% FabArray::ParallelCopy_nowait() 830 2.225 2.391 2.842 1.15% Castro::wd_update() 6 1.49 1.874 2.658 1.07% Castro::initData() 1 2.19 2.491 2.622 1.06% Castro::construct_old_gravity() 9 0.696 1.291 2.515 1.02% Gravity::get_old_grav_vector() 9 0.6949 1.291 2.514 1.02% MLPoisson::Fsmooth() 1376 2.127 2.362 2.463 0.99% Castro::construct_new_source() 63 1.842 2.063 2.148 0.87% MLMG::mgVcycle_down::0 31 1.894 1.971 2.016 0.81% MLCellLinOp::applyBC() 1742 1.18 1.346 1.742 0.70% FillPatchIterator::FillFromTwoLevels() 31 1.54 1.552 1.571 0.63% FillPatchTwoLevels 31 1.54 1.551 1.571 0.63% Amr::bldFineLevels() 1 1.223 1.395 1.479 0.60% FillPatchInterp(MF) 30 1.242 1.365 1.478 0.60% MLMG::mgVcycle_up::0 31 1.373 1.402 1.413 0.57% Castro::Castro() 5 1.33 1.372 1.394 0.56% MLCellLinOp::apply() 318 1.288 1.335 1.393 0.56% FabArray::FillBoundary() 1553 0.7042 0.902 1.372 0.55% amrex::Add() 136 1.044 1.168 1.241 0.50% Amr::InitAmr() 1 1.17 1.17 1.17 0.47% Castro::initMFs() 5 1.115 1.128 1.144 0.46% Castro::construct_old_source() 63 0.9403 1.059 1.124 0.45% MLPoisson::Fapply() 318 0.8853 1.014 1.111 0.45% Amr::writePlotFile() 2 1.098 1.099 1.099 0.44% Castro::construct_old_gravity_source() 18 0.9026 1.027 1.097 0.44% MLCellLinOp::solutionResidual() 72 0.9743 1.032 1.087 0.44% Castro::computeInitialDt() 2 0.491 0.646 1.003 0.41% Castro::volInBoundary() 42 0.8443 0.9131 0.9674 0.39% Castro::construct_new_gravity_source() 9 0.8168 0.9115 0.9574 0.39% FillBoundary_finish() 1553 0.311 0.4855 0.8836 0.36% MLCellLinOp::correctionResidual() 189 0.8072 0.818 0.8319 0.34% FabArray::Saxpy() 182 0.7008 0.7907 0.8267 0.33% Gravity::get_new_grav_vector() 10 0.7862 0.8008 0.814 0.33% VisMF::Write(FabArray) 3 0.5863 0.6835 0.7203 0.29% MLMG:computeResOfCorrection() 155 0.6383 0.6825 0.718 0.29% StateDataPhysBCFunct::() 95 0.5812 0.6175 0.6523 0.26% StateData::FillBoundary(geom) 50 0.5787 0.6112 0.6433 0.26% MLMG::computeResWithCrseSolFineCor() 17 0.5935 0.5944 0.5959 0.24% Gravity::update_max_rhs() 10 0.09468 0.2206 0.5274 0.21% MLMG::computeMLResidual() 15 0.4336 0.4564 0.5084 0.21% Castro::init() 1 0.4878 0.4903 0.4926 0.20% AmrLevel::FillCoarsePatch() 5 0.4877 0.4903 0.4926 0.20% FillBoundary_nowait() 1553 0.3388 0.4121 0.4835 0.20% MultiFab::max() 18 0.03344 0.1623 0.4753 0.19% Castro::check_for_nan() 18 0.3875 0.434 0.4544 0.18% MultiFab::contains_nan() 18 0.3874 0.4338 0.4543 0.18% MLMG::mgVcycle_down::1 31 0.3049 0.3451 0.4143 0.17% amrex::average_down 233 0.2782 0.3627 0.411 0.17% Gravity::test_composite_phi() 1 0.402 0.4026 0.4042 0.16% FabArray::Xpay() 283 0.3367 0.3765 0.3907 0.16% MLCellLinOp::reflux() 30 0.1822 0.2439 0.3817 0.15% Castro::init(old) 3 0.3744 0.376 0.3776 0.15% MLMG::computeResidual() 31 0.3452 0.3554 0.3721 0.15% Castro::apply_source_to_state() 18 0.2807 0.3162 0.3308 0.13% MLPoisson::define() 11 0.2927 0.3018 0.3134 0.13% FabArray::setDomainBndry() 92 0.203 0.241 0.2733 0.11% Castro::react_state() 18 0.2194 0.25 0.2612 0.11% MLMG::prepareForSolve() 10 0.228 0.2311 0.2353 0.10% MLMG::mgVcycle_up::1 31 0.2163 0.2205 0.2236 0.09% MLCellLinOp::defineAuxData() 11 0.1814 0.1998 0.2113 0.09% Castro::fill_hybrid_hydro_source() 27 0.1659 0.1865 0.1953 0.08% MLMG::mgVcycle_bottom 65 0.159 0.1671 0.1907 0.08% Amr::grid_places() 6 0.1904 0.1905 0.1906 0.08% AmrMesh::MakeNewGrids() 6 0.1899 0.19 0.19 0.08% MLMG::getGradSolution() 10 0.1749 0.1785 0.1808 0.07% MLCellLinOp::compGrad() 18 0.1749 0.1785 0.1807 0.07% MLMG::addInterpCorrection() 155 0.1275 0.1628 0.1805 0.07% MLMG::miniCycle() 34 0.1591 0.16 0.1619 0.07% MLPoisson::FFlux() 148 0.004783 0.04258 0.1557 0.06% AmrLevel::AmrLevel(dm) 5 0.1086 0.1241 0.1396 0.06% StateData::define() 25 0.1084 0.1239 0.1394 0.06% Castro::swap_state_time_levels() 9 0.08432 0.1015 0.1373 0.06% FabArray::mult() 56 0.1149 0.1295 0.1353 0.05% Castro::construct_new_hybrid_source() 9 0.1108 0.1245 0.1304 0.05% Castro::avgDown() 4 0.1197 0.1227 0.1262 0.05% Castro::avgDown(state_indx) 20 0.1197 0.1226 0.1262 0.05% amrex::average_down_w_geom 20 0.1196 0.1226 0.1261 0.05% Castro::errorEst() 6 0.1041 0.1165 0.1209 0.05% MLMG::ResNormInf() 54 0.07349 0.09529 0.1205 0.05% MLCellLinOp::updateSolBC() 25 0.08159 0.08926 0.1052 0.04% MLCellLinOp::defineBC() 11 0.08731 0.09002 0.09242 0.04% MLMG::computeResWithCrseCorFineCor() 17 0.08617 0.08713 0.08863 0.04% MLMG::mgVcycle_down::2 31 0.06911 0.07428 0.08351 0.03% MLMG::mgVcycle_up::3 31 0.02616 0.06564 0.07908 0.03% MLMG::MLResNormInf() 15 0.04712 0.06859 0.07635 0.03% FabArray::norminf(mask) 21 0.05448 0.06193 0.06623 0.03% Castro::construct_old_hybrid_source() 9 0.05519 0.06216 0.06505 0.03% BndryData::define() 27 0.05959 0.06199 0.06402 0.03% MLMG::interpCorrection_1 17 0.0277 0.03699 0.06025 0.02% Castro::apply_tagging_restrictions() 6 0.04782 0.05333 0.05554 0.02% MLMG::mgVcycle_up::2 31 0.05172 0.05305 0.05419 0.02% MLCellLinOp::updateCorBC() 17 0.04998 0.05078 0.05235 0.02% Castro::derive() 6 0.04042 0.04526 0.047 0.02% AmrLevel::derive() 6 0.0404 0.04524 0.04697 0.02% Castro::buildMetrics() 5 0.03424 0.04216 0.0465 0.02% FabArray::norminf() 147 0.03828 0.04014 0.04312 0.02% Gravity::swapTimeLevels() 9 0.03094 0.0344 0.03598 0.01% MLMG::mgVcycle_down::3 31 0.03073 0.03185 0.03448 0.01% Castro::FluxRegFineAdd() 9 0.03129 0.03303 0.03431 0.01% FabArrayBase::getCPC() 1440 0.02394 0.02551 0.0296 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.02041 0.024 0.02946 0.01% MLMG::MLRhsNormInf() 10 0.02499 0.02799 0.02908 0.01% MLMG::actualBottomSolve() 31 3.862e-05 0.007241 0.02884 0.01% MLCGSolver::bicgstab 7 0 0.007019 0.02808 0.01% MultiFab::Multiply() 8 0.02201 0.02534 0.02714 0.01% TagBoxArray::mapPRD 6 0.004333 0.0126 0.02703 0.01% MLLinOp::define() 11 0.00254 0.01188 0.02392 0.01% MLLinOp::defineGrids() 11 0.002471 0.01181 0.02385 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.02071 0.02198 0.02286 0.01% MLLinOp::makeSubCommunicator() 11 0.000661 0.009934 0.02189 0.01% MLMG::compResidual() 1 0.01753 0.01962 0.02115 0.01% Castro::build_fine_mask() 44 0.01732 0.01879 0.02059 0.01% Castro::enforce_consistent_e() 1 0.009054 0.01268 0.02029 0.01% MLMG::mgVcycle_down::4 31 0.005963 0.009231 0.01865 0.01% FabArrayBase::CPC::define() 416 0.0131 0.01486 0.0183 0.01% Castro::linear_to_hybrid_momentum() 1 0.01362 0.01534 0.01603 0.01% MLMG::mgVcycle_up::4 31 0.004864 0.007211 0.01407 0.01% MLPoisson::prepareForSolve() 11 0.0118 0.01207 0.01229 0.00% MLCellLinOp::prepareForSolve() 11 0.01175 0.01202 0.01224 0.00% average_down_faces 48 0.009463 0.01055 0.01162 0.00% AMRErrorTag::operator() 6 0.008822 0.009972 0.01049 0.00% Castro::apply_problem_tags() 6 0.006953 0.007834 0.008181 0.00% FabArrayBase::getFB() 1553 0.005573 0.006043 0.006609 0.00% MLCellLinOp::setLevelBC() 19 0.003974 0.005155 0.006116 0.00% FabArrayBase::TheFPinfo() 25 0.001408 0.002881 0.004291 0.00% FPinfo::FPinfo() 3 0.001223 0.002698 0.004108 0.00% DistributionMapping::KnapSackDoIt() 3 0.001102 0.002574 0.003976 0.00% DistributionMapping::LeastUsedCPUs() 5 0.00104 0.002555 0.003965 0.00% amrex::Dot() 115 0 0.0008933 0.003573 0.00% FabArrayBase::FB::FB() 19 0.002444 0.002801 0.003132 0.00% MLCGSolver::ParallelAllReduce 183 0 0.000759 0.003036 0.00% TagBoxArray::collate() 6 0.0004004 0.000956 0.001353 0.00% OwnerMask() 6 0.0007752 0.0008638 0.0009264 0.00% Castro::finalize_advance() 9 0.0003508 0.0004216 0.000484 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0003752 0.0003902 0.000406 0.00% makeSFC 33 0.0002659 0.0002789 0.0002945 0.00% Castro::enforce_speed_limit() 87 0.0002397 0.0002623 0.0002754 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 0.000106 0.0001413 0.0001566 0.00% AmrMesh-cluster 1 0 3.588e-05 0.0001435 0.00% FabArray::RecvLayoutMask() 8 0.0001081 0.0001151 0.0001316 0.00% DistributionMapping::Distribute() 35 0.0001075 0.0001116 0.0001148 0.00% Amr::writeSmallPlotFile() 1 9.412e-05 0.0001045 0.000109 0.00% ClusterList::intersect() 1 0 2.195e-05 8.781e-05 0.00% knapsack() 3 6.998e-05 7.326e-05 7.804e-05 0.00% Amr::initSubcycle() 1 5.104e-05 5.541e-05 6.777e-05 0.00% Castro::create_source_corrector() 9 5.93e-05 6.236e-05 6.687e-05 0.00% Gravity::set_mass_offset() 6 4.053e-05 5.37e-05 6.067e-05 0.00% BoxList::parallelComplementIn() 12 4.934e-05 5.002e-05 5.063e-05 0.00% Castro::construct_old_rotation_source() 9 2.121e-05 2.47e-05 2.745e-05 0.00% Castro::retry_advance_ctu() 5 2.334e-05 2.401e-05 2.566e-05 0.00% Castro::construct_new_rotation_source() 9 2.114e-05 2.294e-05 2.557e-05 0.00% BoxList::complementIn 12 2.208e-05 2.338e-05 2.45e-05 0.00% ClusterList::chop() 1 0 3.073e-06 1.229e-05 0.00% knapsack()swap 1 3.572e-06 4.064e-06 4.547e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-14-g6c6247554f27) finalized