Initializing AMReX (24.04-18-ge293ff685199)... MPI initialized with 4 MPI processes MPI initialized with thread support level 3 OMP initialized with 4 OMP threads AMReX (24.04-18-ge293ff685199) initialized Starting run at 07:37:23 UTC on 2024-04-16. Successfully read inputs file ... Castro git describe: 24.04-14-g3d76cd5a0 AMReX git describe: 24.04-18-ge293ff685 Microphysics git describe: 24.04-7-gd4312a6c reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 174 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 grid_places() time: 0.046866163 new finest: 0 Now regridding at level lbase = 0 grid_places() time: 0.044758218 new finest: 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Gravity::fill_multipole_BCs() time = 0.405865374 Gravity::multilevel_solve_for_new_phi() time = 1.760821796 Gravity::fill_multipole_BCs() time = 0.361880161 ... norm of composite residual at level 0 3.509358608e-10 INITIAL GRIDS Level 0 27 grids 884736 cells 100 % of domain smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32 PLOTFILE: file = wdmerger_3D_plt00000 Write plotfile time = 0.51921317 seconds ...estimated hydro-limited timestep at level 0: 0.05426072637 ...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637 [Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637  Beginning subcycle 1 starting at time 0 with dt = 0.005426072637 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.567726815 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.287624606e+47 ener added: 6.129070894e+49 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.44936293e+25 ymom added: -1.046793362e+26 zmom added: -4.133074948e+24 eint added: 0 ener added: -1.270533196e+50 Castro::do_old_sources() time = 2.643932035 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.00547245e+47 ener added: 1.651139801e+46 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 20.59800912 on level 0 ... new-time composite Poisson gravity solve from level 0 to level 0 Gravity::fill_multipole_BCs() time = 0.609916455 Gravity::multilevel_solve_for_new_phi() time = 1.623710113 Castro::construct_new_gravity() time = 1.737676785 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.440206272e+49 ener added: 2.911791643e+45 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.451207927e+26 ymom added: 1.108730191e+26 zmom added: -5.613112907e+26 eint added: 0 ener added: 1.260457978e+50 Castro::do_new_sources() time = 2.327695794 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.00947637e+27 ener added: 2.068773556e+27 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.02504967122 [Level 0 step 1] Advanced 884736 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.191111111e+26 ener added: 6.213783704e+26 Updating the rotational period from 30.54368673 s to 30.45939751 s. [STEP 1] Coarse TimeStep time: 37.42051634 [STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594] STEP = 1 TIME = 0.005426072637 DT = 0.005426072637 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.05461684804 ... but limiting to: 0.0059686799 = 1.1 * 0.005426072637 Now regridding at level lbase = 0 grid_places() time: 0.031279457 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.407164346 Gravity::multilevel_solve_for_new_phi() time = 1.894042295 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.306135866e+46 ener added: 9.211440366e+51 STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.05461684804 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804 ...estimated hydro-limited timestep at level 1: 2.526135286e-09 ...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92) Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09 [Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.849559407e+31 ener added: 2.785926976e+31  Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.419358236 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.200514105e+40 ener added: 6.433158322e+33 Contributions to the state from old-time sources: mass added: 0 xmom added: 5.533896722e+24 ymom added: 4.756222074e+26 zmom added: -2.8670017e+23 eint added: 0 ener added: -1.721443002e+45 Castro::do_old_sources() time = 2.337994154 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.32580061 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.147330623e+31 ener added: 1.147330701e+31 Castro::construct_old_gravity() time = 0.031296831 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.503703704e+23 ener added: 6.281481481e+23 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.197253778e+40 ener added: 1.791685121e+42 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.571390895e+22 ymom added: 1.505254316e+22 zmom added: 6.441804792e+21 eint added: 0 ener added: -2.586789965e+47 Castro::do_old_sources() time = 0.19379899 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 9.204912576e+51 ener added: 6.747117479e+48 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.758804286 on level 1 Castro::reflux() at level 0 : time = 2.258645499 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.429733381 Gravity::multilevel_solve_for_new_phi() time = 1.363482334 Castro::construct_new_gravity() time = 1.474308095 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.46375568e+41 ener added: 7.485558923e+35 Contributions to the state from new-time sources: mass added: 0 xmom added: -4.861679586e+21 ymom added: -6.245616015e+21 zmom added: -1.245900444e+20 eint added: 0 ener added: -3.223710603e+41 Castro::do_new_sources() time = 1.981913195 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.149299259e+26 ener added: 4.592592593e+21 ...estimated hydro-limited timestep at level 0: 0.05461716025 ...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025 Castro::construct_new_gravity() time = 0.030935431 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.564837764e+47 ener added: 4.559472528e+41 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.764988605e+18 ymom added: -1.361438167e+19 zmom added: -8.219114407e+19 eint added: 0 ener added: 2.564611685e+47 Castro::do_new_sources() time = 0.142456359 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.281889991e+29 ener added: 3.281888214e+29 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02300208278 [Level 0 step 2] Advanced 884736 cells [Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09 Advance at this level has already been completed. [Level 1 step 2] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.057555556e+24 ener added: 5.917703704e+24 Updating the rotational period from 30.45939751 s to 30.52749735 s. [STEP 2] Coarse TimeStep time: 49.42654531 [STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008131491259 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.287037368e-07 ... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09 Now regridding at level lbase = 0 grid_places() time: 0.031442272 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.400507917 Gravity::multilevel_solve_for_new_phi() time = 0.530346719 STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008131491259 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259 ...estimated hydro-limited timestep at level 1: 6.287037368e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07 [Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09  Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.40514658 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.083120164e+24 ymom added: 5.231862796e+26 zmom added: -3.157856713e+23 eint added: 0 ener added: -1.937110674e+45 Castro::do_old_sources() time = 2.376069207 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.1602164 on level 0 Castro::construct_old_gravity() time = 0.031056554 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.818691374e+40 ener added: 1.212217725e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 8.442864557e+22 ymom added: 4.427218578e+21 zmom added: 7.103005275e+21 eint added: 0 ener added: -2.344787748e+45 Castro::do_old_sources() time = 0.195342895 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.83673455e+48 ener added: 2.077900047e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.773684489 on level 1 Castro::reflux() at level 0 : time = 2.249300063 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.429941441 Gravity::multilevel_solve_for_new_phi() time = 0.971319666 Castro::construct_new_gravity() time = 1.078831775 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.106550538e+21 ymom added: -7.896156836e+21 zmom added: 1.108336323e+20 eint added: 0 ener added: -3.427512073e+41 Castro::do_new_sources() time = 2.024186738 on level 0 ...estimated hydro-limited timestep at level 0: 0.0008131520194 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194 Castro::construct_new_gravity() time = 0.038332956 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 5.244373444e+43 ener added: 1.74625952e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: -6.814854158e+17 ymom added: 2.352230085e+19 zmom added: 9.539393154e+19 eint added: 0 ener added: 5.303047905e+43 Castro::do_new_sources() time = 0.169890101 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.490463796e+26 ener added: 1.495539352e+26 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02333304817 [Level 0 step 3] Advanced 884736 cells [Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09 Advance at this level has already been completed. [Level 1 step 3] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 6.281481481e+24 ener added: 6.674962963e+24 Updating the rotational period from 30.52749735 s to 30.52751553 s. [STEP 3] Coarse TimeStep time: 46.96760892 [STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0008130329735 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.564309766e-07 ... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09 Now regridding at level lbase = 0 grid_places() time: 0.031776623 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.410427441 Gravity::multilevel_solve_for_new_phi() time = 0.546375885 STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0008130329735 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735 ...estimated hydro-limited timestep at level 1: 6.564309766e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07 [Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09  Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.376404327 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 6.694655893e+24 ymom added: 5.755038681e+26 zmom added: -3.471622784e+23 eint added: 0 ener added: -2.130751807e+45 Castro::do_old_sources() time = 2.302422228 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.43523906 on level 0 Castro::construct_old_gravity() time = 0.030739076 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.150425349e+40 ener added: 1.373884257e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 9.197566636e+22 ymom added: 1.180591621e+22 zmom added: 8.023901326e+21 eint added: 0 ener added: -2.520808161e+45 Castro::do_old_sources() time = 0.198912544 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.318881554e+48 ener added: 1.675623034e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.829461666 on level 1 Castro::reflux() at level 0 : time = 2.27694671 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.437798249 Gravity::multilevel_solve_for_new_phi() time = 0.987280609 Castro::construct_new_gravity() time = 1.09772435 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.405071346e+21 ymom added: -9.735495453e+21 zmom added: -7.674479504e+18 eint added: 0 ener added: -3.723007452e+41 Castro::do_new_sources() time = 1.993105859 on level 0 ...estimated hydro-limited timestep at level 0: 0.000813036171 ...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171 Castro::construct_new_gravity() time = 0.030184315 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.983601425e+43 ener added: 1.617265925e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.598433569e+18 ymom added: -2.567952508e+19 zmom added: -1.336957775e+19 eint added: 0 ener added: 4.042918443e+43 Castro::do_new_sources() time = 0.142251081 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.942862037e+25 ener added: 2.885587963e+25 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02314141747 [Level 0 step 4] Advanced 884736 cells [Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09 Advance at this level has already been completed. [Level 1 step 4] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.365462963e+23 ener added: 4.62962963e+19 Updating the rotational period from 30.52751553 s to 30.52751552 s. [STEP 4] Coarse TimeStep time: 47.26822464 [STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0002506596503 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Castro::compute_new_dt : limiting dt at level 1 ... new dt computed: 6.863488975e-07 ... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09 Now regridding at level lbase = 0 grid_places() time: 0.031752899 new finest: 1 Castro::numpts_1d at level 1 is 340 Gravity::fill_multipole_BCs() time = 0.413463359 Gravity::multilevel_solve_for_new_phi() time = 0.545331742 STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0 Level 1 4 grids 65536 cells 0.9259259259 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 ...estimated hydro-limited timestep at level 0: 0.0002506596503 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503 ...estimated hydro-limited timestep at level 1: 6.863488975e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07 [Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09  Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.387733194 on level 0 Contributions to the state from old-time sources: mass added: 0 xmom added: 7.366517551e+24 ymom added: 6.330531998e+26 zmom added: -3.819056992e+23 eint added: 0 ener added: -2.343742535e+45 Castro::do_old_sources() time = 2.33703989 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 21.61979475 on level 0 Castro::construct_old_gravity() time = 0.033141591 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.560109532e+40 ener added: 1.662186973e+36 Contributions to the state from old-time sources: mass added: 0 xmom added: 1.013314014e+23 ymom added: 1.770887431e+22 zmom added: 8.796070504e+21 eint added: 0 ener added: -2.728291723e+45 Castro::do_old_sources() time = 0.195970706 on level 1 ... Entering construct_ctu_hydro_source() on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.05099824e+48 ener added: 1.448876286e+42 ... Leaving construct_ctu_hydro_source() on level 1 Castro::construct_ctu_hydro_source() time = 2.807028909 on level 1 Castro::reflux() at level 0 : time = 2.238030431 ... new-time composite Poisson gravity solve from level 0 to level 1 Gravity::fill_multipole_BCs() time = 0.4164723 Gravity::multilevel_solve_for_new_phi() time = 0.962464446 Castro::construct_new_gravity() time = 1.07051771 on level 0 Contributions to the state from new-time sources: mass added: 0 xmom added: -2.799171515e+21 ymom added: -1.177853541e+22 zmom added: -4.924059364e+18 eint added: 0 ener added: -4.148475158e+41 Castro::do_new_sources() time = 1.99308139 on level 0 ...estimated hydro-limited timestep at level 0: 0.0006828000901 ...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901 Castro::construct_new_gravity() time = 0.030287548 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.326552265e+43 ener added: 1.577214716e+38 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.726536205e+18 ymom added: -2.54093091e+19 zmom added: -1.25233881e+19 eint added: 0 ener added: 3.390623254e+43 Castro::do_new_sources() time = 0.141064736 on level 1 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.819509259e+24 ener added: 4.717583333e+24 ...estimated hydro-limited timestep at level 1: 7.169281148e-07 ...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90) Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07  Subcycle completed Subcycling complete Zones advanced per microsecond from level 0 to level 1: 0.02308435528 [Level 0 step 5] Advanced 884736 cells [Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09 Advance at this level has already been completed. [Level 1 step 5] Advanced 65536 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.94814634e+22 ener added: 2.962962963e+20 Updating the rotational period from 30.52751552 s to 30.52751551 s. [STEP 5] Coarse TimeStep time: 47.38758632 [STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735] STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09 PLOTFILE: file = wdmerger_3D_plt00005 Write plotfile time = 0.53596856 seconds Ending run at 07:41:23 UTC on 2024-04-16. Run time = 240.4683597 Run time without initialization = 229.0082523 Average number of zones advanced per microsecond: 0.022 Average number of zones advanced per microsecond per rank: 0.005 TinyProfiler total time across processes [min...avg...max]: 240.5 ... 240.5 ... 240.5 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 9 93.6829 102.8964 106.9647 44.48% Castro::computeTemp() 88 14.87 16.55 17.18 7.15% amrex::Copy() 679 12.67 14.05 14.6 6.07% check_for_negative_density() 9 0.4753 4.499 13.71 5.70% Castro::normalize_species() 87 10.15 11.41 12.15 5.05% MultiFab::AddProduct() 4205 10.5 11.63 12.11 5.04% FabArray::ParallelCopy_finish() 830 1.522 4.134 10.56 4.39% Castro::reset_internal_energy(Fab) 1476 8.302 9.219 9.572 3.98% Castro::estTimeStep() 26 4.118 5.439 8.505 3.54% FabArray::setVal() 5070 7.343 8.092 8.409 3.50% MultiFab::Subtract() 175 7.039 7.761 8.061 3.35% Gravity::fill_multipole_BCs() 11 4.304 4.426 4.643 1.93% Castro::reset_internal_energy(MultiFab) 88 3.48 4.073 4.494 1.87% FabArray::sum() 4205 3.479 3.848 4.012 1.67% FluxRegister::Reflux() 24 2.974 3.293 3.468 1.44% FabArray::ParallelCopy_nowait() 830 2.051 2.24 2.622 1.09% Castro::enforce_min_density() 87 1.506 1.926 2.447 1.02% MLPoisson::Fsmooth() 1376 2.104 2.343 2.442 1.02% Castro::reflux() 4 1.49 1.669 1.749 0.73% Castro::FluxRegCrseInit 9 1.475 1.671 1.746 0.73% Castro::wd_update() 6 0.4521 0.8483 1.668 0.69% FillPatchInterp(MF) 30 1.233 1.338 1.452 0.60% Castro::construct_old_gravity_source() 18 0.9861 1.063 1.212 0.50% Castro::initMFs() 5 1.11 1.138 1.202 0.50% amrex::Add() 136 1.019 1.135 1.184 0.49% Amr::InitAmr() 1 1.172 1.172 1.172 0.49% MLPoisson::Fapply() 318 0.9114 1.012 1.056 0.44% Castro::construct_new_gravity_source() 9 0.8457 0.9037 1.026 0.43% Castro::problem_post_timestep() 10 0.7433 0.8956 0.9491 0.39% FillPatchIterator::Initialize 62 0.7515 0.8257 0.8638 0.36% FillBoundary_finish() 1553 0.2876 0.4374 0.838 0.35% FabArray::Saxpy() 182 0.7101 0.7884 0.8204 0.34% Castro::volInBoundary() 42 0.6141 0.6608 0.6804 0.28% VisMF::Write(FabArray) 3 0.5686 0.6403 0.6738 0.28% StateData::FillBoundary(geom) 50 0.5765 0.588 0.5993 0.25% Castro::construct_new_source() 63 0.495 0.5372 0.5557 0.23% MLCellLinOp::applyBC() 1742 0.3594 0.4207 0.4505 0.19% MultiFab::max() 18 0.02971 0.1615 0.4504 0.19% MultiFab::contains_nan() 18 0.3808 0.4251 0.4453 0.19% FabArray::Xpay() 283 0.3472 0.3855 0.4018 0.17% FillBoundary_nowait() 1553 0.3016 0.3498 0.388 0.16% Castro::initialize_do_advance() 9 0.2322 0.2633 0.2769 0.12% Amr::writePlotFile() 2 0.09399 0.1404 0.2413 0.10% Castro::construct_old_source() 63 0.2089 0.2262 0.2391 0.10% FabArray::setDomainBndry() 92 0.2031 0.2217 0.2332 0.10% amrex::average_down 233 0.1944 0.203 0.2078 0.09% Castro::fill_hybrid_hydro_source() 27 0.1667 0.1835 0.1912 0.08% MLCellLinOp::defineAuxData() 11 0.1526 0.1658 0.1705 0.07% Castro::initData() 1 0.1392 0.1535 0.1683 0.07% MLPoisson::FFlux() 150 0.004605 0.04157 0.1522 0.06% MLCellLinOp::compGrad() 18 0.1226 0.1356 0.1414 0.06% FabArray::mult() 56 0.1193 0.132 0.138 0.06% StateData::define() 25 0.1052 0.1168 0.1234 0.05% MLMG::addInterpCorrection() 155 0.1052 0.1171 0.1221 0.05% Castro::evaluate_source_change() 193 0.1044 0.1108 0.1157 0.05% Gravity::get_new_grav_vector() 10 0.08657 0.09186 0.0945 0.04% Castro::swap_state_time_levels() 9 0.08136 0.08916 0.09321 0.04% Gravity::get_old_grav_vector() 9 0.07507 0.08358 0.08661 0.04% Castro::do_old_sources() 9 0.0005428 0.02269 0.08196 0.03% Castro::initialize_advance() 9 0.06648 0.07615 0.08019 0.03% MLMG::prepareForSolve() 10 0.06008 0.06967 0.07597 0.03% MLCellLinOp::updateSolBC() 25 0.06685 0.06768 0.06852 0.03% MLMG::solve() 10 0.001097 0.04192 0.06609 0.03% FabArray::norminf(mask) 21 0.056 0.06248 0.06528 0.03% Castro::apply_tagging_restrictions() 6 0.0542 0.05767 0.06479 0.03% AmrLevel::FillPatch() 62 0.05256 0.05414 0.05689 0.02% AmrMesh::MakeNewGrids() 6 0.04596 0.04845 0.05534 0.02% MLCellLinOp::updateCorBC() 17 0.04552 0.04594 0.04641 0.02% BndryData::define() 27 0.0415 0.0425 0.04335 0.02% MLMG::ResNormInf() 54 0.001325 0.01399 0.04181 0.02% FabArray::norminf() 147 0.0375 0.03933 0.04144 0.02% Gravity::multilevel_solve_for_new_phi() 10 0.03225 0.0337 0.03502 0.01% MLMG::MLResNormInf() 15 0.000107 0.02382 0.03451 0.01% MLCellLinOp::reflux() 30 0.00424 0.01172 0.03386 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01854 0.02217 0.02804 0.01% MLCellLinOp::defineBC() 11 0.02584 0.02615 0.02645 0.01% Castro::FluxRegFineAdd() 9 0.0255 0.0257 0.02597 0.01% Castro::do_new_sources() 9 0.0005541 0.006991 0.02526 0.01% MultiFab::Multiply() 8 0.02176 0.0241 0.02517 0.01% Castro::Castro() 5 0.01484 0.01741 0.02109 0.01% Castro::build_fine_mask() 44 0.01731 0.01867 0.01982 0.01% MLMG::interpCorrection_1 17 0.01819 0.01832 0.01845 0.01% FabArrayBase::CPC::define() 416 0.01306 0.01479 0.01776 0.01% Castro::buildMetrics() 5 0.01452 0.0164 0.01741 0.01% Castro::linear_to_hybrid_momentum() 1 0.01415 0.01583 0.01667 0.01% StateDataPhysBCFunct::() 95 0.002141 0.006209 0.01579 0.01% FillPatchTwoLevels 31 0.01333 0.01388 0.01456 0.01% AMRErrorTag::operator() 6 0.01016 0.01112 0.01283 0.01% Castro::enforce_consistent_e() 1 0.00889 0.01074 0.0128 0.01% MLLinOp::makeSubCommunicator() 11 0.001216 0.006088 0.01216 0.01% MLCellLinOp::prepareForSolve() 11 0.01147 0.01159 0.01172 0.00% FabArrayBase::getCPC() 1440 0.009779 0.01004 0.01024 0.00% Gravity::actual_solve_with_mlmg() 11 0.009339 0.009531 0.009706 0.00% Gravity::actual_multilevel_solve() 10 0.008701 0.009111 0.009609 0.00% Gravity::update_max_rhs() 10 0.007339 0.008312 0.009055 0.00% Castro::apply_problem_tags() 6 0.007676 0.008071 0.008613 0.00% Castro::finalize_do_advance() 9 0.005722 0.007202 0.008417 0.00% average_down_faces 48 0.005703 0.005767 0.005807 0.00% AmrLevel::derive() 6 0.003807 0.004825 0.005555 0.00% MLCellLinOp::setLevelBC() 19 0.003647 0.004527 0.0053 0.00% FabArray::FillBoundary() 1553 0.004244 0.004388 0.004712 0.00% MLCellLinOp::smooth() 688 0.003621 0.003738 0.003831 0.00% MLCGSolver::bicgstab 7 0 0.0009548 0.003819 0.00% Castro::construct_new_gravity() 9 0.000415 0.001283 0.003594 0.00% DistributionMapping::LeastUsedCPUs() 5 0.001469 0.002421 0.003491 0.00% FabArrayBase::getFB() 1553 0.003059 0.003188 0.003488 0.00% amrex::Dot() 115 0 0.0008611 0.003444 0.00% Castro::construct_old_gravity() 9 0.0003689 0.001257 0.003192 0.00% FabArray::ParallelCopy() 830 0.002984 0.003083 0.003177 0.00% FabArrayBase::FB::FB() 19 0.002513 0.00283 0.003154 0.00% Gravity::test_composite_phi() 1 0.002147 0.002412 0.00262 0.00% main() 1 0.001667 0.001688 0.001727 0.00% MLCellLinOp::apply() 318 0.0008657 0.001019 0.001451 0.00% MLLinOp::defineGrids() 11 0.001331 0.001386 0.001437 0.00% Amr::regrid() 5 0.0009421 0.001129 0.001424 0.00% TagBoxArray::collate() 6 0.0004451 0.001054 0.001343 0.00% Castro::clean_state() 87 0.001228 0.001269 0.001338 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0002779 0.001112 0.00% Amr::coarseTimeStep() 5 0.0004795 0.0009362 0.001101 0.00% AmrLevel::FillCoarsePatch() 5 0.0009022 0.0009432 0.0009856 0.00% Gravity::average_fine_ec_onto_crse_ec() 8 0.0009158 0.0009269 0.0009412 0.00% OwnerMask() 6 0.0007261 0.0008381 0.0008998 0.00% MLCellLinOp::correctionResidual() 189 0.0006461 0.0006673 0.0006846 0.00% Castro::do_advance_ctu() 5 0.0005033 0.0005429 0.0006351 0.00% MLMG::mgVcycle() 65 0.0005758 0.0005916 0.0006044 0.00% FillPatchSingleLevel 92 0.0005279 0.0005496 0.0005798 0.00% Amr::grid_places() 6 0.0004531 0.0004898 0.0005344 0.00% TagBoxArray::mapPRD 6 0.0004537 0.0004717 0.000499 0.00% FillPatchIterator::FillFromLevel0() 31 0.0003959 0.0004218 0.0004567 0.00% Castro::finalize_advance() 9 0.000338 0.000388 0.0004157 0.00% Castro::subcycle_advance_ctu() 5 7.929e-05 0.0001678 0.0004105 0.00% MLMG:computeResOfCorrection() 155 0.0003686 0.0003825 0.0003901 0.00% MLCellLinOp::solutionResidual() 72 0.0003425 0.0003523 0.0003642 0.00% MLMG::actualBottomSolve() 31 3.968e-05 0.0001203 0.000357 0.00% Castro::computeNewDt() 8 0.0001033 0.0001704 0.0003501 0.00% MLMG::oneIter() 31 0.0003354 0.0003435 0.0003494 0.00% FillPatchIterator::FillFromTwoLevels() 31 0.0002832 0.0003084 0.0003455 0.00% MLMG::mgVcycle_down::0 31 0.0002716 0.0002845 0.0003001 0.00% Amr::timeStep() 9 0.0001846 0.0002375 0.0002631 0.00% Gravity::solve_phi_with_mlmg() 11 0.0002302 0.0002431 0.0002624 0.00% Castro::enforce_speed_limit() 87 0.0002413 0.0002528 0.0002623 0.00% MLMG::mgVcycle_down::1 31 0.000231 0.0002376 0.0002451 0.00% Amr::defBaseLevel() 1 0.0002303 0.0002338 0.0002422 0.00% MLMG::mgVcycle_bottom 65 0.0002029 0.0002126 0.0002208 0.00% Castro::post_regrid() 10 0.0001883 0.0002003 0.0002163 0.00% MLMG::mgVcycle_down::3 31 0.0001884 0.0001916 0.0001956 0.00% MLMG::mgVcycle_down::2 31 0.0001877 0.0001909 0.0001947 0.00% MLMG::mgVcycle_up::0 31 0.0001755 0.0001812 0.0001919 0.00% AmrLevel::AmrLevel(dm) 5 0.0001807 0.0001848 0.0001902 0.00% FabArrayBase::TheFPinfo() 25 0.000167 0.0001747 0.0001874 0.00% makeSFC 33 0.0001631 0.000176 0.0001818 0.00% MLMG::mgVcycle_down::4 31 0.000163 0.0001689 0.0001803 0.00% Amr::FinalizeInit() 1 3.123e-05 7.101e-05 0.000167 0.00% Castro::check_for_nan() 18 0.0001331 0.000149 0.0001619 0.00% MLMG::computeResWithCrseSolFineCor() 17 0.0001242 0.0001309 0.0001359 0.00% MLMG::mgVcycle_up::1 31 0.0001279 0.0001316 0.0001358 0.00% FPinfo::FPinfo() 3 0.0001064 0.0001215 0.0001319 0.00% Castro::expand_state() 13 0.0001047 0.0001158 0.0001287 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0001066 0.0001153 0.0001274 0.00% MLMG::mgVcycle_up::2 31 0.0001253 0.0001262 0.0001267 0.00% MLMG::mgVcycle_up::4 31 0.0001098 0.0001159 0.000125 0.00% MLMG::mgVcycle_up::3 31 0.0001206 0.0001219 0.0001236 0.00% Castro::react_state() 18 0.0001126 0.0001147 0.0001169 0.00% Castro::errorEst() 6 0.0001055 0.0001096 0.0001154 0.00% DistributionMapping::Distribute() 35 0.0001073 0.0001113 0.0001149 0.00% FabArray::RecvLayoutMask() 8 9.099e-05 9.955e-05 0.0001121 0.00% Castro::apply_source_to_state() 18 0.0001051 0.0001075 0.0001121 0.00% Amr::writeSmallPlotFile() 1 0.0001045 0.0001072 0.0001118 0.00% MLPoisson::define() 11 9.943e-05 0.0001046 0.0001097 0.00% Gravity::swapTimeLevels() 9 8.544e-05 9.372e-05 0.000105 0.00% Castro::post_timestep() 9 7.924e-05 8.41e-05 9.468e-05 0.00% Castro::advance() 5 8.097e-05 8.55e-05 9.351e-05 0.00% ClusterList::intersect() 1 0 2.241e-05 8.965e-05 0.00% MLMG::computeMLResidual() 15 7.574e-05 8.034e-05 8.94e-05 0.00% MLMG::computeResidual() 31 8.12e-05 8.611e-05 8.874e-05 0.00% Castro::avgDown(state_indx) 20 6.834e-05 7.344e-05 8.079e-05 0.00% amrex::average_down_w_geom 20 4.987e-05 5.809e-05 7.74e-05 0.00% Castro::create_source_corrector() 9 6.071e-05 6.606e-05 7.647e-05 0.00% knapsack() 3 6.572e-05 6.968e-05 7.42e-05 0.00% MLLinOp::define() 11 5.914e-05 6.528e-05 7.178e-05 0.00% MLMG::miniCycle() 34 6.597e-05 6.779e-05 6.94e-05 0.00% MLMG::getGradSolution() 10 5.866e-05 6.179e-05 6.83e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 4.127e-05 4.952e-05 6.6e-05 0.00% MLMG::computeResWithCrseCorFineCor() 17 5.978e-05 6.072e-05 6.168e-05 0.00% Castro::avgDown() 4 3.071e-05 3.915e-05 5.882e-05 0.00% Gravity::set_mass_offset() 6 3.297e-05 4.525e-05 5.724e-05 0.00% Castro::computeInitialDt() 2 1.443e-05 2.626e-05 5.504e-05 0.00% Castro::construct_new_hybrid_source() 9 4.37e-05 4.734e-05 5.418e-05 0.00% Amr::initSubcycle() 1 5e-05 5.19e-05 5.267e-05 0.00% MLPoisson::prepareForSolve() 11 4.46e-05 4.822e-05 5.066e-05 0.00% Castro::init(old) 3 4.307e-05 4.552e-05 4.809e-05 0.00% Castro::post_init() 1 2.301e-05 3.271e-05 4.343e-05 0.00% Castro::retry_advance_ctu() 5 2.187e-05 2.801e-05 4.011e-05 0.00% AmrMesh-cluster 1 0 1.002e-05 4.008e-05 0.00% Castro::construct_old_hybrid_source() 9 3.49e-05 3.733e-05 4.003e-05 0.00% Amr::bldFineLevels() 1 1.873e-05 2.609e-05 3.648e-05 0.00% MLMG::MLRhsNormInf() 10 3.081e-05 3.298e-05 3.476e-05 0.00% DistributionMapping::KnapSackDoIt() 3 3.103e-05 3.223e-05 3.312e-05 0.00% BoxList::parallelComplementIn() 12 2.44e-05 2.616e-05 2.818e-05 0.00% MLMG::compResidual() 1 2.609e-05 2.716e-05 2.805e-05 0.00% Castro::construct_new_rotation_source() 9 1.87e-05 2.359e-05 2.803e-05 0.00% Castro::construct_old_rotation_source() 9 2.094e-05 2.315e-05 2.607e-05 0.00% BoxList::complementIn 12 2.195e-05 2.32e-05 2.547e-05 0.00% Castro::derive() 6 1.884e-05 2.099e-05 2.515e-05 0.00% Castro::init() 1 1.536e-05 1.676e-05 1.927e-05 0.00% ClusterList::chop() 1 0 2.714e-06 1.086e-05 0.00% Amr::InitializeInit() 1 7.824e-06 8.804e-06 1.083e-05 0.00% Amr::initialInit() 1 4.441e-06 5.778e-06 7.457e-06 0.00% Amr::init() 1 5.915e-06 6.576e-06 6.998e-06 0.00% knapsack()swap 1 3.544e-06 3.9e-06 4.196e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 240.5 240.5 240.5 100.00% Amr::coarseTimeStep() 5 228.5 228.5 228.5 95.01% Amr::timeStep() 9 227.1 227.1 227.1 94.44% Castro::advance() 5 199.6 199.6 199.6 83.00% Castro::subcycle_advance_ctu() 5 191 191.4 192.2 79.93% Castro::do_advance_ctu() 5 191 191.3 192.2 79.93% Castro::construct_ctu_hydro_source() 9 117 117.2 117.3 48.76% Castro::clean_state() 87 71.73 80.18 83.78 34.84% Castro::computeTemp() 88 45.48 50.79 52.93 22.01% Castro::reset_internal_energy(MultiFab) 88 30.61 34.24 35.75 14.87% Castro::evaluate_source_change() 193 17.81 19.72 20.56 8.55% Castro::enforce_min_density() 87 16.89 18.87 19.79 8.23% Castro::post_regrid() 10 15.88 17.35 17.96 7.47% Amr::regrid() 5 15.75 17.12 17.66 7.34% Castro::initialize_do_advance() 9 14.73 14.97 15.15 6.30% amrex::Copy() 679 12.67 14.05 14.6 6.07% AmrLevel::FillPatch() 62 7.874 9.487 13.82 5.75% check_for_negative_density() 9 0.4753 4.499 13.71 5.70% Castro::do_old_sources() 9 11.05 11.55 12.78 5.31% FabArray::ParallelCopy() 830 4.018 6.439 12.76 5.31% FillPatchIterator::Initialize 62 6.201 7.864 12.35 5.14% Castro::normalize_species() 87 10.15 11.41 12.15 5.05% MultiFab::AddProduct() 4205 10.5 11.63 12.11 5.04% Gravity::solve_phi_with_mlmg() 11 11.14 11.26 11.48 4.77% Gravity::multilevel_solve_for_new_phi() 10 10.85 10.97 11.18 4.65% Gravity::actual_multilevel_solve() 10 10.82 10.94 11.15 4.64% Castro::do_new_sources() 9 9.538 10.47 10.91 4.54% FabArray::ParallelCopy_finish() 830 1.522 4.134 10.56 4.39% Amr::init() 1 10.29 10.29 10.29 4.28% FillPatchSingleLevel 92 3.959 5.672 10.28 4.27% Castro::post_timestep() 9 10.19 10.19 10.2 4.24% FillPatchIterator::FillFromLevel0() 31 3.599 5.301 9.866 4.10% Amr::initialInit() 1 9.767 9.767 9.768 4.06% Castro::reset_internal_energy(Fab) 1476 8.302 9.219 9.572 3.98% Castro::reflux() 4 8.947 8.998 9.023 3.75% Castro::initialize_advance() 9 7.382 8.236 8.574 3.57% Castro::estTimeStep() 26 4.118 5.439 8.505 3.54% FabArray::setVal() 5070 7.343 8.092 8.409 3.50% MultiFab::Subtract() 175 7.039 7.761 8.061 3.35% Gravity::actual_solve_with_mlmg() 11 6.735 6.739 6.744 2.80% Castro::construct_new_gravity() 9 6.273 6.386 6.586 2.74% Castro::expand_state() 13 5.051 5.469 6.461 2.69% MLMG::solve() 10 6.237 6.247 6.265 2.61% Amr::FinalizeInit() 1 5.63 5.787 6.091 2.53% MLMG::oneIter() 31 5.033 5.051 5.06 2.10% Gravity::fill_multipole_BCs() 11 4.386 4.504 4.716 1.96% FluxRegister::Reflux() 24 4.384 4.4 4.412 1.83% MLMG::mgVcycle() 65 4.208 4.236 4.248 1.77% Amr::InitializeInit() 1 3.677 3.981 4.138 1.72% Amr::defBaseLevel() 1 3.677 3.981 4.138 1.72% FabArray::sum() 4205 3.479 3.848 4.012 1.67% Castro::problem_post_timestep() 10 2.784 3.166 3.939 1.64% Castro::computeNewDt() 8 2.256 2.721 3.915 1.63% Castro::finalize_do_advance() 9 1.374 2.072 3.638 1.51% MLCellLinOp::smooth() 688 3.188 3.205 3.228 1.34% Castro::post_init() 1 2.477 2.611 2.895 1.20% Castro::FluxRegCrseInit 9 1.807 2.077 2.719 1.13% FabArray::ParallelCopy_nowait() 830 2.111 2.302 2.69 1.12% Castro::initData() 1 2.236 2.513 2.61 1.09% MLPoisson::Fsmooth() 1376 2.104 2.343 2.442 1.02% Castro::wd_update() 6 1.127 1.509 2.282 0.95% Castro::construct_old_gravity() 9 0.6707 1.183 2.279 0.95% Gravity::get_old_grav_vector() 9 0.6697 1.182 2.279 0.95% Castro::construct_new_source() 63 1.926 2.046 2.212 0.92% MLMG::mgVcycle_down::0 31 1.875 1.938 1.966 0.82% MLCellLinOp::applyBC() 1742 1.05 1.218 1.593 0.66% FillPatchIterator::FillFromTwoLevels() 31 1.504 1.516 1.53 0.64% FillPatchTwoLevels 31 1.504 1.516 1.53 0.64% Amr::bldFineLevels() 1 1.268 1.441 1.521 0.63% Castro::Castro() 5 1.382 1.427 1.486 0.62% FillPatchInterp(MF) 30 1.233 1.338 1.452 0.60% MLMG::mgVcycle_up::0 31 1.345 1.37 1.381 0.57% MLCellLinOp::apply() 318 1.281 1.306 1.326 0.55% FabArray::FillBoundary() 1553 0.5991 0.7976 1.234 0.51% Castro::construct_old_gravity_source() 18 0.9861 1.063 1.212 0.50% Castro::initMFs() 5 1.117 1.144 1.208 0.50% amrex::Add() 136 1.019 1.135 1.184 0.49% Amr::InitAmr() 1 1.172 1.172 1.172 0.49% Castro::construct_old_source() 63 0.9352 1.028 1.072 0.45% Amr::writePlotFile() 2 1.056 1.056 1.056 0.44% MLPoisson::Fapply() 318 0.9114 1.012 1.056 0.44% MLCellLinOp::solutionResidual() 72 0.9747 1.021 1.046 0.44% Castro::construct_new_gravity_source() 9 0.8457 0.9037 1.026 0.43% Castro::computeInitialDt() 2 0.4959 0.6532 0.9573 0.40% FillBoundary_finish() 1553 0.2876 0.4374 0.838 0.35% FabArray::Saxpy() 182 0.7101 0.7884 0.8204 0.34% MLCellLinOp::correctionResidual() 189 0.8014 0.8045 0.8101 0.34% Gravity::get_new_grav_vector() 10 0.7716 0.7812 0.7894 0.33% MLMG:computeResOfCorrection() 155 0.6487 0.6787 0.691 0.29% Castro::volInBoundary() 42 0.6142 0.6609 0.6804 0.28% VisMF::Write(FabArray) 3 0.5686 0.6403 0.6738 0.28% StateDataPhysBCFunct::() 95 0.5787 0.5942 0.6025 0.25% StateData::FillBoundary(geom) 50 0.5765 0.588 0.5993 0.25% MLMG::computeResWithCrseSolFineCor() 17 0.5731 0.574 0.5759 0.24% Gravity::update_max_rhs() 10 0.08933 0.2209 0.5053 0.21% MLMG::computeMLResidual() 15 0.4196 0.4445 0.5011 0.21% Castro::init() 1 0.4737 0.4753 0.4775 0.20% AmrLevel::FillCoarsePatch() 5 0.4736 0.4753 0.4775 0.20% MultiFab::max() 18 0.02971 0.1615 0.4504 0.19% Castro::check_for_nan() 18 0.3809 0.4252 0.4455 0.19% MultiFab::contains_nan() 18 0.3808 0.4251 0.4453 0.19% Gravity::test_composite_phi() 1 0.4028 0.4037 0.4056 0.17% FabArray::Xpay() 283 0.3472 0.3855 0.4018 0.17% amrex::average_down 233 0.2756 0.3524 0.3976 0.17% FillBoundary_nowait() 1553 0.3072 0.3558 0.3944 0.16% MLMG::mgVcycle_down::1 31 0.2988 0.323 0.3809 0.16% Castro::init(old) 3 0.3625 0.365 0.3668 0.15% MLCellLinOp::reflux() 30 0.1811 0.2326 0.3661 0.15% MLMG::computeResidual() 31 0.3453 0.3525 0.3574 0.15% Castro::apply_source_to_state() 18 0.2842 0.3154 0.3285 0.14% MLPoisson::define() 11 0.2774 0.2886 0.2974 0.12% Castro::react_state() 18 0.2199 0.2439 0.2561 0.11% FabArray::setDomainBndry() 92 0.2031 0.2217 0.2332 0.10% MLMG::prepareForSolve() 10 0.2171 0.2207 0.2252 0.09% Amr::grid_places() 6 0.2178 0.2179 0.2179 0.09% AmrMesh::MakeNewGrids() 6 0.2173 0.2174 0.2174 0.09% MLMG::mgVcycle_up::1 31 0.2102 0.2135 0.216 0.09% MLCellLinOp::defineAuxData() 11 0.1784 0.1945 0.2037 0.08% Castro::fill_hybrid_hydro_source() 27 0.1667 0.1835 0.1912 0.08% MLMG::addInterpCorrection() 155 0.1265 0.1628 0.1808 0.08% MLMG::mgVcycle_bottom 65 0.15 0.1572 0.1777 0.07% MLMG::getGradSolution() 10 0.1667 0.1697 0.1714 0.07% MLCellLinOp::compGrad() 18 0.1667 0.1696 0.1714 0.07% MLPoisson::FFlux() 150 0.004605 0.04157 0.1522 0.06% MLMG::miniCycle() 34 0.1501 0.1504 0.1506 0.06% Castro::errorEst() 6 0.1204 0.1277 0.1437 0.06% FabArray::mult() 56 0.1193 0.132 0.138 0.06% Castro::avgDown() 4 0.1179 0.1247 0.1287 0.05% Castro::avgDown(state_indx) 20 0.1179 0.1246 0.1286 0.05% amrex::average_down_w_geom 20 0.1178 0.1246 0.1286 0.05% Castro::construct_new_hybrid_source() 9 0.1113 0.1227 0.1274 0.05% AmrLevel::AmrLevel(dm) 5 0.1054 0.117 0.1236 0.05% StateData::define() 25 0.1052 0.1168 0.1234 0.05% MLMG::ResNormInf() 54 0.07461 0.08407 0.1051 0.04% MLCellLinOp::updateSolBC() 25 0.07642 0.08573 0.09979 0.04% Castro::swap_state_time_levels() 9 0.08136 0.08916 0.09321 0.04% MLMG::computeResWithCrseCorFineCor() 17 0.08571 0.08655 0.08862 0.04% MLCellLinOp::defineBC() 11 0.08486 0.08599 0.08728 0.04% MLMG::mgVcycle_up::3 31 0.02516 0.06446 0.07769 0.03% MLMG::mgVcycle_down::2 31 0.06729 0.0709 0.07668 0.03% MLMG::MLResNormInf() 15 0.04471 0.06722 0.07552 0.03% FabArray::norminf(mask) 21 0.056 0.06248 0.06528 0.03% Castro::apply_tagging_restrictions() 6 0.0542 0.05767 0.06479 0.03% Castro::construct_old_hybrid_source() 9 0.05544 0.06096 0.06385 0.03% BndryData::define() 27 0.05717 0.05861 0.06022 0.03% Castro::derive() 6 0.04745 0.05069 0.0574 0.02% AmrLevel::derive() 6 0.04743 0.05067 0.05738 0.02% MLMG::interpCorrection_1 17 0.02593 0.03488 0.05698 0.02% MLMG::mgVcycle_up::2 31 0.05043 0.05135 0.05223 0.02% MLCellLinOp::updateCorBC() 17 0.04949 0.05021 0.05108 0.02% Castro::buildMetrics() 5 0.04257 0.0433 0.04407 0.02% FabArray::norminf() 147 0.0375 0.03933 0.04144 0.02% TagBoxArray::mapPRD 6 0.004047 0.02803 0.0378 0.02% Gravity::swapTimeLevels() 9 0.03383 0.03548 0.03681 0.02% MLMG::mgVcycle_down::3 31 0.03069 0.03157 0.03408 0.01% MLMG::MLRhsNormInf() 10 0.02568 0.02856 0.02973 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01854 0.02217 0.02804 0.01% FabArrayBase::getCPC() 1440 0.02283 0.02483 0.02778 0.01% MLMG::actualBottomSolve() 31 3.968e-05 0.006901 0.02748 0.01% MLCGSolver::bicgstab 7 0 0.006692 0.02677 0.01% Castro::FluxRegFineAdd() 9 0.0255 0.0257 0.02597 0.01% MultiFab::Multiply() 8 0.02176 0.0241 0.02517 0.01% Gravity::average_fine_ec_onto_crse_ec() 8 0.01967 0.02019 0.02143 0.01% MLMG::compResidual() 1 0.01785 0.01956 0.02031 0.01% Castro::build_fine_mask() 44 0.01731 0.01867 0.01982 0.01% MLMG::mgVcycle_down::4 31 0.005218 0.008524 0.01841 0.01% FabArrayBase::CPC::define() 416 0.01306 0.01479 0.01776 0.01% Castro::linear_to_hybrid_momentum() 1 0.01415 0.01583 0.01667 0.01% MLLinOp::define() 11 0.003115 0.007931 0.01408 0.01% MLLinOp::defineGrids() 11 0.003044 0.007865 0.01401 0.01% MLMG::mgVcycle_up::4 31 0.004292 0.006692 0.01387 0.01% AMRErrorTag::operator() 6 0.01016 0.01112 0.01283 0.01% Castro::enforce_consistent_e() 1 0.00889 0.01074 0.0128 0.01% MLLinOp::makeSubCommunicator() 11 0.001216 0.006088 0.01216 0.01% MLPoisson::prepareForSolve() 11 0.01152 0.01164 0.01177 0.00% MLCellLinOp::prepareForSolve() 11 0.01147 0.01159 0.01172 0.00% average_down_faces 48 0.008927 0.00958 0.01011 0.00% Castro::apply_problem_tags() 6 0.007676 0.008071 0.008613 0.00% FabArrayBase::getFB() 1553 0.005632 0.006018 0.006453 0.00% MLCellLinOp::setLevelBC() 19 0.003647 0.004527 0.0053 0.00% FabArrayBase::TheFPinfo() 25 0.001808 0.00274 0.003802 0.00% FPinfo::FPinfo() 3 0.001639 0.002565 0.003626 0.00% DistributionMapping::KnapSackDoIt() 3 0.001514 0.002444 0.003503 0.00% DistributionMapping::LeastUsedCPUs() 5 0.001469 0.002421 0.003491 0.00% amrex::Dot() 115 0 0.0008611 0.003444 0.00% FabArrayBase::FB::FB() 19 0.002513 0.00283 0.003154 0.00% MLCGSolver::ParallelAllReduce 183 0 0.0007409 0.002964 0.00% TagBoxArray::collate() 6 0.0004451 0.001054 0.001343 0.00% OwnerMask() 6 0.0007261 0.0008381 0.0008998 0.00% Castro::finalize_advance() 9 0.000338 0.000388 0.0004157 0.00% MLLinOp::makeAgglomeratedDMap 11 0.0003682 0.0003913 0.0004115 0.00% makeSFC 33 0.0002598 0.000276 0.0002851 0.00% Castro::enforce_speed_limit() 87 0.0002413 0.0002528 0.0002623 0.00% DistributionMapping::SFCProcessorMapDoIt() 2 0.0001337 0.0001442 0.0001515 0.00% AmrMesh-cluster 1 0 3.515e-05 0.0001406 0.00% DistributionMapping::Distribute() 35 0.0001073 0.0001113 0.0001149 0.00% FabArray::RecvLayoutMask() 8 9.099e-05 9.955e-05 0.0001121 0.00% Amr::writeSmallPlotFile() 1 0.0001045 0.0001072 0.0001118 0.00% ClusterList::intersect() 1 0 2.241e-05 8.965e-05 0.00% knapsack() 3 6.991e-05 7.358e-05 7.806e-05 0.00% Castro::create_source_corrector() 9 6.071e-05 6.606e-05 7.647e-05 0.00% Gravity::set_mass_offset() 6 3.297e-05 4.525e-05 5.724e-05 0.00% Amr::initSubcycle() 1 5e-05 5.19e-05 5.267e-05 0.00% BoxList::parallelComplementIn() 12 4.634e-05 4.935e-05 5.179e-05 0.00% Castro::retry_advance_ctu() 5 2.187e-05 2.801e-05 4.011e-05 0.00% Castro::construct_new_rotation_source() 9 1.87e-05 2.359e-05 2.803e-05 0.00% Castro::construct_old_rotation_source() 9 2.094e-05 2.315e-05 2.607e-05 0.00% BoxList::complementIn 12 2.195e-05 2.32e-05 2.547e-05 0.00% ClusterList::chop() 1 0 2.714e-06 1.086e-05 0.00% knapsack()swap 1 3.544e-06 3.9e-06 4.196e-06 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (24.04-18-ge293ff685199) finalized