Initializing AMReX (v2024-33-g9e71c2cb9714)... MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (v2024-33-g9e71c2cb9714) initialized Starting run at 14:51:30 UTC on 2024-03-25. Successfully read inputs file ... Castro git describe: 24.03-30-g437ebcb19 AMReX git describe: v2024-33-g9e71c2cb9 Microphysics git describe: 24.03-21-g81de2adb reading extern runtime parameters ... 13 Species: He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56 Successfully read inputs file ... Creating primary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Creating secondary with CO core with mass fractions C = 0.4and O = 0.6 and a He shell of solar mass =0. Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm. Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU. The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU. The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU. The initial orbital period is 30.543687 s. The initial orbital speed of the primary is -1.831e+08 cm/s. The initial orbital speed of the secondary is 1.831e+08 cm/s. Castro::numpts_1d at level 0 is 294 Setting the gravity type to PoissonGrav Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.0344533514 ...hydro-limited CFL timestep constrained at (i,j) = (0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0344533514 Gravity::fill_multipole_BCs() time = 0.0006977520002 Gravity::multilevel_solve_for_new_phi() time = 0.086637606 Gravity::fill_multipole_BCs() time = 0.0007357200002 ... norm of composite residual at level 0 3.231614828e-11 INITIAL GRIDS Level 0 32 grids 32768 cells 100 % of domain smallest grid: 32 x 32 biggest grid: 32 x 32 PLOTFILE: file = wdmerger_2D_plt00000 Write plotfile time = 0.175714883 seconds ...estimated hydro-limited timestep at level 0: 0.0344533514 ...hydro-limited CFL timestep constrained at (i,j) = (0,0) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0344533514 [Level 0 step 1] ADVANCE at time 0 with dt = 0.00344533514  Beginning subcycle 1 starting at time 0 with dt = 0.00344533514 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006677413 on level 0 Castro::do_old_sources() time = 0.061203345 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.308912126 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003584527 Gravity::solve_for_phi() time = 0.04413365 on level 0 Castro::construct_new_gravity() time = 0.046311941 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.140725016e+44 ener added: 5.455966658e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.18800867e+34 ymom added: 1.298680826e+28 zmom added: -6.497032614e+24 eint added: 0 ener added: -4.211215734e+44 Castro::do_new_sources() time = 0.066983 on level 0 ...estimated hydro-limited timestep at level 0: 0.03440361002 ...hydro-limited CFL timestep constrained at (i,j) = (17,146) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03440361002  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04629162102 [Level 0 step 1] Advanced 32768 cells [STEP 1] Coarse TimeStep time: 0.765753988 [STEP 1] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 1 TIME = 0.00344533514 DT = 0.00344533514 ...estimated hydro-limited timestep at level 0: 0.03440361002 ...hydro-limited CFL timestep constrained at (i,j) = (17,146) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03440361002 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03440361002 ... but limiting to: 0.003789868654 = 1.1 * 0.00344533514 [Level 0 step 2] ADVANCE at time 0.00344533514 with dt = 0.003789868654  Beginning subcycle 1 starting at time 0.00344533514 with dt = 0.003789868654 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.007262021 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.669837779e+45 ener added: 8.701371447e+38 Contributions to the state from old-time sources: mass added: 0 xmom added: -6.214540452e+39 ymom added: 3.102168822e+28 zmom added: -2.591595872e+25 eint added: 0 ener added: -1.412849514e+44 Castro::do_old_sources() time = 0.061541522 on level 0 ... Entering construct_ctu_hydro_source() on level 0 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.322442942 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003730221 Gravity::solve_for_phi() time = 0.044609373 on level 0 Castro::construct_new_gravity() time = 0.04681737 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -4.531858784e+44 ener added: 6.778764846e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.576883653e+34 ymom added: 6.100271266e+27 zmom added: -2.551409828e+25 eint added: 0 ener added: -4.608821729e+44 Castro::do_new_sources() time = 0.066819499 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.056141333e+25 ener added: 3.056141333e+25 ...estimated hydro-limited timestep at level 0: 0.0343540251 ...hydro-limited CFL timestep constrained at (i,j) = (18,150) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0343540251  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04521996045 [Level 0 step 2] Advanced 32768 cells [STEP 2] Coarse TimeStep time: 0.783032638 [STEP 2] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 2 TIME = 0.007235203794 DT = 0.003789868654 ...estimated hydro-limited timestep at level 0: 0.0343540251 ...hydro-limited CFL timestep constrained at (i,j) = (18,150) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0343540251 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.0343540251 ... but limiting to: 0.00416885552 = 1.1 * 0.003789868654 [Level 0 step 3] ADVANCE at time 0.007235203794 with dt = 0.00416885552  Beginning subcycle 1 starting at time 0.007235203794 with dt = 0.00416885552 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.007748647 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.04904428e+46 ener added: 2.332636392e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: -6.835959806e+39 ymom added: 4.754410573e+28 zmom added: -9.69463683e+25 eint added: 0 ener added: -3.256514228e+44 Castro::do_old_sources() time = 0.061166153 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.11338645e+46 ener added: 1.280682343e+38 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324231232 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003695059 Gravity::solve_for_phi() time = 0.044304964 on level 0 Castro::construct_new_gravity() time = 0.046413751 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.008755236e+44 ener added: 7.629290314e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.099314371e+34 ymom added: 8.955651133e+27 zmom added: -4.327571039e+25 eint added: 0 ener added: -5.093231808e+44 Castro::do_new_sources() time = 0.066348738 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 0 ener added: 5.780530483e+23 ...estimated hydro-limited timestep at level 0: 0.03429796701 ...hydro-limited CFL timestep constrained at (i,j) = (18,110) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03429796701  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04537015436 [Level 0 step 3] Advanced 32768 cells [STEP 3] Coarse TimeStep time: 0.778852095 [STEP 3] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 3 TIME = 0.01140405931 DT = 0.00416885552 ...estimated hydro-limited timestep at level 0: 0.03429796701 ...hydro-limited CFL timestep constrained at (i,j) = (18,110) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03429796701 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03429796701 ... but limiting to: 0.004585741072 = 1.1 * 0.00416885552 [Level 0 step 4] ADVANCE at time 0.01140405931 with dt = 0.004585741072  Beginning subcycle 1 starting at time 0.01140405931 with dt = 0.004585741072 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.006545702 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.269333414e+46 ener added: 8.145745262e+39 Contributions to the state from old-time sources: mass added: 0 xmom added: -7.519509602e+39 ymom added: 7.200103396e+28 zmom added: -2.201070783e+26 eint added: 0 ener added: -5.633567318e+44 Castro::do_old_sources() time = 0.061523073 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.339373653e+46 ener added: 2.30880358e+40 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.32362245 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003295859 Gravity::solve_for_phi() time = 0.043805763 on level 0 Castro::construct_new_gravity() time = 0.045927053 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -5.53106043e+44 ener added: 9.556977699e+42 Contributions to the state from new-time sources: mass added: 0 xmom added: 2.794378512e+34 ymom added: 1.262115466e+28 zmom added: -7.104163471e+25 eint added: 0 ener added: -5.634620176e+44 Castro::do_new_sources() time = 0.067352642 on level 0 ...estimated hydro-limited timestep at level 0: 0.03423270804 ...hydro-limited CFL timestep constrained at (i,j) = (18,145) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03423270804  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04532095145 [Level 0 step 4] Advanced 32768 cells [STEP 4] Coarse TimeStep time: 0.780319555 [STEP 4] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 4 TIME = 0.01598980039 DT = 0.004585741072 ...estimated hydro-limited timestep at level 0: 0.03423270804 ...hydro-limited CFL timestep constrained at (i,j) = (18,145) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03423270804 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03423270804 ... but limiting to: 0.005044315179 = 1.1 * 0.004585741072 [Level 0 step 5] ADVANCE at time 0.01598980039 with dt = 0.005044315179  Beginning subcycle 1 starting at time 0.01598980039 with dt = 0.005044315179 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.007105729 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.535877456e+46 ener added: 1.666453987e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -8.271399086e+39 ymom added: 1.069689674e+29 zmom added: -4.253325733e+26 eint added: 0 ener added: -8.667485799e+44 Castro::do_old_sources() time = 0.062087364 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.612325109e+46 ener added: 7.239372824e+40 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.326766819 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003501871 Gravity::solve_for_phi() time = 0.044092181 on level 0 Castro::construct_new_gravity() time = 0.046272713 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.122070573e+44 ener added: 1.115694628e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 3.718832165e+34 ymom added: 1.766162575e+28 zmom added: -1.126388547e+26 eint added: 0 ener added: -6.241858001e+44 Castro::do_new_sources() time = 0.067701467 on level 0 ...estimated hydro-limited timestep at level 0: 0.03417100873 ...hydro-limited CFL timestep constrained at (i,j) = (18,100) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03417100873  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04505212624 [Level 0 step 5] Advanced 32768 cells [STEP 5] Coarse TimeStep time: 0.784155301 [STEP 5] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 5 TIME = 0.02103411556 DT = 0.005044315179 ...estimated hydro-limited timestep at level 0: 0.03417100873 ...hydro-limited CFL timestep constrained at (i,j) = (18,100) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03417100873 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03417100873 ... but limiting to: 0.005548746697 = 1.1 * 0.005044315179 [Level 0 step 6] ADVANCE at time 0.02103411556 with dt = 0.005548746697  Beginning subcycle 1 starting at time 0.02103411556 with dt = 0.005548746697 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.024307389 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.858386233e+46 ener added: 3.543829393e+40 Contributions to the state from old-time sources: mass added: 0 xmom added: -9.09845718e+39 ymom added: 1.565206837e+29 zmom added: -7.555431688e+26 eint added: 0 ener added: -1.250770083e+45 Castro::do_old_sources() time = 0.080449453 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.942052755e+46 ener added: 1.324471742e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.376657863 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003444054 Gravity::solve_for_phi() time = 0.044008158 on level 0 Castro::construct_new_gravity() time = 0.046114649 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -6.778694182e+44 ener added: 1.381393165e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 4.947635083e+34 ymom added: 2.430677162e+28 zmom added: -1.746629594e+26 eint added: 0 ener added: -6.925408003e+44 Castro::do_new_sources() time = 0.090288081 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.989068688e+26 ener added: 3.989068688e+26 ...estimated hydro-limited timestep at level 0: 0.03411155066 ...hydro-limited CFL timestep constrained at (i,j) = (17,142) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03411155066  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04100332001 [Level 0 step 6] Advanced 32768 cells Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 1.415475986e+26 ener added: 1.415475986e+26 [STEP 6] Coarse TimeStep time: 0.857271114 [STEP 6] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 6 TIME = 0.02658286226 DT = 0.005548746697 ...estimated hydro-limited timestep at level 0: 0.03411155066 ...hydro-limited CFL timestep constrained at (i,j) = (17,142) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03411155066 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03411155066 ... but limiting to: 0.006103621366 = 1.1 * 0.005548746697 [Level 0 step 7] ADVANCE at time 0.02658286226 with dt = 0.006103621366  Beginning subcycle 1 starting at time 0.02658286226 with dt = 0.006103621366 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.010795291 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.248603542e+46 ener added: 1.094365848e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.000819405e+40 ymom added: 2.256464104e+29 zmom added: -1.274536111e+27 eint added: 0 ener added: -1.733474982e+45 Castro::do_old_sources() time = 0.067201389 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.340396229e+46 ener added: 2.049134635e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.343105922 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003081712 Gravity::solve_for_phi() time = 0.053910748 on level 0 Castro::construct_new_gravity() time = 0.056623898 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -7.482684146e+44 ener added: 2.016974783e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 6.578125243e+34 ymom added: -9.590422638e+28 zmom added: -2.623098227e+26 eint added: 0 ener added: -7.693388938e+44 Castro::do_new_sources() time = 0.069163482 on level 0 ...estimated hydro-limited timestep at level 0: 0.03402428858 ...hydro-limited CFL timestep constrained at (i,j) = (16,140) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03402428858  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04321916796 [Level 0 step 7] Advanced 32768 cells [STEP 7] Coarse TimeStep time: 0.823746475 [STEP 7] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 7 TIME = 0.03268648363 DT = 0.006103621366 ...estimated hydro-limited timestep at level 0: 0.03402428858 ...hydro-limited CFL timestep constrained at (i,j) = (16,140) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03402428858 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03402428858 ... but limiting to: 0.006713983503 = 1.1 * 0.006103621366 [Level 0 step 8] ADVANCE at time 0.03268648363 with dt = 0.006713983503  Beginning subcycle 1 starting at time 0.03268648363 with dt = 0.006713983503 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.024263586 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -2.720742398e+46 ener added: 2.406521309e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.100886874e+40 ymom added: 3.722276932e+28 zmom added: -1.709526421e+27 eint added: 0 ener added: -2.336656985e+45 Castro::do_old_sources() time = 0.076893531 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 2.821602242e+46 ener added: 2.913363246e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.340017573 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.0030819 Gravity::solve_for_phi() time = 0.052593311 on level 0 Castro::construct_new_gravity() time = 0.054703515 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -8.305357939e+44 ener added: 2.399835511e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 8.73845175e+34 ymom added: 1.931002436e+27 zmom added: 7.468211608e+24 eint added: 0 ener added: -8.554854963e+44 Castro::do_new_sources() time = 0.081969039 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.731709418e+26 ener added: 3.731709418e+26 ...estimated hydro-limited timestep at level 0: 0.03393063109 ...hydro-limited CFL timestep constrained at (i,j) = (16,140) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03393063109  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04235949135 [Level 0 step 8] Advanced 32768 cells [STEP 8] Coarse TimeStep time: 0.831036908 [STEP 8] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 8 TIME = 0.03940046713 DT = 0.006713983503 ...estimated hydro-limited timestep at level 0: 0.03393063109 ...hydro-limited CFL timestep constrained at (i,j) = (16,140) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03393063109 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03393063109 ... but limiting to: 0.007385381853 = 1.1 * 0.006713983503 [Level 0 step 9] ADVANCE at time 0.03940046713 with dt = 0.007385381853  Beginning subcycle 1 starting at time 0.03940046713 with dt = 0.007385381853 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.040603608 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.291968129e+46 ener added: 7.228596916e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.210956336e+40 ymom added: 4.519187609e+28 zmom added: -1.860575939e+27 eint added: 0 ener added: -3.086589574e+45 Castro::do_old_sources() time = 0.093405686 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 3.402996685e+46 ener added: 4.008788345e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.357087451 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.004401358 Gravity::solve_for_phi() time = 0.054142518 on level 0 Castro::construct_new_gravity() time = 0.05626247 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -9.178865443e+44 ener added: 3.327101741e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.159702743e+35 ymom added: 2.77218232e+27 zmom added: 9.781679521e+25 eint added: 0 ener added: -9.521743446e+44 Castro::do_new_sources() time = 0.067736687 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.375107593e+26 ener added: 4.375107593e+26 ...estimated hydro-limited timestep at level 0: 0.03383660016 ...hydro-limited CFL timestep constrained at (i,j) = (16,140) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03383660016  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04064969522 [Level 0 step 9] Advanced 32768 cells [STEP 9] Coarse TimeStep time: 0.864868435 [STEP 9] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 9 TIME = 0.04678584898 DT = 0.007385381853 ...estimated hydro-limited timestep at level 0: 0.03383660016 ...hydro-limited CFL timestep constrained at (i,j) = (16,140) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03383660016 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.03383660016 ... but limiting to: 0.008123920038 = 1.1 * 0.007385381853 [Level 0 step 10] ADVANCE at time 0.04678584898 with dt = 0.008123920038  Beginning subcycle 1 starting at time 0.04678584898 with dt = 0.008123920038 Estimated number of subcycles remaining: 1 Castro::construct_old_gravity() time = 0.004945397 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -3.983147048e+46 ener added: 9.005394236e+41 Contributions to the state from old-time sources: mass added: 0 xmom added: -1.332026456e+40 ymom added: 5.581380087e+28 zmom added: -1.820180516e+27 eint added: 0 ener added: -4.014903804e+45 Castro::do_old_sources() time = 0.061835064 on level 0 ... Entering construct_ctu_hydro_source() on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 4.105401637e+46 ener added: 5.367325155e+41 ... Leaving construct_ctu_hydro_source() on level 0 Castro::construct_ctu_hydro_source() time = 0.324579214 on level 0 ... new-time level Poisson gravity solve at level 0 Gravity::fill_multipole_BCs() time = 0.003072526 Gravity::solve_for_phi() time = 0.052935285 on level 0 Castro::construct_new_gravity() time = 0.055135773 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: -1.021763347e+45 ener added: 3.720820211e+43 Contributions to the state from new-time sources: mass added: 0 xmom added: 1.537223284e+35 ymom added: 3.307378875e+27 zmom added: 3.275167137e+26 eint added: 0 ener added: -1.060074101e+45 Castro::do_new_sources() time = 0.070871227 on level 0 Contributions to the state from negative energy resets: mass added: 0 xmom added: 0 ymom added: 0 zmom added: 0 eint added: 8.660139442e+27 ener added: 8.660139442e+27 ...estimated hydro-limited timestep at level 0: 0.03371858679 ...hydro-limited CFL timestep constrained at (i,j) = (16,140) Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.03371858679  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.04393652244 [Level 0 step 10] Advanced 32768 cells [STEP 10] Coarse TimeStep time: 0.808788495 [STEP 10] FAB kilobyte spread across MPI nodes: [4659 ... 4659] STEP = 10 TIME = 0.05490976902 DT = 0.008123920038 PLOTFILE: file = wdmerger_2D_plt00010 Write plotfile time = 0.179671357 seconds Ending run at 14:51:41 UTC on 2024-03-25. Run time = 11.04386051 Run time without initialization = 8.258958255 Average number of zones advanced per microsecond: 0.040 Average number of zones advanced per microsecond per rank: 0.002 TinyProfiler total time across processes [min...avg...max]: 11.04 ... 11.04 ... 11.04 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 2.6084 2.6495 2.6816 24.28% Amr::InitAmr() 1 1.301 1.306 1.308 11.84% Castro::initMFs() 1 1.016 1.031 1.064 9.64% Castro::computeTemp() 83 0.8333 0.879 0.9052 8.20% amrex::Copy() 1000 0.7847 0.7968 0.8195 7.42% MultiFab::AddProduct() 3440 0.5691 0.5841 0.6842 6.20% Castro::normalize_species() 82 0.5854 0.5955 0.6247 5.66% Castro::reset_internal_energy(Fab) 166 0.4992 0.5077 0.5215 4.72% MultiFab::Subtract() 165 0.3596 0.3677 0.4049 3.67% Castro::estTimeStep() 21 0.2127 0.3274 0.3792 3.43% FabArray::setVal() 4351 0.3256 0.3305 0.3377 3.06% Castro::reset_internal_energy(MultiFab) 83 0.02368 0.0519 0.2745 2.49% check_for_negative_density() 10 0.04378 0.1511 0.2596 2.35% FabArray::ParallelCopy_finish() 763 0.0313 0.1846 0.2402 2.17% FabArray::sum() 3440 0.185 0.188 0.1897 1.72% MLPoisson::Fsmooth() 2544 0.1318 0.1432 0.1717 1.55% AmrLevel::derive() 112 0.1266 0.1284 0.131 1.19% Castro::enforce_min_density() 82 0.01833 0.0314 0.1297 1.17% FabArray::ParallelCopy_nowait() 763 0.05857 0.06406 0.0683 0.62% FabArray::Saxpy() 150 0.05903 0.05995 0.0621 0.56% Castro::construct_new_rotation_source() 10 0.05938 0.06031 0.06116 0.55% Castro::wd_update() 11 0.03089 0.04528 0.05561 0.50% MLPoisson::Fapply() 412 0.04032 0.04238 0.04801 0.43% MLCellLinOp::applyBC() 2967 0.02147 0.02655 0.0452 0.41% FillBoundary_nowait() 2649 0.02671 0.03745 0.04454 0.40% FillBoundary_finish() 2649 0.02181 0.02952 0.04252 0.39% Castro::construct_new_gravity_source() 10 0.04101 0.04143 0.0423 0.38% VisMF::Write(FabArray) 2 0.018 0.01944 0.03493 0.32% Gravity::fill_multipole_BCs() 12 0.0067 0.02341 0.0346 0.31% Amr::writePlotFile() 2 0.009356 0.02381 0.02711 0.25% Castro::volInBoundary() 77 0.01906 0.02008 0.02692 0.24% FabArray::Xpay() 395 0.02224 0.02338 0.02606 0.24% MultiFab::contains_nan() 20 0.02433 0.02462 0.02506 0.23% Castro::construct_old_gravity_source() 10 0.02252 0.02307 0.02462 0.22% Castro::construct_old_rotation_source() 10 0.02215 0.02258 0.0233 0.21% Castro::do_new_sources() 10 0.0002312 0.003047 0.02044 0.19% MLMG::addInterpCorrection() 318 0.0137 0.01476 0.0175 0.16% amrex::average_down 318 0.01004 0.01095 0.0132 0.12% Castro::evaluate_source_change() 185 0.01194 0.01218 0.01253 0.11% StateData::FillBoundary(geom) 66 0.004512 0.006626 0.01242 0.11% Castro::construct_new_source() 60 0.01082 0.01101 0.01122 0.10% MLCellLinOp::defineAuxData() 12 0.009271 0.009565 0.01078 0.10% FillPatchIterator::Initialize 233 0.009577 0.009743 0.009835 0.09% Castro::construct_old_source() 60 0.006075 0.006268 0.007849 0.07% DistributionMapping::LeastUsedCPUs() 1 7.138e-05 0.002454 0.006912 0.06% FabArray::FillBoundary() 2649 0.005669 0.005873 0.006872 0.06% FabArray::norminf() 124 0.00495 0.005289 0.006774 0.06% MLCGSolver::bicgstab 3 0 0.0004085 0.006536 0.06% MultiFab::max() 11 0.003175 0.005475 0.006509 0.06% MLMG::prepareForSolve() 11 0.006016 0.006186 0.006453 0.06% amrex::Add() 53 0.005827 0.005904 0.006003 0.05% Castro::initData() 1 0.003325 0.003753 0.005625 0.05% FabArrayBase::getFB() 2649 0.004322 0.004485 0.005539 0.05% Castro::do_old_sources() 10 0.0002678 0.001018 0.005371 0.05% FabArray::mult() 44 0.004882 0.004916 0.005193 0.05% MLCellLinOp::smooth() 1272 0.004532 0.004713 0.005057 0.05% Gravity::actual_solve_with_mlmg() 12 0.004246 0.004383 0.004885 0.04% FabArray::setDomainBndry() 233 0.002229 0.002902 0.004881 0.04% MLMG::solve() 11 0.0004006 0.002979 0.004776 0.04% MLMG::ResNormInf() 64 0.002217 0.00307 0.00428 0.04% Gravity::get_new_grav_vector() 11 0.003681 0.003796 0.004089 0.04% FabArrayBase::CPC::define() 365 0.001488 0.002197 0.004006 0.04% FabArrayBase::getCPC() 967 0.003687 0.003756 0.003858 0.03% Castro::construct_old_gravity() 10 0.000207 0.00071 0.003796 0.03% MLCellLinOp::compGrad() 11 0.003483 0.003538 0.003664 0.03% Gravity::get_old_grav_vector() 10 0.003228 0.003318 0.003566 0.03% Gravity::applyMetricTerms() 11 0.00267 0.002745 0.003485 0.03% amrex::Dot() 58 0 0.0001582 0.00253 0.02% AmrLevel::FillPatch() 233 0.002439 0.002462 0.002499 0.02% Castro::buildMetrics() 1 0.0005761 0.0007015 0.002373 0.02% Castro::initialize_do_advance() 10 0.002058 0.002081 0.002105 0.02% BndryData::define() 12 0.001901 0.001954 0.001994 0.02% MLCGSolver::ParallelAllReduce 92 0 0.0001237 0.00198 0.02% FabArray::ParallelCopy() 763 0.00178 0.001836 0.001957 0.02% MLCellLinOp::apply() 412 0.0008389 0.0009307 0.001954 0.02% MLLinOp::defineGrids() 12 0.001167 0.00128 0.001344 0.01% MLCellLinOp::prepareForSolve() 12 0.001071 0.001126 0.001327 0.01% MLPoisson::normalize() 32 0 8.164e-05 0.001306 0.01% StateData::define() 5 0.0009227 0.0009624 0.001261 0.01% Gravity::update_max_rhs() 11 0.0009387 0.001031 0.001171 0.01% Castro::initialize_advance() 10 0.0009545 0.001077 0.001151 0.01% MLCellLinOp::defineBC() 12 0.0009447 0.0009853 0.00104 0.01% Amr::coarseTimeStep() 10 0.0009582 0.001016 0.001034 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 384 0.0008199 0.0009469 0.001013 0.01% main() 1 0.0007407 0.0008265 0.0009332 0.01% FabArrayBase::FB::FB() 46 0.0002034 0.000458 0.0009184 0.01% FillPatchIterator::FillFromLevel0() 233 0.0008244 0.0008407 0.0008604 0.01% StateDataPhysBCFunct::() 233 0.0007548 0.0007812 0.0008386 0.01% Gravity::solve_for_phi() 10 0.0004685 0.0005658 0.0008234 0.01% MLCellLinOp::correctionResidual() 318 0.0007576 0.0007795 0.0008093 0.01% MLLinOp::makeSubCommunicator() 12 0.0005243 0.0005593 0.000758 0.01% MLMG::mgVcycle() 53 0.0006538 0.0006874 0.0007477 0.01% Castro::subcycle_advance_ctu() 10 6.32e-05 0.0001138 0.0007419 0.01% Castro::construct_new_gravity() 10 0.0001713 0.0003193 0.0006753 0.01% FillPatchSingleLevel 233 0.0006169 0.0006328 0.0006562 0.01% MLMG:computeResOfCorrection() 318 0.000575 0.0005989 0.0006377 0.01% Castro::Castro() 1 0.0004799 0.0005125 0.0005602 0.01% MLCellLinOp::setLevelBC() 12 0.0003971 0.0004358 0.0005231 0.00% Castro::clean_state() 82 0.0004276 0.0004441 0.0004569 0.00% MLMG::actualBottomSolve() 53 5.697e-05 8.177e-05 0.0004334 0.00% Castro::swap_state_time_levels() 10 0.0004053 0.0004165 0.0004269 0.00% Castro::enforce_consistent_e() 1 0.0003627 0.0003748 0.0003932 0.00% Castro::computeNewDt() 9 2.917e-05 5.281e-05 0.0003357 0.00% MLMG::mgVcycle_down::2 53 0.0002612 0.0002853 0.0003157 0.00% MLMG::mgVcycle_down::1 53 0.0002801 0.0002886 0.0003046 0.00% MLMG::mgVcycle_down::3 53 0.0002352 0.000258 0.0002965 0.00% MLMG::mgVcycle_down::0 53 0.0002811 0.0002878 0.0002946 0.00% Castro::finalize_advance() 10 0.0002084 0.0002364 0.0002939 0.00% MLMG::mgVcycle_down::4 53 0.0002308 0.0002431 0.0002871 0.00% MLMG::mgVcycle_down::5 53 0.0002422 0.0002524 0.0002798 0.00% makeSFC 60 0.0002516 0.0002727 0.0002781 0.00% Castro::do_advance_ctu() 10 0.0002283 0.0002405 0.0002766 0.00% Castro::derive() 112 0.0002248 0.0002301 0.0002342 0.00% MLLinOp::makeAgglomeratedDMap 12 0.0002075 0.0002107 0.0002132 0.00% MLMG::mgVcycle_up::1 53 0.0001839 0.0001942 0.0002062 0.00% MLMG::mgVcycle_up::0 53 0.000194 0.0001979 0.0002045 0.00% MLCellLinOp::solutionResidual() 65 0.0001894 0.0001933 0.0001999 0.00% MLMG::mgVcycle_up::2 53 0.0001583 0.000175 0.0001935 0.00% MLMG::mgVcycle_up::3 53 0.0001566 0.0001625 0.0001844 0.00% MLMG::mgVcycle_up::4 53 0.0001581 0.0001638 0.0001842 0.00% MLMG::mgVcycle_up::5 53 0.0001669 0.0001704 0.0001809 0.00% MLMG::compResidual() 1 0.0001523 0.0001585 0.0001701 0.00% MLMG::oneIter() 53 0.0001585 0.000166 0.0001693 0.00% DistributionMapping::Distribute() 61 0.0001483 0.000155 0.0001688 0.00% Amr::timeStep() 10 0.000107 0.0001201 0.0001681 0.00% Amr::initSubcycle() 1 4.355e-05 5.344e-05 0.000157 0.00% Gravity::solve_phi_with_mlmg() 12 0.0001367 0.0001437 0.0001559 0.00% Amr::defBaseLevel() 1 8.09e-05 8.969e-05 0.0001474 0.00% MLPoisson::define() 12 9.687e-05 0.0001154 0.0001356 0.00% Gravity::test_composite_phi() 1 9.278e-05 9.81e-05 0.0001288 0.00% Amr::writeSmallPlotFile() 1 9.059e-05 9.524e-05 0.0001285 0.00% Castro::finalize_do_advance() 10 0.0001008 0.0001096 0.0001269 0.00% Castro::enforce_speed_limit() 82 0.0001006 0.0001087 0.0001254 0.00% MLMG::mgVcycle_bottom 53 9.29e-05 9.684e-05 0.0001071 0.00% MLMG::computeResidual() 53 9.612e-05 9.854e-05 0.0001052 0.00% Castro::advance() 10 6.102e-05 7.528e-05 0.000105 0.00% Castro::problem_post_timestep() 11 5.628e-05 6.818e-05 0.0001044 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.921e-05 7.061e-05 9.777e-05 0.00% AmrLevel::AmrLevel(dm) 1 3.84e-05 5.87e-05 8.187e-05 0.00% Castro::react_state() 20 5.431e-05 5.759e-05 7.917e-05 0.00% Amr::FinalizeInit() 1 1.016e-05 1.952e-05 7.101e-05 0.00% MLLinOp::define() 12 4.801e-05 5.278e-05 5.697e-05 0.00% Castro::post_timestep() 10 4.622e-05 4.985e-05 5.681e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 2.704e-05 3.107e-05 5.63e-05 0.00% Castro::check_for_nan() 20 4.82e-05 5.089e-05 5.419e-05 0.00% MLPoisson::prepareForSolve() 12 4.319e-05 4.735e-05 5.253e-05 0.00% Castro::FluxRegCrseInit 10 1.419e-05 2.339e-05 5.08e-05 0.00% Castro::apply_source_to_state() 20 4.518e-05 4.703e-05 4.818e-05 0.00% Gravity::swapTimeLevels() 10 3.73e-05 4.052e-05 4.769e-05 0.00% Castro::FluxRegFineAdd() 10 1.034e-05 2.012e-05 4.691e-05 0.00% Castro::retry_advance_ctu() 10 2.043e-05 2.611e-05 4.295e-05 0.00% Amr::InitializeInit() 1 5.875e-06 9.197e-06 3.943e-05 0.00% Gravity::set_mass_offset() 11 2.579e-05 2.942e-05 3.609e-05 0.00% Castro::expand_state() 10 2.673e-05 2.858e-05 3.243e-05 0.00% Castro::create_source_corrector() 10 2.222e-05 2.465e-05 3.219e-05 0.00% MLMG::computeMLResidual() 11 2.56e-05 2.784e-05 2.955e-05 0.00% Castro::post_regrid() 1 9.901e-06 1.62e-05 2.814e-05 0.00% Gravity::actual_multilevel_solve() 1 2.549e-05 2.649e-05 2.777e-05 0.00% MLMG::getGradSolution() 11 2.455e-05 2.54e-05 2.685e-05 0.00% MLMG::MLRhsNormInf() 11 1.875e-05 1.984e-05 2.526e-05 0.00% MLMG::MLResNormInf() 11 1.948e-05 2.031e-05 2.111e-05 0.00% Castro::computeInitialDt() 2 8.208e-06 9.308e-06 1.294e-05 0.00% Castro::post_init() 1 1.046e-05 1.131e-05 1.177e-05 0.00% Amr::init() 1 5.204e-06 5.879e-06 8.977e-06 0.00% Amr::initialInit() 1 3.083e-06 3.468e-06 5.429e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 11.04 11.04 11.04 100.00% Amr::coarseTimeStep() 10 8.258 8.258 8.258 74.78% Amr::timeStep() 10 7.981 7.982 7.982 72.27% Castro::advance() 10 7.488 7.488 7.488 67.80% Castro::subcycle_advance_ctu() 10 6.977 6.994 7.005 63.43% Castro::do_advance_ctu() 10 6.976 6.994 7.005 63.43% Castro::clean_state() 82 3.787 3.88 4.107 37.19% Castro::construct_ctu_hydro_source() 10 3.2 3.282 3.343 30.27% Castro::computeTemp() 83 2.386 2.458 2.651 24.01% Castro::reset_internal_energy(MultiFab) 83 1.523 1.579 1.775 16.07% Amr::init() 1 1.476 1.479 1.483 13.43% Amr::InitAmr() 1 1.301 1.306 1.308 11.84% Amr::initialInit() 1 1.3 1.303 1.307 11.84% Amr::InitializeInit() 1 1.099 1.124 1.156 10.47% Amr::defBaseLevel() 1 1.099 1.124 1.156 10.47% Castro::evaluate_source_change() 185 0.9707 0.9914 1.094 9.91% Castro::Castro() 1 1.02 1.036 1.07 9.68% Castro::initMFs() 1 1.016 1.031 1.064 9.64% Castro::enforce_min_density() 82 0.8334 0.8615 0.9445 8.55% amrex::Copy() 1000 0.7847 0.7968 0.8195 7.42% Castro::do_new_sources() 10 0.6308 0.662 0.7144 6.47% Castro::initialize_do_advance() 10 0.6455 0.6602 0.7102 6.43% MultiFab::AddProduct() 3440 0.5691 0.5841 0.6842 6.20% Castro::do_old_sources() 10 0.596 0.6189 0.672 6.08% Castro::normalize_species() 82 0.5854 0.5955 0.6247 5.66% Gravity::solve_phi_with_mlmg() 12 0.539 0.5554 0.5669 5.13% Gravity::actual_solve_with_mlmg() 12 0.5293 0.5297 0.5301 4.80% Castro::reset_internal_energy(Fab) 166 0.4992 0.5077 0.5215 4.72% Castro::initialize_advance() 10 0.4803 0.4913 0.5081 4.60% MLMG::solve() 11 0.4981 0.5005 0.5012 4.54% Castro::construct_new_gravity() 10 0.4736 0.4887 0.5002 4.53% Castro::post_timestep() 10 0.4933 0.4937 0.4939 4.47% Gravity::solve_for_phi() 10 0.451 0.4671 0.4784 4.33% MLMG::oneIter() 53 0.4375 0.4386 0.4393 3.98% MLMG::mgVcycle() 53 0.4315 0.4325 0.4332 3.92% AmrLevel::FillPatch() 233 0.2963 0.3523 0.4242 3.84% MultiFab::Subtract() 165 0.3596 0.3677 0.4049 3.67% FabArray::ParallelCopy() 763 0.1688 0.3223 0.3819 3.46% Castro::estTimeStep() 21 0.2127 0.3274 0.3792 3.43% Amr::writePlotFile() 2 0.3558 0.3559 0.3559 3.22% FabArray::setVal() 4351 0.3256 0.3305 0.3377 3.06% FillPatchIterator::Initialize 233 0.1711 0.2283 0.299 2.71% Castro::derive() 112 0.2887 0.2909 0.2925 2.65% AmrLevel::derive() 112 0.2885 0.2907 0.2923 2.65% FillPatchIterator::FillFromLevel0() 233 0.1592 0.2157 0.287 2.60% MLCellLinOp::smooth() 1272 0.2117 0.2321 0.2868 2.60% FillPatchSingleLevel 233 0.1584 0.2149 0.2862 2.59% check_for_negative_density() 10 0.04378 0.1511 0.2596 2.35% FabArray::ParallelCopy_finish() 763 0.0313 0.1846 0.2402 2.17% Castro::finalize_do_advance() 10 0.1079 0.1957 0.2327 2.11% Amr::FinalizeInit() 1 0.1513 0.1785 0.2033 1.84% FabArray::sum() 3440 0.185 0.188 0.1897 1.72% MLPoisson::Fsmooth() 2544 0.1318 0.1432 0.1717 1.55% MLMG::mgVcycle_up::1 53 0.03512 0.1026 0.1702 1.54% Castro::construct_new_source() 60 0.157 0.1588 0.1601 1.45% MLMG::addInterpCorrection() 318 0.02509 0.125 0.1537 1.39% FabArray::ParallelCopy_nowait() 763 0.1291 0.1358 0.1398 1.27% MLCellLinOp::applyBC() 2967 0.08939 0.1043 0.1386 1.26% Castro::initData() 1 0.07478 0.08467 0.1265 1.15% Castro::construct_old_gravity() 10 0.02027 0.04798 0.1145 1.04% Gravity::get_old_grav_vector() 10 0.01971 0.04727 0.1143 1.03% MLMG::mgVcycle_up::2 53 0.004456 0.04775 0.1138 1.03% Castro::expand_state() 10 0.08539 0.09556 0.108 0.98% MLMG::mgVcycle_down::0 53 0.1034 0.1045 0.1053 0.95% Castro::post_init() 1 0.09814 0.09956 0.1005 0.91% FabArray::FillBoundary() 2649 0.06409 0.07778 0.09429 0.85% Castro::computeNewDt() 9 0.08696 0.08704 0.08742 0.79% Gravity::multilevel_solve_for_new_phi() 1 0.08658 0.08662 0.08665 0.78% Gravity::actual_multilevel_solve() 1 0.08652 0.08655 0.08659 0.78% MLCellLinOp::apply() 412 0.05816 0.06256 0.07773 0.70% Castro::construct_old_source() 60 0.07379 0.075 0.07685 0.70% MLMG::mgVcycle_up::0 53 0.07555 0.07592 0.07659 0.69% Castro::problem_post_timestep() 11 0.05003 0.06543 0.07477 0.68% Castro::wd_update() 11 0.04996 0.06537 0.07471 0.68% MLMG::mgVcycle_up::3 53 0.004424 0.009712 0.07345 0.67% Castro::computeInitialDt() 2 0.01761 0.04483 0.06959 0.63% FabArray::Saxpy() 150 0.05903 0.05995 0.0621 0.56% Castro::construct_new_rotation_source() 10 0.05938 0.06031 0.06116 0.55% MLMG:computeResOfCorrection() 318 0.04441 0.04836 0.0579 0.52% MLCellLinOp::correctionResidual() 318 0.04384 0.04777 0.05726 0.52% FillBoundary_nowait() 2649 0.03124 0.04239 0.04969 0.45% MLPoisson::Fapply() 412 0.04032 0.04238 0.04801 0.43% MLMG::mgVcycle_down::1 53 0.04262 0.04393 0.04543 0.41% Castro::post_regrid() 1 0.04197 0.0429 0.04431 0.40% FillBoundary_finish() 2649 0.02181 0.02952 0.04252 0.39% Castro::construct_new_gravity_source() 10 0.04101 0.04143 0.0423 0.38% MLCellLinOp::solutionResidual() 65 0.03699 0.0385 0.04145 0.38% Gravity::fill_multipole_BCs() 12 0.008025 0.02472 0.0359 0.33% VisMF::Write(FabArray) 2 0.018 0.01944 0.03493 0.32% MLMG::mgVcycle_down::2 53 0.005245 0.01727 0.03126 0.28% MLMG::computeResidual() 53 0.02997 0.03026 0.03113 0.28% MLMG::mgVcycle_bottom 53 0.0001499 0.001985 0.02943 0.27% MLMG::actualBottomSolve() 53 5.697e-05 0.001888 0.02933 0.27% MLCGSolver::bicgstab 3 0 0.001794 0.02871 0.26% Castro::volInBoundary() 77 0.01906 0.02008 0.02692 0.24% FabArray::Xpay() 395 0.02224 0.02338 0.02606 0.24% Castro::check_for_nan() 20 0.02438 0.02467 0.02511 0.23% MultiFab::contains_nan() 20 0.02433 0.02462 0.02506 0.23% MLMG::mgVcycle_down::3 53 0.004956 0.007524 0.02482 0.22% Castro::construct_old_gravity_source() 10 0.02252 0.02307 0.02462 0.22% Castro::construct_old_rotation_source() 10 0.02215 0.02258 0.0233 0.21% Gravity::get_new_grav_vector() 11 0.02153 0.02189 0.02254 0.20% amrex::average_down 318 0.0136 0.01619 0.02198 0.20% MLPoisson::define() 12 0.01809 0.01895 0.02126 0.19% Castro::react_state() 20 0.01637 0.01661 0.01764 0.16% Castro::apply_source_to_state() 20 0.0148 0.01499 0.01517 0.14% MLCellLinOp::defineAuxData() 12 0.012 0.01269 0.015 0.14% MLMG::mgVcycle_down::4 53 0.004951 0.00562 0.01454 0.13% MLMG::prepareForSolve() 11 0.01238 0.01293 0.01425 0.13% Gravity::update_max_rhs() 11 0.01096 0.01267 0.01363 0.12% StateDataPhysBCFunct::() 233 0.005277 0.007407 0.01326 0.12% StateData::FillBoundary(geom) 66 0.004512 0.006626 0.01242 0.11% MLMG::mgVcycle_up::4 53 0.004433 0.004938 0.01136 0.10% MLMG::mgVcycle_down::5 53 0.004974 0.00533 0.009724 0.09% MLMG::computeMLResidual() 11 0.006374 0.007742 0.00968 0.09% MLMG::ResNormInf() 64 0.006435 0.007249 0.008401 0.08% MLMG::mgVcycle_up::5 53 0.004512 0.004777 0.008175 0.07% FabArrayBase::getCPC() 967 0.005175 0.005954 0.007864 0.07% DistributionMapping::SFCProcessorMapDoIt() 1 0.0001524 0.002495 0.006957 0.06% DistributionMapping::LeastUsedCPUs() 1 7.138e-05 0.002454 0.006912 0.06% FabArray::norminf() 124 0.00495 0.005289 0.006774 0.06% MultiFab::max() 11 0.003175 0.005475 0.006509 0.06% FabArrayBase::getFB() 2649 0.004529 0.004943 0.006457 0.06% amrex::Add() 53 0.005827 0.005904 0.006003 0.05% FabArray::mult() 44 0.004882 0.004916 0.005193 0.05% FabArray::setDomainBndry() 233 0.002229 0.002902 0.004881 0.04% MLMG::getGradSolution() 11 0.004333 0.004468 0.004593 0.04% MLCellLinOp::compGrad() 11 0.004309 0.004443 0.004566 0.04% Gravity::test_composite_phi() 1 0.004153 0.00419 0.004225 0.04% FabArrayBase::CPC::define() 365 0.001488 0.002197 0.004006 0.04% MLCellLinOp::defineBC() 12 0.003457 0.00363 0.003723 0.03% Gravity::applyMetricTerms() 11 0.00267 0.002745 0.003485 0.03% MLCGSolver::ParallelAllReduce 92 0 0.0002089 0.003342 0.03% Castro::finalize_advance() 10 0.002681 0.002794 0.00311 0.03% Castro::buildMetrics() 1 0.0006372 0.0007838 0.002753 0.02% BndryData::define() 12 0.002479 0.002645 0.002725 0.02% MLLinOp::define() 12 0.002378 0.00252 0.002606 0.02% MLLinOp::defineGrids() 12 0.002328 0.002467 0.002549 0.02% amrex::Dot() 58 0 0.0001582 0.00253 0.02% Gravity::swapTimeLevels() 10 0.001454 0.001518 0.002191 0.02% MLPoisson::prepareForSolve() 12 0.001116 0.001174 0.001373 0.01% AmrLevel::AmrLevel(dm) 1 0.0009671 0.001021 0.001339 0.01% MLCellLinOp::prepareForSolve() 12 0.001071 0.001126 0.001327 0.01% MLPoisson::normalize() 32 0 8.164e-05 0.001306 0.01% StateData::define() 5 0.0009227 0.0009624 0.001261 0.01% MLMG::compResidual() 1 0.0009171 0.0009851 0.001122 0.01% FabArray::setVal(val, thecmd, scomp, ncomp) 384 0.0008199 0.0009469 0.001013 0.01% FabArrayBase::FB::FB() 46 0.0002034 0.000458 0.0009184 0.01% MLMG::MLResNormInf() 11 0.0007455 0.0007616 0.0007799 0.01% MLLinOp::makeSubCommunicator() 12 0.0005243 0.0005593 0.000758 0.01% MLMG::MLRhsNormInf() 11 0.0007143 0.0007319 0.0007569 0.01% MLLinOp::makeAgglomeratedDMap 12 0.0006011 0.000628 0.0006379 0.01% MLCellLinOp::setLevelBC() 12 0.0003971 0.0004358 0.0005231 0.00% Castro::swap_state_time_levels() 10 0.0004053 0.0004165 0.0004269 0.00% makeSFC 60 0.0003902 0.0004173 0.0004266 0.00% Castro::enforce_consistent_e() 1 0.0003627 0.0003748 0.0003932 0.00% DistributionMapping::Distribute() 61 0.0001483 0.000155 0.0001688 0.00% Amr::initSubcycle() 1 4.355e-05 5.344e-05 0.000157 0.00% Amr::writeSmallPlotFile() 1 9.059e-05 9.524e-05 0.0001285 0.00% Castro::enforce_speed_limit() 82 0.0001006 0.0001087 0.0001254 0.00% Castro::FluxRegCrseInit 10 1.419e-05 2.339e-05 5.08e-05 0.00% Castro::FluxRegFineAdd() 10 1.034e-05 2.012e-05 4.691e-05 0.00% Castro::retry_advance_ctu() 10 2.043e-05 2.611e-05 4.295e-05 0.00% Gravity::set_mass_offset() 11 2.579e-05 2.942e-05 3.609e-05 0.00% Castro::create_source_corrector() 10 2.222e-05 2.465e-05 3.219e-05 0.00% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::mg.v(nvals = 1) :: [2] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 16 16 14 B 19 B 28 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (v2024-33-g9e71c2cb9714) finalized