MPI initialized with 4 MPI processes
MPI initialized with thread support level 3
OMP initialized with 4 OMP threads
AMReX (23.08-56-g9a85e502923e) initialized
Starting run at 07:12:31 UTC on 2023-09-04.
Successfully read inputs file ...
Castro git describe: 23.08-7-gf1b93be75
AMReX git describe: 23.08-56-g9a85e5029
Microphysics git describe: 23.08-19-gbb8d2a2b
reading extern runtime parameters ...
13 Species:
He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56
Successfully read inputs file ...
Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.
Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.
Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU.
The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU.
The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU.
The initial orbital period is 30.543687 s.
The initial orbital speed of the primary is -1.831e+08 cm/s.
The initial orbital speed of the secondary is 1.831e+08 cm/s.
Castro::numpts_1d at level 0 is 174
Setting the gravity type to PoissonGrav
Initializing the data at level 0
Done initializing the level 0 data
...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637
grid_places() time: 0.036669239 new finest: 0
Now regridding at level lbase = 0
grid_places() time: 0.032203659 new finest: 0
STEP = 0 TIME = 0 : REGRID with lbase = 0
Gravity::fill_multipole_BCs() time = 0.390194559
Gravity::multilevel_solve_for_new_phi() time = 1.804017019
Gravity::fill_multipole_BCs() time = 0.383690454
... norm of composite residual at level 0 3.509358608e-10
INITIAL GRIDS
Level 0 27 grids 884736 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
PLOTFILE: file = wdmerger_3D_plt00000
Write plotfile time = 0.589063938 seconds
...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637
[Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637
[1m[32m Beginning subcycle 1 starting at time 0 with dt = 0.005426072637[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.937129509 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -3.287624606e+47
ener added: 6.129070894e+49
Contributions to the state from old-time sources:
mass added: 0
xmom added: 1.44936293e+25
ymom added: -1.046793351e+26
zmom added: -4.133074948e+24
eint added: 0
ener added: -1.270533196e+50
Castro::do_old_sources() time = 2.378943153 on level 0
... Entering construct_ctu_hydro_source() on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 9.00547245e+47
ener added: 1.651139801e+46
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 20.55189284 on level 0
... new-time composite Poisson gravity solve from level 0 to level 0
Gravity::fill_multipole_BCs() time = 0.664168392
Gravity::multilevel_solve_for_new_phi() time = 1.745818954
Castro::construct_new_gravity() time = 1.862704725 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 6.440206272e+49
ener added: 2.911791643e+45
Contributions to the state from new-time sources:
mass added: 0
xmom added: 1.451207927e+26
ymom added: 1.075144428e+26
zmom added: -5.613375295e+26
eint added: 0
ener added: 1.260457978e+50
Castro::do_new_sources() time = 2.34805129 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.184461852e+27
ener added: 2.243834889e+27
...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond at this level: 0.02481671267
[Level 0 step 1] Advanced 884736 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 5.190352593e+26
ener added: 6.213783704e+26
Updating the rotational period from 30.54368673 s to 30.45939751 s.
[STEP 1] Coarse TimeStep time: 37.8420486
[STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594]
STEP = 1 TIME = 0.005426072637 DT = 0.005426072637
...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.05461684804
... but limiting to: 0.0059686799 = 1.1 * 0.005426072637
Now regridding at level lbase = 0
grid_places() time: 0.034109779 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.420603825
Gravity::multilevel_solve_for_new_phi() time = 1.966143946
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.306135866e+46
ener added: 9.211440366e+51
STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804
...estimated hydro-limited timestep at level 1: 2.526135286e-09
...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09
[Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.849569753e+31
ener added: 2.785937322e+31
[1m[32m Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.855804714 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.200514105e+40
ener added: 6.433158191e+33
Contributions to the state from old-time sources:
mass added: 0
xmom added: 5.533896722e+24
ymom added: 4.756222073e+26
zmom added: -2.866993882e+23
eint added: 0
ener added: -1.721443002e+45
Castro::do_old_sources() time = 2.0499931 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 21.16886711 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.147330623e+31
ener added: 1.147330701e+31
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 4.551111111e+23
ener added: 6.281481481e+23
Castro::construct_old_gravity() time = 0.035474673 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.197253775e+40
ener added: 1.79168512e+42
Contributions to the state from old-time sources:
mass added: 0
xmom added: 7.574596332e+22
ymom added: 1.446224735e+22
zmom added: 6.441948907e+21
eint added: 0
ener added: -2.586789965e+47
Castro::do_old_sources() time = 0.194569201 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 9.204912576e+51
ener added: 6.747117479e+48
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.804239515 on level 1
Castro::reflux() at level 0 : time = 2.238173997
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.579289405
Gravity::multilevel_solve_for_new_phi() time = 1.535767799
Castro::construct_new_gravity() time = 1.647918741 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -3.46375568e+41
ener added: 7.485558923e+35
Contributions to the state from new-time sources:
mass added: 0
xmom added: -4.864072325e+21
ymom added: -6.244635709e+21
zmom added: -1.246148803e+20
eint added: 0
ener added: -3.223710603e+41
Castro::do_new_sources() time = 1.959957191 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.14873037e+26
ener added: 4.251851852e+22
...estimated hydro-limited timestep at level 0: 0.05461716025
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025
Castro::construct_new_gravity() time = 0.034140195 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.564837764e+47
ener added: 4.559472528e+41
Contributions to the state from new-time sources:
mass added: 0
xmom added: 5.112102468e+18
ymom added: -1.460517359e+19
zmom added: -8.220975275e+19
eint added: 0
ener added: 2.564611685e+47
Castro::do_new_sources() time = 0.138436053 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 3.281876859e+29
ener added: 3.281875295e+29
...estimated hydro-limited timestep at level 1: 6.287037368e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02303392664
[Level 0 step 2] Advanced 884736 cells
[Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09
Advance at this level has already been completed.
[Level 1 step 2] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 6.036240741e+24
ener added: 5.917722222e+24
Updating the rotational period from 30.45939751 s to 30.52749735 s.
[STEP 2] Coarse TimeStep time: 49.43884222
[STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09
...estimated hydro-limited timestep at level 0: 0.0008131491259
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259
...estimated hydro-limited timestep at level 1: 6.287037368e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.0008131491259
... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09
Castro::compute_new_dt : limiting dt at level 1
... new dt computed: 6.287037368e-07
... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09
Now regridding at level lbase = 0
grid_places() time: 0.032025186 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.406572525
Gravity::multilevel_solve_for_new_phi() time = 0.536829428
STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.0008131491259
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259
...estimated hydro-limited timestep at level 1: 6.287037368e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07
[Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09
[1m[32m Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.902408691 on level 0
Contributions to the state from old-time sources:
mass added: 0
xmom added: 6.083120164e+24
ymom added: 5.231862796e+26
zmom added: -3.157842738e+23
eint added: 0
ener added: -1.937110674e+45
Castro::do_old_sources() time = 2.035384718 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 21.54801311 on level 0
Castro::construct_old_gravity() time = 0.074322281 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.818691488e+40
ener added: 1.212217726e+36
Contributions to the state from old-time sources:
mass added: 0
xmom added: 8.441918463e+22
ymom added: 4.722366483e+21
zmom added: 7.10314939e+21
eint added: 0
ener added: -2.344787748e+45
Castro::do_old_sources() time = 0.202280562 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.83673455e+48
ener added: 2.077900047e+42
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.849384515 on level 1
Castro::reflux() at level 0 : time = 2.269538467
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.586521297
Gravity::multilevel_solve_for_new_phi() time = 1.141291427
Castro::construct_new_gravity() time = 1.255377627 on level 0
Contributions to the state from new-time sources:
mass added: 0
xmom added: -2.108598872e+21
ymom added: -7.90284783e+21
zmom added: 1.10682106e+20
eint added: 0
ener added: -3.427512073e+41
Castro::do_new_sources() time = 1.968730895 on level 0
...estimated hydro-limited timestep at level 0: 0.0008131520194
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194
Castro::construct_new_gravity() time = 0.029900358 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 5.244373444e+43
ener added: 1.74625952e+38
Contributions to the state from new-time sources:
mass added: 0
xmom added: -5.608851908e+17
ymom added: 2.1743379e+19
zmom added: 9.538641534e+19
eint added: 0
ener added: 5.303047905e+43
Castro::do_new_sources() time = 0.140113211 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.495038611e+26
ener added: 1.500090463e+26
...estimated hydro-limited timestep at level 1: 6.564309766e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02300389144
[Level 0 step 3] Advanced 884736 cells
[Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09
Advance at this level has already been completed.
[Level 1 step 3] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 6.283851852e+24
ener added: 6.674962963e+24
Updating the rotational period from 30.52749735 s to 30.52751553 s.
[STEP 3] Coarse TimeStep time: 47.42830195
[STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09
...estimated hydro-limited timestep at level 0: 0.0008130329735
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735
...estimated hydro-limited timestep at level 1: 6.564309766e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.0008130329735
... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09
Castro::compute_new_dt : limiting dt at level 1
... new dt computed: 6.564309766e-07
... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09
Now regridding at level lbase = 0
grid_places() time: 0.034598277 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.416066323
Gravity::multilevel_solve_for_new_phi() time = 0.550622357
STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.0008130329735
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735
...estimated hydro-limited timestep at level 1: 6.564309766e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07
[Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09
[1m[32m Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.894967619 on level 0
Contributions to the state from old-time sources:
mass added: 0
xmom added: 6.694655893e+24
ymom added: 5.755038681e+26
zmom added: -3.471615689e+23
eint added: 0
ener added: -2.130751807e+45
Castro::do_old_sources() time = 2.066112358 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 21.18266793 on level 0
Castro::construct_old_gravity() time = 0.036389949 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -2.150425501e+40
ener added: 1.373884257e+36
Contributions to the state from old-time sources:
mass added: 0
xmom added: 9.201303273e+22
ymom added: 1.239621202e+22
zmom added: 8.023757211e+21
eint added: 0
ener added: -2.520808161e+45
Castro::do_old_sources() time = 0.19511495 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.318881554e+48
ener added: 1.675623034e+42
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.768255129 on level 1
Castro::reflux() at level 0 : time = 2.241223505
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.603822883
Gravity::multilevel_solve_for_new_phi() time = 1.157128522
Castro::construct_new_gravity() time = 1.267145064 on level 0
Contributions to the state from new-time sources:
mass added: 0
xmom added: -2.405469507e+21
ymom added: -9.735672131e+21
zmom added: -7.437548959e+18
eint added: 0
ener added: -3.723007452e+41
Castro::do_new_sources() time = 1.952382758 on level 0
...estimated hydro-limited timestep at level 0: 0.000813036171
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171
Castro::construct_new_gravity() time = 0.029267893 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 3.983601425e+43
ener added: 1.617265925e+38
Contributions to the state from new-time sources:
mass added: 0
xmom added: 3.521439975e+18
ymom added: -2.666130979e+19
zmom added: -1.338679871e+19
eint added: 0
ener added: 4.042918443e+43
Castro::do_new_sources() time = 0.136816261 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.851958796e+25
ener added: 2.794684722e+25
...estimated hydro-limited timestep at level 1: 6.863488975e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02333345426
[Level 0 step 4] Advanced 884736 cells
[Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09
Advance at this level has already been completed.
[Level 1 step 4] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -3.365462963e+23
ener added: 4.62962963e+19
Updating the rotational period from 30.52751553 s to 30.52751552 s.
[STEP 4] Coarse TimeStep time: 46.90553125
[STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09
...estimated hydro-limited timestep at level 0: 0.0002506596503
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503
...estimated hydro-limited timestep at level 1: 6.863488975e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.0002506596503
... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09
Castro::compute_new_dt : limiting dt at level 1
... new dt computed: 6.863488975e-07
... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09
Now regridding at level lbase = 0
grid_places() time: 0.032014629 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.402806284
Gravity::multilevel_solve_for_new_phi() time = 0.530944021
STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.0002506596503
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503
...estimated hydro-limited timestep at level 1: 6.863488975e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07
[Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09
[1m[32m Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.837332434 on level 0
Contributions to the state from old-time sources:
mass added: 0
xmom added: 7.366517551e+24
ymom added: 6.330531998e+26
zmom added: -3.819051789e+23
eint added: 0
ener added: -2.343742535e+45
Castro::do_old_sources() time = 2.041958199 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 21.16924615 on level 0
Castro::construct_old_gravity() time = 0.036043345 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -2.560109508e+40
ener added: 1.662186972e+36
Contributions to the state from old-time sources:
mass added: 0
xmom added: 1.013376446e+23
ymom added: 1.770887431e+22
zmom added: 8.797223426e+21
eint added: 0
ener added: -2.728291723e+45
Castro::do_old_sources() time = 0.193486279 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.05099824e+48
ener added: 1.448876286e+42
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.749821265 on level 1
Castro::reflux() at level 0 : time = 2.217362111
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.587201276
Gravity::multilevel_solve_for_new_phi() time = 1.145673543
Castro::construct_new_gravity() time = 1.255720294 on level 0
Contributions to the state from new-time sources:
mass added: 0
xmom added: -2.798425632e+21
ymom added: -1.178643014e+22
zmom added: -5.143756067e+18
eint added: 0
ener added: -4.148475158e+41
Castro::do_new_sources() time = 1.969371197 on level 0
...estimated hydro-limited timestep at level 0: 0.0006828000901
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901
Castro::construct_new_gravity() time = 0.029517212 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 3.326552265e+43
ener added: 1.577214716e+38
Contributions to the state from new-time sources:
mass added: 0
xmom added: 2.012736213e+18
ymom added: -2.460766836e+19
zmom added: -1.244730616e+19
eint added: 0
ener added: 3.390623254e+43
Castro::do_new_sources() time = 0.137286033 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 4.005277778e+24
ener added: 3.882013889e+24
...estimated hydro-limited timestep at level 1: 7.169281148e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02341957797
[Level 0 step 5] Advanced 884736 cells
[Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09
Advance at this level has already been completed.
[Level 1 step 5] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -2.814813006e+22
ener added: 2.962962963e+20
Updating the rotational period from 30.52751552 s to 30.52751551 s.
[STEP 5] Coarse TimeStep time: 46.65978106
[STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09
PLOTFILE: file = wdmerger_3D_plt00005
Write plotfile time = 0.560565239 seconds
Ending run at 07:16:32 UTC on 2023-09-04.
Run time = 240.8766598
Run time without initialization = 228.8409099
Average number of zones advanced per microsecond: 0.022
Average number of zones advanced per microsecond per rank: 0.005
TinyProfiler total time across processes [min...avg...max]: 240.9 ... 240.9 ... 240.9
--------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
--------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 9 91.5492 102.2028 106.2487 44.11%
Castro::computeTemp() 88 14.72 16.63 17.37 7.21%
check_for_negative_density() 9 0.4047 4.467 15.21 6.32%
amrex::Copy() 736 12.56 14.28 15.1 6.27%
MultiFab::AddProduct() 4205 10.24 11.53 12.15 5.04%
Castro::normalize_species() 87 9.799 11.11 11.62 4.82%
FabArray::ParallelCopy_finish() 830 1.638 4.477 11.11 4.61%
Castro::reset_internal_energy(Fab) 1476 8.331 9.271 9.632 4.00%
Castro::estTimeStep() 26 4.089 5.573 9.256 3.84%
FabArray::setVal() 5078 7.423 8.347 8.821 3.66%
MultiFab::Subtract() 175 6.778 7.656 8.09 3.36%
Gravity::fill_multipole_BCs() 11 4.302 4.629 5.355 2.22%
Castro::reset_internal_energy(MultiFab) 88 3.34 4.128 4.862 2.02%
FabArray::sum() 4205 3.278 3.695 3.898 1.62%
FluxRegister::Reflux() 24 2.912 3.278 3.409 1.42%
Castro::enforce_min_density() 87 1.602 2.057 2.86 1.19%
FabArray::ParallelCopy_nowait() 830 2.003 2.209 2.583 1.07%
MLPoisson::Fsmooth() 1376 2.108 2.369 2.49 1.03%
Castro::wd_update() 6 0.4376 0.9071 1.885 0.78%
Castro::FluxRegCrseInit 9 1.458 1.681 1.77 0.73%
Castro::reflux() 4 1.469 1.647 1.733 0.72%
FillPatchInterp(MF) 30 1.257 1.342 1.444 0.60%
Amr::InitAmr() 1 1.263 1.263 1.264 0.52%
Castro::initMFs() 5 1.098 1.152 1.19 0.49%
amrex::Add() 143 0.9997 1.109 1.166 0.48%
Castro::construct_old_gravity_source() 18 0.9252 1.029 1.139 0.47%
FillBoundary_finish() 1561 0.404 0.6375 1.114 0.46%
MLPoisson::Fapply() 326 0.8873 1.005 1.074 0.45%
Castro::problem_post_timestep() 10 0.7956 0.8261 0.8915 0.37%
Castro::construct_new_gravity_source() 9 0.741 0.8261 0.8683 0.36%
FillPatchIterator::Initialize 62 0.7195 0.814 0.8559 0.36%
FabArray::Saxpy() 125 0.6919 0.7796 0.8205 0.34%
VisMF::Write(FabArray) 3 0.5938 0.6885 0.7453 0.31%
Castro::volInBoundary() 42 0.5235 0.6479 0.7167 0.30%
StateData::FillBoundary(geom) 50 0.6009 0.6175 0.6456 0.27%
Castro::construct_new_source() 63 0.4761 0.538 0.5661 0.24%
MultiFab::max() 18 0.02817 0.154 0.5165 0.21%
MLCellLinOp::applyBC() 1750 0.3577 0.4196 0.4544 0.19%
MultiFab::contains_nan() 18 0.3777 0.4215 0.4387 0.18%
FabArray::Xpay() 291 0.3385 0.3856 0.4198 0.17%
FillBoundary_nowait() 1561 0.3348 0.3705 0.4123 0.17%
Amr::writePlotFile() 2 0.1008 0.1712 0.2985 0.12%
Castro::initialize_do_advance() 9 0.2281 0.2617 0.2858 0.12%
FabArray::setDomainBndry() 92 0.1995 0.222 0.2342 0.10%
amrex::average_down 233 0.1977 0.2088 0.216 0.09%
Castro::fill_hybrid_hydro_source() 27 0.1682 0.1919 0.2123 0.09%
Castro::construct_old_source() 63 0.1783 0.2017 0.212 0.09%
MLCellLinOp::defineAuxData() 11 0.1572 0.1707 0.176 0.07%
MLPoisson::FFlux() 150 0.004599 0.04177 0.153 0.06%
Castro::initData() 1 0.1277 0.1451 0.1525 0.06%
MLCellLinOp::compGrad() 18 0.1243 0.1394 0.1456 0.06%
FabArray::mult() 56 0.1107 0.1262 0.1347 0.06%
StateData::define() 25 0.1112 0.1224 0.1285 0.05%
Castro::evaluate_source_change() 193 0.109 0.1189 0.1274 0.05%
MLMG::addInterpCorrection() 155 0.1004 0.1143 0.1238 0.05%
Castro::swap_state_time_levels() 9 0.09934 0.1084 0.1132 0.05%
Gravity::get_new_grav_vector() 10 0.0837 0.0942 0.09995 0.04%
Gravity::get_old_grav_vector() 9 0.07796 0.0894 0.0954 0.04%
Castro::initialize_advance() 9 0.07585 0.08743 0.0945 0.04%
MLMG::prepareForSolve() 10 0.06979 0.07645 0.08293 0.03%
MLMG::solve() 10 0.007205 0.0461 0.07287 0.03%
MLCellLinOp::updateSolBC() 25 0.06759 0.06799 0.0685 0.03%
MLMG::ResNormInf() 54 0.002239 0.03178 0.06626 0.03%
FabArray::norminf(mask) 21 0.05439 0.06151 0.06529 0.03%
AmrLevel::FillPatch() 62 0.05317 0.06022 0.06479 0.03%
Castro::apply_tagging_restrictions() 6 0.0493 0.05541 0.05821 0.02%
AmrMesh::MakeNewGrids() 6 0.04738 0.04963 0.05344 0.02%
BndryData::define() 27 0.043 0.04503 0.04976 0.02%
Gravity::multilevel_solve_for_new_phi() 10 0.03494 0.04237 0.04929 0.02%
MLCellLinOp::updateCorBC() 17 0.04601 0.04648 0.04681 0.02%
FabArray::norminf() 117 0.0388 0.04101 0.04256 0.02%
MultiFab::Multiply() 8 0.0331 0.03782 0.04037 0.02%
Castro::do_new_sources() 9 0.0005862 0.009778 0.03691 0.02%
MLMG::MLResNormInf() 15 8.788e-05 0.02394 0.03475 0.01%
MLCellLinOp::reflux() 30 0.004039 0.01127 0.03259 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01917 0.02387 0.0294 0.01%
MLCellLinOp::defineBC() 11 0.02631 0.02651 0.0267 0.01%
Castro::FluxRegFineAdd() 9 0.02574 0.02606 0.02625 0.01%
Castro::build_fine_mask() 44 0.0191 0.01963 0.0211 0.01%
StateDataPhysBCFunct::() 95 0.001781 0.006476 0.01993 0.01%
MLMG::interpCorrection_1 17 0.01823 0.01862 0.01957 0.01%
FabArrayBase::CPC::define() 416 0.01399 0.01594 0.01929 0.01%
MLLinOp::makeSubCommunicator() 11 0.000877 0.009731 0.01863 0.01%
Castro::Castro() 5 0.01615 0.01703 0.01809 0.01%
Castro::buildMetrics() 5 0.01531 0.01686 0.01772 0.01%
Castro::linear_to_hybrid_momentum() 1 0.01402 0.01605 0.01734 0.01%
Gravity::actual_multilevel_solve() 10 0.009621 0.01248 0.01549 0.01%
FillPatchTwoLevels 31 0.01366 0.01406 0.01476 0.01%
DistributionMapping::LeastUsedCPUs() 5 0.0001345 0.006278 0.01436 0.01%
MLCellLinOp::prepareForSolve() 11 0.01144 0.01164 0.01193 0.00%
Castro::enforce_consistent_e() 1 0.009249 0.01041 0.01082 0.00%
Castro::do_old_sources() 9 0.000607 0.003193 0.01079 0.00%
FabArrayBase::getCPC() 1440 0.01 0.01039 0.01059 0.00%
AMRErrorTag::operator() 6 0.008872 0.01004 0.01052 0.00%
Gravity::update_max_rhs() 10 0.008472 0.009255 0.01007 0.00%
Gravity::actual_solve_with_mlmg() 11 0.009252 0.009612 0.009977 0.00%
Castro::finalize_do_advance() 9 0.005731 0.00766 0.008979 0.00%
Castro::apply_problem_tags() 6 0.006363 0.007151 0.007469 0.00%
average_down_faces 48 0.005888 0.005896 0.005908 0.00%
main() 1 0.001678 0.003701 0.00571 0.00%
AmrLevel::derive() 6 0.004689 0.005198 0.005518 0.00%
MLCellLinOp::setLevelBC() 19 0.003618 0.004477 0.005185 0.00%
AmrLevel::FillCoarsePatch() 5 0.0009795 0.00211 0.005151 0.00%
MLCGSolver::bicgstab 7 0 0.001285 0.005138 0.00%
FabArray::FillBoundary() 1561 0.004311 0.00458 0.005035 0.00%
Castro::construct_old_gravity() 9 0.0004025 0.001568 0.00501 0.00%
MLCellLinOp::smooth() 688 0.003769 0.003958 0.004094 0.00%
Castro::construct_new_gravity() 9 0.0004612 0.001594 0.003866 0.00%
FabArrayBase::getFB() 1561 0.00315 0.003328 0.003735 0.00%
FabArrayBase::FB::FB() 19 0.002737 0.003066 0.003437 0.00%
amrex::Dot() 115 0 0.0008454 0.003382 0.00%
FabArray::ParallelCopy() 830 0.003043 0.003155 0.003241 0.00%
Gravity::test_composite_phi() 1 0.002186 0.002447 0.002686 0.00%
FabArray::LinComb() 57 0 0.0004687 0.001875 0.00%
MLLinOp::defineGrids() 11 0.001384 0.001505 0.001626 0.00%
MLCellLinOp::apply() 326 0.000879 0.00109 0.00162 0.00%
Amr::regrid() 5 0.0009952 0.001211 0.001592 0.00%
Castro::clean_state() 87 0.001257 0.001308 0.001433 0.00%
Amr::coarseTimeStep() 5 0.0004797 0.001039 0.001231 0.00%
TagBoxArray::collate() 6 0.0005097 0.0008454 0.001203 0.00%
MLCGSolver::ParallelAllReduce 153 0 0.0002781 0.001112 0.00%
Gravity::average_fine_ec_onto_crse_ec() 8 0.000928 0.0009425 0.0009588 0.00%
OwnerMask() 6 0.0007468 0.0008706 0.00095 0.00%
MLCellLinOp::correctionResidual() 196 0.0007068 0.0007636 0.0008599 0.00%
Castro::do_advance_ctu() 5 0.0005602 0.0006424 0.0007113 0.00%
Amr::grid_places() 6 0.0004877 0.0005356 0.000635 0.00%
MLMG::mgVcycle() 65 0.0005623 0.000597 0.0006345 0.00%
FillPatchSingleLevel 92 0.0005407 0.0005545 0.0005642 0.00%
FillPatchIterator::FillFromLevel0() 31 0.0004367 0.0004575 0.0005107 0.00%
Castro::finalize_advance() 9 0.0003642 0.0004233 0.0004759 0.00%
TagBoxArray::mapPRD 6 0.0004411 0.000456 0.0004691 0.00%
Castro::subcycle_advance_ctu() 5 8.676e-05 0.000194 0.000439 0.00%
MLMG:computeResOfCorrection() 155 0.0003947 0.000405 0.0004237 0.00%
MLCellLinOp::solutionResidual() 72 0.0003608 0.0003835 0.0003994 0.00%
MLMG::actualBottomSolve() 31 4.025e-05 0.0001278 0.000387 0.00%
MLMG::oneIter() 31 0.0003516 0.000355 0.0003585 0.00%
FillPatchIterator::FillFromTwoLevels() 31 0.0003094 0.0003295 0.0003572 0.00%
MLMG::mgVcycle_down::0 31 0.0002696 0.0003 0.0003374 0.00%
Castro::computeNewDt() 8 0.000114 0.0001725 0.0003222 0.00%
Gravity::solve_phi_with_mlmg() 11 0.0002442 0.0002676 0.0002811 0.00%
Castro::enforce_speed_limit() 87 0.0002479 0.0002571 0.0002671 0.00%
Amr::timeStep() 9 0.0002041 0.0002321 0.0002589 0.00%
MLMG::mgVcycle_down::1 31 0.0002395 0.0002489 0.0002582 0.00%
Amr::defBaseLevel() 1 0.0002129 0.000228 0.0002409 0.00%
Castro::post_regrid() 10 0.000193 0.0002112 0.0002333 0.00%
MLMG::mgVcycle_down::2 31 0.0001942 0.0002044 0.0002238 0.00%
makeSFC 33 0.0001784 0.0001938 0.000221 0.00%
MLMG::mgVcycle_bottom 65 0.0002112 0.000215 0.000221 0.00%
MLMG::mgVcycle_up::0 31 0.0001848 0.000196 0.0002139 0.00%
MLMG::mgVcycle_down::3 31 0.0001977 0.0002004 0.0002049 0.00%
AmrLevel::AmrLevel(dm) 5 0.0001841 0.0001958 0.0002037 0.00%
Castro::react_state() 18 0.0001262 0.0001557 0.0001986 0.00%
MLMG::mgVcycle_down::4 31 0.0001728 0.0001794 0.0001948 0.00%
FabArrayBase::TheFPinfo() 25 0.0001653 0.0001805 0.0001918 0.00%
FPinfo::FPinfo() 3 0.0001092 0.0001324 0.0001597 0.00%
Castro::check_for_nan() 18 0.0001351 0.0001435 0.0001597 0.00%
MLMG::mgVcycle_up::1 31 0.0001377 0.0001443 0.0001514 0.00%
MLMG::mgVcycle_up::2 31 0.0001322 0.000136 0.0001421 0.00%
MLLinOp::makeAgglomeratedDMap 11 0.0001162 0.0001256 0.0001406 0.00%
MLMG::computeResWithCrseSolFineCor() 17 0.0001295 0.0001346 0.0001396 0.00%
MLMG::mgVcycle_up::4 31 0.0001121 0.0001204 0.0001372 0.00%
Castro::apply_source_to_state() 18 9.659e-05 0.0001103 0.0001362 0.00%
DistributionMapping::Distribute() 35 0.0001126 0.0001221 0.0001305 0.00%
MLMG::mgVcycle_up::3 31 0.0001274 0.0001286 0.0001297 0.00%
Castro::expand_state() 13 0.0001065 0.0001152 0.0001266 0.00%
Amr::writeSmallPlotFile() 1 0.0001004 0.00011 0.0001213 0.00%
FabArray::RecvLayoutMask() 8 9.536e-05 0.000104 0.0001186 0.00%
Amr::FinalizeInit() 1 2.937e-05 5.826e-05 0.0001164 0.00%
MLPoisson::define() 11 0.0001074 0.0001101 0.0001132 0.00%
Castro::errorEst() 6 0.0001082 0.0001103 0.0001125 0.00%
Castro::advance() 5 9.784e-05 0.0001022 0.0001099 0.00%
Gravity::swapTimeLevels() 9 9.336e-05 0.0001007 0.0001089 0.00%
MLMG::computeResidual() 31 8.121e-05 8.838e-05 9.517e-05 0.00%
ClusterList::intersect() 1 0 2.331e-05 9.322e-05 0.00%
DistributionMapping::SFCProcessorMapDoIt() 2 4.987e-05 6.357e-05 8.881e-05 0.00%
Castro::post_timestep() 9 8.039e-05 8.402e-05 8.86e-05 0.00%
Castro::avgDown(state_indx) 20 7.221e-05 8.124e-05 8.833e-05 0.00%
MLMG::computeMLResidual() 15 7.525e-05 8.125e-05 8.829e-05 0.00%
knapsack() 3 6.549e-05 7.288e-05 8.328e-05 0.00%
Castro::create_source_corrector() 9 5.225e-05 6.37e-05 7.637e-05 0.00%
MLMG::miniCycle() 34 6.777e-05 7.002e-05 7.259e-05 0.00%
MLLinOp::define() 11 6.125e-05 6.885e-05 7.246e-05 0.00%
Gravity::set_mass_offset() 6 3.934e-05 4.895e-05 6.942e-05 0.00%
MLMG::getGradSolution() 10 5.741e-05 6.202e-05 6.621e-05 0.00%
MLMG::computeResWithCrseCorFineCor() 17 6.519e-05 6.556e-05 6.573e-05 0.00%
Castro::post_init() 1 2.387e-05 3.972e-05 6.056e-05 0.00%
amrex::average_down_w_geom 20 5.222e-05 5.551e-05 6.014e-05 0.00%
MLPoisson::prepareForSolve() 11 4.676e-05 5.056e-05 5.439e-05 0.00%
Castro::construct_new_hybrid_source() 9 4.594e-05 4.906e-05 5.388e-05 0.00%
Amr::initSubcycle() 1 5.24e-05 5.279e-05 5.336e-05 0.00%
Castro::computeInitialDt() 2 1.754e-05 2.834e-05 5.044e-05 0.00%
Castro::init(old) 3 4.247e-05 4.566e-05 4.867e-05 0.00%
Castro::retry_advance_ctu() 5 2.153e-05 2.857e-05 4.423e-05 0.00%
Castro::construct_old_hybrid_source() 9 3.267e-05 3.643e-05 4.079e-05 0.00%
MLMG::compResidual() 1 2.841e-05 3.246e-05 3.99e-05 0.00%
DistributionMapping::KnapSackDoIt() 3 3.138e-05 3.422e-05 3.829e-05 0.00%
AmrMesh-cluster 1 0 9.364e-06 3.746e-05 0.00%
MLMG::MLRhsNormInf() 10 3.384e-05 3.416e-05 3.493e-05 0.00%
Castro::avgDown() 4 3.033e-05 3.184e-05 3.369e-05 0.00%
BoxList::parallelComplementIn() 12 2.586e-05 2.795e-05 3.163e-05 0.00%
BoxList::complementIn 12 2.466e-05 2.576e-05 2.745e-05 0.00%
Castro::construct_old_rotation_source() 9 2.176e-05 2.421e-05 2.599e-05 0.00%
Amr::bldFineLevels() 1 2.122e-05 2.202e-05 2.42e-05 0.00%
Amr::initialInit() 1 4.274e-06 9.549e-06 2.254e-05 0.00%
Castro::construct_new_rotation_source() 9 2.016e-05 2.102e-05 2.212e-05 0.00%
Castro::derive() 6 1.867e-05 1.996e-05 2.18e-05 0.00%
Castro::init() 1 1.665e-05 1.783e-05 1.905e-05 0.00%
Amr::InitializeInit() 1 7.839e-06 9.618e-06 1.276e-05 0.00%
ClusterList::chop() 1 0 2.728e-06 1.091e-05 0.00%
Amr::init() 1 6.861e-06 7.908e-06 9.987e-06 0.00%
knapsack()swap 1 3.72e-06 3.866e-06 4.047e-06 0.00%
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
--------------------------------------------------------------------------------------------
main() 1 240.9 240.9 240.9 100.00%
Amr::coarseTimeStep() 5 228.3 228.3 228.3 94.77%
Amr::timeStep() 9 226.9 226.9 226.9 94.20%
Castro::advance() 5 199.5 199.5 199.5 82.83%
Castro::subcycle_advance_ctu() 5 190.8 191.2 192.2 79.78%
Castro::do_advance_ctu() 5 190.8 191.2 192.2 79.78%
Castro::construct_ctu_hydro_source() 9 116.5 116.6 116.7 48.44%
Castro::clean_state() 87 70.45 80.1 84.23 34.97%
Castro::computeTemp() 88 44.93 50.94 53.37 22.15%
Castro::reset_internal_energy(MultiFab) 88 30.21 34.31 35.99 14.94%
Castro::evaluate_source_change() 193 17.39 19.57 20.63 8.57%
Castro::enforce_min_density() 87 16.51 18.96 20.25 8.41%
Castro::post_regrid() 10 15.85 17.5 18.15 7.53%
Amr::regrid() 5 15.66 17.15 17.75 7.37%
Castro::initialize_do_advance() 9 14.59 15.03 15.39 6.39%
check_for_negative_density() 9 0.4047 4.467 15.21 6.32%
amrex::Copy() 736 12.56 14.28 15.1 6.27%
AmrLevel::FillPatch() 62 8.077 10.01 14.71 6.11%
FillPatchIterator::Initialize 62 6.369 8.388 13.28 5.51%
FabArray::ParallelCopy() 830 4.017 6.75 13.26 5.50%
Gravity::solve_phi_with_mlmg() 11 11.38 11.71 12.43 5.16%
MultiFab::AddProduct() 4205 10.24 11.53 12.15 5.04%
Gravity::multilevel_solve_for_new_phi() 10 11.08 11.41 12.11 5.03%
Gravity::actual_multilevel_solve() 10 11.04 11.36 12.07 5.01%
Castro::normalize_species() 87 9.799 11.11 11.62 4.82%
Castro::do_old_sources() 9 11.23 11.27 11.36 4.71%
FillPatchSingleLevel 92 4.118 6.213 11.26 4.67%
FabArray::ParallelCopy_finish() 830 1.638 4.477 11.11 4.61%
Amr::init() 1 10.77 10.77 10.77 4.47%
Castro::do_new_sources() 9 9.091 10.27 10.75 4.46%
FillPatchIterator::FillFromLevel0() 31 3.737 5.787 10.75 4.46%
Amr::initialInit() 1 10.18 10.18 10.18 4.23%
Castro::post_timestep() 9 10.11 10.11 10.12 4.20%
Castro::reset_internal_energy(Fab) 1476 8.331 9.271 9.632 4.00%
Castro::estTimeStep() 26 4.089 5.573 9.256 3.84%
Castro::reflux() 4 8.246 8.754 8.967 3.72%
FabArray::setVal() 5078 7.423 8.347 8.821 3.66%
Castro::initialize_advance() 9 7.337 8.298 8.705 3.61%
MultiFab::Subtract() 175 6.778 7.656 8.09 3.36%
Castro::construct_new_gravity() 9 6.419 6.721 7.411 3.08%
Gravity::actual_solve_with_mlmg() 11 6.963 6.97 6.98 2.90%
MLMG::solve() 10 6.445 6.457 6.477 2.69%
Amr::FinalizeInit() 1 5.883 6.068 6.415 2.66%
Castro::expand_state() 13 5.135 5.559 6.406 2.66%
Gravity::fill_multipole_BCs() 11 4.399 4.721 5.438 2.26%
MLMG::oneIter() 31 5.202 5.221 5.231 2.17%
Castro::construct_old_gravity() 9 0.7111 1.925 4.61 1.91%
Gravity::get_old_grav_vector() 9 0.7061 1.923 4.61 1.91%
MLMG::mgVcycle() 65 4.417 4.475 4.504 1.87%
FluxRegister::Reflux() 24 3.763 4.233 4.442 1.84%
Amr::InitializeInit() 1 3.768 4.115 4.3 1.79%
Amr::defBaseLevel() 1 3.768 4.115 4.3 1.79%
Castro::finalize_do_advance() 9 1.356 2.18 4.224 1.75%
Castro::computeNewDt() 8 2.176 2.696 3.986 1.65%
Castro::problem_post_timestep() 10 2.686 3.086 3.94 1.64%
FabArray::sum() 4205 3.278 3.695 3.898 1.62%
MLCellLinOp::smooth() 688 3.362 3.42 3.489 1.45%
Castro::post_init() 1 2.545 2.669 3.025 1.26%
Castro::FluxRegCrseInit 9 1.813 2.187 2.977 1.24%
Castro::initData() 1 2.299 2.639 2.792 1.16%
FabArray::ParallelCopy_nowait() 830 2.063 2.27 2.648 1.10%
MLPoisson::Fsmooth() 1376 2.108 2.369 2.49 1.03%
Castro::wd_update() 6 1.154 1.555 2.409 1.00%
MLMG::mgVcycle_down::0 31 2.022 2.072 2.136 0.89%
Castro::construct_new_source() 63 1.759 1.972 2.073 0.86%
MLCellLinOp::applyBC() 1750 1.22 1.439 1.895 0.79%
FillPatchIterator::FillFromTwoLevels() 31 1.499 1.566 1.613 0.67%
FillPatchTwoLevels 31 1.498 1.565 1.613 0.67%
Amr::bldFineLevels() 1 1.303 1.499 1.591 0.66%
FabArray::FillBoundary() 1561 0.7658 1.019 1.537 0.64%
Castro::Castro() 5 1.401 1.437 1.472 0.61%
FillPatchInterp(MF) 30 1.257 1.342 1.444 0.60%
MLMG::mgVcycle_up::0 31 1.391 1.413 1.434 0.60%
MLCellLinOp::apply() 326 1.293 1.325 1.354 0.56%
Amr::InitAmr() 1 1.264 1.264 1.264 0.52%
Castro::initMFs() 5 1.104 1.158 1.195 0.50%
Castro::construct_old_source() 63 0.9174 1.04 1.168 0.49%
amrex::Add() 143 0.9997 1.109 1.166 0.48%
Amr::writePlotFile() 2 1.15 1.15 1.15 0.48%
Castro::construct_old_gravity_source() 18 0.9252 1.029 1.139 0.47%
FillBoundary_finish() 1561 0.404 0.6375 1.114 0.46%
MLPoisson::Fapply() 326 0.8873 1.005 1.074 0.45%
MLCellLinOp::solutionResidual() 72 1.007 1.037 1.053 0.44%
Castro::computeInitialDt() 2 0.52 0.7051 1.052 0.44%
Castro::construct_new_gravity_source() 9 0.741 0.8261 0.8683 0.36%
MLCellLinOp::correctionResidual() 196 0.8149 0.8234 0.8392 0.35%
FabArray::Saxpy() 125 0.6919 0.7796 0.8205 0.34%
Gravity::get_new_grav_vector() 10 0.7809 0.7952 0.817 0.34%
VisMF::Write(FabArray) 3 0.5938 0.6885 0.7453 0.31%
MLMG:computeResOfCorrection() 155 0.6504 0.6901 0.7175 0.30%
Castro::volInBoundary() 42 0.5235 0.6479 0.7168 0.30%
StateDataPhysBCFunct::() 95 0.6029 0.624 0.6479 0.27%
StateData::FillBoundary(geom) 50 0.6009 0.6175 0.6456 0.27%
MLMG::computeResWithCrseSolFineCor() 17 0.4675 0.4996 0.5797 0.24%
Gravity::update_max_rhs() 10 0.09099 0.2127 0.5693 0.24%
MultiFab::max() 18 0.02817 0.154 0.5165 0.21%
MLMG::computeMLResidual() 15 0.415 0.4559 0.5024 0.21%
Castro::init() 1 0.484 0.4875 0.491 0.20%
AmrLevel::FillCoarsePatch() 5 0.4839 0.4875 0.491 0.20%
Castro::check_for_nan() 18 0.3779 0.4216 0.4389 0.18%
MultiFab::contains_nan() 18 0.3777 0.4215 0.4387 0.18%
Gravity::test_composite_phi() 1 0.4287 0.4296 0.4301 0.18%
MLMG::mgVcycle_down::1 31 0.3303 0.3625 0.4264 0.18%
FabArray::Xpay() 291 0.3385 0.3856 0.4198 0.17%
FillBoundary_nowait() 1561 0.3409 0.3769 0.4189 0.17%
Castro::init(old) 3 0.366 0.37 0.3755 0.16%
MLMG::computeResidual() 31 0.3458 0.3583 0.3754 0.16%
MLCellLinOp::reflux() 30 0.1839 0.2325 0.3627 0.15%
Castro::apply_source_to_state() 18 0.2766 0.3135 0.3328 0.14%
MLPoisson::define() 11 0.2913 0.3022 0.3198 0.13%
amrex::average_down 233 0.2537 0.2667 0.2837 0.12%
Castro::react_state() 18 0.2334 0.2625 0.281 0.12%
MLMG::prepareForSolve() 10 0.1975 0.2215 0.238 0.10%
FabArray::setDomainBndry() 92 0.1995 0.222 0.2342 0.10%
MLMG::mgVcycle_up::1 31 0.2134 0.2187 0.222 0.09%
Castro::fill_hybrid_hydro_source() 27 0.1682 0.1919 0.2123 0.09%
MLCellLinOp::defineAuxData() 11 0.1833 0.2001 0.21 0.09%
Amr::grid_places() 6 0.2015 0.2017 0.2017 0.08%
AmrMesh::MakeNewGrids() 6 0.201 0.2011 0.2012 0.08%
MLMG::addInterpCorrection() 155 0.1219 0.1639 0.1874 0.08%
MLMG::mgVcycle_bottom 65 0.1507 0.1601 0.185 0.08%
MLMG::getGradSolution() 10 0.1742 0.1771 0.1793 0.07%
MLCellLinOp::compGrad() 18 0.1742 0.177 0.1792 0.07%
MLPoisson::FFlux() 150 0.004599 0.04177 0.153 0.06%
MLMG::miniCycle() 34 0.1508 0.152 0.1525 0.06%
MLCellLinOp::updateSolBC() 25 0.07722 0.09957 0.1381 0.06%
FabArray::mult() 56 0.1107 0.1262 0.1347 0.06%
Castro::construct_new_hybrid_source() 9 0.1117 0.1258 0.1333 0.06%
AmrLevel::AmrLevel(dm) 5 0.1114 0.1226 0.1287 0.05%
StateData::define() 25 0.1112 0.1224 0.1285 0.05%
MLMG::ResNormInf() 54 0.07748 0.1018 0.1282 0.05%
Castro::errorEst() 6 0.1069 0.121 0.1267 0.05%
Castro::avgDown() 4 0.1162 0.1194 0.123 0.05%
Castro::avgDown(state_indx) 20 0.1161 0.1194 0.123 0.05%
amrex::average_down_w_geom 20 0.116 0.1193 0.1229 0.05%
Castro::swap_state_time_levels() 9 0.09934 0.1084 0.1132 0.05%
MLCellLinOp::defineBC() 11 0.0866 0.09021 0.09673 0.04%
MLMG::computeResWithCrseCorFineCor() 17 0.08621 0.08786 0.08956 0.04%
MLMG::mgVcycle_down::2 31 0.06834 0.0771 0.08722 0.04%
MLMG::mgVcycle_up::3 31 0.02624 0.06941 0.08416 0.03%
Castro::construct_old_hybrid_source() 9 0.05663 0.06619 0.07901 0.03%
MLMG::MLResNormInf() 15 0.04397 0.06686 0.07611 0.03%
BndryData::define() 27 0.05863 0.0624 0.06889 0.03%
FabArray::norminf(mask) 21 0.05439 0.06151 0.06529 0.03%
MLMG::interpCorrection_1 17 0.02596 0.04236 0.06477 0.03%
Castro::apply_tagging_restrictions() 6 0.0493 0.05541 0.05821 0.02%
MLMG::mgVcycle_up::2 31 0.05107 0.05232 0.05328 0.02%
Castro::buildMetrics() 5 0.03868 0.04644 0.05303 0.02%
MLCellLinOp::updateCorBC() 17 0.05056 0.05159 0.0522 0.02%
Castro::derive() 6 0.04227 0.04825 0.05122 0.02%
AmrLevel::derive() 6 0.04225 0.04823 0.05119 0.02%
Gravity::swapTimeLevels() 9 0.03461 0.03978 0.04815 0.02%
FabArray::norminf() 117 0.0388 0.04101 0.04256 0.02%
MultiFab::Multiply() 8 0.0331 0.03782 0.04037 0.02%
MLMG::mgVcycle_down::3 31 0.03167 0.03311 0.03672 0.02%
TagBoxArray::mapPRD 6 0.01113 0.01835 0.03572 0.01%
MLMG::actualBottomSolve() 31 4.025e-05 0.008185 0.03262 0.01%
MLCGSolver::bicgstab 7 0 0.007974 0.0319 0.01%
MLMG::MLRhsNormInf() 10 0.02491 0.0281 0.03007 0.01%
FabArrayBase::getCPC() 1440 0.02458 0.02633 0.02983 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01917 0.02387 0.0294 0.01%
Castro::FluxRegFineAdd() 9 0.02574 0.02606 0.02625 0.01%
Gravity::average_fine_ec_onto_crse_ec() 8 0.01447 0.01723 0.02158 0.01%
MLMG::compResidual() 1 0.01854 0.02027 0.02118 0.01%
Castro::build_fine_mask() 44 0.0191 0.01963 0.0211 0.01%
MLLinOp::define() 11 0.002778 0.01173 0.02078 0.01%
MLLinOp::defineGrids() 11 0.002717 0.01166 0.02071 0.01%
FabArrayBase::CPC::define() 416 0.01399 0.01594 0.01929 0.01%
MLLinOp::makeSubCommunicator() 11 0.000877 0.009731 0.01863 0.01%
MLMG::mgVcycle_down::4 31 0.005235 0.008695 0.01861 0.01%
Castro::linear_to_hybrid_momentum() 1 0.01402 0.01605 0.01734 0.01%
FabArrayBase::TheFPinfo() 25 0.0005264 0.006645 0.01476 0.01%
FPinfo::FPinfo() 3 0.0003346 0.006464 0.01458 0.01%
DistributionMapping::KnapSackDoIt() 3 0.0002022 0.006332 0.01442 0.01%
DistributionMapping::LeastUsedCPUs() 5 0.0001345 0.006278 0.01436 0.01%
MLMG::mgVcycle_up::4 31 0.004358 0.006843 0.01403 0.01%
MLPoisson::prepareForSolve() 11 0.0115 0.01169 0.01198 0.00%
MLCellLinOp::prepareForSolve() 11 0.01144 0.01164 0.01193 0.00%
average_down_faces 48 0.009131 0.01017 0.01118 0.00%
Castro::enforce_consistent_e() 1 0.009249 0.01041 0.01082 0.00%
AMRErrorTag::operator() 6 0.008872 0.01004 0.01052 0.00%
Castro::apply_problem_tags() 6 0.006363 0.007151 0.007469 0.00%
FabArrayBase::getFB() 1561 0.006012 0.006395 0.006899 0.00%
MLCellLinOp::setLevelBC() 19 0.003618 0.004477 0.005185 0.00%
FabArrayBase::FB::FB() 19 0.002737 0.003066 0.003437 0.00%
amrex::Dot() 115 0 0.0008454 0.003382 0.00%
MLCGSolver::ParallelAllReduce 153 0 0.000732 0.002928 0.00%
FabArray::LinComb() 57 0 0.0004687 0.001875 0.00%
TagBoxArray::collate() 6 0.0005097 0.0008454 0.001203 0.00%
OwnerMask() 6 0.0007468 0.0008706 0.00095 0.00%
Castro::finalize_advance() 9 0.0003642 0.0004233 0.0004759 0.00%
MLLinOp::makeAgglomeratedDMap 11 0.0003945 0.0004268 0.0004542 0.00%
makeSFC 33 0.0002783 0.0003012 0.0003284 0.00%
Castro::enforce_speed_limit() 87 0.0002479 0.0002571 0.0002671 0.00%
DistributionMapping::SFCProcessorMapDoIt() 2 0.0001229 0.0001356 0.0001498 0.00%
AmrMesh-cluster 1 0 3.54e-05 0.0001416 0.00%
DistributionMapping::Distribute() 35 0.0001126 0.0001221 0.0001305 0.00%
Amr::writeSmallPlotFile() 1 0.0001004 0.00011 0.0001213 0.00%
FabArray::RecvLayoutMask() 8 9.536e-05 0.000104 0.0001186 0.00%
ClusterList::intersect() 1 0 2.331e-05 9.322e-05 0.00%
knapsack() 3 6.931e-05 7.674e-05 8.733e-05 0.00%
Castro::create_source_corrector() 9 5.225e-05 6.37e-05 7.637e-05 0.00%
Gravity::set_mass_offset() 6 3.934e-05 4.895e-05 6.942e-05 0.00%
BoxList::parallelComplementIn() 12 5.098e-05 5.372e-05 5.745e-05 0.00%
Amr::initSubcycle() 1 5.24e-05 5.279e-05 5.336e-05 0.00%
Castro::retry_advance_ctu() 5 2.153e-05 2.857e-05 4.423e-05 0.00%
BoxList::complementIn 12 2.466e-05 2.576e-05 2.745e-05 0.00%
Castro::construct_old_rotation_source() 9 2.176e-05 2.421e-05 2.599e-05 0.00%
Castro::construct_new_rotation_source() 9 2.016e-05 2.102e-05 2.212e-05 0.00%
ClusterList::chop() 1 0 2.728e-06 1.091e-05 0.00%
knapsack()swap 1 3.72e-06 3.866e-06 4.047e-06 0.00%
--------------------------------------------------------------------------------------------
Unused ParmParse Variables:
[TOP]::mg.v(nvals = 1) :: [2]
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.08-56-g9a85e502923e) finalized