MPI initialized with 4 MPI processes
MPI initialized with thread support level 3
OMP initialized with 4 OMP threads
AMReX (23.09-6-gae65b3afc481) initialized
Starting run at 06:41:52 UTC on 2023-09-13.
Successfully read inputs file ...
Castro git describe: 23.09-5-g0aabe1705
AMReX git describe: 23.09-6-gae65b3afc
Microphysics git describe: 23.09-6-g94b016d2
reading extern runtime parameters ...
13 Species:
He4 C12 O16 Ne20 Mg24 Si28 S32 Ar36 Ca40 Ti44 Cr48 Fe52 Ni56
Successfully read inputs file ...
Generated initial model for primary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.
Generated initial model for secondary WD of mass 0.9 solar masses, central density 1.574e+07 g cm**-3, and radius 6.747e+08 cm.
Generated binary orbit of distance 1.781e+09 cm = 1.190e-04 AU.
The primary orbits the center of mass at distance -8.903e+08 cm = -5.951e-05 AU.
The secondary orbits the center of mass at distance 8.903e+08 cm = 5.951e-05 AU.
The initial orbital period is 30.543687 s.
The initial orbital speed of the primary is -1.831e+08 cm/s.
The initial orbital speed of the secondary is 1.831e+08 cm/s.
Castro::numpts_1d at level 0 is 174
Setting the gravity type to PoissonGrav
Initializing the data at level 0
Done initializing the level 0 data
...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637
grid_places() time: 0.033900523 new finest: 0
Now regridding at level lbase = 0
grid_places() time: 0.030170351 new finest: 0
STEP = 0 TIME = 0 : REGRID with lbase = 0
Gravity::fill_multipole_BCs() time = 0.360829589
Gravity::multilevel_solve_for_new_phi() time = 1.733488426
Gravity::fill_multipole_BCs() time = 0.359252057
... norm of composite residual at level 0 3.509358608e-10
INITIAL GRIDS
Level 0 27 grids 884736 cells 100 % of domain
smallest grid: 32 x 32 x 32 biggest grid: 32 x 32 x 32
PLOTFILE: file = wdmerger_3D_plt00000
Write plotfile time = 0.583083689 seconds
...estimated hydro-limited timestep at level 0: 0.05426072637
...hydro-limited CFL timestep constrained at (i,j,k) = (64,0,0)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05426072637
[Level 0 step 1] ADVANCE at time 0 with dt = 0.005426072637
[1m[32m Beginning subcycle 1 starting at time 0 with dt = 0.005426072637[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.871686277 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -3.287624606e+47
ener added: 6.129070894e+49
Contributions to the state from old-time sources:
mass added: 0
xmom added: 1.44936293e+25
ymom added: -1.046793351e+26
zmom added: -4.133074948e+24
eint added: 0
ener added: -1.270533196e+50
Castro::do_old_sources() time = 2.368126973 on level 0
... Entering construct_ctu_hydro_source() on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 9.00547245e+47
ener added: 1.651139801e+46
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 21.42797164 on level 0
... new-time composite Poisson gravity solve from level 0 to level 0
Gravity::fill_multipole_BCs() time = 0.676191395
Gravity::multilevel_solve_for_new_phi() time = 1.758992351
Castro::construct_new_gravity() time = 1.881896353 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 6.440206272e+49
ener added: 2.911791643e+45
Contributions to the state from new-time sources:
mass added: 0
xmom added: 1.451207933e+26
ymom added: 1.075144428e+26
zmom added: -5.613375295e+26
eint added: 0
ener added: 1.260457978e+50
Castro::do_new_sources() time = 2.337154794 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.184461852e+27
ener added: 2.243834889e+27
...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond at this level: 0.02422272774
[Level 0 step 1] Advanced 884736 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 5.190352593e+26
ener added: 6.213783704e+26
Updating the rotational period from 30.54368673 s to 30.45939751 s.
[STEP 1] Coarse TimeStep time: 38.6551365
[STEP 1] FAB kilobyte spread across MPI nodes: [679617 ... 761594]
STEP = 1 TIME = 0.005426072637 DT = 0.005426072637
...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.05461684804
... but limiting to: 0.0059686799 = 1.1 * 0.005426072637
Now regridding at level lbase = 0
grid_places() time: 0.032761664 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.4057787
Gravity::multilevel_solve_for_new_phi() time = 1.97702545
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.306135866e+46
ener added: 9.211440366e+51
STEP = 1 TIME = 0.005426072637 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.05461684804
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461684804
...estimated hydro-limited timestep at level 1: 2.526135286e-09
...hydro-limited CFL timestep constrained at (i,j,k) = (87,103,92)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 2.526135286e-09
[Level 0 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.849569753e+31
ener added: 2.785937322e+31
[1m[32m Beginning subcycle 1 starting at time 0.005426072637 with dt = 2.526135286e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.893685612 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.200514105e+40
ener added: 6.433158191e+33
Contributions to the state from old-time sources:
mass added: 0
xmom added: 5.533896722e+24
ymom added: 4.756222073e+26
zmom added: -2.866993882e+23
eint added: 0
ener added: -1.721443002e+45
Castro::do_old_sources() time = 2.1092304 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 22.34824931 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.147330623e+31
ener added: 1.147330701e+31
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 4.551111111e+23
ener added: 6.281481481e+23
Castro::construct_old_gravity() time = 0.035983563 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.197253775e+40
ener added: 1.79168512e+42
Contributions to the state from old-time sources:
mass added: 0
xmom added: 7.575221657e+22
ymom added: 1.505254316e+22
zmom added: 6.442093022e+21
eint added: 0
ener added: -2.586789965e+47
Castro::do_old_sources() time = 0.195364978 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 9.204912576e+51
ener added: 6.747117479e+48
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.91483843 on level 1
Castro::reflux() at level 0 : time = 2.464706948
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.59533747
Gravity::multilevel_solve_for_new_phi() time = 1.548484555
Castro::construct_new_gravity() time = 1.665235142 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -3.46375568e+41
ener added: 7.485558923e+35
Contributions to the state from new-time sources:
mass added: 0
xmom added: -4.864072325e+21
ymom added: -6.244635709e+21
zmom added: -1.246148803e+20
eint added: 0
ener added: -3.223710603e+41
Castro::do_new_sources() time = 1.975410163 on level 0
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.14873037e+26
ener added: 4.251851852e+22
...estimated hydro-limited timestep at level 0: 0.05461716025
...hydro-limited CFL timestep constrained at (i,j,k) = (0,29,94)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.05461716025
Castro::construct_new_gravity() time = 0.03153639 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.564837764e+47
ener added: 4.559472528e+41
Contributions to the state from new-time sources:
mass added: 0
xmom added: 5.111905638e+18
ymom added: -1.461418079e+19
zmom added: -8.220975406e+19
eint added: 0
ener added: 2.564611685e+47
Castro::do_new_sources() time = 0.141379997 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 3.281876859e+29
ener added: 3.281875295e+29
...estimated hydro-limited timestep at level 1: 6.287037368e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02204535987
[Level 0 step 2] Advanced 884736 cells
[Level 1 step 2] ADVANCE at time 0.005426072637 with dt = 2.526135286e-09
Advance at this level has already been completed.
[Level 1 step 2] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 6.036240741e+24
ener added: 5.917722222e+24
Updating the rotational period from 30.45939751 s to 30.52749735 s.
[STEP 2] Coarse TimeStep time: 51.30162242
[STEP 2] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 2 TIME = 0.005426075163 DT = 2.526135286e-09
...estimated hydro-limited timestep at level 0: 0.0008131491259
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259
...estimated hydro-limited timestep at level 1: 6.287037368e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.0008131491259
... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09
Castro::compute_new_dt : limiting dt at level 1
... new dt computed: 6.287037368e-07
... but limiting to: 2.778748814e-09 = 1.1 * 2.526135286e-09
Now regridding at level lbase = 0
grid_places() time: 0.033041142 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.459351559
Gravity::multilevel_solve_for_new_phi() time = 0.593295325
STEP = 2 TIME = 0.005426075163 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.0008131491259
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131491259
...estimated hydro-limited timestep at level 1: 6.287037368e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.287037368e-07
[Level 0 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09
[1m[32m Beginning subcycle 1 starting at time 0.005426075163 with dt = 2.778748814e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.875902203 on level 0
Contributions to the state from old-time sources:
mass added: 0
xmom added: 6.083120164e+24
ymom added: 5.231862796e+26
zmom added: -3.157842738e+23
eint added: 0
ener added: -1.937110674e+45
Castro::do_old_sources() time = 2.134125505 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 22.42738438 on level 0
Castro::construct_old_gravity() time = 0.045693778 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -1.818691488e+40
ener added: 1.212217726e+36
Contributions to the state from old-time sources:
mass added: 0
xmom added: 8.442348445e+22
ymom added: 5.312662293e+21
zmom added: 7.10314939e+21
eint added: 0
ener added: -2.344787748e+45
Castro::do_old_sources() time = 0.193827603 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.83673455e+48
ener added: 2.077900047e+42
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.911992822 on level 1
Castro::reflux() at level 0 : time = 2.379410364
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.587076025
Gravity::multilevel_solve_for_new_phi() time = 1.154674899
Castro::construct_new_gravity() time = 1.274367626 on level 0
Contributions to the state from new-time sources:
mass added: 0
xmom added: -2.108598872e+21
ymom added: -7.90284783e+21
zmom added: 1.10682106e+20
eint added: 0
ener added: -3.427512073e+41
Castro::do_new_sources() time = 1.999418034 on level 0
...estimated hydro-limited timestep at level 0: 0.0008131520194
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008131520194
Castro::construct_new_gravity() time = 0.029990661 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 5.244373444e+43
ener added: 1.74625952e+38
Contributions to the state from new-time sources:
mass added: 0
xmom added: -5.607933644e+17
ymom added: 2.17388754e+19
zmom added: 9.538641541e+19
eint added: 0
ener added: 5.303047905e+43
Castro::do_new_sources() time = 0.140798672 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.495038611e+26
ener added: 1.500090463e+26
...estimated hydro-limited timestep at level 1: 6.564309766e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02226627916
[Level 0 step 3] Advanced 884736 cells
[Level 1 step 3] ADVANCE at time 0.005426075163 with dt = 2.778748814e-09
Advance at this level has already been completed.
[Level 1 step 3] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 6.283851852e+24
ener added: 6.674962963e+24
Updating the rotational period from 30.52749735 s to 30.52751553 s.
[STEP 3] Coarse TimeStep time: 48.9479244
[STEP 3] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 3 TIME = 0.005426077942 DT = 2.778748814e-09
...estimated hydro-limited timestep at level 0: 0.0008130329735
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735
...estimated hydro-limited timestep at level 1: 6.564309766e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.0008130329735
... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09
Castro::compute_new_dt : limiting dt at level 1
... new dt computed: 6.564309766e-07
... but limiting to: 3.056623696e-09 = 1.1 * 2.778748814e-09
Now regridding at level lbase = 0
grid_places() time: 0.032581258 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.398915788
Gravity::multilevel_solve_for_new_phi() time = 0.530827335
STEP = 3 TIME = 0.005426077942 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.0008130329735
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0008130329735
...estimated hydro-limited timestep at level 1: 6.564309766e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.564309766e-07
[Level 0 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09
[1m[32m Beginning subcycle 1 starting at time 0.005426077942 with dt = 3.056623695e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.779382571 on level 0
Contributions to the state from old-time sources:
mass added: 0
xmom added: 6.694655893e+24
ymom added: 5.755038681e+26
zmom added: -3.471615689e+23
eint added: 0
ener added: -2.130751807e+45
Castro::do_old_sources() time = 2.037971577 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 22.26107409 on level 0
Castro::construct_old_gravity() time = 0.033941731 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -2.150425501e+40
ener added: 1.373884257e+36
Contributions to the state from old-time sources:
mass added: 0
xmom added: 9.203147947e+22
ymom added: 1.180591621e+22
zmom added: 8.023901326e+21
eint added: 0
ener added: -2.520808161e+45
Castro::do_old_sources() time = 0.195882228 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.318881554e+48
ener added: 1.675623034e+42
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.895411942 on level 1
Castro::reflux() at level 0 : time = 2.392980458
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.584818512
Gravity::multilevel_solve_for_new_phi() time = 1.152509969
Castro::construct_new_gravity() time = 1.265615433 on level 0
Contributions to the state from new-time sources:
mass added: 0
xmom added: -2.405469507e+21
ymom added: -9.735672131e+21
zmom added: -7.437548959e+18
eint added: 0
ener added: -3.723007452e+41
Castro::do_new_sources() time = 2.041002816 on level 0
...estimated hydro-limited timestep at level 0: 0.000813036171
...hydro-limited CFL timestep constrained at (i,j,k) = (37,49,42)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.000813036171
Castro::construct_new_gravity() time = 0.030247156 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 3.983601425e+43
ener added: 1.617265925e+38
Contributions to the state from new-time sources:
mass added: 0
xmom added: 3.521266751e+18
ymom added: -2.667031699e+19
zmom added: -1.338681369e+19
eint added: 0
ener added: 4.042918443e+43
Castro::do_new_sources() time = 0.142292961 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 2.851958796e+25
ener added: 2.794684722e+25
...estimated hydro-limited timestep at level 1: 6.863488975e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02243592084
[Level 0 step 4] Advanced 884736 cells
[Level 1 step 4] ADVANCE at time 0.005426077942 with dt = 3.056623696e-09
Advance at this level has already been completed.
[Level 1 step 4] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -3.365462963e+23
ener added: 4.62962963e+19
Updating the rotational period from 30.52751553 s to 30.52751552 s.
[STEP 4] Coarse TimeStep time: 48.49691263
[STEP 4] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 4 TIME = 0.005426080998 DT = 3.056623696e-09
...estimated hydro-limited timestep at level 0: 0.0002506596503
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503
...estimated hydro-limited timestep at level 1: 6.863488975e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07
Castro::compute_new_dt : limiting dt at level 0
... new dt computed: 0.0002506596503
... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09
Castro::compute_new_dt : limiting dt at level 1
... new dt computed: 6.863488975e-07
... but limiting to: 3.362286065e-09 = 1.1 * 3.056623696e-09
Now regridding at level lbase = 0
grid_places() time: 0.035583748 new finest: 1
Castro::numpts_1d at level 1 is 340
Gravity::fill_multipole_BCs() time = 0.404882057
Gravity::multilevel_solve_for_new_phi() time = 0.539537381
STEP = 4 TIME = 0.005426080998 : REGRID with lbase = 0
Level 1 4 grids 65536 cells 0.9259259259 % of domain
smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16
...estimated hydro-limited timestep at level 0: 0.0002506596503
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0002506596503
...estimated hydro-limited timestep at level 1: 6.863488975e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 6.863488975e-07
[Level 0 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09
[1m[32m Beginning subcycle 1 starting at time 0.005426080998 with dt = 3.362286065e-09[0m
Estimated number of subcycles remaining: 1
Castro::construct_old_gravity() time = 0.778821888 on level 0
Contributions to the state from old-time sources:
mass added: 0
xmom added: 7.366517551e+24
ymom added: 6.330531998e+26
zmom added: -3.819051789e+23
eint added: 0
ener added: -2.343742535e+45
Castro::do_old_sources() time = 2.014669535 on level 0
... Entering construct_ctu_hydro_source() on level 0
... Leaving construct_ctu_hydro_source() on level 0
Castro::construct_ctu_hydro_source() time = 22.36699474 on level 0
Castro::construct_old_gravity() time = 0.034265809 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -2.560109508e+40
ener added: 1.662186972e+36
Contributions to the state from old-time sources:
mass added: 0
xmom added: 1.01327239e+23
ymom added: 1.888946593e+22
zmom added: 8.797223426e+21
eint added: 0
ener added: -2.728291723e+45
Castro::do_old_sources() time = 0.194336801 on level 1
... Entering construct_ctu_hydro_source() on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 1.05099824e+48
ener added: 1.448876286e+42
... Leaving construct_ctu_hydro_source() on level 1
Castro::construct_ctu_hydro_source() time = 2.8625472 on level 1
Castro::reflux() at level 0 : time = 2.420143507
... new-time composite Poisson gravity solve from level 0 to level 1
Gravity::fill_multipole_BCs() time = 0.605848405
Gravity::multilevel_solve_for_new_phi() time = 1.162850946
Castro::construct_new_gravity() time = 1.28061078 on level 0
Contributions to the state from new-time sources:
mass added: 0
xmom added: -2.798425632e+21
ymom added: -1.178643014e+22
zmom added: -5.143756067e+18
eint added: 0
ener added: -4.148475158e+41
Castro::do_new_sources() time = 1.996412832 on level 0
...estimated hydro-limited timestep at level 0: 0.0006828000901
...hydro-limited CFL timestep constrained at (i,j,k) = (57,41,46)
Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.0006828000901
Castro::construct_new_gravity() time = 0.029936243 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 3.326552265e+43
ener added: 1.577214716e+38
Contributions to the state from new-time sources:
mass added: 0
xmom added: 2.012990252e+18
ymom added: -2.460766836e+19
zmom added: -1.244730437e+19
eint added: 0
ener added: 3.390623254e+43
Castro::do_new_sources() time = 0.142064728 on level 1
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: 4.005277778e+24
ener added: 3.882013889e+24
...estimated hydro-limited timestep at level 1: 7.169281148e-07
...hydro-limited CFL timestep constrained at (i,j,k) = (121,90,90)
Castro::estTimeStep (hydro-limited) at level 1: estdt = 7.169281148e-07
[1m[32m Subcycle completed[0m
Subcycling complete
Zones advanced per microsecond from level 0 to level 1: 0.02244799756
[Level 0 step 5] Advanced 884736 cells
[Level 1 step 5] ADVANCE at time 0.005426080998 with dt = 3.362286065e-09
Advance at this level has already been completed.
[Level 1 step 5] Advanced 65536 cells
Contributions to the state from negative energy resets:
mass added: 0
xmom added: 0
ymom added: 0
zmom added: 0
eint added: -2.814813006e+22
ener added: 2.962962963e+20
Updating the rotational period from 30.52751552 s to 30.52751551 s.
[STEP 5] Coarse TimeStep time: 48.5817197
[STEP 5] FAB kilobyte spread across MPI nodes: [833440 ... 934735]
STEP = 5 TIME = 0.005426084361 DT = 3.362286065e-09
PLOTFILE: file = wdmerger_3D_plt00005
Write plotfile time = 0.584285762 seconds
Ending run at 06:46:01 UTC on 2023-09-13.
Run time = 248.3137271
Run time without initialization = 236.5696004
Average number of zones advanced per microsecond: 0.021
Average number of zones advanced per microsecond per rank: 0.005
TinyProfiler total time across processes [min...avg...max]: 248.3 ... 248.3 ... 248.3
--------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
--------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 9 98.4319 105.4314 111.7897 45.02%
Castro::computeTemp() 88 15.08 16.75 17.54 7.06%
amrex::Copy() 736 13.18 14.45 15.01 6.04%
check_for_negative_density() 9 0.2186 6.705 13.78 5.55%
MultiFab::AddProduct() 4205 10.48 11.56 11.99 4.83%
Castro::normalize_species() 87 10.1 11.16 11.56 4.65%
FabArray::ParallelCopy_finish() 830 1.837 4.905 9.811 3.95%
Castro::reset_internal_energy(Fab) 1476 8.416 9.307 9.708 3.91%
Castro::estTimeStep() 26 3.981 5.639 8.68 3.50%
FabArray::setVal() 5078 7.591 8.342 8.623 3.47%
MultiFab::Subtract() 175 7.004 7.734 8.112 3.27%
Gravity::fill_multipole_BCs() 11 4.251 4.792 5.35 2.15%
Castro::reset_internal_energy(MultiFab) 88 3.902 4.342 5.085 2.05%
FabArray::sum() 4205 3.335 3.686 3.819 1.54%
FluxRegister::Reflux() 24 3.165 3.436 3.741 1.51%
FabArray::ParallelCopy_nowait() 830 2.076 2.287 2.703 1.09%
Castro::enforce_min_density() 87 1.837 2.07 2.588 1.04%
MLPoisson::Fsmooth() 1376 2.144 2.373 2.465 0.99%
Castro::FluxRegCrseInit 9 1.608 1.741 1.876 0.76%
Castro::reflux() 4 1.621 1.742 1.83 0.74%
Castro::wd_update() 6 0.5018 0.8903 1.58 0.64%
FillPatchInterp(MF) 30 1.234 1.332 1.415 0.57%
Amr::InitAmr() 1 1.213 1.213 1.213 0.49%
amrex::Add() 143 1.098 1.154 1.197 0.48%
Castro::initMFs() 5 1.098 1.138 1.161 0.47%
Castro::construct_old_gravity_source() 18 0.9264 1.021 1.112 0.45%
MLPoisson::Fapply() 326 0.9064 1.005 1.051 0.42%
FillPatchIterator::Initialize 62 0.8105 0.8873 1.011 0.41%
FillBoundary_finish() 1561 0.4032 0.5863 0.9701 0.39%
Castro::construct_new_gravity_source() 9 0.8272 0.8692 0.9229 0.37%
Castro::problem_post_timestep() 10 0.7464 0.795 0.8552 0.34%
FabArray::Saxpy() 125 0.7275 0.7887 0.8185 0.33%
VisMF::Write(FabArray) 3 0.6344 0.7081 0.7889 0.32%
Castro::volInBoundary() 42 0.6455 0.7052 0.788 0.32%
StateData::FillBoundary(geom) 50 0.613 0.6346 0.672 0.27%
Castro::construct_new_source() 63 0.4941 0.542 0.5686 0.23%
MultiFab::max() 18 0.02049 0.1602 0.4967 0.20%
MLCellLinOp::applyBC() 1750 0.3741 0.4347 0.4818 0.19%
FillBoundary_nowait() 1561 0.3303 0.3944 0.4695 0.19%
MultiFab::contains_nan() 18 0.3946 0.4315 0.4444 0.18%
FabArray::Xpay() 291 0.3447 0.3831 0.3998 0.16%
Castro::initialize_do_advance() 9 0.2516 0.2808 0.3451 0.14%
Amr::writePlotFile() 2 0.09015 0.1834 0.2847 0.11%
FabArray::setDomainBndry() 92 0.2198 0.2384 0.2717 0.11%
amrex::average_down 233 0.2007 0.2091 0.2139 0.09%
Castro::construct_old_source() 63 0.194 0.2035 0.2129 0.09%
Castro::fill_hybrid_hydro_source() 27 0.1728 0.1893 0.1974 0.08%
MLCellLinOp::defineAuxData() 11 0.1581 0.1707 0.1794 0.07%
Castro::initData() 1 0.1277 0.1452 0.1599 0.06%
MLPoisson::FFlux() 150 0.0047 0.0426 0.1561 0.06%
MLCellLinOp::compGrad() 18 0.125 0.1379 0.144 0.06%
Castro::evaluate_source_change() 193 0.1192 0.1243 0.1317 0.05%
FabArray::mult() 56 0.113 0.126 0.1312 0.05%
StateData::define() 25 0.1137 0.1237 0.1301 0.05%
MLMG::addInterpCorrection() 155 0.1058 0.118 0.1231 0.05%
Castro::swap_state_time_levels() 9 0.1038 0.112 0.1183 0.05%
Gravity::get_old_grav_vector() 9 0.08809 0.09558 0.1034 0.04%
Gravity::get_new_grav_vector() 10 0.09023 0.09638 0.09988 0.04%
Castro::initialize_advance() 9 0.08668 0.09282 0.09933 0.04%
MLMG::prepareForSolve() 10 0.07381 0.08065 0.08661 0.03%
AmrLevel::FillPatch() 62 0.06362 0.07159 0.0747 0.03%
MLCellLinOp::updateSolBC() 25 0.06759 0.06837 0.06933 0.03%
MLMG::solve() 10 0.001129 0.04446 0.06889 0.03%
FabArray::norminf(mask) 21 0.05498 0.06115 0.06362 0.03%
Castro::apply_tagging_restrictions() 6 0.04892 0.05464 0.05707 0.02%
Gravity::multilevel_solve_for_new_phi() 10 0.0392 0.04493 0.05571 0.02%
AmrMesh::MakeNewGrids() 6 0.04698 0.04867 0.05335 0.02%
MLMG::ResNormInf() 54 0.002117 0.02194 0.0483 0.02%
MLCellLinOp::updateCorBC() 17 0.04572 0.04624 0.04708 0.02%
BndryData::define() 27 0.04465 0.04554 0.04692 0.02%
FabArray::norminf() 117 0.03698 0.03918 0.04127 0.02%
MultiFab::Multiply() 8 0.03403 0.03786 0.03975 0.02%
MLMG::MLResNormInf() 15 0.0001168 0.02476 0.03558 0.01%
MLCellLinOp::reflux() 30 0.004137 0.01204 0.03505 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01938 0.02315 0.02945 0.01%
Castro::FluxRegFineAdd() 9 0.02599 0.02791 0.0291 0.01%
MLCellLinOp::defineBC() 11 0.02637 0.0266 0.02686 0.01%
Castro::build_fine_mask() 44 0.01866 0.0214 0.0249 0.01%
StateDataPhysBCFunct::() 95 0.002001 0.01055 0.02395 0.01%
FabArrayBase::CPC::define() 416 0.01398 0.01612 0.01994 0.01%
Castro::Castro() 5 0.01546 0.01741 0.01969 0.01%
MLMG::interpCorrection_1 17 0.01825 0.01884 0.01969 0.01%
FillPatchTwoLevels 31 0.01336 0.01585 0.01903 0.01%
MLLinOp::makeSubCommunicator() 11 0.001942 0.009681 0.01883 0.01%
Castro::buildMetrics() 5 0.01482 0.01645 0.01725 0.01%
Castro::linear_to_hybrid_momentum() 1 0.01387 0.01558 0.01667 0.01%
Gravity::actual_multilevel_solve() 10 0.01034 0.01285 0.01632 0.01%
Castro::construct_old_gravity() 9 0.0004362 0.004631 0.01485 0.01%
DistributionMapping::LeastUsedCPUs() 5 0.003187 0.007865 0.01401 0.01%
Gravity::update_max_rhs() 10 0.009595 0.01096 0.01341 0.01%
MLCellLinOp::prepareForSolve() 11 0.01152 0.01182 0.01221 0.00%
FabArrayBase::getCPC() 1440 0.01022 0.01106 0.01203 0.00%
Castro::do_old_sources() 9 0.000633 0.004922 0.01138 0.00%
Gravity::actual_solve_with_mlmg() 11 0.009375 0.01027 0.01124 0.00%
Castro::finalize_do_advance() 9 0.009688 0.0103 0.01066 0.00%
Castro::enforce_consistent_e() 1 0.009171 0.0102 0.0106 0.00%
AMRErrorTag::operator() 6 0.008902 0.009914 0.01046 0.00%
Castro::apply_problem_tags() 6 0.006356 0.00705 0.007336 0.00%
AmrLevel::FillCoarsePatch() 5 0.0009699 0.003415 0.006306 0.00%
average_down_faces 48 0.00586 0.005968 0.006036 0.00%
AmrLevel::derive() 6 0.004777 0.005538 0.005925 0.00%
MLCellLinOp::setLevelBC() 19 0.004072 0.004841 0.005664 0.00%
MLCGSolver::bicgstab 7 0 0.001302 0.00521 0.00%
FabArray::FillBoundary() 1561 0.004371 0.004677 0.005109 0.00%
MLCellLinOp::smooth() 688 0.003926 0.004134 0.00444 0.00%
FabArrayBase::getFB() 1561 0.003201 0.003397 0.003828 0.00%
FabArray::ParallelCopy() 830 0.003134 0.003309 0.003511 0.00%
FabArrayBase::FB::FB() 19 0.002685 0.003104 0.003499 0.00%
amrex::Dot() 115 0 0.0008508 0.003403 0.00%
Castro::construct_new_gravity() 9 0.0004366 0.00187 0.003393 0.00%
Gravity::test_composite_phi() 1 0.002099 0.002447 0.002628 0.00%
Castro::do_new_sources() 9 0.0005594 0.001177 0.002 0.00%
FabArray::LinComb() 57 0 0.0004728 0.001891 0.00%
main() 1 0.0015 0.001718 0.001809 0.00%
Amr::regrid() 5 0.001016 0.001372 0.001756 0.00%
MLLinOp::defineGrids() 11 0.001423 0.001517 0.00174 0.00%
MLCellLinOp::apply() 326 0.000937 0.001134 0.00165 0.00%
Castro::clean_state() 87 0.001311 0.001425 0.001585 0.00%
TagBoxArray::collate() 6 0.0004154 0.001011 0.001319 0.00%
Amr::coarseTimeStep() 5 0.0005234 0.001035 0.001212 0.00%
MLCGSolver::ParallelAllReduce 153 0 0.0002905 0.001162 0.00%
Gravity::average_fine_ec_onto_crse_ec() 8 0.0009302 0.000965 0.001015 0.00%
OwnerMask() 6 0.0007793 0.0008722 0.0009342 0.00%
MLCellLinOp::correctionResidual() 196 0.0007359 0.0007925 0.0008741 0.00%
Castro::do_advance_ctu() 5 0.0005866 0.0006492 0.0007008 0.00%
MLMG::mgVcycle() 65 0.0005939 0.0006127 0.0006345 0.00%
FillPatchSingleLevel 92 0.0005566 0.0005892 0.0006087 0.00%
Castro::finalize_advance() 9 0.0004013 0.0004953 0.0006016 0.00%
FillPatchIterator::FillFromLevel0() 31 0.0004093 0.0004852 0.0005821 0.00%
Amr::grid_places() 6 0.0003879 0.0004764 0.0005681 0.00%
TagBoxArray::mapPRD 6 0.0004538 0.0004713 0.0004843 0.00%
MLMG:computeResOfCorrection() 155 0.0003962 0.0004137 0.0004375 0.00%
MLMG::actualBottomSolve() 31 4.047e-05 0.0001359 0.0004198 0.00%
MLCellLinOp::solutionResidual() 72 0.0003772 0.0004007 0.0004195 0.00%
Castro::subcycle_advance_ctu() 5 6.734e-05 0.0001741 0.0004131 0.00%
MLMG::oneIter() 31 0.0003475 0.0003686 0.0003881 0.00%
FillPatchIterator::FillFromTwoLevels() 31 0.0003198 0.0003394 0.0003566 0.00%
MLMG::mgVcycle_down::0 31 0.0002872 0.000301 0.0003205 0.00%
Castro::enforce_speed_limit() 87 0.0002534 0.0002777 0.000304 0.00%
Castro::computeNewDt() 8 0.0001177 0.0001638 0.0002893 0.00%
Gravity::solve_phi_with_mlmg() 11 0.0002466 0.0002661 0.0002872 0.00%
Amr::timeStep() 9 0.0001911 0.0002175 0.0002653 0.00%
MLMG::mgVcycle_down::1 31 0.000254 0.0002595 0.0002625 0.00%
Amr::defBaseLevel() 1 0.0002211 0.0002326 0.0002441 0.00%
Castro::post_regrid() 10 0.0001816 0.0002183 0.0002437 0.00%
MLMG::mgVcycle_down::2 31 0.0002021 0.0002183 0.0002404 0.00%
MLMG::mgVcycle_bottom 65 0.0002192 0.0002222 0.0002272 0.00%
MLMG::mgVcycle_down::3 31 0.0002 0.0002071 0.0002223 0.00%
makeSFC 33 0.0001824 0.0001966 0.0002181 0.00%
AmrLevel::AmrLevel(dm) 5 0.0001928 0.0002015 0.0002118 0.00%
MLMG::mgVcycle_up::0 31 0.0001932 0.0001994 0.0002071 0.00%
FabArrayBase::TheFPinfo() 25 0.0001653 0.0001898 0.0002025 0.00%
MLMG::mgVcycle_down::4 31 0.0001746 0.0001887 0.0001991 0.00%
Castro::check_for_nan() 18 0.0001365 0.0001612 0.000194 0.00%
Castro::react_state() 18 0.0001412 0.0001595 0.0001791 0.00%
Amr::FinalizeInit() 1 3.043e-05 7.053e-05 0.0001665 0.00%
Castro::advance() 5 9.338e-05 0.0001205 0.0001584 0.00%
MLMG::computeResWithCrseSolFineCor() 17 0.000133 0.0001448 0.0001552 0.00%
MLMG::mgVcycle_up::1 31 0.0001416 0.0001474 0.000155 0.00%
Castro::expand_state() 13 0.0001125 0.0001262 0.0001491 0.00%
MLMG::mgVcycle_up::2 31 0.0001348 0.0001396 0.0001464 0.00%
MLMG::mgVcycle_up::4 31 0.000118 0.0001264 0.0001444 0.00%
FPinfo::FPinfo() 3 0.0001202 0.0001298 0.0001412 0.00%
MLMG::mgVcycle_up::3 31 0.0001255 0.0001329 0.0001385 0.00%
MLLinOp::makeAgglomeratedDMap 11 0.0001175 0.0001239 0.0001327 0.00%
Castro::apply_source_to_state() 18 0.0001007 0.0001146 0.0001289 0.00%
DistributionMapping::Distribute() 35 0.000115 0.0001214 0.0001272 0.00%
FabArray::RecvLayoutMask() 8 9.643e-05 0.0001051 0.0001258 0.00%
Amr::writeSmallPlotFile() 1 9.979e-05 0.0001094 0.0001254 0.00%
Castro::errorEst() 6 0.0001041 0.0001157 0.0001247 0.00%
MLPoisson::define() 11 0.0001063 0.000112 0.000117 0.00%
Gravity::swapTimeLevels() 9 8.963e-05 9.605e-05 0.0001022 0.00%
ClusterList::intersect() 1 0 2.494e-05 9.977e-05 0.00%
MLMG::computeResidual() 31 9.148e-05 9.491e-05 9.958e-05 0.00%
Castro::avgDown(state_indx) 20 7.158e-05 8.515e-05 9.71e-05 0.00%
Castro::post_timestep() 9 8.556e-05 9.142e-05 9.697e-05 0.00%
MLMG::computeMLResidual() 15 8.237e-05 8.973e-05 9.428e-05 0.00%
MLMG::miniCycle() 34 7.057e-05 7.536e-05 8.131e-05 0.00%
MLLinOp::define() 11 6.387e-05 7.243e-05 8.088e-05 0.00%
knapsack() 3 6.995e-05 7.252e-05 7.854e-05 0.00%
MLMG::computeResWithCrseCorFineCor() 17 6.581e-05 6.938e-05 7.574e-05 0.00%
Castro::create_source_corrector() 9 5.774e-05 6.593e-05 7.498e-05 0.00%
MLMG::getGradSolution() 10 6.581e-05 6.889e-05 7.104e-05 0.00%
DistributionMapping::SFCProcessorMapDoIt() 2 4.649e-05 5.33e-05 6.852e-05 0.00%
amrex::average_down_w_geom 20 5.263e-05 5.863e-05 6.38e-05 0.00%
MLPoisson::prepareForSolve() 11 4.821e-05 5.257e-05 5.634e-05 0.00%
Castro::construct_new_hybrid_source() 9 4.82e-05 5.137e-05 5.475e-05 0.00%
Amr::initSubcycle() 1 5.095e-05 5.177e-05 5.22e-05 0.00%
Castro::init(old) 3 4.508e-05 4.891e-05 5.186e-05 0.00%
Gravity::set_mass_offset() 6 3.964e-05 4.449e-05 4.847e-05 0.00%
AmrMesh-cluster 1 0 1.165e-05 4.661e-05 0.00%
Castro::retry_advance_ctu() 5 2.247e-05 2.957e-05 4.263e-05 0.00%
Castro::avgDown() 4 3.217e-05 3.595e-05 3.954e-05 0.00%
Castro::construct_old_hybrid_source() 9 3.712e-05 3.83e-05 3.906e-05 0.00%
MLMG::MLRhsNormInf() 10 3.349e-05 3.501e-05 3.666e-05 0.00%
Castro::post_init() 1 2.719e-05 3.066e-05 3.661e-05 0.00%
DistributionMapping::KnapSackDoIt() 3 3.13e-05 3.231e-05 3.412e-05 0.00%
MLMG::compResidual() 1 2.867e-05 3.041e-05 3.317e-05 0.00%
BoxList::parallelComplementIn() 12 2.7e-05 2.919e-05 3.142e-05 0.00%
BoxList::complementIn 12 2.44e-05 2.626e-05 2.975e-05 0.00%
Castro::construct_old_rotation_source() 9 2.284e-05 2.553e-05 2.798e-05 0.00%
Castro::derive() 6 1.786e-05 2.1e-05 2.758e-05 0.00%
Castro::construct_new_rotation_source() 9 2.098e-05 2.333e-05 2.701e-05 0.00%
Amr::bldFineLevels() 1 2.258e-05 2.432e-05 2.626e-05 0.00%
Castro::computeInitialDt() 2 1.662e-05 1.883e-05 2.456e-05 0.00%
Castro::init() 1 1.704e-05 2.027e-05 2.249e-05 0.00%
ClusterList::chop() 1 0 4.479e-06 1.792e-05 0.00%
Amr::InitializeInit() 1 6.994e-06 8.106e-06 1.061e-05 0.00%
Amr::init() 1 7.556e-06 8.204e-06 1.001e-05 0.00%
Amr::initialInit() 1 4.799e-06 6.335e-06 8.635e-06 0.00%
knapsack()swap 1 3.783e-06 4.041e-06 4.241e-06 0.00%
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
--------------------------------------------------------------------------------------------
main() 1 248.3 248.3 248.3 100.00%
Amr::coarseTimeStep() 5 236 236 236 95.03%
Amr::timeStep() 9 234.7 234.7 234.7 94.50%
Castro::advance() 5 207 207 207 83.36%
Castro::subcycle_advance_ctu() 5 198.2 198.6 199.4 80.28%
Castro::do_advance_ctu() 5 198.2 198.6 199.4 80.28%
Castro::construct_ctu_hydro_source() 9 122.1 122.2 122.4 49.28%
Castro::clean_state() 87 73.1 80.75 84.99 34.23%
Castro::computeTemp() 88 46.5 51.46 54.28 21.86%
Castro::reset_internal_energy(MultiFab) 88 31.41 34.71 36.74 14.80%
Castro::evaluate_source_change() 193 17.75 19.6 20.33 8.19%
Castro::enforce_min_density() 87 17.28 19.06 20.21 8.14%
Castro::post_regrid() 10 16.18 17.58 18.3 7.37%
Amr::regrid() 5 16.04 17.29 17.94 7.22%
Castro::initialize_do_advance() 9 14.97 15.45 15.97 6.43%
amrex::Copy() 736 13.18 14.45 15.01 6.04%
AmrLevel::FillPatch() 62 8.831 10.59 14.13 5.69%
check_for_negative_density() 9 0.2186 6.705 13.78 5.55%
FillPatchIterator::Initialize 62 7.077 8.912 12.63 5.09%
Gravity::solve_phi_with_mlmg() 11 11.34 11.88 12.44 5.01%
Gravity::multilevel_solve_for_new_phi() 10 11.09 11.61 12.15 4.89%
Gravity::actual_multilevel_solve() 10 11.03 11.56 12.11 4.88%
FabArray::ParallelCopy() 830 4.61 7.258 12.1 4.87%
MultiFab::AddProduct() 4205 10.48 11.56 11.99 4.83%
Castro::normalize_species() 87 10.1 11.16 11.56 4.65%
Castro::do_old_sources() 9 11.28 11.34 11.43 4.60%
Castro::do_new_sources() 9 9.46 10.38 10.92 4.40%
Amr::init() 1 10.53 10.53 10.53 4.24%
FillPatchSingleLevel 92 4.68 6.664 10.47 4.22%
Castro::post_timestep() 9 10.14 10.15 10.15 4.09%
FillPatchIterator::FillFromLevel0() 31 4.296 6.239 10.02 4.03%
Amr::initialInit() 1 9.947 9.947 9.947 4.01%
FabArray::ParallelCopy_finish() 830 1.837 4.905 9.811 3.95%
Castro::reset_internal_energy(Fab) 1476 8.416 9.307 9.708 3.91%
Castro::reflux() 4 8.957 9.309 9.658 3.89%
Castro::initialize_advance() 9 7.642 8.347 8.748 3.52%
Castro::estTimeStep() 26 3.981 5.639 8.68 3.50%
FabArray::setVal() 5078 7.591 8.342 8.623 3.47%
MultiFab::Subtract() 175 7.004 7.734 8.112 3.27%
Castro::construct_new_gravity() 9 6.466 6.957 7.488 3.02%
Gravity::actual_solve_with_mlmg() 11 6.967 6.975 6.982 2.81%
Castro::expand_state() 13 5.633 5.944 6.538 2.63%
MLMG::solve() 10 6.445 6.463 6.479 2.61%
Amr::FinalizeInit() 1 5.747 5.915 6.286 2.53%
Gravity::fill_multipole_BCs() 11 4.351 4.887 5.437 2.19%
MLMG::oneIter() 31 5.209 5.224 5.237 2.11%
FluxRegister::Reflux() 24 4.058 4.422 4.801 1.93%
MLMG::mgVcycle() 65 4.419 4.478 4.505 1.81%
Castro::construct_old_gravity() 9 0.7389 2.119 4.327 1.74%
Gravity::get_old_grav_vector() 9 0.7361 2.114 4.327 1.74%
Amr::InitializeInit() 1 3.661 4.033 4.2 1.69%
Amr::defBaseLevel() 1 3.661 4.032 4.2 1.69%
Castro::finalize_do_advance() 9 1.323 2.238 3.835 1.54%
FabArray::sum() 4205 3.335 3.686 3.819 1.54%
Castro::computeNewDt() 8 2.156 2.742 3.815 1.54%
Castro::problem_post_timestep() 10 2.645 3.092 3.74 1.51%
MLCellLinOp::smooth() 688 3.349 3.419 3.48 1.40%
Castro::post_init() 1 2.48 2.611 2.945 1.19%
Castro::FluxRegCrseInit 9 1.923 2.229 2.825 1.14%
Castro::initData() 1 2.256 2.609 2.823 1.14%
FabArray::ParallelCopy_nowait() 830 2.137 2.349 2.77 1.12%
MLPoisson::Fsmooth() 1376 2.144 2.373 2.465 0.99%
Castro::wd_update() 6 1.147 1.596 2.244 0.90%
MLMG::mgVcycle_down::0 31 2.037 2.081 2.123 0.86%
Castro::construct_new_source() 63 1.876 2.023 2.123 0.86%
MLCellLinOp::applyBC() 1750 1.242 1.427 1.825 0.74%
FillPatchIterator::FillFromTwoLevels() 31 1.499 1.547 1.612 0.65%
FillPatchTwoLevels 31 1.499 1.547 1.612 0.65%
Amr::bldFineLevels() 1 1.304 1.477 1.55 0.62%
MLMG::mgVcycle_up::0 31 1.413 1.433 1.457 0.59%
FabArray::FillBoundary() 1561 0.8102 0.9919 1.451 0.58%
Castro::Castro() 5 1.337 1.387 1.422 0.57%
FillPatchInterp(MF) 30 1.234 1.332 1.415 0.57%
MLCellLinOp::apply() 326 1.3 1.321 1.353 0.54%
Amr::InitAmr() 1 1.213 1.213 1.213 0.49%
amrex::Add() 143 1.098 1.154 1.197 0.48%
Amr::writePlotFile() 2 1.167 1.168 1.168 0.47%
Castro::initMFs() 5 1.104 1.144 1.167 0.47%
Castro::construct_old_gravity_source() 18 0.9264 1.021 1.112 0.45%
Castro::construct_old_source() 63 0.9544 1.035 1.1 0.44%
MLCellLinOp::solutionResidual() 72 1.035 1.05 1.058 0.43%
MLPoisson::Fapply() 326 0.9064 1.005 1.051 0.42%
Castro::computeInitialDt() 2 0.5018 0.6692 1.041 0.42%
FillBoundary_finish() 1561 0.4032 0.5863 0.9701 0.39%
Castro::construct_new_gravity_source() 9 0.8272 0.8692 0.9229 0.37%
Gravity::get_new_grav_vector() 10 0.7982 0.8109 0.8385 0.34%
MLCellLinOp::correctionResidual() 196 0.8075 0.818 0.824 0.33%
FabArray::Saxpy() 125 0.7275 0.7887 0.8185 0.33%
VisMF::Write(FabArray) 3 0.6344 0.7081 0.7889 0.32%
Castro::volInBoundary() 42 0.6456 0.7052 0.7881 0.32%
MLMG:computeResOfCorrection() 155 0.6583 0.6898 0.7078 0.29%
StateDataPhysBCFunct::() 95 0.6334 0.6451 0.6748 0.27%
StateData::FillBoundary(geom) 50 0.613 0.6346 0.672 0.27%
MLMG::computeResWithCrseSolFineCor() 17 0.4649 0.4968 0.5801 0.23%
Gravity::update_max_rhs() 10 0.08342 0.2211 0.5556 0.22%
MLMG::computeMLResidual() 15 0.4445 0.4686 0.5018 0.20%
MultiFab::max() 18 0.02049 0.1602 0.4967 0.20%
Castro::init() 1 0.4827 0.4863 0.4894 0.20%
AmrLevel::FillCoarsePatch() 5 0.4827 0.4863 0.4893 0.20%
FillBoundary_nowait() 1561 0.3362 0.4009 0.4764 0.19%
Castro::check_for_nan() 18 0.3947 0.4317 0.4445 0.18%
MultiFab::contains_nan() 18 0.3946 0.4315 0.4444 0.18%
Gravity::test_composite_phi() 1 0.4012 0.4017 0.4028 0.16%
FabArray::Xpay() 291 0.3447 0.3831 0.3998 0.16%
MLMG::mgVcycle_down::1 31 0.3054 0.3415 0.3953 0.16%
Castro::init(old) 3 0.3643 0.3789 0.3899 0.16%
MLCellLinOp::reflux() 30 0.1869 0.2337 0.3675 0.15%
MLMG::computeResidual() 31 0.349 0.3579 0.3635 0.15%
Castro::apply_source_to_state() 18 0.2926 0.3176 0.3295 0.13%
MLPoisson::define() 11 0.2932 0.302 0.3119 0.13%
Castro::react_state() 18 0.2602 0.2743 0.2821 0.11%
amrex::average_down 233 0.2531 0.27 0.281 0.11%
FabArray::setDomainBndry() 92 0.2198 0.2384 0.2717 0.11%
MLMG::prepareForSolve() 10 0.2057 0.2237 0.2382 0.10%
MLMG::mgVcycle_up::1 31 0.2134 0.218 0.2214 0.09%
MLCellLinOp::defineAuxData() 11 0.1847 0.1999 0.2138 0.09%
Amr::grid_places() 6 0.1979 0.1981 0.1982 0.08%
AmrMesh::MakeNewGrids() 6 0.1975 0.1976 0.1978 0.08%
Castro::fill_hybrid_hydro_source() 27 0.1728 0.1893 0.1974 0.08%
MLMG::addInterpCorrection() 155 0.1278 0.168 0.1874 0.08%
MLMG::mgVcycle_bottom 65 0.1525 0.1611 0.1856 0.07%
MLMG::getGradSolution() 10 0.1744 0.1757 0.1773 0.07%
MLCellLinOp::compGrad() 18 0.1743 0.1756 0.1772 0.07%
MLPoisson::FFlux() 150 0.0047 0.0426 0.1561 0.06%
MLMG::miniCycle() 34 0.1526 0.1529 0.1536 0.06%
MLCellLinOp::updateSolBC() 25 0.07933 0.1135 0.1443 0.06%
Castro::avgDown() 4 0.1181 0.1249 0.1366 0.06%
Castro::avgDown(state_indx) 20 0.1181 0.1248 0.1366 0.05%
amrex::average_down_w_geom 20 0.118 0.1248 0.1365 0.05%
Castro::construct_new_hybrid_source() 9 0.1148 0.1264 0.1321 0.05%
FabArray::mult() 56 0.113 0.126 0.1312 0.05%
AmrLevel::AmrLevel(dm) 5 0.1139 0.1239 0.1303 0.05%
StateData::define() 25 0.1137 0.1237 0.1301 0.05%
Castro::errorEst() 6 0.1072 0.1198 0.1253 0.05%
Castro::swap_state_time_levels() 9 0.1038 0.112 0.1183 0.05%
MLMG::ResNormInf() 54 0.07425 0.09152 0.1111 0.04%
MLCellLinOp::defineBC() 11 0.08845 0.09028 0.09416 0.04%
MLMG::computeResWithCrseCorFineCor() 17 0.08846 0.08886 0.08912 0.04%
MLMG::mgVcycle_up::3 31 0.02555 0.06887 0.08423 0.03%
MLMG::mgVcycle_down::2 31 0.06736 0.0717 0.07968 0.03%
MLMG::MLResNormInf() 15 0.04454 0.06755 0.0757 0.03%
BndryData::define() 27 0.06082 0.06242 0.06603 0.03%
Castro::construct_old_hybrid_source() 9 0.05812 0.06294 0.06535 0.03%
FabArray::norminf(mask) 21 0.05498 0.06115 0.06362 0.03%
MLMG::interpCorrection_1 17 0.02741 0.04398 0.06194 0.02%
Castro::apply_tagging_restrictions() 6 0.04892 0.05464 0.05707 0.02%
MLMG::mgVcycle_up::2 31 0.05151 0.05277 0.05402 0.02%
MLCellLinOp::updateCorBC() 17 0.05228 0.05259 0.05295 0.02%
Castro::derive() 6 0.0429 0.04804 0.05027 0.02%
AmrLevel::derive() 6 0.04288 0.04802 0.05025 0.02%
Castro::buildMetrics() 5 0.03914 0.04203 0.04676 0.02%
FabArray::norminf() 117 0.03698 0.03918 0.04127 0.02%
Gravity::swapTimeLevels() 9 0.03559 0.03875 0.04105 0.02%
MultiFab::Multiply() 8 0.03403 0.03786 0.03975 0.02%
MLMG::mgVcycle_down::3 31 0.03133 0.03253 0.03487 0.01%
MLMG::actualBottomSolve() 31 4.047e-05 0.008283 0.03301 0.01%
MLCGSolver::bicgstab 7 0 0.008059 0.03224 0.01%
FabArrayBase::getCPC() 1440 0.02425 0.02718 0.03198 0.01%
TagBoxArray::mapPRD 6 0.006773 0.01713 0.03184 0.01%
FabArray::setVal(val, thecmd, scomp, ncomp) 622 0.01938 0.02315 0.02945 0.01%
Castro::FluxRegFineAdd() 9 0.02599 0.02791 0.0291 0.01%
MLMG::MLRhsNormInf() 10 0.02502 0.02782 0.02899 0.01%
Castro::build_fine_mask() 44 0.01866 0.0214 0.0249 0.01%
Gravity::average_fine_ec_onto_crse_ec() 8 0.01535 0.01746 0.02228 0.01%
MLLinOp::define() 11 0.003886 0.0117 0.02111 0.01%
MLLinOp::defineGrids() 11 0.003809 0.01163 0.02103 0.01%
MLMG::compResidual() 1 0.01812 0.01951 0.02003 0.01%
FabArrayBase::CPC::define() 416 0.01398 0.01612 0.01994 0.01%
MLMG::mgVcycle_down::4 31 0.005456 0.009132 0.01891 0.01%
MLLinOp::makeSubCommunicator() 11 0.001942 0.009681 0.01883 0.01%
Castro::linear_to_hybrid_momentum() 1 0.01387 0.01558 0.01667 0.01%
FabArrayBase::TheFPinfo() 25 0.00358 0.008244 0.01438 0.01%
MLMG::mgVcycle_up::4 31 0.004469 0.007126 0.0143 0.01%
FPinfo::FPinfo() 3 0.003378 0.008054 0.01418 0.01%
DistributionMapping::KnapSackDoIt() 3 0.003248 0.007924 0.01406 0.01%
DistributionMapping::LeastUsedCPUs() 5 0.003187 0.007865 0.01401 0.01%
MLPoisson::prepareForSolve() 11 0.01157 0.01187 0.01226 0.00%
MLCellLinOp::prepareForSolve() 11 0.01152 0.01182 0.01221 0.00%
average_down_faces 48 0.009345 0.0102 0.01092 0.00%
Castro::enforce_consistent_e() 1 0.009171 0.0102 0.0106 0.00%
AMRErrorTag::operator() 6 0.008902 0.009914 0.01046 0.00%
Castro::apply_problem_tags() 6 0.006356 0.00705 0.007336 0.00%
FabArrayBase::getFB() 1561 0.005885 0.006501 0.007112 0.00%
MLCellLinOp::setLevelBC() 19 0.004072 0.004841 0.005664 0.00%
FabArrayBase::FB::FB() 19 0.002685 0.003104 0.003499 0.00%
amrex::Dot() 115 0 0.0008508 0.003403 0.00%
MLCGSolver::ParallelAllReduce 153 0 0.0007455 0.002982 0.00%
FabArray::LinComb() 57 0 0.0004728 0.001891 0.00%
TagBoxArray::collate() 6 0.0004154 0.001011 0.001319 0.00%
OwnerMask() 6 0.0007793 0.0008722 0.0009342 0.00%
Castro::finalize_advance() 9 0.0004013 0.0004953 0.0006016 0.00%
MLLinOp::makeAgglomeratedDMap 11 0.000402 0.0004294 0.0004636 0.00%
makeSFC 33 0.0002845 0.0003055 0.0003309 0.00%
Castro::enforce_speed_limit() 87 0.0002534 0.0002777 0.000304 0.00%
AmrMesh-cluster 1 0 4.108e-05 0.0001643 0.00%
DistributionMapping::Distribute() 35 0.000115 0.0001214 0.0001272 0.00%
FabArray::RecvLayoutMask() 8 9.643e-05 0.0001051 0.0001258 0.00%
Amr::writeSmallPlotFile() 1 9.979e-05 0.0001094 0.0001254 0.00%
DistributionMapping::SFCProcessorMapDoIt() 2 0.0001125 0.0001158 0.0001227 0.00%
ClusterList::intersect() 1 0 2.494e-05 9.977e-05 0.00%
knapsack() 3 7.419e-05 7.657e-05 8.27e-05 0.00%
Castro::create_source_corrector() 9 5.774e-05 6.593e-05 7.498e-05 0.00%
BoxList::parallelComplementIn() 12 5.295e-05 5.545e-05 5.762e-05 0.00%
Amr::initSubcycle() 1 5.095e-05 5.177e-05 5.22e-05 0.00%
Gravity::set_mass_offset() 6 3.964e-05 4.449e-05 4.847e-05 0.00%
Castro::retry_advance_ctu() 5 2.247e-05 2.957e-05 4.263e-05 0.00%
BoxList::complementIn 12 2.44e-05 2.626e-05 2.975e-05 0.00%
Castro::construct_old_rotation_source() 9 2.284e-05 2.553e-05 2.798e-05 0.00%
Castro::construct_new_rotation_source() 9 2.098e-05 2.333e-05 2.701e-05 0.00%
ClusterList::chop() 1 0 4.479e-06 1.792e-05 0.00%
knapsack()swap 1 3.783e-06 4.041e-06 4.241e-06 0.00%
--------------------------------------------------------------------------------------------
Unused ParmParse Variables:
[TOP]::mg.v(nvals = 1) :: [2]
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 4 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.09-6-gae65b3afc481) finalized