MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.06-25-g239d4d899334) initialized
Starting run at 05:20:19 UTC on 2023-06-22.
Successfully read inputs file ...
Castro git describe: 23.06-36-g90afb40ca
AMReX git describe: 23.06-25-g239d4d899
Microphysics git describe: 23.06-30-g70e08b65
reading extern runtime parameters ...
3 Species:
C12 O16 Mg24
Successfully read inputs file ...
grid_places() time: 0.001466692 new finest: 1
grid_places() time: 0.006799856 new finest: 2
Now regridding at level lbase = 0
grid_places() time: 0.006770636 new finest: 2
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
Now regridding at level lbase = 0
grid_places() time: 0.008431075 new finest: 2
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
INITIAL GRIDS
Level 0 16 grids 65536 cells 100 % of domain
smallest grid: 64 x 64 biggest grid: 64 x 64
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
PLOTFILE: file = dustcollapse-2d-poissonn_plt00000
Write plotfile time = 0.018008474 seconds
[Level 0 step 1] ADVANCE with dt = 1.135435554e-05
[Level 0 step 1] Advanced 65536 cells
[Level 1 step 1] ADVANCE with dt = 5.677177769e-06
[Level 1 step 1] Advanced 36800 cells
[Level 2 step 1] ADVANCE with dt = 2.838588884e-06
[Level 2 step 1] Advanced 75392 cells
[Level 2 step 2] ADVANCE with dt = 2.838588884e-06
[Level 2 step 2] Advanced 75392 cells
[Level 1 step 2] ADVANCE with dt = 5.677177769e-06
[Level 1 step 2] Advanced 36800 cells
[Level 2 step 3] ADVANCE with dt = 2.838588884e-06
[Level 2 step 3] Advanced 75392 cells
[Level 2 step 4] ADVANCE with dt = 2.838588884e-06
[Level 2 step 4] Advanced 75392 cells
[STEP 1] Coarse TimeStep time: 0.504210782
[STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452]
STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05
Now regridding at level lbase = 1
grid_places() time: 0.00052223 new finest: 2
TIME = 1.135435554e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 2] ADVANCE with dt = 1.192207331e-05
[Level 0 step 2] Advanced 65536 cells
[Level 1 step 3] ADVANCE with dt = 5.961036657e-06
[Level 1 step 3] Advanced 36800 cells
[Level 2 step 5] ADVANCE with dt = 2.980518328e-06
[Level 2 step 5] Advanced 75392 cells
[Level 2 step 6] ADVANCE with dt = 2.980518328e-06
[Level 2 step 6] Advanced 75392 cells
[Level 1 step 4] ADVANCE with dt = 5.961036657e-06
[Level 1 step 4] Advanced 36800 cells
[Level 2 step 7] ADVANCE with dt = 2.980518328e-06
[Level 2 step 7] Advanced 75392 cells
[Level 2 step 8] ADVANCE with dt = 2.980518328e-06
[Level 2 step 8] Advanced 75392 cells
[STEP 2] Coarse TimeStep time: 0.555685882
[STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05
Now regridding at level lbase = 0
grid_places() time: 0.000804702 new finest: 2
STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 3] ADVANCE with dt = 1.251817698e-05
[Level 0 step 3] Advanced 65536 cells
[Level 1 step 5] ADVANCE with dt = 6.25908849e-06
[Level 1 step 5] Advanced 36800 cells
[Level 2 step 9] ADVANCE with dt = 3.129544245e-06
[Level 2 step 9] Advanced 75392 cells
[Level 2 step 10] ADVANCE with dt = 3.129544245e-06
[Level 2 step 10] Advanced 75392 cells
[Level 1 step 6] ADVANCE with dt = 6.25908849e-06
[Level 1 step 6] Advanced 36800 cells
[Level 2 step 11] ADVANCE with dt = 3.129544245e-06
[Level 2 step 11] Advanced 75392 cells
[Level 2 step 12] ADVANCE with dt = 3.129544245e-06
[Level 2 step 12] Advanced 75392 cells
[STEP 3] Coarse TimeStep time: 0.566895644
[STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05
Now regridding at level lbase = 1
grid_places() time: 0.000554343 new finest: 2
TIME = 3.579460583e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 4] ADVANCE with dt = 1.314408583e-05
[Level 0 step 4] Advanced 65536 cells
[Level 1 step 7] ADVANCE with dt = 6.572042914e-06
[Level 1 step 7] Advanced 36800 cells
[Level 2 step 13] ADVANCE with dt = 3.286021457e-06
[Level 2 step 13] Advanced 75392 cells
[Level 2 step 14] ADVANCE with dt = 3.286021457e-06
[Level 2 step 14] Advanced 75392 cells
[Level 1 step 8] ADVANCE with dt = 6.572042914e-06
[Level 1 step 8] Advanced 36800 cells
[Level 2 step 15] ADVANCE with dt = 3.286021457e-06
[Level 2 step 15] Advanced 75392 cells
[Level 2 step 16] ADVANCE with dt = 3.286021457e-06
[Level 2 step 16] Advanced 75392 cells
[STEP 4] Coarse TimeStep time: 0.578290697
[STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05
Now regridding at level lbase = 0
grid_places() time: 0.00080435 new finest: 2
STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 5] ADVANCE with dt = 1.380129012e-05
[Level 0 step 5] Advanced 65536 cells
[Level 1 step 9] ADVANCE with dt = 6.90064506e-06
[Level 1 step 9] Advanced 36800 cells
[Level 2 step 17] ADVANCE with dt = 3.45032253e-06
[Level 2 step 17] Advanced 75392 cells
[Level 2 step 18] ADVANCE with dt = 3.45032253e-06
[Level 2 step 18] Advanced 75392 cells
[Level 1 step 10] ADVANCE with dt = 6.90064506e-06
[Level 1 step 10] Advanced 36800 cells
[Level 2 step 19] ADVANCE with dt = 3.45032253e-06
[Level 2 step 19] Advanced 75392 cells
[Level 2 step 20] ADVANCE with dt = 3.45032253e-06
[Level 2 step 20] Advanced 75392 cells
[STEP 5] Coarse TimeStep time: 0.534668565
[STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05
Now regridding at level lbase = 1
grid_places() time: 0.000532935 new finest: 2
TIME = 6.273998178e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 6] ADVANCE with dt = 1.449135463e-05
[Level 0 step 6] Advanced 65536 cells
[Level 1 step 11] ADVANCE with dt = 7.245677313e-06
[Level 1 step 11] Advanced 36800 cells
[Level 2 step 21] ADVANCE with dt = 3.622838657e-06
[Level 2 step 21] Advanced 75392 cells
[Level 2 step 22] ADVANCE with dt = 3.622838657e-06
[Level 2 step 22] Advanced 75392 cells
[Level 1 step 12] ADVANCE with dt = 7.245677313e-06
[Level 1 step 12] Advanced 36800 cells
[Level 2 step 23] ADVANCE with dt = 3.622838657e-06
[Level 2 step 23] Advanced 75392 cells
[Level 2 step 24] ADVANCE with dt = 3.622838657e-06
[Level 2 step 24] Advanced 75392 cells
[STEP 6] Coarse TimeStep time: 0.512682407
[STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05
Now regridding at level lbase = 0
grid_places() time: 0.000765885 new finest: 2
STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 7] ADVANCE with dt = 1.521592236e-05
[Level 0 step 7] Advanced 65536 cells
[Level 1 step 13] ADVANCE with dt = 7.607961179e-06
[Level 1 step 13] Advanced 36800 cells
[Level 2 step 25] ADVANCE with dt = 3.803980589e-06
[Level 2 step 25] Advanced 75392 cells
[Level 2 step 26] ADVANCE with dt = 3.803980589e-06
[Level 2 step 26] Advanced 75392 cells
[Level 1 step 14] ADVANCE with dt = 7.607961179e-06
[Level 1 step 14] Advanced 36800 cells
[Level 2 step 27] ADVANCE with dt = 3.803980589e-06
[Level 2 step 27] Advanced 75392 cells
[Level 2 step 28] ADVANCE with dt = 3.803980589e-06
[Level 2 step 28] Advanced 75392 cells
[STEP 7] Coarse TimeStep time: 0.525851362
[STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05
Now regridding at level lbase = 1
grid_places() time: 0.000512315 new finest: 2
TIME = 9.244725876e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 8] ADVANCE with dt = 1.597671848e-05
[Level 0 step 8] Advanced 65536 cells
[Level 1 step 15] ADVANCE with dt = 7.988359238e-06
[Level 1 step 15] Advanced 36800 cells
[Level 2 step 29] ADVANCE with dt = 3.994179619e-06
[Level 2 step 29] Advanced 75392 cells
[Level 2 step 30] ADVANCE with dt = 3.994179619e-06
[Level 2 step 30] Advanced 75392 cells
[Level 1 step 16] ADVANCE with dt = 7.988359238e-06
[Level 1 step 16] Advanced 36800 cells
[Level 2 step 31] ADVANCE with dt = 3.994179619e-06
[Level 2 step 31] Advanced 75392 cells
[Level 2 step 32] ADVANCE with dt = 3.994179619e-06
[Level 2 step 32] Advanced 75392 cells
[STEP 8] Coarse TimeStep time: 0.524223317
[STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05
Now regridding at level lbase = 0
grid_places() time: 0.00076897 new finest: 2
STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 9] ADVANCE with dt = 1.67755544e-05
[Level 0 step 9] Advanced 65536 cells
[Level 1 step 17] ADVANCE with dt = 8.387777199e-06
[Level 1 step 17] Advanced 36800 cells
[Level 2 step 33] ADVANCE with dt = 4.1938886e-06
[Level 2 step 33] Advanced 75392 cells
[Level 2 step 34] ADVANCE with dt = 4.1938886e-06
[Level 2 step 34] Advanced 75392 cells
[Level 1 step 18] ADVANCE with dt = 8.387777199e-06
[Level 1 step 18] Advanced 36800 cells
[Level 2 step 35] ADVANCE with dt = 4.1938886e-06
[Level 2 step 35] Advanced 75392 cells
[Level 2 step 36] ADVANCE with dt = 4.1938886e-06
[Level 2 step 36] Advanced 75392 cells
[STEP 9] Coarse TimeStep time: 0.515320902
[STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05
Now regridding at level lbase = 1
grid_places() time: 0.000512446 new finest: 2
TIME = 0.0001251995316 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 10] ADVANCE with dt = 1.761433212e-05
[Level 0 step 10] Advanced 65536 cells
[Level 1 step 19] ADVANCE with dt = 8.807166059e-06
[Level 1 step 19] Advanced 36800 cells
[Level 2 step 37] ADVANCE with dt = 4.40358303e-06
[Level 2 step 37] Advanced 75392 cells
[Level 2 step 38] ADVANCE with dt = 4.40358303e-06
[Level 2 step 38] Advanced 75392 cells
[Level 1 step 20] ADVANCE with dt = 8.807166059e-06
[Level 1 step 20] Advanced 36800 cells
[Level 2 step 39] ADVANCE with dt = 4.40358303e-06
[Level 2 step 39] Advanced 75392 cells
[Level 2 step 40] ADVANCE with dt = 4.40358303e-06
[Level 2 step 40] Advanced 75392 cells
[STEP 10] Coarse TimeStep time: 0.523942242
[STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05
Now regridding at level lbase = 0
grid_places() time: 0.000765725 new finest: 2
STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 11] ADVANCE with dt = 1.849504872e-05
[Level 0 step 11] Advanced 65536 cells
[Level 1 step 21] ADVANCE with dt = 9.247524362e-06
[Level 1 step 21] Advanced 36800 cells
[Level 2 step 41] ADVANCE with dt = 4.623762181e-06
[Level 2 step 41] Advanced 75392 cells
[Level 2 step 42] ADVANCE with dt = 4.623762181e-06
[Level 2 step 42] Advanced 75392 cells
[Level 1 step 22] ADVANCE with dt = 9.247524362e-06
[Level 1 step 22] Advanced 36800 cells
[Level 2 step 43] ADVANCE with dt = 4.623762181e-06
[Level 2 step 43] Advanced 75392 cells
[Level 2 step 44] ADVANCE with dt = 4.623762181e-06
[Level 2 step 44] Advanced 75392 cells
[STEP 11] Coarse TimeStep time: 0.534233547
[STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05
Now regridding at level lbase = 1
grid_places() time: 0.000525603 new finest: 2
TIME = 0.0001613089125 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 12] ADVANCE with dt = 1.941980116e-05
[Level 0 step 12] Advanced 65536 cells
[Level 1 step 23] ADVANCE with dt = 9.709900581e-06
[Level 1 step 23] Advanced 36800 cells
[Level 2 step 45] ADVANCE with dt = 4.85495029e-06
[Level 2 step 45] Advanced 75392 cells
[Level 2 step 46] ADVANCE with dt = 4.85495029e-06
[Level 2 step 46] Advanced 75392 cells
[Level 1 step 24] ADVANCE with dt = 9.709900581e-06
[Level 1 step 24] Advanced 36800 cells
[Level 2 step 47] ADVANCE with dt = 4.85495029e-06
[Level 2 step 47] Advanced 75392 cells
[Level 2 step 48] ADVANCE with dt = 4.85495029e-06
[Level 2 step 48] Advanced 75392 cells
[STEP 12] Coarse TimeStep time: 0.558675108
[STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05
Now regridding at level lbase = 0
grid_places() time: 0.000766309 new finest: 2
STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 13] ADVANCE with dt = 2.039079122e-05
[Level 0 step 13] Advanced 65536 cells
[Level 1 step 25] ADVANCE with dt = 1.019539561e-05
[Level 1 step 25] Advanced 36800 cells
[Level 2 step 49] ADVANCE with dt = 5.097697805e-06
[Level 2 step 49] Advanced 75392 cells
[Level 2 step 50] ADVANCE with dt = 5.097697805e-06
[Level 2 step 50] Advanced 75392 cells
[Level 1 step 26] ADVANCE with dt = 1.019539561e-05
[Level 1 step 26] Advanced 36800 cells
[Level 2 step 51] ADVANCE with dt = 5.097697805e-06
[Level 2 step 51] Advanced 75392 cells
[Level 2 step 52] ADVANCE with dt = 5.097697805e-06
[Level 2 step 52] Advanced 75392 cells
[STEP 13] Coarse TimeStep time: 0.517015698
[STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05
Now regridding at level lbase = 1
grid_places() time: 0.000526891 new finest: 2
TIME = 0.0002011195049 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 14] ADVANCE with dt = 2.141033078e-05
[Level 0 step 14] Advanced 65536 cells
[Level 1 step 27] ADVANCE with dt = 1.070516539e-05
[Level 1 step 27] Advanced 36800 cells
[Level 2 step 53] ADVANCE with dt = 5.352582695e-06
[Level 2 step 53] Advanced 75392 cells
[Level 2 step 54] ADVANCE with dt = 5.352582695e-06
[Level 2 step 54] Advanced 75392 cells
[Level 1 step 28] ADVANCE with dt = 1.070516539e-05
[Level 1 step 28] Advanced 36800 cells
[Level 2 step 55] ADVANCE with dt = 5.352582695e-06
[Level 2 step 55] Advanced 75392 cells
[Level 2 step 56] ADVANCE with dt = 5.352582695e-06
[Level 2 step 56] Advanced 75392 cells
[STEP 14] Coarse TimeStep time: 0.512193651
[STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05
Now regridding at level lbase = 0
grid_places() time: 0.00078592 new finest: 2
STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 15] ADVANCE with dt = 2.248084732e-05
[Level 0 step 15] Advanced 65536 cells
[Level 1 step 29] ADVANCE with dt = 1.124042366e-05
[Level 1 step 29] Advanced 36800 cells
[Level 2 step 57] ADVANCE with dt = 5.62021183e-06
[Level 2 step 57] Advanced 75392 cells
[Level 2 step 58] ADVANCE with dt = 5.62021183e-06
[Level 2 step 58] Advanced 75392 cells
[Level 1 step 30] ADVANCE with dt = 1.124042366e-05
[Level 1 step 30] Advanced 36800 cells
[Level 2 step 59] ADVANCE with dt = 5.62021183e-06
[Level 2 step 59] Advanced 75392 cells
[Level 2 step 60] ADVANCE with dt = 5.62021183e-06
[Level 2 step 60] Advanced 75392 cells
[STEP 15] Coarse TimeStep time: 0.534899741
[STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05
Now regridding at level lbase = 1
grid_places() time: 0.000535758 new finest: 2
TIME = 0.000245010683 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 16] ADVANCE with dt = 2.360488969e-05
[Level 0 step 16] Advanced 65536 cells
[Level 1 step 31] ADVANCE with dt = 1.180244484e-05
[Level 1 step 31] Advanced 36800 cells
[Level 2 step 61] ADVANCE with dt = 5.901222421e-06
[Level 2 step 61] Advanced 75392 cells
[Level 2 step 62] ADVANCE with dt = 5.901222421e-06
[Level 2 step 62] Advanced 75392 cells
[Level 1 step 32] ADVANCE with dt = 1.180244484e-05
[Level 1 step 32] Advanced 36800 cells
[Level 2 step 63] ADVANCE with dt = 5.901222421e-06
[Level 2 step 63] Advanced 75392 cells
[Level 2 step 64] ADVANCE with dt = 5.901222421e-06
[Level 2 step 64] Advanced 75392 cells
[STEP 16] Coarse TimeStep time: 0.512503684
[STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05
Now regridding at level lbase = 0
grid_places() time: 0.000770061 new finest: 2
STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 17] ADVANCE with dt = 2.478513417e-05
[Level 0 step 17] Advanced 65536 cells
[Level 1 step 33] ADVANCE with dt = 1.239256708e-05
[Level 1 step 33] Advanced 36800 cells
[Level 2 step 65] ADVANCE with dt = 6.196283542e-06
[Level 2 step 65] Advanced 75392 cells
[Level 2 step 66] ADVANCE with dt = 6.196283542e-06
[Level 2 step 66] Advanced 75392 cells
[Level 1 step 34] ADVANCE with dt = 1.239256708e-05
[Level 1 step 34] Advanced 36800 cells
[Level 2 step 67] ADVANCE with dt = 6.196283542e-06
[Level 2 step 67] Advanced 75392 cells
[Level 2 step 68] ADVANCE with dt = 6.196283542e-06
[Level 2 step 68] Advanced 75392 cells
[STEP 17] Coarse TimeStep time: 0.518183012
[STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05
Now regridding at level lbase = 1
grid_places() time: 0.00053394 new finest: 2
TIME = 0.0002934007068 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 18] ADVANCE with dt = 2.602439088e-05
[Level 0 step 18] Advanced 65536 cells
[Level 1 step 35] ADVANCE with dt = 1.301219544e-05
[Level 1 step 35] Advanced 36800 cells
[Level 2 step 69] ADVANCE with dt = 6.506097719e-06
[Level 2 step 69] Advanced 75392 cells
[Level 2 step 70] ADVANCE with dt = 6.506097719e-06
[Level 2 step 70] Advanced 75392 cells
[Level 1 step 36] ADVANCE with dt = 1.301219544e-05
[Level 1 step 36] Advanced 36800 cells
[Level 2 step 71] ADVANCE with dt = 6.506097719e-06
[Level 2 step 71] Advanced 75392 cells
[Level 2 step 72] ADVANCE with dt = 6.506097719e-06
[Level 2 step 72] Advanced 75392 cells
[STEP 18] Coarse TimeStep time: 0.5082459
[STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05
Now regridding at level lbase = 0
grid_places() time: 0.000747368 new finest: 2
STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 19] ADVANCE with dt = 2.732561042e-05
[Level 0 step 19] Advanced 65536 cells
[Level 1 step 37] ADVANCE with dt = 1.366280521e-05
[Level 1 step 37] Advanced 36800 cells
[Level 2 step 73] ADVANCE with dt = 6.831402605e-06
[Level 2 step 73] Advanced 75392 cells
[Level 2 step 74] ADVANCE with dt = 6.831402605e-06
[Level 2 step 74] Advanced 75392 cells
[Level 1 step 38] ADVANCE with dt = 1.366280521e-05
[Level 1 step 38] Advanced 36800 cells
[Level 2 step 75] ADVANCE with dt = 6.831402605e-06
[Level 2 step 75] Advanced 75392 cells
[Level 2 step 76] ADVANCE with dt = 6.831402605e-06
[Level 2 step 76] Advanced 75392 cells
[STEP 19] Coarse TimeStep time: 0.513526879
[STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05
Now regridding at level lbase = 1
grid_places() time: 0.00051833 new finest: 2
TIME = 0.0003467507081 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 20] ADVANCE with dt = 2.869189094e-05
[Level 0 step 20] Advanced 65536 cells
[Level 1 step 39] ADVANCE with dt = 1.434594547e-05
[Level 1 step 39] Advanced 36800 cells
[Level 2 step 77] ADVANCE with dt = 7.172972736e-06
[Level 2 step 77] Advanced 75392 cells
[Level 2 step 78] ADVANCE with dt = 7.172972736e-06
[Level 2 step 78] Advanced 75392 cells
[Level 1 step 40] ADVANCE with dt = 1.434594547e-05
[Level 1 step 40] Advanced 36800 cells
[Level 2 step 79] ADVANCE with dt = 7.172972736e-06
[Level 2 step 79] Advanced 75392 cells
[Level 2 step 80] ADVANCE with dt = 7.172972736e-06
[Level 2 step 80] Advanced 75392 cells
[STEP 20] Coarse TimeStep time: 0.512580565
[STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05
PLOTFILE: file = dustcollapse-2d-poissonn_plt00020
Write plotfile time = 0.017336021 seconds
Ending run at 05:20:30 UTC on 2023-06-22.
Run time = 10.76975122
Run time without initialization = 10.58458806
Average number of zones advanced per microsecond: 0.833
Average number of zones advanced per microsecond per rank: 0.104
TinyProfiler total time across processes [min...avg...max]: 10.77 ... 10.77 ... 10.77
--------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
--------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 140 1.9515 2.3417 2.5931 24.08%
MLCGSolver::ParallelAllReduce 243542 0.8899 1.123 1.402 13.02%
MLPoisson::Fsmooth() 54976 0.8543 0.9439 1.047 9.72%
check_for_negative_density() 140 0.3019 0.561 0.953 8.85%
FillBoundary_finish() 157859 0.4494 0.6193 0.8133 7.55%
FillBoundary_nowait() 157859 0.5654 0.6678 0.7598 7.05%
FabArray::ParallelCopy_finish() 21259 0.3106 0.4607 0.631 5.86%
MLCellLinOp::applyBC() 165252 0.2265 0.3216 0.4241 3.94%
MLPoisson::Fapply() 108875 0.2508 0.2817 0.3083 2.86%
FabArray::setVal() 27514 0.1427 0.1789 0.2163 2.01%
FabArray::ParallelCopy_nowait() 21259 0.1623 0.1887 0.2107 1.96%
amrex::Dot() 193316 0.1647 0.1899 0.2084 1.94%
Castro::estTimeStep() 308 0.1083 0.1545 0.189 1.75%
Castro::reset_internal_energy(Fab) 5919 0.1456 0.1681 0.1828 1.70%
amrex::Copy() 106562 0.1378 0.158 0.1794 1.67%
FabArray::Saxpy() 145223 0.1332 0.157 0.1758 1.63%
Castro::normalize_species() 1182 0.1258 0.1421 0.155 1.44%
MLCGSolver::bicgstab 1420 0.1245 0.1304 0.1372 1.27%
FabArray::norminf() 100641 0.1079 0.121 0.1334 1.24%
MLPoisson::normalize() 98078 0.09924 0.111 0.1211 1.12%
Castro::construct_new_gravity_source() 260 0.07294 0.08317 0.0902 0.84%
amrex::average_down 8093 0.07391 0.08261 0.08988 0.83%
FabArray::LinComb() 96778 0.05596 0.06954 0.08193 0.76%
Castro::computeTemp() 1189 0.0637 0.07206 0.07992 0.74%
MLMG::ResNormInf() 2383 0.02196 0.05138 0.07964 0.74%
FabArray::Xpay() 59602 0.05025 0.05974 0.06742 0.63%
FillPatchInterp(MF) 728 0.06549 0.06645 0.0673 0.62%
Castro::initData() 7 0.04339 0.05044 0.05991 0.56%
FillPatchIterator::Initialize 889 0.0472 0.05058 0.05595 0.52%
MLMG::addInterpCorrection() 6101 0.04569 0.04888 0.05459 0.51%
FabArray::FillBoundary() 157859 0.05111 0.05258 0.05406 0.50%
amrex::Add() 7701 0.03829 0.0453 0.05192 0.48%
MLCellLinOp::defineAuxData() 360 0.03702 0.0419 0.05041 0.47%
MLMG::prepareForSolve() 360 0.03422 0.03793 0.04457 0.41%
FillPatchSingleLevel 1617 0.03224 0.03925 0.04286 0.40%
FabArrayBase::CPC::define() 4099 0.03054 0.03588 0.04063 0.38%
MLCellLinOp::apply() 108875 0.03773 0.03846 0.04034 0.37%
amrex::average_down_w_geom 248 0.02957 0.03448 0.03979 0.37%
Castro::reflux() 60 0.02459 0.03025 0.03499 0.32%
Gravity::actual_solve_with_mlmg() 360 0.02263 0.02721 0.03483 0.32%
FluxRegister::Reflux() 960 0.0238 0.02915 0.03304 0.31%
MLMG::solve() 360 0.008691 0.01979 0.02986 0.28%
VisMF::Write(FabArray) 6 0.008348 0.01176 0.02971 0.28%
Castro::initialize_do_advance() 140 0.02267 0.02737 0.02956 0.27%
FillPatchTwoLevels 756 0.02622 0.02774 0.02906 0.27%
Castro::initMFs() 35 0.02163 0.02486 0.02904 0.27%
Gravity::fill_multipole_BCs() 70 0.02562 0.02675 0.02809 0.26%
FabArrayBase::getCPC() 29651 0.02601 0.027 0.02788 0.26%
Amr::writePlotFile() 2 0.006037 0.02407 0.02756 0.26%
FabArrayBase::getFB() 157859 0.02612 0.02673 0.02737 0.25%
MLCellLinOp::reflux() 951 0.01955 0.02245 0.02599 0.24%
MLCellLinOp::updateSolBC() 871 0.01182 0.01706 0.02458 0.23%
Castro::enforce_min_density() 1182 0.01856 0.0209 0.02343 0.22%
MultiFab::contains_nan() 280 0.01704 0.02035 0.02294 0.21%
Castro::construct_new_source() 1300 0.02047 0.02119 0.0226 0.21%
MLCellLinOp::updateCorBC() 771 0.01067 0.01531 0.02209 0.21%
MLMG::interpCorrection_1 771 0.01512 0.01788 0.02117 0.20%
Amr::coarseTimeStep() 20 0.002219 0.005009 0.02097 0.19%
BndryData::define() 540 0.01204 0.0154 0.02076 0.19%
Castro::FluxRegCrseInit 140 0.01386 0.0167 0.01913 0.18%
MLCellLinOp::smooth() 27488 0.01679 0.01709 0.01774 0.16%
Gravity::get_new_grav_vector() 263 0.01065 0.01227 0.01524 0.14%
StateData::define() 140 0.01046 0.01155 0.01357 0.13%
Castro::construct_old_source() 700 0.01054 0.01168 0.01351 0.13%
Castro::initialize_advance() 140 0.009359 0.01111 0.01337 0.12%
MLPoisson::FFlux() 7882 0.006856 0.01081 0.01312 0.12%
Castro::FluxRegFineAdd() 140 0.005757 0.007961 0.01255 0.12%
MLCellLinOp::setLevelBC() 450 0.00749 0.009537 0.01233 0.11%
Castro::swap_state_time_levels() 140 0.00625 0.008242 0.01196 0.11%
MLCellLinOp::defineBC() 360 0.007773 0.009048 0.01114 0.10%
FPinfo::FPinfo() 7 0.001444 0.006097 0.0106 0.10%
MLCellLinOp::compGrad() 450 0.00801 0.009153 0.01051 0.10%
Castro::construct_old_gravity_source() 140 0.007944 0.009476 0.01016 0.09%
FabArray::ParallelCopy() 21259 0.008693 0.008983 0.009422 0.09%
Gravity::get_old_grav_vector() 140 0.005371 0.006325 0.009025 0.08%
FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003798 0.006676 0.009017 0.08%
Castro::buildMetrics() 35 0.005666 0.006301 0.008585 0.08%
MultiFab::max() 90 0.004187 0.005789 0.00784 0.07%
DistributionMapping::LeastUsedCPUs() 12 0.0002347 0.004366 0.007623 0.07%
Gravity::applyMetricTerms() 90 0.005768 0.006238 0.006695 0.06%
Amr::timeStep() 140 0.002614 0.00382 0.006504 0.06%
FabArray::mult() 1063 0.004289 0.005206 0.006249 0.06%
StateData::FillBoundary(geom) 745 0.001428 0.003755 0.006164 0.06%
Amr::regrid() 21 0.003599 0.004565 0.005938 0.06%
Gravity::solve_for_phi() 280 0.004672 0.00508 0.005774 0.05%
AmrMesh::MakeNewGrids() 23 0.00271 0.005051 0.005703 0.05%
Gravity::gravity_sync() 60 0.004209 0.004828 0.005379 0.05%
BoxList::pci 22 0.0003866 0.003065 0.005224 0.05%
MLCellLinOp::prepareForSolve() 360 0.002985 0.003858 0.005045 0.05%
MLLinOp::defineGrids() 360 0.00402 0.004347 0.004996 0.05%
FabArray::norminf(mask) 270 0.003287 0.004002 0.004711 0.04%
FabArray::setDomainBndry() 1617 0.003624 0.003914 0.004541 0.04%
Castro::Castro() 35 0.00367 0.004119 0.004389 0.04%
MLCellLinOp::correctionResidual() 9063 0.004042 0.004204 0.004342 0.04%
MLMG::mgVcycle() 3385 0.004023 0.004104 0.004297 0.04%
average_down_faces 360 0.002328 0.0027 0.003338 0.03%
MultiFab::Subtract() 420 0.001935 0.002471 0.003079 0.03%
MLMG::actualBottomSolve() 1843 0.002248 0.002389 0.002955 0.03%
Gravity::update_max_rhs() 30 0.002483 0.002616 0.002786 0.03%
Gravity::GetCrsePhi() 250 0.002034 0.002277 0.002744 0.03%
Castro::construct_old_gravity() 140 0.002024 0.002199 0.00263 0.02%
Castro::reset_internal_energy(MultiFab) 1189 0.001613 0.001988 0.002463 0.02%
MLMG::MLResNormInf() 440 0.000669 0.001366 0.002462 0.02%
MLMG::oneIter() 1843 0.002308 0.002384 0.002445 0.02%
MLLinOp::makeSubCommunicator() 70 0.001362 0.001665 0.002315 0.02%
MLMG:computeResOfCorrection() 6101 0.002099 0.002199 0.002259 0.02%
Gravity::create_comp_minus_level_grad_phi() 60 0.001573 0.00182 0.002076 0.02%
MLMG::mgVcycle_bottom 3385 0.001858 0.001898 0.001935 0.02%
Gravity::average_fine_ec_onto_crse_ec() 90 0.001471 0.001672 0.001896 0.02%
MLMG::mgVcycle_down::0 1843 0.001655 0.001717 0.001784 0.02%
MLCellLinOp::solutionResidual() 3154 0.001658 0.001712 0.001749 0.02%
Castro::finalize_advance() 140 0.001249 0.0014 0.00172 0.02%
Castro::apply_tagging_restrictions() 34 0.001113 0.001364 0.001644 0.02%
TagBoxArray::collate() 34 0.0006789 0.0009934 0.001629 0.02%
Gravity::multilevel_solve_for_new_phi() 20 0.001181 0.001408 0.001605 0.01%
Gravity::solve_phi_with_mlmg() 300 0.0009386 0.001197 0.001587 0.01%
StateDataPhysBCFunct::() 1617 0.001376 0.001444 0.001551 0.01%
Castro::clean_state() 1182 0.00136 0.00143 0.001479 0.01%
AMRErrorTag::operator() 34 0.0009875 0.001219 0.001462 0.01%
MLMG::mgVcycle_down::1 1843 0.001381 0.001416 0.001458 0.01%
MLMG::mgVcycle_up::1 1843 0.001285 0.001366 0.001457 0.01%
ClusterList::chop() 4 0 0.0001783 0.001426 0.01%
Castro::expand_state() 200 0.001036 0.0011 0.001204 0.01%
MLMG::mgVcycle_up::0 1843 0.001107 0.001135 0.001183 0.01%
FabArrayBase::TheFPinfo() 728 0.000835 0.0009231 0.001111 0.01%
Castro::do_old_sources() 140 0.000889 0.0009362 0.001049 0.01%
MLMG::computeResWithCrseSolFineCor() 771 0.00094 0.0009718 0.001014 0.01%
Castro::do_advance_ctu() 140 0.0007572 0.00086 0.0009979 0.01%
Castro::construct_new_gravity() 140 0.0008232 0.0008579 0.0009336 0.01%
MLMG::computeResidual() 1843 0.0008246 0.0008578 0.0009144 0.01%
MLPoisson::define() 360 0.0006804 0.0007832 0.0008908 0.01%
main() 1 0.000715 0.0007596 0.000848 0.01%
Castro::finalize_do_advance() 140 0.0005789 0.0006551 0.0008083 0.01%
FabArrayBase::FB::FB() 299 0.0001859 0.0004154 0.0007081 0.01%
Castro::do_new_sources() 260 0.0006211 0.000654 0.0006836 0.01%
Castro::build_fine_mask() 40 0.0005804 0.0006113 0.0006453 0.01%
Castro::derive() 34 0.000465 0.0005087 0.000591 0.01%
MLMG::miniCycle() 1542 0.0005106 0.0005268 0.0005647 0.01%
Gravity::actual_multilevel_solve() 20 0.0004278 0.0005163 0.0005642 0.01%
Amr::grid_places() 23 0.0003063 0.0003605 0.0005606 0.01%
ClusterList::intersect() 4 0 6.946e-05 0.0005557 0.01%
Castro::apply_source_to_state() 520 0.000475 0.0005146 0.0005473 0.01%
MLLinOp::define() 360 0.0003952 0.0004453 0.0005357 0.00%
MLMG::computeResWithCrseCorFineCor() 771 0.0004783 0.0005064 0.0005327 0.00%
MLMG::computeMLResidual() 440 0.000439 0.0004611 0.0005091 0.00%
Castro::subcycle_advance_ctu() 140 0.0003703 0.0004357 0.0004938 0.00%
Castro::init(old) 28 0.0003228 0.0003879 0.0004673 0.00%
Castro::advance() 140 0.0003699 0.0004103 0.0004415 0.00%
Castro::enforce_speed_limit() 1182 0.000364 0.0004018 0.0004337 0.00%
MLMG::mgVcycle_down::2 483 0.0003794 0.0003947 0.0004206 0.00%
Amr::InitAmr() 1 0.0002746 0.0003014 0.0004125 0.00%
MLMG::mgVcycle_down::6 483 0.0003683 0.0003785 0.0003971 0.00%
MLMG::mgVcycle_down::3 483 0.000321 0.0003453 0.0003822 0.00%
MLMG::mgVcycle_down::4 483 0.0003073 0.0003324 0.000373 0.00%
AmrMesh-cluster 4 0 4.117e-05 0.0003293 0.00%
MLMG::mgVcycle_down::5 483 0.0002875 0.0003051 0.0003267 0.00%
MLPoisson::prepareForSolve() 360 0.0002346 0.0002604 0.0002892 0.00%
MLMG::getGradSolution() 360 0.000253 0.0002645 0.0002831 0.00%
Gravity::swapTimeLevels() 140 0.0002247 0.0002461 0.0002798 0.00%
MLMG::mgVcycle_up::6 483 0.0002415 0.0002522 0.0002753 0.00%
AmrLevel::AmrLevel(dm) 35 0.0002464 0.0002583 0.0002709 0.00%
MLMG::mgVcycle_up::2 483 0.0002453 0.0002561 0.0002703 0.00%
MLMG::mgVcycle_up::3 483 0.000212 0.0002362 0.0002622 0.00%
MLMG::mgVcycle_up::5 483 0.0002317 0.0002398 0.00025 0.00%
MLMG::mgVcycle_up::4 483 0.0002165 0.0002264 0.0002483 0.00%
TagBoxArray::mapPRD 34 0.0001908 0.0002084 0.0002316 0.00%
OwnerMask() 34 0.0001629 0.0001852 0.0002278 0.00%
makeSFC 350 0.0001988 0.0002126 0.000227 0.00%
Castro::check_for_nan() 280 0.0001645 0.0001783 0.0002028 0.00%
Castro::post_regrid() 66 0.0001565 0.0001735 0.0001945 0.00%
Castro::avgDown(state_indx) 248 0.000158 0.0001736 0.0001892 0.00%
Castro::post_timestep() 140 0.0001472 0.0001634 0.0001748 0.00%
DistributionMapping::Distribute() 355 0.0001357 0.0001529 0.0001717 0.00%
MultiFab::Multiply() 40 0.000157 0.0001612 0.0001653 0.00%
MLLinOp::makeAgglomeratedDMap 70 0.0001412 0.0001501 0.000164 0.00%
MLMG::MLRhsNormInf() 360 0.0001456 0.0001536 0.000161 0.00%
knapsack() 7 0.0001029 0.0001107 0.0001263 0.00%
FabArray::RecvLayoutMask() 90 8.976e-05 0.000111 0.0001237 0.00%
Gravity::solve_for_delta_phi 60 8.938e-05 0.0001009 0.0001207 0.00%
Amr::FinalizeInit() 1 3.795e-06 1.842e-05 0.000118 0.00%
Castro::enforce_consistent_e() 7 7.354e-05 8.291e-05 0.0001049 0.00%
Castro::retry_advance_ctu() 140 5.55e-05 6.635e-05 9.672e-05 0.00%
Castro::create_source_corrector() 140 5.804e-05 7.593e-05 8.808e-05 0.00%
BoxList::complementIn 574 6.595e-05 7.132e-05 8.468e-05 0.00%
Castro::avgDown() 62 6.719e-05 7.191e-05 7.653e-05 0.00%
Castro::errorEst() 34 5.978e-05 6.282e-05 6.458e-05 0.00%
Castro::computeNewDt() 28 4.361e-05 4.872e-05 5.399e-05 0.00%
Amr::writeSmallPlotFile() 1 3.354e-05 3.567e-05 3.77e-05 0.00%
DistributionMapping::SFCProcessorMapDoIt() 5 2.951e-05 3.374e-05 3.726e-05 0.00%
Amr::defBaseLevel() 1 2.084e-05 2.359e-05 3.393e-05 0.00%
Amr::bldFineLevels() 1 2.177e-05 2.52e-05 2.9e-05 0.00%
Gravity::set_mass_offset() 21 1.961e-05 2.436e-05 2.765e-05 0.00%
DistributionMapping::KnapSackDoIt() 7 2.194e-05 2.447e-05 2.724e-05 0.00%
BoxList::parallelComplementIn() 57 2.13e-05 2.286e-05 2.413e-05 0.00%
Castro::apply_problem_tags() 34 1.528e-05 1.678e-05 1.828e-05 0.00%
Castro::post_init() 3 8.76e-06 9.488e-06 1.035e-05 0.00%
Amr::initSubcycle() 1 8.454e-06 8.968e-06 9.76e-06 0.00%
Amr::initialInit() 1 1.112e-06 1.853e-06 5.526e-06 0.00%
Amr::InitializeInit() 1 2.625e-06 3.462e-06 5.386e-06 0.00%
Castro::computeInitialDt() 2 3.602e-06 4.198e-06 4.838e-06 0.00%
Amr::init() 1 1.799e-06 2.037e-06 2.384e-06 0.00%
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
--------------------------------------------------------------------------------------------
main() 1 10.77 10.77 10.77 100.00%
Amr::coarseTimeStep() 20 10.57 10.57 10.57 98.10%
Amr::timeStep() 140 10.53 10.55 10.55 97.96%
Castro::advance() 140 7.803 7.807 7.809 72.51%
Castro::subcycle_advance_ctu() 140 7.567 7.606 7.644 70.98%
Castro::do_advance_ctu() 140 7.567 7.605 7.643 70.97%
Gravity::actual_solve_with_mlmg() 360 5.712 5.722 5.735 53.25%
MLMG::solve() 360 5.538 5.546 5.553 51.56%
MLMG::oneIter() 1843 5.147 5.177 5.197 48.25%
MLMG::mgVcycle() 3385 4.766 4.814 4.854 45.07%
Gravity::solve_phi_with_mlmg() 300 4.302 4.31 4.32 40.12%
Gravity::solve_for_phi() 280 3.651 3.659 3.669 34.06%
MLMG::mgVcycle_bottom 3385 3.265 3.285 3.299 30.63%
Castro::construct_ctu_hydro_source() 140 2.952 2.958 2.963 27.51%
Castro::construct_new_gravity() 140 2.933 2.937 2.944 27.34%
MLMG::actualBottomSolve() 1843 2.882 2.891 2.917 27.08%
MLCGSolver::bicgstab 1420 2.879 2.887 2.913 27.04%
Castro::post_timestep() 140 1.965 1.981 1.987 18.45%
Castro::reflux() 60 1.852 1.864 1.878 17.44%
MLCellLinOp::applyBC() 165252 1.465 1.661 1.872 17.39%
MLCellLinOp::smooth() 27488 1.542 1.608 1.664 15.45%
FabArray::FillBoundary() 157859 1.176 1.367 1.594 14.80%
Gravity::gravity_sync() 60 1.539 1.54 1.54 14.30%
MLCGSolver::ParallelAllReduce 243542 0.9948 1.22 1.486 13.79%
Gravity::solve_for_delta_phi 60 1.464 1.465 1.465 13.60%
MLCellLinOp::apply() 108875 1.153 1.311 1.458 13.54%
MLPoisson::Fsmooth() 54976 0.8543 0.9439 1.047 9.72%
check_for_negative_density() 140 0.3019 0.561 0.953 8.85%
FabArray::ParallelCopy() 21259 0.5796 0.7168 0.8647 8.03%
Castro::construct_old_gravity() 140 0.8541 0.8575 0.8611 8.00%
Amr::regrid() 21 0.7983 0.8048 0.8138 7.56%
FillBoundary_finish() 157859 0.4494 0.6193 0.8133 7.55%
FillBoundary_nowait() 157859 0.5925 0.6949 0.7873 7.31%
Gravity::multilevel_solve_for_new_phi() 20 0.6658 0.6679 0.6687 6.21%
Gravity::actual_multilevel_solve() 20 0.6642 0.6664 0.6675 6.20%
Castro::post_regrid() 66 0.6386 0.6426 0.6456 5.99%
FabArray::ParallelCopy_finish() 21259 0.3106 0.4607 0.631 5.86%
FillPatchIterator::Initialize 889 0.457 0.5267 0.6064 5.63%
FillPatchTwoLevels 756 0.3858 0.4548 0.5377 4.99%
MLMG::mgVcycle_down::0 1843 0.4711 0.4929 0.513 4.76%
MLMG::mgVcycle_up::0 1843 0.4369 0.4487 0.4568 4.24%
Castro::clean_state() 1182 0.3565 0.4059 0.442 4.10%
Castro::initialize_do_advance() 140 0.3538 0.3852 0.4211 3.91%
MLMG::miniCycle() 1542 0.369 0.395 0.4145 3.85%
FillPatchSingleLevel 1617 0.2245 0.2882 0.3782 3.51%
Castro::expand_state() 200 0.2378 0.269 0.3157 2.93%
MLPoisson::Fapply() 108875 0.2508 0.2817 0.3083 2.86%
MLCellLinOp::correctionResidual() 9063 0.2548 0.2801 0.2947 2.74%
FabArray::ParallelCopy_nowait() 21259 0.215 0.2471 0.2713 2.52%
Castro::do_new_sources() 260 0.2177 0.2473 0.271 2.52%
Castro::computeTemp() 1189 0.2113 0.2421 0.2629 2.44%
MLMG::mgVcycle_down::1 1843 0.2245 0.2319 0.2436 2.26%
MLCellLinOp::solutionResidual() 3154 0.2071 0.2208 0.2356 2.19%
Castro::do_old_sources() 140 0.2151 0.2175 0.2202 2.05%
FabArray::setVal() 27514 0.1427 0.1789 0.2163 2.01%
amrex::Dot() 193316 0.1647 0.1899 0.2084 1.94%
MLMG::computeResWithCrseSolFineCor() 771 0.15 0.1742 0.1928 1.79%
Castro::estTimeStep() 308 0.1083 0.1545 0.189 1.75%
Castro::initialize_advance() 140 0.1189 0.1536 0.1868 1.73%
Castro::reset_internal_energy(MultiFab) 1189 0.1476 0.1701 0.1848 1.72%
Amr::init() 1 0.1846 0.1847 0.1847 1.72%
Castro::reset_internal_energy(Fab) 5919 0.1456 0.1681 0.1828 1.70%
MLMG::mgVcycle_up::1 1843 0.1679 0.1764 0.1819 1.69%
amrex::Copy() 106562 0.1378 0.158 0.1794 1.67%
FabArray::Saxpy() 145223 0.1332 0.157 0.1758 1.63%
Amr::initialInit() 1 0.1664 0.1664 0.1664 1.55%
amrex::average_down 8093 0.1232 0.1451 0.1626 1.51%
Amr::FinalizeInit() 1 0.154 0.1565 0.1592 1.48%
Castro::normalize_species() 1182 0.1258 0.1421 0.155 1.44%
Castro::construct_new_source() 1300 0.118 0.1325 0.1434 1.33%
MLMG::computeResidual() 1843 0.118 0.1326 0.1403 1.30%
FabArray::norminf() 100641 0.1079 0.121 0.1334 1.24%
MLMG:computeResOfCorrection() 6101 0.1265 0.13 0.1331 1.24%
MLMG::addInterpCorrection() 6101 0.05899 0.1109 0.1323 1.23%
MLPoisson::normalize() 98078 0.09924 0.111 0.1211 1.12%
MLMG::mgVcycle_up::2 483 0.02812 0.06821 0.1081 1.00%
MLPoisson::define() 360 0.07713 0.08918 0.1075 1.00%
MLMG::ResNormInf() 2383 0.05371 0.08047 0.1067 0.99%
Gravity::get_new_grav_vector() 263 0.09766 0.09868 0.1005 0.93%
Castro::finalize_do_advance() 140 0.05408 0.07858 0.09931 0.92%
Castro::avgDown() 62 0.05796 0.07567 0.09559 0.89%
Castro::avgDown(state_indx) 248 0.0579 0.0756 0.09551 0.89%
amrex::average_down_w_geom 248 0.05771 0.07543 0.09533 0.89%
MLMG::computeResWithCrseCorFineCor() 771 0.07867 0.08846 0.09334 0.87%
Castro::construct_new_gravity_source() 260 0.07294 0.08317 0.0902 0.84%
MLCellLinOp::reflux() 951 0.06787 0.08121 0.08922 0.83%
Amr::bldFineLevels() 1 0.08181 0.08478 0.08728 0.81%
FabArray::LinComb() 96778 0.05596 0.06954 0.08193 0.76%
MLMG::computeMLResidual() 440 0.05448 0.06337 0.07248 0.67%
Castro::post_init() 3 0.0655 0.0681 0.07113 0.66%
FabArrayBase::getCPC() 29651 0.05655 0.06288 0.06844 0.64%
MLCellLinOp::setLevelBC() 450 0.02449 0.04413 0.06825 0.63%
MLMG::prepareForSolve() 360 0.06249 0.06534 0.06824 0.63%
FabArray::Xpay() 59602 0.05025 0.05974 0.06742 0.63%
FillPatchInterp(MF) 728 0.06549 0.06645 0.0673 0.62%
MLCellLinOp::updateSolBC() 871 0.04682 0.05796 0.06582 0.61%
Castro::initData() 7 0.04717 0.05449 0.06473 0.60%
MLMG::mgVcycle_up::3 483 0.004176 0.02874 0.06437 0.60%
MLCellLinOp::defineAuxData() 360 0.04579 0.05271 0.06286 0.58%
Gravity::get_old_grav_vector() 140 0.06008 0.06096 0.06186 0.57%
FluxRegister::Reflux() 960 0.0489 0.05485 0.05998 0.56%
Castro::init(old) 28 0.04743 0.05531 0.05983 0.56%
MLCellLinOp::updateCorBC() 771 0.04169 0.04985 0.05543 0.51%
Castro::finalize_advance() 140 0.04332 0.0467 0.05317 0.49%
Castro::Castro() 35 0.03912 0.04439 0.05309 0.49%
amrex::Add() 7701 0.03829 0.0453 0.05192 0.48%
MLMG::interpCorrection_1 771 0.02916 0.03597 0.04715 0.44%
Gravity::GetCrsePhi() 250 0.01755 0.03209 0.04562 0.42%
FabArrayBase::CPC::define() 4099 0.03054 0.03588 0.04063 0.38%
MLCellLinOp::defineBC() 360 0.0227 0.02872 0.0374 0.35%
Castro::apply_source_to_state() 520 0.02963 0.03358 0.03678 0.34%
Amr::writePlotFile() 2 0.0364 0.03649 0.03654 0.34%
Castro::FluxRegCrseInit 140 0.03147 0.03309 0.03471 0.32%
MLMG::mgVcycle_down::2 483 0.03123 0.03251 0.03387 0.31%
Castro::construct_old_source() 700 0.02776 0.03077 0.03309 0.31%
Amr::grid_places() 23 0.02173 0.02596 0.03053 0.28%
AmrMesh::MakeNewGrids() 23 0.02143 0.0256 0.03022 0.28%
VisMF::Write(FabArray) 6 0.008348 0.01176 0.02971 0.28%
Gravity::fill_multipole_BCs() 70 0.02674 0.0279 0.0292 0.27%
Castro::initMFs() 35 0.02163 0.02486 0.02904 0.27%
FabArrayBase::getFB() 157859 0.02635 0.02715 0.02792 0.26%
BndryData::define() 540 0.01471 0.0194 0.02594 0.24%
Castro::enforce_min_density() 1182 0.01856 0.0209 0.02343 0.22%
MLMG::mgVcycle_down::3 483 0.005592 0.01366 0.02312 0.21%
Castro::check_for_nan() 280 0.01724 0.02053 0.02312 0.21%
MultiFab::contains_nan() 280 0.01704 0.02035 0.02294 0.21%
Castro::computeNewDt() 28 0.01909 0.02005 0.02092 0.19%
Gravity::average_fine_ec_onto_crse_ec() 90 0.01658 0.01741 0.01872 0.17%
Castro::errorEst() 34 0.01028 0.0142 0.01797 0.17%
MLMG::getGradSolution() 360 0.01352 0.01507 0.01779 0.17%
Gravity::update_max_rhs() 30 0.015 0.01594 0.01769 0.16%
MLCellLinOp::compGrad() 450 0.01325 0.0148 0.0175 0.16%
Castro::derive() 34 0.0081 0.01154 0.01512 0.14%
AmrLevel::AmrLevel(dm) 35 0.01071 0.01181 0.01384 0.13%
StateData::define() 140 0.01046 0.01155 0.01357 0.13%
MLPoisson::FFlux() 7882 0.006856 0.01081 0.01312 0.12%
Castro::FluxRegFineAdd() 140 0.005757 0.007961 0.01255 0.12%
Amr::InitializeInit() 1 0.007261 0.009892 0.01241 0.12%
Amr::defBaseLevel() 1 0.007255 0.009889 0.01241 0.12%
Castro::swap_state_time_levels() 140 0.00625 0.008242 0.01196 0.11%
FabArrayBase::TheFPinfo() 728 0.002526 0.007242 0.01179 0.11%
MLMG::mgVcycle_down::4 483 0.005113 0.006167 0.01123 0.10%
FPinfo::FPinfo() 7 0.00166 0.006319 0.01082 0.10%
average_down_faces 360 0.00824 0.009525 0.01032 0.10%
MLMG::MLResNormInf() 440 0.007683 0.008853 0.01028 0.10%
Castro::construct_old_gravity_source() 140 0.007944 0.009476 0.01016 0.09%
FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003798 0.006676 0.009017 0.08%
MLMG::mgVcycle_up::4 483 0.004141 0.004827 0.008861 0.08%
Castro::buildMetrics() 35 0.005772 0.006421 0.008727 0.08%
MLMG::mgVcycle_down::5 483 0.005003 0.005508 0.007948 0.07%
MultiFab::max() 90 0.004187 0.005789 0.00784 0.07%
MLLinOp::define() 360 0.006335 0.006961 0.007749 0.07%
StateDataPhysBCFunct::() 1617 0.002805 0.005199 0.007715 0.07%
DistributionMapping::LeastUsedCPUs() 12 0.0002347 0.004366 0.007623 0.07%
DistributionMapping::SFCProcessorMapDoIt() 5 0.0002228 0.004324 0.007591 0.07%
MLLinOp::defineGrids() 360 0.005932 0.006516 0.007213 0.07%
MLMG::mgVcycle_down::6 483 0.005049 0.005425 0.007091 0.07%
Gravity::applyMetricTerms() 90 0.005768 0.006238 0.006695 0.06%
MLMG::mgVcycle_up::6 483 0.004713 0.005073 0.006601 0.06%
MLMG::mgVcycle_up::5 483 0.004242 0.004639 0.006476 0.06%
Castro::computeInitialDt() 2 0.001152 0.00365 0.006303 0.06%
MLMG::MLRhsNormInf() 360 0.005219 0.005806 0.006302 0.06%
FabArray::mult() 1063 0.004289 0.005206 0.006249 0.06%
StateData::FillBoundary(geom) 745 0.001428 0.003755 0.006164 0.06%
MLPoisson::prepareForSolve() 360 0.003274 0.004119 0.005297 0.05%
BoxList::parallelComplementIn() 57 0.0004346 0.003101 0.005257 0.05%
BoxList::pci 22 0.0003866 0.003065 0.005224 0.05%
MLCellLinOp::prepareForSolve() 360 0.002985 0.003858 0.005045 0.05%
FabArray::norminf(mask) 270 0.003287 0.004002 0.004711 0.04%
Gravity::swapTimeLevels() 140 0.003053 0.003833 0.004675 0.04%
FabArray::setDomainBndry() 1617 0.003624 0.003914 0.004541 0.04%
Gravity::create_comp_minus_level_grad_phi() 60 0.003046 0.003448 0.004058 0.04%
MultiFab::Subtract() 420 0.001935 0.002471 0.003079 0.03%
TagBoxArray::mapPRD 34 0.001383 0.001835 0.002708 0.03%
MLLinOp::makeSubCommunicator() 70 0.001362 0.001665 0.002315 0.02%
AmrMesh-cluster 4 0 0.0002889 0.002311 0.02%
Castro::apply_tagging_restrictions() 34 0.001113 0.001364 0.001644 0.02%
TagBoxArray::collate() 34 0.0006789 0.0009934 0.001629 0.02%
AMRErrorTag::operator() 34 0.0009875 0.001219 0.001462 0.01%
ClusterList::chop() 4 0 0.0001783 0.001426 0.01%
FabArrayBase::FB::FB() 299 0.0001859 0.0004154 0.0007081 0.01%
Castro::build_fine_mask() 40 0.0005804 0.0006113 0.0006453 0.01%
ClusterList::intersect() 4 0 6.946e-05 0.0005557 0.01%
MLLinOp::makeAgglomeratedDMap 70 0.0004685 0.0005041 0.0005435 0.01%
Castro::enforce_speed_limit() 1182 0.000364 0.0004018 0.0004337 0.00%
Amr::InitAmr() 1 0.0002836 0.0003104 0.0004211 0.00%
makeSFC 350 0.0003248 0.000354 0.0003795 0.00%
DistributionMapping::KnapSackDoIt() 7 0.0002155 0.0002222 0.0002352 0.00%
OwnerMask() 34 0.0001629 0.0001852 0.0002278 0.00%
DistributionMapping::Distribute() 355 0.0001357 0.0001529 0.0001717 0.00%
MultiFab::Multiply() 40 0.000157 0.0001612 0.0001653 0.00%
knapsack() 7 0.0001029 0.0001107 0.0001263 0.00%
FabArray::RecvLayoutMask() 90 8.976e-05 0.000111 0.0001237 0.00%
Castro::enforce_consistent_e() 7 7.354e-05 8.291e-05 0.0001049 0.00%
Castro::retry_advance_ctu() 140 5.55e-05 6.635e-05 9.672e-05 0.00%
Castro::create_source_corrector() 140 5.804e-05 7.593e-05 8.808e-05 0.00%
BoxList::complementIn 574 6.595e-05 7.132e-05 8.468e-05 0.00%
Amr::writeSmallPlotFile() 1 3.354e-05 3.567e-05 3.77e-05 0.00%
Gravity::set_mass_offset() 21 1.961e-05 2.436e-05 2.765e-05 0.00%
Castro::apply_problem_tags() 34 1.528e-05 1.678e-05 1.828e-05 0.00%
Amr::initSubcycle() 1 8.454e-06 8.968e-06 9.76e-06 0.00%
--------------------------------------------------------------------------------------------
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 10 B 11 B 16 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.06-25-g239d4d899334) finalized