MPI initialized with 8 MPI processes
MPI initialized with thread support level 3
AMReX (23.05-30-g07f87b0a9047) initialized
Starting run at 19:39:38 UTC on 2023-05-30.
Successfully read inputs file ...
Castro git describe: 23.05-33-gf0647a658
AMReX git describe: 23.05-30-g07f87b0a9
Microphysics git describe: 23.05-13-gbf803460
reading extern runtime parameters ...
3 Species:
C12 O16 Mg24
Successfully read inputs file ...
grid_places() time: 0.00148789 new finest: 1
grid_places() time: 0.006349513 new finest: 2
Now regridding at level lbase = 0
grid_places() time: 0.006874244 new finest: 2
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
Now regridding at level lbase = 0
grid_places() time: 0.008676696 new finest: 2
STEP = 0 TIME = 0 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
INITIAL GRIDS
Level 0 16 grids 65536 cells 100 % of domain
smallest grid: 64 x 64 biggest grid: 64 x 64
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
PLOTFILE: file = dustcollapse-2d-poissonn_plt00000
Write plotfile time = 0.017971023 seconds
[Level 0 step 1] ADVANCE with dt = 1.135435554e-05
[Level 0 step 1] Advanced 65536 cells
[Level 1 step 1] ADVANCE with dt = 5.677177769e-06
[Level 1 step 1] Advanced 36800 cells
[Level 2 step 1] ADVANCE with dt = 2.838588884e-06
[Level 2 step 1] Advanced 75392 cells
[Level 2 step 2] ADVANCE with dt = 2.838588884e-06
[Level 2 step 2] Advanced 75392 cells
[Level 1 step 2] ADVANCE with dt = 5.677177769e-06
[Level 1 step 2] Advanced 36800 cells
[Level 2 step 3] ADVANCE with dt = 2.838588884e-06
[Level 2 step 3] Advanced 75392 cells
[Level 2 step 4] ADVANCE with dt = 2.838588884e-06
[Level 2 step 4] Advanced 75392 cells
[STEP 1] Coarse TimeStep time: 0.516391541
[STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452]
STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05
Now regridding at level lbase = 1
grid_places() time: 0.00056611 new finest: 2
TIME = 1.135435554e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 2] ADVANCE with dt = 1.192207331e-05
[Level 0 step 2] Advanced 65536 cells
[Level 1 step 3] ADVANCE with dt = 5.961036657e-06
[Level 1 step 3] Advanced 36800 cells
[Level 2 step 5] ADVANCE with dt = 2.980518328e-06
[Level 2 step 5] Advanced 75392 cells
[Level 2 step 6] ADVANCE with dt = 2.980518328e-06
[Level 2 step 6] Advanced 75392 cells
[Level 1 step 4] ADVANCE with dt = 5.961036657e-06
[Level 1 step 4] Advanced 36800 cells
[Level 2 step 7] ADVANCE with dt = 2.980518328e-06
[Level 2 step 7] Advanced 75392 cells
[Level 2 step 8] ADVANCE with dt = 2.980518328e-06
[Level 2 step 8] Advanced 75392 cells
[STEP 2] Coarse TimeStep time: 0.566637988
[STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05
Now regridding at level lbase = 0
grid_places() time: 0.000814029 new finest: 2
STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 3] ADVANCE with dt = 1.251817698e-05
[Level 0 step 3] Advanced 65536 cells
[Level 1 step 5] ADVANCE with dt = 6.25908849e-06
[Level 1 step 5] Advanced 36800 cells
[Level 2 step 9] ADVANCE with dt = 3.129544245e-06
[Level 2 step 9] Advanced 75392 cells
[Level 2 step 10] ADVANCE with dt = 3.129544245e-06
[Level 2 step 10] Advanced 75392 cells
[Level 1 step 6] ADVANCE with dt = 6.25908849e-06
[Level 1 step 6] Advanced 36800 cells
[Level 2 step 11] ADVANCE with dt = 3.129544245e-06
[Level 2 step 11] Advanced 75392 cells
[Level 2 step 12] ADVANCE with dt = 3.129544245e-06
[Level 2 step 12] Advanced 75392 cells
[STEP 3] Coarse TimeStep time: 0.576026493
[STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05
Now regridding at level lbase = 1
grid_places() time: 0.000542775 new finest: 2
TIME = 3.579460583e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 4] ADVANCE with dt = 1.314408583e-05
[Level 0 step 4] Advanced 65536 cells
[Level 1 step 7] ADVANCE with dt = 6.572042914e-06
[Level 1 step 7] Advanced 36800 cells
[Level 2 step 13] ADVANCE with dt = 3.286021457e-06
[Level 2 step 13] Advanced 75392 cells
[Level 2 step 14] ADVANCE with dt = 3.286021457e-06
[Level 2 step 14] Advanced 75392 cells
[Level 1 step 8] ADVANCE with dt = 6.572042914e-06
[Level 1 step 8] Advanced 36800 cells
[Level 2 step 15] ADVANCE with dt = 3.286021457e-06
[Level 2 step 15] Advanced 75392 cells
[Level 2 step 16] ADVANCE with dt = 3.286021457e-06
[Level 2 step 16] Advanced 75392 cells
[STEP 4] Coarse TimeStep time: 0.588573534
[STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05
Now regridding at level lbase = 0
grid_places() time: 0.000816028 new finest: 2
STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 5] ADVANCE with dt = 1.380129012e-05
[Level 0 step 5] Advanced 65536 cells
[Level 1 step 9] ADVANCE with dt = 6.90064506e-06
[Level 1 step 9] Advanced 36800 cells
[Level 2 step 17] ADVANCE with dt = 3.45032253e-06
[Level 2 step 17] Advanced 75392 cells
[Level 2 step 18] ADVANCE with dt = 3.45032253e-06
[Level 2 step 18] Advanced 75392 cells
[Level 1 step 10] ADVANCE with dt = 6.90064506e-06
[Level 1 step 10] Advanced 36800 cells
[Level 2 step 19] ADVANCE with dt = 3.45032253e-06
[Level 2 step 19] Advanced 75392 cells
[Level 2 step 20] ADVANCE with dt = 3.45032253e-06
[Level 2 step 20] Advanced 75392 cells
[STEP 5] Coarse TimeStep time: 0.550162089
[STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05
Now regridding at level lbase = 1
grid_places() time: 0.000516573 new finest: 2
TIME = 6.273998178e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 6] ADVANCE with dt = 1.449135463e-05
[Level 0 step 6] Advanced 65536 cells
[Level 1 step 11] ADVANCE with dt = 7.245677313e-06
[Level 1 step 11] Advanced 36800 cells
[Level 2 step 21] ADVANCE with dt = 3.622838657e-06
[Level 2 step 21] Advanced 75392 cells
[Level 2 step 22] ADVANCE with dt = 3.622838657e-06
[Level 2 step 22] Advanced 75392 cells
[Level 1 step 12] ADVANCE with dt = 7.245677313e-06
[Level 1 step 12] Advanced 36800 cells
[Level 2 step 23] ADVANCE with dt = 3.622838657e-06
[Level 2 step 23] Advanced 75392 cells
[Level 2 step 24] ADVANCE with dt = 3.622838657e-06
[Level 2 step 24] Advanced 75392 cells
[STEP 6] Coarse TimeStep time: 0.545279434
[STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05
Now regridding at level lbase = 0
grid_places() time: 0.000785852 new finest: 2
STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 7] ADVANCE with dt = 1.521592236e-05
[Level 0 step 7] Advanced 65536 cells
[Level 1 step 13] ADVANCE with dt = 7.607961179e-06
[Level 1 step 13] Advanced 36800 cells
[Level 2 step 25] ADVANCE with dt = 3.803980589e-06
[Level 2 step 25] Advanced 75392 cells
[Level 2 step 26] ADVANCE with dt = 3.803980589e-06
[Level 2 step 26] Advanced 75392 cells
[Level 1 step 14] ADVANCE with dt = 7.607961179e-06
[Level 1 step 14] Advanced 36800 cells
[Level 2 step 27] ADVANCE with dt = 3.803980589e-06
[Level 2 step 27] Advanced 75392 cells
[Level 2 step 28] ADVANCE with dt = 3.803980589e-06
[Level 2 step 28] Advanced 75392 cells
[STEP 7] Coarse TimeStep time: 0.550370416
[STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05
Now regridding at level lbase = 1
grid_places() time: 0.000535731 new finest: 2
TIME = 9.244725876e-05 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 8] ADVANCE with dt = 1.597671848e-05
[Level 0 step 8] Advanced 65536 cells
[Level 1 step 15] ADVANCE with dt = 7.988359238e-06
[Level 1 step 15] Advanced 36800 cells
[Level 2 step 29] ADVANCE with dt = 3.994179619e-06
[Level 2 step 29] Advanced 75392 cells
[Level 2 step 30] ADVANCE with dt = 3.994179619e-06
[Level 2 step 30] Advanced 75392 cells
[Level 1 step 16] ADVANCE with dt = 7.988359238e-06
[Level 1 step 16] Advanced 36800 cells
[Level 2 step 31] ADVANCE with dt = 3.994179619e-06
[Level 2 step 31] Advanced 75392 cells
[Level 2 step 32] ADVANCE with dt = 3.994179619e-06
[Level 2 step 32] Advanced 75392 cells
[STEP 8] Coarse TimeStep time: 0.545812822
[STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05
Now regridding at level lbase = 0
grid_places() time: 0.000776253 new finest: 2
STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 9] ADVANCE with dt = 1.67755544e-05
[Level 0 step 9] Advanced 65536 cells
[Level 1 step 17] ADVANCE with dt = 8.387777199e-06
[Level 1 step 17] Advanced 36800 cells
[Level 2 step 33] ADVANCE with dt = 4.1938886e-06
[Level 2 step 33] Advanced 75392 cells
[Level 2 step 34] ADVANCE with dt = 4.1938886e-06
[Level 2 step 34] Advanced 75392 cells
[Level 1 step 18] ADVANCE with dt = 8.387777199e-06
[Level 1 step 18] Advanced 36800 cells
[Level 2 step 35] ADVANCE with dt = 4.1938886e-06
[Level 2 step 35] Advanced 75392 cells
[Level 2 step 36] ADVANCE with dt = 4.1938886e-06
[Level 2 step 36] Advanced 75392 cells
[STEP 9] Coarse TimeStep time: 0.551203925
[STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05
Now regridding at level lbase = 1
grid_places() time: 0.000531911 new finest: 2
TIME = 0.0001251995316 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 10] ADVANCE with dt = 1.761433212e-05
[Level 0 step 10] Advanced 65536 cells
[Level 1 step 19] ADVANCE with dt = 8.807166059e-06
[Level 1 step 19] Advanced 36800 cells
[Level 2 step 37] ADVANCE with dt = 4.40358303e-06
[Level 2 step 37] Advanced 75392 cells
[Level 2 step 38] ADVANCE with dt = 4.40358303e-06
[Level 2 step 38] Advanced 75392 cells
[Level 1 step 20] ADVANCE with dt = 8.807166059e-06
[Level 1 step 20] Advanced 36800 cells
[Level 2 step 39] ADVANCE with dt = 4.40358303e-06
[Level 2 step 39] Advanced 75392 cells
[Level 2 step 40] ADVANCE with dt = 4.40358303e-06
[Level 2 step 40] Advanced 75392 cells
[STEP 10] Coarse TimeStep time: 0.547410663
[STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05
Now regridding at level lbase = 0
grid_places() time: 0.000778674 new finest: 2
STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 11] ADVANCE with dt = 1.849504872e-05
[Level 0 step 11] Advanced 65536 cells
[Level 1 step 21] ADVANCE with dt = 9.247524362e-06
[Level 1 step 21] Advanced 36800 cells
[Level 2 step 41] ADVANCE with dt = 4.623762181e-06
[Level 2 step 41] Advanced 75392 cells
[Level 2 step 42] ADVANCE with dt = 4.623762181e-06
[Level 2 step 42] Advanced 75392 cells
[Level 1 step 22] ADVANCE with dt = 9.247524362e-06
[Level 1 step 22] Advanced 36800 cells
[Level 2 step 43] ADVANCE with dt = 4.623762181e-06
[Level 2 step 43] Advanced 75392 cells
[Level 2 step 44] ADVANCE with dt = 4.623762181e-06
[Level 2 step 44] Advanced 75392 cells
[STEP 11] Coarse TimeStep time: 0.553561752
[STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05
Now regridding at level lbase = 1
grid_places() time: 0.000588097 new finest: 2
TIME = 0.0001613089125 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 12] ADVANCE with dt = 1.941980116e-05
[Level 0 step 12] Advanced 65536 cells
[Level 1 step 23] ADVANCE with dt = 9.709900581e-06
[Level 1 step 23] Advanced 36800 cells
[Level 2 step 45] ADVANCE with dt = 4.85495029e-06
[Level 2 step 45] Advanced 75392 cells
[Level 2 step 46] ADVANCE with dt = 4.85495029e-06
[Level 2 step 46] Advanced 75392 cells
[Level 1 step 24] ADVANCE with dt = 9.709900581e-06
[Level 1 step 24] Advanced 36800 cells
[Level 2 step 47] ADVANCE with dt = 4.85495029e-06
[Level 2 step 47] Advanced 75392 cells
[Level 2 step 48] ADVANCE with dt = 4.85495029e-06
[Level 2 step 48] Advanced 75392 cells
[STEP 12] Coarse TimeStep time: 0.548715848
[STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05
Now regridding at level lbase = 0
grid_places() time: 0.000766115 new finest: 2
STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 13] ADVANCE with dt = 2.039079122e-05
[Level 0 step 13] Advanced 65536 cells
[Level 1 step 25] ADVANCE with dt = 1.019539561e-05
[Level 1 step 25] Advanced 36800 cells
[Level 2 step 49] ADVANCE with dt = 5.097697805e-06
[Level 2 step 49] Advanced 75392 cells
[Level 2 step 50] ADVANCE with dt = 5.097697805e-06
[Level 2 step 50] Advanced 75392 cells
[Level 1 step 26] ADVANCE with dt = 1.019539561e-05
[Level 1 step 26] Advanced 36800 cells
[Level 2 step 51] ADVANCE with dt = 5.097697805e-06
[Level 2 step 51] Advanced 75392 cells
[Level 2 step 52] ADVANCE with dt = 5.097697805e-06
[Level 2 step 52] Advanced 75392 cells
[STEP 13] Coarse TimeStep time: 0.558713185
[STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05
Now regridding at level lbase = 1
grid_places() time: 0.000521456 new finest: 2
TIME = 0.0002011195049 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 14] ADVANCE with dt = 2.141033078e-05
[Level 0 step 14] Advanced 65536 cells
[Level 1 step 27] ADVANCE with dt = 1.070516539e-05
[Level 1 step 27] Advanced 36800 cells
[Level 2 step 53] ADVANCE with dt = 5.352582695e-06
[Level 2 step 53] Advanced 75392 cells
[Level 2 step 54] ADVANCE with dt = 5.352582695e-06
[Level 2 step 54] Advanced 75392 cells
[Level 1 step 28] ADVANCE with dt = 1.070516539e-05
[Level 1 step 28] Advanced 36800 cells
[Level 2 step 55] ADVANCE with dt = 5.352582695e-06
[Level 2 step 55] Advanced 75392 cells
[Level 2 step 56] ADVANCE with dt = 5.352582695e-06
[Level 2 step 56] Advanced 75392 cells
[STEP 14] Coarse TimeStep time: 0.564038469
[STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05
Now regridding at level lbase = 0
grid_places() time: 0.000776983 new finest: 2
STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 15] ADVANCE with dt = 2.248084732e-05
[Level 0 step 15] Advanced 65536 cells
[Level 1 step 29] ADVANCE with dt = 1.124042366e-05
[Level 1 step 29] Advanced 36800 cells
[Level 2 step 57] ADVANCE with dt = 5.62021183e-06
[Level 2 step 57] Advanced 75392 cells
[Level 2 step 58] ADVANCE with dt = 5.62021183e-06
[Level 2 step 58] Advanced 75392 cells
[Level 1 step 30] ADVANCE with dt = 1.124042366e-05
[Level 1 step 30] Advanced 36800 cells
[Level 2 step 59] ADVANCE with dt = 5.62021183e-06
[Level 2 step 59] Advanced 75392 cells
[Level 2 step 60] ADVANCE with dt = 5.62021183e-06
[Level 2 step 60] Advanced 75392 cells
[STEP 15] Coarse TimeStep time: 0.558290596
[STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05
Now regridding at level lbase = 1
grid_places() time: 0.000527255 new finest: 2
TIME = 0.000245010683 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 16] ADVANCE with dt = 2.360488969e-05
[Level 0 step 16] Advanced 65536 cells
[Level 1 step 31] ADVANCE with dt = 1.180244484e-05
[Level 1 step 31] Advanced 36800 cells
[Level 2 step 61] ADVANCE with dt = 5.901222421e-06
[Level 2 step 61] Advanced 75392 cells
[Level 2 step 62] ADVANCE with dt = 5.901222421e-06
[Level 2 step 62] Advanced 75392 cells
[Level 1 step 32] ADVANCE with dt = 1.180244484e-05
[Level 1 step 32] Advanced 36800 cells
[Level 2 step 63] ADVANCE with dt = 5.901222421e-06
[Level 2 step 63] Advanced 75392 cells
[Level 2 step 64] ADVANCE with dt = 5.901222421e-06
[Level 2 step 64] Advanced 75392 cells
[STEP 16] Coarse TimeStep time: 0.551343107
[STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05
Now regridding at level lbase = 0
grid_places() time: 0.000777471 new finest: 2
STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 17] ADVANCE with dt = 2.478513417e-05
[Level 0 step 17] Advanced 65536 cells
[Level 1 step 33] ADVANCE with dt = 1.239256708e-05
[Level 1 step 33] Advanced 36800 cells
[Level 2 step 65] ADVANCE with dt = 6.196283542e-06
[Level 2 step 65] Advanced 75392 cells
[Level 2 step 66] ADVANCE with dt = 6.196283542e-06
[Level 2 step 66] Advanced 75392 cells
[Level 1 step 34] ADVANCE with dt = 1.239256708e-05
[Level 1 step 34] Advanced 36800 cells
[Level 2 step 67] ADVANCE with dt = 6.196283542e-06
[Level 2 step 67] Advanced 75392 cells
[Level 2 step 68] ADVANCE with dt = 6.196283542e-06
[Level 2 step 68] Advanced 75392 cells
[STEP 17] Coarse TimeStep time: 0.560934851
[STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05
Now regridding at level lbase = 1
grid_places() time: 0.000531613 new finest: 2
TIME = 0.0002934007068 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 18] ADVANCE with dt = 2.602439088e-05
[Level 0 step 18] Advanced 65536 cells
[Level 1 step 35] ADVANCE with dt = 1.301219544e-05
[Level 1 step 35] Advanced 36800 cells
[Level 2 step 69] ADVANCE with dt = 6.506097719e-06
[Level 2 step 69] Advanced 75392 cells
[Level 2 step 70] ADVANCE with dt = 6.506097719e-06
[Level 2 step 70] Advanced 75392 cells
[Level 1 step 36] ADVANCE with dt = 1.301219544e-05
[Level 1 step 36] Advanced 36800 cells
[Level 2 step 71] ADVANCE with dt = 6.506097719e-06
[Level 2 step 71] Advanced 75392 cells
[Level 2 step 72] ADVANCE with dt = 6.506097719e-06
[Level 2 step 72] Advanced 75392 cells
[STEP 18] Coarse TimeStep time: 0.54951911
[STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05
Now regridding at level lbase = 0
grid_places() time: 0.000775679 new finest: 2
STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0
Level 1 25 grids 36800 cells 14.03808594 % of domain
smallest grid: 8 x 8 biggest grid: 40 x 64
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 19] ADVANCE with dt = 2.732561042e-05
[Level 0 step 19] Advanced 65536 cells
[Level 1 step 37] ADVANCE with dt = 1.366280521e-05
[Level 1 step 37] Advanced 36800 cells
[Level 2 step 73] ADVANCE with dt = 6.831402605e-06
[Level 2 step 73] Advanced 75392 cells
[Level 2 step 74] ADVANCE with dt = 6.831402605e-06
[Level 2 step 74] Advanced 75392 cells
[Level 1 step 38] ADVANCE with dt = 1.366280521e-05
[Level 1 step 38] Advanced 36800 cells
[Level 2 step 75] ADVANCE with dt = 6.831402605e-06
[Level 2 step 75] Advanced 75392 cells
[Level 2 step 76] ADVANCE with dt = 6.831402605e-06
[Level 2 step 76] Advanced 75392 cells
[STEP 19] Coarse TimeStep time: 0.556018827
[STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05
Now regridding at level lbase = 1
grid_places() time: 0.000538567 new finest: 2
TIME = 0.0003467507081 : REGRID with lbase = 1
Level 2 58 grids 75392 cells 7.189941406 % of domain
smallest grid: 8 x 8 biggest grid: 56 x 56
[Level 0 step 20] ADVANCE with dt = 2.869189094e-05
[Level 0 step 20] Advanced 65536 cells
[Level 1 step 39] ADVANCE with dt = 1.434594547e-05
[Level 1 step 39] Advanced 36800 cells
[Level 2 step 77] ADVANCE with dt = 7.172972736e-06
[Level 2 step 77] Advanced 75392 cells
[Level 2 step 78] ADVANCE with dt = 7.172972736e-06
[Level 2 step 78] Advanced 75392 cells
[Level 1 step 40] ADVANCE with dt = 1.434594547e-05
[Level 1 step 40] Advanced 36800 cells
[Level 2 step 79] ADVANCE with dt = 7.172972736e-06
[Level 2 step 79] Advanced 75392 cells
[Level 2 step 80] ADVANCE with dt = 7.172972736e-06
[Level 2 step 80] Advanced 75392 cells
[STEP 20] Coarse TimeStep time: 0.552816731
[STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286]
STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05
PLOTFILE: file = dustcollapse-2d-poissonn_plt00020
Write plotfile time = 0.017425004 seconds
Ending run at 19:39:50 UTC on 2023-05-30.
Run time = 11.29638994
Run time without initialization = 11.11315349
Average number of zones advanced per microsecond: 0.793
Average number of zones advanced per microsecond per rank: 0.099
TinyProfiler total time across processes [min...avg...max]: 11.3 ... 11.3 ... 11.3
--------------------------------------------------------------------------------------------
Name NCalls Excl. Min Excl. Avg Excl. Max Max %
--------------------------------------------------------------------------------------------
Castro::construct_ctu_hydro_source() 140 2.1065 2.5336 2.8212 24.97%
MLCGSolver::ParallelAllReduce 243656 0.9804 1.239 1.508 13.35%
MLPoisson::Fsmooth() 54976 0.9529 1.063 1.139 10.08%
Castro::do_advance_ctu() 140 0.3211 0.6157 1.044 9.25%
FillBoundary_finish() 157901 0.4981 0.6303 0.8107 7.18%
FillBoundary_nowait() 157901 0.5522 0.6843 0.7631 6.76%
FabArray::ParallelCopy_finish() 21259 0.3295 0.4538 0.677 5.99%
MLCellLinOp::applyBC() 165294 0.2313 0.3308 0.4373 3.87%
MLPoisson::Fapply() 108917 0.2508 0.284 0.3041 2.69%
amrex::Dot() 193401 0.1651 0.1914 0.2109 1.87%
FabArray::ParallelCopy_nowait() 21259 0.1589 0.188 0.2076 1.84%
FabArray::setVal() 27514 0.1415 0.1784 0.2015 1.78%
Castro::estTimeStep() 308 0.11 0.1541 0.1892 1.67%
Castro::reset_internal_energy(Fab) 5919 0.148 0.1715 0.1853 1.64%
FabArray::Saxpy() 145295 0.1399 0.1597 0.1806 1.60%
amrex::Copy() 106604 0.1338 0.1563 0.1765 1.56%
Castro::normalize_species() 1182 0.1272 0.1434 0.1574 1.39%
MLCGSolver::bicgstab 1420 0.1208 0.1291 0.1386 1.23%
FabArray::norminf() 100683 0.1087 0.1228 0.134 1.19%
MLPoisson::normalize() 98120 0.09884 0.1133 0.1217 1.08%
Castro::construct_new_gravity_source() 260 0.07431 0.08475 0.09239 0.82%
amrex::average_down 8093 0.06779 0.0762 0.08461 0.75%
FabArray::LinComb() 96820 0.05669 0.06987 0.08399 0.74%
Castro::computeTemp() 1189 0.06459 0.07334 0.08241 0.73%
MLMG::ResNormInf() 2383 0.0206 0.05016 0.07933 0.70%
FillPatchInterp(MF) 728 0.06498 0.06693 0.06863 0.61%
FabArray::Xpay() 59632 0.05112 0.05919 0.06833 0.60%
Castro::initData() 7 0.04365 0.0508 0.05897 0.52%
FabArray::FillBoundary() 157901 0.05298 0.0547 0.05741 0.51%
FillPatchIterator::Initialize 889 0.04615 0.05138 0.05483 0.49%
MLMG::addInterpCorrection() 6101 0.04537 0.04889 0.05294 0.47%
amrex::Add() 7701 0.03698 0.04413 0.05069 0.45%
MLCellLinOp::defineAuxData() 360 0.0366 0.04194 0.04951 0.44%
MLMG::prepareForSolve() 360 0.03365 0.0386 0.04353 0.39%
MLCellLinOp::apply() 108917 0.03798 0.03912 0.04168 0.37%
FillPatchSingleLevel 1617 0.0284 0.03755 0.04158 0.37%
amrex::average_down_w_geom 248 0.03039 0.03589 0.0415 0.37%
FabArrayBase::CPC::define() 4099 0.03038 0.03583 0.04067 0.36%
Castro::reflux() 60 0.02383 0.03032 0.03554 0.31%
Gravity::actual_solve_with_mlmg() 360 0.02201 0.02743 0.0354 0.31%
FluxRegister::Reflux() 960 0.02516 0.03076 0.03502 0.31%
MLCellLinOp::reflux() 951 0.0229 0.02583 0.03129 0.28%
VisMF::Write(FabArray) 6 0.008933 0.01174 0.02993 0.26%
Gravity::fill_multipole_BCs() 70 0.02722 0.02813 0.02881 0.26%
FillPatchTwoLevels 756 0.02624 0.02739 0.02852 0.25%
MLMG::solve() 360 0.008352 0.01904 0.02845 0.25%
Castro::initMFs() 35 0.02123 0.02435 0.02844 0.25%
Castro::initialize_do_advance() 140 0.02353 0.02583 0.02838 0.25%
FabArrayBase::getFB() 157901 0.02619 0.02708 0.02813 0.25%
FabArrayBase::getCPC() 29651 0.02579 0.02719 0.02772 0.25%
Amr::writePlotFile() 2 0.005919 0.02419 0.02707 0.24%
MLCellLinOp::updateSolBC() 871 0.01166 0.01686 0.02443 0.22%
Castro::enforce_min_density() 1182 0.01905 0.02131 0.02369 0.21%
MultiFab::contains_nan() 280 0.01751 0.0207 0.02324 0.21%
MLCellLinOp::updateCorBC() 771 0.0105 0.01557 0.02294 0.20%
Amr::coarseTimeStep() 20 0.00226 0.005514 0.02246 0.20%
MLMG::interpCorrection_1 771 0.01515 0.01813 0.02203 0.19%
Castro::construct_new_source() 1300 0.02053 0.02114 0.02198 0.19%
BndryData::define() 540 0.01193 0.01542 0.02065 0.18%
Castro::FluxRegCrseInit 140 0.01296 0.01635 0.0191 0.17%
MLCellLinOp::smooth() 27488 0.01633 0.01678 0.01735 0.15%
Gravity::get_new_grav_vector() 263 0.01072 0.01238 0.01497 0.13%
MLPoisson::FFlux() 7882 0.007855 0.01164 0.01423 0.13%
StateData::define() 140 0.01075 0.01172 0.01305 0.12%
Castro::initialize_advance() 140 0.008635 0.01119 0.01292 0.11%
Castro::construct_old_source() 700 0.01052 0.01107 0.01285 0.11%
MLCellLinOp::setLevelBC() 450 0.007618 0.009657 0.0124 0.11%
Castro::FluxRegFineAdd() 140 0.005313 0.0079 0.01172 0.10%
MLCellLinOp::defineBC() 360 0.007708 0.009056 0.01104 0.10%
MultiFab::max() 90 0.00377 0.006788 0.01082 0.10%
FPinfo::FPinfo() 7 0.001546 0.006171 0.01081 0.10%
MLCellLinOp::compGrad() 450 0.007823 0.009284 0.01051 0.09%
Castro::construct_old_gravity_source() 140 0.007158 0.008774 0.009548 0.08%
Castro::swap_state_time_levels() 140 0.00642 0.007527 0.00903 0.08%
FabArray::ParallelCopy() 21259 0.008506 0.008777 0.008976 0.08%
Gravity::get_old_grav_vector() 140 0.005313 0.006457 0.008845 0.08%
FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003711 0.006686 0.008814 0.08%
Castro::buildMetrics() 35 0.0056 0.006334 0.008511 0.08%
DistributionMapping::LeastUsedCPUs() 12 0.0002155 0.004065 0.007364 0.07%
FabArray::mult() 1063 0.005367 0.00609 0.007002 0.06%
Gravity::applyMetricTerms() 90 0.005786 0.006239 0.006649 0.06%
Amr::timeStep() 140 0.002819 0.003926 0.006607 0.06%
StateData::FillBoundary(geom) 745 0.001438 0.003792 0.006324 0.06%
Amr::regrid() 21 0.003403 0.004573 0.006149 0.05%
Gravity::solve_for_phi() 280 0.005266 0.005728 0.006025 0.05%
AmrMesh::MakeNewGrids() 23 0.002817 0.005084 0.005672 0.05%
Gravity::gravity_sync() 60 0.004239 0.004939 0.005336 0.05%
BoxList::pci 22 0.0003925 0.003051 0.005148 0.05%
MLLinOp::defineGrids() 360 0.004033 0.004367 0.005123 0.05%
MLCellLinOp::prepareForSolve() 360 0.002944 0.00379 0.004913 0.04%
FabArray::norminf(mask) 270 0.003349 0.004059 0.004654 0.04%
MLCellLinOp::correctionResidual() 9063 0.004054 0.004291 0.004484 0.04%
FabArray::setDomainBndry() 1617 0.003503 0.003855 0.004424 0.04%
Castro::Castro() 35 0.003631 0.00413 0.004422 0.04%
MLMG::mgVcycle() 3385 0.00376 0.003905 0.004306 0.04%
average_down_faces 360 0.002239 0.002635 0.003286 0.03%
Gravity::update_max_rhs() 30 0.002255 0.002735 0.003227 0.03%
MLMG::actualBottomSolve() 1843 0.002341 0.002525 0.003137 0.03%
MultiFab::Subtract() 420 0.001925 0.002396 0.00285 0.03%
Gravity::GetCrsePhi() 250 0.00189 0.002463 0.00283 0.03%
MLMG::oneIter() 1843 0.002428 0.002508 0.00282 0.02%
Castro::construct_old_gravity() 140 0.002091 0.002444 0.002695 0.02%
MLMG::MLResNormInf() 440 0.0007545 0.001453 0.002584 0.02%
Castro::reset_internal_energy(MultiFab) 1189 0.001632 0.002055 0.002503 0.02%
MLLinOp::makeSubCommunicator() 70 0.001332 0.00154 0.002232 0.02%
MLMG:computeResOfCorrection() 6101 0.001918 0.002058 0.002127 0.02%
Gravity::create_comp_minus_level_grad_phi() 60 0.001512 0.001869 0.002119 0.02%
MLMG::mgVcycle_bottom 3385 0.001822 0.00187 0.001976 0.02%
Gravity::average_fine_ec_onto_crse_ec() 90 0.001491 0.001677 0.001939 0.02%
MLMG::mgVcycle_down::0 1843 0.001662 0.00174 0.001797 0.02%
MLCellLinOp::solutionResidual() 3154 0.001708 0.00176 0.001796 0.02%
Castro::apply_tagging_restrictions() 34 0.001138 0.001383 0.001604 0.01%
Gravity::solve_phi_with_mlmg() 300 0.0008473 0.001135 0.001601 0.01%
Castro::clean_state() 1182 0.001407 0.00147 0.001593 0.01%
TagBoxArray::collate() 34 0.0005967 0.0009386 0.001583 0.01%
Castro::finalize_advance() 140 0.001052 0.001313 0.001538 0.01%
Gravity::multilevel_solve_for_new_phi() 20 0.001112 0.001423 0.001532 0.01%
StateDataPhysBCFunct::() 1617 0.001244 0.001337 0.001463 0.01%
MLMG::mgVcycle_down::1 1843 0.001339 0.00138 0.001429 0.01%
MLMG::mgVcycle_up::1 1843 0.001297 0.001361 0.001427 0.01%
ClusterList::chop() 4 0 0.0001737 0.001389 0.01%
AMRErrorTag::operator() 34 0.0009432 0.001173 0.001379 0.01%
main() 1 0.0007003 0.0009204 0.001247 0.01%
MLMG::mgVcycle_up::0 1843 0.001128 0.001174 0.001209 0.01%
FabArrayBase::TheFPinfo() 728 0.0009326 0.001044 0.001194 0.01%
Castro::expand_state() 200 0.001009 0.001074 0.001136 0.01%
MLMG::computeResWithCrseSolFineCor() 771 0.0009269 0.0009853 0.001078 0.01%
MLPoisson::define() 360 0.0007049 0.0007673 0.0009325 0.01%
Castro::construct_new_gravity() 140 0.0007099 0.0008127 0.0009178 0.01%
MLMG::computeResidual() 1843 0.0008181 0.0008411 0.0009165 0.01%
Castro::finalize_do_advance() 140 0.0004189 0.0005746 0.0007433 0.01%
FabArrayBase::FB::FB() 299 0.0001855 0.000415 0.0007007 0.01%
Castro::do_new_sources() 260 0.0005873 0.0006244 0.0006512 0.01%
Castro::build_fine_mask() 40 0.0005515 0.0006201 0.000651 0.01%
Gravity::actual_multilevel_solve() 20 0.0004212 0.000565 0.000638 0.01%
Castro::derive() 34 0.0004559 0.000502 0.0005791 0.01%
Amr::grid_places() 23 0.0003033 0.0003641 0.000549 0.00%
MLLinOp::define() 360 0.0003876 0.0004641 0.0005441 0.00%
MLMG::miniCycle() 1542 0.0004912 0.0005142 0.0005419 0.00%
ClusterList::intersect() 4 0 6.69e-05 0.0005352 0.00%
Castro::apply_source_to_state() 520 0.0004718 0.0004961 0.0005284 0.00%
MLMG::computeResWithCrseCorFineCor() 771 0.0004632 0.0004849 0.0005025 0.00%
MLMG::computeMLResidual() 440 0.0004062 0.0004488 0.0004938 0.00%
Castro::init(old) 28 0.0003443 0.0003904 0.0004634 0.00%
Castro::subcycle_advance_ctu() 140 0.0003795 0.000415 0.0004607 0.00%
Castro::enforce_speed_limit() 1182 0.0003615 0.0003943 0.0004507 0.00%
Castro::advance() 140 0.0003716 0.0004032 0.000445 0.00%
MLMG::mgVcycle_down::2 483 0.0003641 0.0003948 0.0004332 0.00%
Amr::InitAmr() 1 0.0002804 0.0003217 0.0004261 0.00%
MLMG::mgVcycle_down::6 483 0.0003523 0.000373 0.000398 0.00%
MLMG::mgVcycle_down::3 483 0.0003236 0.0003462 0.0003704 0.00%
MLMG::mgVcycle_down::4 483 0.0003138 0.0003316 0.0003593 0.00%
Castro::do_old_sources() 140 0.0003092 0.0003361 0.0003589 0.00%
MLMG::mgVcycle_down::5 483 0.0002847 0.0003058 0.0003313 0.00%
AmrMesh-cluster 4 0 3.986e-05 0.0003188 0.00%
Gravity::swapTimeLevels() 140 0.0002343 0.0002671 0.0002949 0.00%
MLPoisson::prepareForSolve() 360 0.0002263 0.0002556 0.000285 0.00%
MLMG::getGradSolution() 360 0.0002557 0.0002695 0.000283 0.00%
MLMG::mgVcycle_up::3 483 0.0002054 0.000234 0.0002795 0.00%
AmrLevel::AmrLevel(dm) 35 0.0002279 0.0002449 0.0002602 0.00%
MLMG::mgVcycle_up::2 483 0.0002399 0.0002455 0.0002572 0.00%
MLMG::mgVcycle_up::6 483 0.0002353 0.000247 0.0002551 0.00%
MLMG::mgVcycle_up::4 483 0.0002082 0.0002235 0.0002481 0.00%
MLMG::mgVcycle_up::5 483 0.0002199 0.0002328 0.0002476 0.00%
makeSFC 350 0.0002069 0.0002218 0.0002317 0.00%
OwnerMask() 34 0.000162 0.0001874 0.0002255 0.00%
TagBoxArray::mapPRD 34 0.0001949 0.0002074 0.0002255 0.00%
Castro::post_regrid() 66 0.000146 0.0001759 0.0002057 0.00%
Castro::avgDown(state_indx) 248 0.0001609 0.0001758 0.0001937 0.00%
Castro::post_timestep() 140 0.0001613 0.0001736 0.0001844 0.00%
Castro::check_for_nan() 280 0.0001598 0.0001742 0.000183 0.00%
MultiFab::Multiply() 40 0.0001588 0.0001663 0.0001725 0.00%
MLLinOp::makeAgglomeratedDMap 70 0.0001509 0.0001557 0.0001642 0.00%
DistributionMapping::Distribute() 355 0.0001492 0.0001548 0.0001593 0.00%
MLMG::MLRhsNormInf() 360 0.0001366 0.0001451 0.0001578 0.00%
FabArray::RecvLayoutMask() 90 0.0001007 0.0001101 0.000121 0.00%
Amr::FinalizeInit() 1 3.596e-06 1.772e-05 0.0001134 0.00%
Gravity::solve_for_delta_phi 60 8.683e-05 9.609e-05 0.0001103 0.00%
knapsack() 7 0.000103 0.0001066 0.0001084 0.00%
Castro::enforce_consistent_e() 7 7.956e-05 8.902e-05 9.661e-05 0.00%
Castro::create_source_corrector() 140 6.672e-05 7.654e-05 8.56e-05 0.00%
Castro::avgDown() 62 6.327e-05 6.921e-05 8.119e-05 0.00%
BoxList::complementIn 574 6.552e-05 7.105e-05 7.663e-05 0.00%
Castro::errorEst() 34 5.943e-05 6.468e-05 7.115e-05 0.00%
Castro::retry_advance_ctu() 140 4.748e-05 5.578e-05 6.902e-05 0.00%
Castro::computeNewDt() 28 4.038e-05 4.359e-05 4.749e-05 0.00%
Amr::writeSmallPlotFile() 1 3.323e-05 3.475e-05 3.605e-05 0.00%
Amr::initSubcycle() 1 1.323e-05 1.748e-05 3.488e-05 0.00%
DistributionMapping::SFCProcessorMapDoIt() 5 2.971e-05 3.166e-05 3.44e-05 0.00%
Gravity::set_mass_offset() 21 1.971e-05 2.313e-05 2.884e-05 0.00%
Amr::bldFineLevels() 1 1.989e-05 2.313e-05 2.636e-05 0.00%
DistributionMapping::KnapSackDoIt() 7 2.131e-05 2.307e-05 2.61e-05 0.00%
Amr::defBaseLevel() 1 1.557e-05 1.961e-05 2.521e-05 0.00%
BoxList::parallelComplementIn() 57 1.985e-05 2.197e-05 2.32e-05 0.00%
Castro::apply_problem_tags() 34 1.404e-05 1.523e-05 1.662e-05 0.00%
Castro::post_init() 3 7.969e-06 8.829e-06 1.051e-05 0.00%
Amr::InitializeInit() 1 2.03e-06 2.631e-06 4.644e-06 0.00%
Castro::computeInitialDt() 2 3.146e-06 3.468e-06 4.047e-06 0.00%
Amr::init() 1 1.464e-06 1.74e-06 1.882e-06 0.00%
Amr::initialInit() 1 1.016e-06 1.33e-06 1.785e-06 0.00%
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
Name NCalls Incl. Min Incl. Avg Incl. Max Max %
--------------------------------------------------------------------------------------------
main() 1 11.3 11.3 11.3 100.00%
Amr::coarseTimeStep() 20 11.09 11.09 11.09 98.21%
Amr::timeStep() 140 11.06 11.07 11.08 98.06%
Castro::advance() 140 8.186 8.191 8.193 72.53%
Castro::subcycle_advance_ctu() 140 7.975 7.996 8.024 71.03%
Castro::do_advance_ctu() 140 7.975 7.995 8.024 71.03%
Gravity::actual_solve_with_mlmg() 360 6.001 6.01 6.024 53.32%
MLMG::solve() 360 5.826 5.834 5.842 51.71%
MLMG::oneIter() 1843 5.434 5.468 5.489 48.59%
MLMG::mgVcycle() 3385 5.034 5.09 5.132 45.43%
Gravity::solve_phi_with_mlmg() 300 4.511 4.519 4.531 40.11%
Gravity::solve_for_phi() 280 3.816 3.824 3.836 33.96%
MLMG::mgVcycle_bottom 3385 3.459 3.48 3.492 30.91%
MLMG::actualBottomSolve() 1843 3.037 3.046 3.072 27.19%
MLCGSolver::bicgstab 1420 3.033 3.042 3.067 27.15%
Castro::construct_new_gravity() 140 3.044 3.048 3.056 27.05%
Castro::construct_ctu_hydro_source() 140 2.107 2.534 2.821 24.97%
Castro::post_timestep() 140 2.06 2.076 2.083 18.44%
Castro::reflux() 60 1.94 1.954 1.971 17.45%
MLCellLinOp::applyBC() 165294 1.511 1.698 1.907 16.88%
MLCellLinOp::smooth() 27488 1.661 1.736 1.794 15.88%
FabArray::FillBoundary() 157901 1.229 1.397 1.632 14.44%
Gravity::gravity_sync() 60 1.625 1.626 1.626 14.39%
MLCGSolver::ParallelAllReduce 243656 1.088 1.337 1.593 14.10%
Gravity::solve_for_delta_phi 60 1.547 1.548 1.549 13.71%
MLCellLinOp::apply() 108917 1.197 1.341 1.49 13.19%
MLPoisson::Fsmooth() 54976 0.9529 1.063 1.139 10.08%
Castro::construct_old_gravity() 140 0.9058 0.9113 0.9167 8.11%
FabArray::ParallelCopy() 21259 0.6028 0.7089 0.8969 7.94%
Amr::regrid() 21 0.846 0.8533 0.8635 7.64%
FillBoundary_finish() 157901 0.4981 0.6303 0.8107 7.18%
FillBoundary_nowait() 157901 0.5792 0.7118 0.7918 7.01%
Gravity::multilevel_solve_for_new_phi() 20 0.7113 0.7131 0.7141 6.32%
Gravity::actual_multilevel_solve() 20 0.7098 0.7117 0.713 6.31%
Castro::post_regrid() 66 0.6866 0.6908 0.6934 6.14%
FabArray::ParallelCopy_finish() 21259 0.3295 0.4538 0.677 5.99%
FillPatchIterator::Initialize 889 0.471 0.5122 0.561 4.97%
MLMG::mgVcycle_down::0 1843 0.5009 0.5242 0.5466 4.84%
MLMG::mgVcycle_up::0 1843 0.4698 0.4837 0.4911 4.35%
FillPatchTwoLevels 756 0.3919 0.4344 0.4908 4.34%
MLMG::miniCycle() 1542 0.408 0.4346 0.4534 4.01%
Castro::clean_state() 1182 0.3619 0.4123 0.4518 4.00%
Castro::initialize_do_advance() 140 0.2845 0.3129 0.3311 2.93%
FillPatchSingleLevel 1617 0.2356 0.2736 0.3257 2.88%
MLPoisson::Fapply() 108917 0.2508 0.284 0.3041 2.69%
MLCellLinOp::correctionResidual() 9063 0.2593 0.2827 0.2996 2.65%
Castro::expand_state() 200 0.2314 0.2597 0.2845 2.52%
Castro::do_new_sources() 260 0.2221 0.251 0.2727 2.41%
Castro::computeTemp() 1189 0.2147 0.2469 0.2702 2.39%
FabArray::ParallelCopy_nowait() 21259 0.2114 0.2463 0.2693 2.38%
MLMG::mgVcycle_down::1 1843 0.228 0.2342 0.2446 2.17%
MLCellLinOp::solutionResidual() 3154 0.2062 0.2201 0.2349 2.08%
amrex::Dot() 193401 0.1651 0.1914 0.2109 1.87%
MLMG::computeResWithCrseSolFineCor() 771 0.1593 0.1863 0.2073 1.83%
FabArray::setVal() 27514 0.1415 0.1784 0.2015 1.78%
MLMG::mgVcycle_up::1 1843 0.1777 0.1879 0.1948 1.72%
Castro::estTimeStep() 308 0.11 0.1541 0.1892 1.67%
Castro::reset_internal_energy(MultiFab) 1189 0.1501 0.1735 0.1878 1.66%
Castro::reset_internal_energy(Fab) 5919 0.148 0.1715 0.1853 1.64%
Amr::init() 1 0.1827 0.1827 0.1828 1.62%
FabArray::Saxpy() 145295 0.1399 0.1597 0.1806 1.60%
amrex::Copy() 106604 0.1338 0.1563 0.1765 1.56%
Castro::initialize_advance() 140 0.1316 0.1541 0.1725 1.53%
Amr::initialInit() 1 0.1645 0.1645 0.1646 1.46%
amrex::average_down 8093 0.1184 0.1403 0.1582 1.40%
Castro::normalize_species() 1182 0.1272 0.1434 0.1574 1.39%
Amr::FinalizeInit() 1 0.1517 0.1543 0.1572 1.39%
Castro::construct_new_source() 1300 0.1199 0.1345 0.1448 1.28%
MLMG::computeResidual() 1843 0.1155 0.1306 0.1379 1.22%
FabArray::norminf() 100683 0.1087 0.1228 0.134 1.19%
MLMG::addInterpCorrection() 6101 0.05819 0.1107 0.1336 1.18%
MLMG:computeResOfCorrection() 6101 0.126 0.129 0.1326 1.17%
MLPoisson::normalize() 98120 0.09884 0.1133 0.1217 1.08%
Castro::do_old_sources() 140 0.09005 0.1031 0.1145 1.01%
MLMG::mgVcycle_up::2 483 0.02823 0.06815 0.109 0.96%
MLMG::ResNormInf() 2383 0.05228 0.07931 0.1063 0.94%
MLPoisson::define() 360 0.07647 0.08928 0.1062 0.94%
Castro::avgDown() 62 0.06136 0.08035 0.1021 0.90%
Castro::avgDown(state_indx) 248 0.0613 0.08028 0.102 0.90%
amrex::average_down_w_geom 248 0.06113 0.08011 0.1018 0.90%
Gravity::get_new_grav_vector() 263 0.09706 0.09879 0.1012 0.90%
MLCellLinOp::reflux() 951 0.07303 0.08944 0.09961 0.88%
MLMG::computeResWithCrseCorFineCor() 771 0.08211 0.0919 0.09711 0.86%
Castro::construct_new_gravity_source() 260 0.07431 0.08475 0.09239 0.82%
Amr::bldFineLevels() 1 0.08213 0.08475 0.08751 0.77%
FabArray::LinComb() 96820 0.05669 0.06987 0.08399 0.74%
MLMG::computeMLResidual() 440 0.05422 0.06416 0.07339 0.65%
MLCellLinOp::setLevelBC() 450 0.02497 0.04377 0.07045 0.62%
FillPatchInterp(MF) 728 0.06498 0.06693 0.06863 0.61%
Castro::post_init() 3 0.06288 0.06577 0.06842 0.61%
FabArrayBase::getCPC() 29651 0.05618 0.06302 0.06838 0.61%
FabArray::Xpay() 59632 0.05112 0.05919 0.06833 0.60%
MLMG::prepareForSolve() 360 0.0618 0.06534 0.0674 0.60%
FluxRegister::Reflux() 960 0.05095 0.05849 0.06461 0.57%
MLMG::mgVcycle_up::3 483 0.00412 0.02808 0.06432 0.57%
MLCellLinOp::updateSolBC() 871 0.04377 0.05626 0.06431 0.57%
Gravity::get_old_grav_vector() 140 0.06062 0.06207 0.06365 0.56%
Castro::initData() 7 0.04757 0.055 0.06333 0.56%
MLCellLinOp::defineAuxData() 360 0.04533 0.05281 0.0617 0.55%
Castro::init(old) 28 0.04897 0.05566 0.05965 0.53%
MLCellLinOp::updateCorBC() 771 0.04451 0.05185 0.0569 0.50%
Castro::Castro() 35 0.03872 0.04388 0.05211 0.46%
amrex::Add() 7701 0.03698 0.04413 0.05069 0.45%
Gravity::GetCrsePhi() 250 0.02006 0.03435 0.05039 0.45%
MLMG::interpCorrection_1 771 0.03072 0.03625 0.0491 0.43%
Castro::finalize_advance() 140 0.03681 0.04027 0.04414 0.39%
FabArrayBase::CPC::define() 4099 0.03038 0.03583 0.04067 0.36%
Castro::apply_source_to_state() 520 0.03013 0.03433 0.03872 0.34%
MLCellLinOp::defineBC() 360 0.02249 0.02881 0.03725 0.33%
Amr::writePlotFile() 2 0.0365 0.03658 0.03662 0.32%
MLMG::mgVcycle_down::2 483 0.03199 0.03337 0.03505 0.31%
Castro::construct_old_source() 700 0.02589 0.02911 0.03102 0.27%
Amr::grid_places() 23 0.02158 0.02617 0.0307 0.27%
AmrMesh::MakeNewGrids() 23 0.02125 0.02581 0.03038 0.27%
Gravity::fill_multipole_BCs() 70 0.02839 0.0293 0.02996 0.27%
VisMF::Write(FabArray) 6 0.008933 0.01174 0.02993 0.26%
FabArrayBase::getFB() 157901 0.02642 0.0275 0.02874 0.25%
Castro::initMFs() 35 0.02123 0.02435 0.02844 0.25%
Castro::FluxRegCrseInit 140 0.02578 0.02717 0.02763 0.24%
BndryData::define() 540 0.01454 0.01947 0.02585 0.23%
Castro::enforce_min_density() 1182 0.01905 0.02131 0.02369 0.21%
MLMG::mgVcycle_down::3 483 0.005552 0.01406 0.02353 0.21%
Castro::check_for_nan() 280 0.0177 0.02088 0.02341 0.21%
MultiFab::contains_nan() 280 0.01751 0.0207 0.02324 0.21%
Castro::computeNewDt() 28 0.01946 0.02015 0.0211 0.19%
Gravity::update_max_rhs() 30 0.0148 0.01718 0.02007 0.18%
Gravity::average_fine_ec_onto_crse_ec() 90 0.01697 0.0178 0.01913 0.17%
Castro::errorEst() 34 0.01023 0.01448 0.01786 0.16%
MLMG::getGradSolution() 360 0.013 0.01536 0.01743 0.15%
MLCellLinOp::compGrad() 450 0.01274 0.01509 0.01715 0.15%
Castro::derive() 34 0.008065 0.01185 0.01504 0.13%
MLPoisson::FFlux() 7882 0.007855 0.01164 0.01423 0.13%
AmrLevel::AmrLevel(dm) 35 0.01099 0.01197 0.01329 0.12%
StateData::define() 140 0.01075 0.01172 0.01305 0.12%
Amr::InitializeInit() 1 0.007327 0.01024 0.01287 0.11%
Amr::defBaseLevel() 1 0.007322 0.01024 0.01287 0.11%
FabArrayBase::TheFPinfo() 728 0.002696 0.007411 0.0122 0.11%
Castro::FluxRegFineAdd() 140 0.005313 0.0079 0.01172 0.10%
MLMG::mgVcycle_down::4 483 0.005128 0.006256 0.01149 0.10%
FPinfo::FPinfo() 7 0.001734 0.006366 0.01101 0.10%
MultiFab::max() 90 0.00377 0.006788 0.01082 0.10%
MLMG::MLResNormInf() 440 0.007922 0.009118 0.01076 0.10%
average_down_faces 360 0.008006 0.00949 0.01031 0.09%
Castro::construct_old_gravity_source() 140 0.007158 0.008774 0.009548 0.08%
Castro::swap_state_time_levels() 140 0.00642 0.007527 0.00903 0.08%
MLMG::mgVcycle_up::4 483 0.004123 0.004947 0.008905 0.08%
FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003711 0.006686 0.008814 0.08%
Castro::buildMetrics() 35 0.005705 0.006453 0.008663 0.08%
MLMG::mgVcycle_down::5 483 0.004942 0.005596 0.008337 0.07%
MLLinOp::define() 360 0.006367 0.006893 0.007883 0.07%
StateDataPhysBCFunct::() 1617 0.002682 0.005129 0.007787 0.07%
MLLinOp::defineGrids() 360 0.005979 0.006429 0.00737 0.07%
DistributionMapping::LeastUsedCPUs() 12 0.0002155 0.004065 0.007364 0.07%
DistributionMapping::SFCProcessorMapDoIt() 5 0.0001922 0.004042 0.007346 0.07%
MLMG::mgVcycle_down::6 483 0.004984 0.005459 0.007234 0.06%
FabArray::mult() 1063 0.005367 0.00609 0.007002 0.06%
Gravity::applyMetricTerms() 90 0.005786 0.006239 0.006649 0.06%
MLMG::MLRhsNormInf() 360 0.005293 0.005907 0.006393 0.06%
Castro::computeInitialDt() 2 0.0009226 0.003511 0.00638 0.06%
MLMG::mgVcycle_up::5 483 0.004228 0.004696 0.006368 0.06%
MLMG::mgVcycle_up::6 483 0.004745 0.005119 0.006342 0.06%
StateData::FillBoundary(geom) 745 0.001438 0.003792 0.006324 0.06%
BoxList::parallelComplementIn() 57 0.0004229 0.00309 0.005191 0.05%
BoxList::pci 22 0.0003925 0.003051 0.005148 0.05%
MLPoisson::prepareForSolve() 360 0.003226 0.004046 0.005146 0.05%
MLCellLinOp::prepareForSolve() 360 0.002944 0.00379 0.004913 0.04%
Gravity::swapTimeLevels() 140 0.003308 0.003907 0.00476 0.04%
FabArray::norminf(mask) 270 0.003349 0.004059 0.004654 0.04%
FabArray::setDomainBndry() 1617 0.003503 0.003855 0.004424 0.04%
Gravity::create_comp_minus_level_grad_phi() 60 0.002873 0.003499 0.004071 0.04%
MultiFab::Subtract() 420 0.001925 0.002396 0.00285 0.03%
TagBoxArray::mapPRD 34 0.001315 0.001812 0.002833 0.03%
AmrMesh-cluster 4 0 0.0002804 0.002243 0.02%
MLLinOp::makeSubCommunicator() 70 0.001332 0.00154 0.002232 0.02%
Castro::apply_tagging_restrictions() 34 0.001138 0.001383 0.001604 0.01%
TagBoxArray::collate() 34 0.0005967 0.0009386 0.001583 0.01%
ClusterList::chop() 4 0 0.0001737 0.001389 0.01%
AMRErrorTag::operator() 34 0.0009432 0.001173 0.001379 0.01%
Castro::finalize_do_advance() 140 0.0004189 0.0005746 0.0007433 0.01%
FabArrayBase::FB::FB() 299 0.0001855 0.000415 0.0007007 0.01%
Castro::build_fine_mask() 40 0.0005515 0.0006201 0.000651 0.01%
MLLinOp::makeAgglomeratedDMap 70 0.0005021 0.0005213 0.0005404 0.00%
ClusterList::intersect() 4 0 6.69e-05 0.0005352 0.00%
Castro::enforce_speed_limit() 1182 0.0003615 0.0003943 0.0004507 0.00%
Amr::InitAmr() 1 0.0002965 0.0003392 0.0004393 0.00%
makeSFC 350 0.0003505 0.0003656 0.0003762 0.00%
OwnerMask() 34 0.000162 0.0001874 0.0002255 0.00%
DistributionMapping::KnapSackDoIt() 7 0.0001887 0.0001954 0.0002002 0.00%
MultiFab::Multiply() 40 0.0001588 0.0001663 0.0001725 0.00%
DistributionMapping::Distribute() 355 0.0001492 0.0001548 0.0001593 0.00%
FabArray::RecvLayoutMask() 90 0.0001007 0.0001101 0.000121 0.00%
knapsack() 7 0.000103 0.0001066 0.0001084 0.00%
Castro::enforce_consistent_e() 7 7.956e-05 8.902e-05 9.661e-05 0.00%
Castro::create_source_corrector() 140 6.672e-05 7.654e-05 8.56e-05 0.00%
BoxList::complementIn 574 6.552e-05 7.105e-05 7.663e-05 0.00%
Castro::retry_advance_ctu() 140 4.748e-05 5.578e-05 6.902e-05 0.00%
Amr::writeSmallPlotFile() 1 3.323e-05 3.475e-05 3.605e-05 0.00%
Amr::initSubcycle() 1 1.323e-05 1.748e-05 3.488e-05 0.00%
Gravity::set_mass_offset() 21 1.971e-05 2.313e-05 2.884e-05 0.00%
Castro::apply_problem_tags() 34 1.404e-05 1.523e-05 1.662e-05 0.00%
--------------------------------------------------------------------------------------------
Pinned Memory Usage:
---------------------------------------------------------------------------------------------------------------------
Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max
---------------------------------------------------------------------------------------------------------------------
The_Pinned_Arena::Initialize() 8 8 10 B 10 B 12 B 8192 KiB 8192 KiB 8192 KiB
---------------------------------------------------------------------------------------------------------------------
AMReX (23.05-30-g07f87b0a9047) finalized