MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.06-10-g18d0a2861d31) initialized Starting run at 01:00:42 UTC on 2022-06-08. Successfully read inputs file ... Castro git describe: 22.06-8-g07c40ca1e AMReX git describe: 22.06-10-g18d0a2861 Microphysics git describe: 22.06-1-gb8e427c1 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001256374 new finest: 1 grid_places() time: 0.005866436 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.006951364 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.008595572 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.014752314 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.494936642 [STEP 1] FAB kilobyte spread across MPI nodes: [18072 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000533533 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.529686057 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000792018 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.542149401 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000549797 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.543302334 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000818523 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.532956608 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000548044 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.526885167 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000801523 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.53260635 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.00054203 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.530069534 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000799541 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.534206527 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000549497 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.551225174 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.001045052 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.558218574 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000551327 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.530065404 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000794112 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.538829668 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000539388 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.532177677 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000784369 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.540300896 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000539127 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.532710669 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000796433 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.538329903 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000541833 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.547276318 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000774197 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.546662694 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000543271 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.538360294 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.014067401 seconds Ending run at 01:00:53 UTC on 2022-06-08. Run time = 10.91349266 Run time without initialization = 10.73867026 Average number of zones advanced per microsecond: 0.821 Average number of zones advanced per microsecond per rank: 0.103 TinyProfiler total time across processes [min...avg...max]: 10.91 ... 10.91 ... 10.91 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.8791 2.2051 2.4915 22.83% MLCGSolver::ParallelAllReduce 243542 0.8788 1.129 1.392 12.75% MLPoisson::Fsmooth() 54976 0.8623 0.9532 1.074 9.84% Castro::do_advance_ctu() 140 0.3178 0.6072 0.9303 8.52% FillBoundary_finish() 157859 0.442 0.653 0.8364 7.66% FabArray::ParallelCopy_finish() 21259 0.3153 0.5221 0.7567 6.93% FillBoundary_nowait() 157859 0.4922 0.6583 0.7514 6.88% MLCellLinOp::applyBC() 165252 0.2143 0.3031 0.4054 3.71% MLPoisson::Fapply() 108875 0.2703 0.2988 0.3323 3.04% MLCGSolver::bicgstab 1420 0.2143 0.2384 0.2655 2.43% MultiFab::LinComb() 288336 0.1698 0.2066 0.2452 2.25% FabArray::setVal() 27604 0.1407 0.1924 0.2451 2.25% FabArray::ParallelCopy_nowait() 21259 0.1596 0.2009 0.2235 2.05% MultiFab::Dot() 193316 0.1679 0.1913 0.2199 2.01% Castro::estTimeStep() 308 0.1012 0.1625 0.2095 1.92% Castro::reset_internal_energy(Fab) 5919 0.1527 0.1737 0.1914 1.75% Castro::normalize_species() 1182 0.1298 0.1434 0.1601 1.47% MLPoisson::normalize() 98078 0.1024 0.1141 0.1272 1.17% MLMG::ResNormInf() 2383 0.05624 0.08453 0.1091 1.00% Castro::construct_new_gravity_source() 260 0.06753 0.07948 0.09055 0.83% amrex::average_down 8093 0.07046 0.07785 0.08692 0.80% Castro::computeTemp() 1189 0.06316 0.07104 0.08136 0.75% MultiFab::Saxpy() 1180 0.05216 0.06747 0.07795 0.71% MLMG::addInterpCorrection() 6101 0.05878 0.06562 0.07501 0.69% CellConservativeLinear::interp() 9059 0.0639 0.07055 0.07267 0.67% CGSolver::sxay() 288086 0.05626 0.06306 0.06908 0.63% FillPatchIterator::Initialize 889 0.03376 0.05464 0.06654 0.61% Castro::reflux() 60 0.03859 0.04716 0.05894 0.54% Castro::initData() 7 0.04417 0.05245 0.05892 0.54% FabArray::FillBoundary() 157859 0.04849 0.05401 0.05774 0.53% MLCellLinOp::defineAuxData() 360 0.03712 0.04237 0.05328 0.49% FillPatchSingleLevel 1617 0.03384 0.04233 0.05038 0.46% MLMG::prepareForSolve() 360 0.03075 0.03756 0.04656 0.43% amrex::average_down_w_geom 248 0.03092 0.03716 0.04484 0.41% FabArrayBase::CPC::define() 4099 0.02769 0.03599 0.04277 0.39% MLCellLinOp::apply() 108875 0.03528 0.03993 0.04233 0.39% Gravity::fill_multipole_BCs() 70 0.02835 0.03163 0.04034 0.37% Gravity::actual_solve_with_mlmg() 360 0.02332 0.02805 0.03908 0.36% FluxRegister::Reflux() 960 0.02668 0.03086 0.03675 0.34% MultiFab::Xpay() 12217 0.02961 0.03298 0.03657 0.34% Castro::initialize_do_advance() 140 0.01569 0.02833 0.03518 0.32% Castro::expand_state() 200 0.01959 0.02933 0.03458 0.32% FillPatchTwoLevels 756 0.02136 0.03001 0.03448 0.32% MLMG::solve() 360 0.008976 0.02104 0.03278 0.30% MLMG::interpCorrection_1 771 0.0239 0.0272 0.03221 0.30% MLCellLinOp::reflux() 951 0.02182 0.02644 0.03219 0.29% FabArrayBase::getFB() 157859 0.02366 0.02872 0.03214 0.29% Castro::initMFs() 35 0.01691 0.02466 0.03163 0.29% FabArrayBase::getCPC() 29741 0.02379 0.02796 0.03054 0.28% Castro::enforce_min_density() 1182 0.02195 0.02491 0.0286 0.26% Castro::construct_new_source() 1300 0.01725 0.0244 0.02784 0.26% Gravity::get_new_grav_vector() 263 0.01714 0.02055 0.02674 0.25% MLMG::oneIter() 1843 0.02103 0.02342 0.02612 0.24% MLCellLinOp::updateSolBC() 871 0.01192 0.01692 0.02513 0.23% VisMF::Write(FabArray) 6 0.007461 0.0102 0.02432 0.22% MLCellLinOp::updateCorBC() 771 0.01121 0.01585 0.02359 0.22% MultiFab::contains_nan() 280 0.01714 0.02004 0.02334 0.21% Castro::FluxRegCrseInit 140 0.01431 0.01857 0.02315 0.21% BndryData::define() 540 0.01281 0.01594 0.02263 0.21% Amr::writePlotFile() 2 0.005545 0.01976 0.02251 0.21% Amr::coarseTimeStep() 20 0.002309 0.006163 0.01983 0.18% Gravity::get_old_grav_vector() 140 0.009204 0.01167 0.01765 0.16% MLCellLinOp::smooth() 27488 0.01489 0.01651 0.01732 0.16% Castro::construct_old_source() 700 0.007693 0.01321 0.01568 0.14% StateData::define() 140 0.008362 0.01178 0.01513 0.14% Castro::initialize_advance() 140 0.009643 0.01208 0.01508 0.14% MLPoisson::FFlux() 7882 0.007167 0.01078 0.01392 0.13% MLCellLinOp::setLevelBC() 450 0.008185 0.01011 0.01326 0.12% MLCellLinOp::compGrad() 450 0.009151 0.01095 0.01276 0.12% Castro::FluxRegFineAdd() 140 0.006804 0.008857 0.01269 0.12% Castro::swap_state_time_levels() 140 0.00517 0.008997 0.01264 0.12% Castro::construct_old_gravity_source() 140 0.006654 0.01052 0.01253 0.11% MLCellLinOp::defineBC() 360 0.008382 0.009689 0.01237 0.11% Gravity::gravity_sync() 60 0.007984 0.01036 0.01208 0.11% FPinfo::FPinfo() 7 0.001199 0.005287 0.01036 0.09% Castro::buildMetrics() 35 0.004985 0.006655 0.01016 0.09% FabArray::ParallelCopy() 21259 0.008176 0.009004 0.009451 0.09% Gravity::solve_for_phi() 280 0.005589 0.007877 0.009029 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004069 0.006745 0.008856 0.08% MultiFab::max() 90 0.003954 0.006486 0.008755 0.08% Amr::timeStep() 140 0.003251 0.004045 0.007902 0.07% Castro::init(old) 28 0.004778 0.006984 0.007822 0.07% FabArray::mult() 1063 0.005689 0.006401 0.00748 0.07% StateData::FillBoundary(geom) 745 0.001681 0.00384 0.00659 0.06% Amr::regrid() 21 0.003913 0.004801 0.006569 0.06% Castro::construct_old_gravity() 140 0.003479 0.004941 0.006067 0.06% MLLinOp::defineGrids() 360 0.004847 0.005085 0.006002 0.06% AmrMesh::MakeNewGrids() 23 0.002677 0.005049 0.005668 0.05% Gravity::applyMetricTerms() 90 0.00481 0.005223 0.005583 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0003078 0.002352 0.005524 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003855 0.004386 0.005521 0.05% MLCellLinOp::prepareForSolve() 360 0.002945 0.003771 0.005301 0.05% MLMG::MLRhsNormInf() 360 0.004047 0.00459 0.005205 0.05% FabArray::setDomainBndry() 1617 0.003322 0.004156 0.005036 0.05% Castro::construct_new_gravity() 140 0.003443 0.004223 0.004997 0.05% BoxList::pci 22 0.0004097 0.002995 0.004989 0.05% MultiFab::norm0(mask) 270 0.003289 0.00407 0.004888 0.04% Castro::Castro() 35 0.003413 0.004277 0.004851 0.04% MLMG::mgVcycle() 3385 0.00387 0.004324 0.004699 0.04% MLCellLinOp::correctionResidual() 9063 0.003982 0.004341 0.004627 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.002873 0.003238 0.003974 0.04% FillPatchInterp(Fab) 728 0.002883 0.003449 0.003781 0.03% Gravity::update_max_rhs() 30 0.002866 0.003366 0.003755 0.03% MLMG::computeResWithCrseCorFineCor() 771 0.00259 0.0029 0.003653 0.03% Gravity::GetCrsePhi() 250 0.002074 0.002828 0.003502 0.03% MLMG::actualBottomSolve() 1843 0.002651 0.002934 0.00349 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002193 0.002776 0.003377 0.03% MultiFab::Subtract() 420 0.002088 0.002526 0.003351 0.03% Castro::reset_internal_energy(MultiFab) 1189 0.001897 0.002336 0.003037 0.03% MultiFab::Copy() 450 0.001707 0.002113 0.002814 0.03% MLMG::MLResNormInf() 440 0.0006239 0.00161 0.002713 0.02% MLLinOp::makeSubCommunicator() 70 0.001483 0.001781 0.002389 0.02% MLMG::mgVcycle_down::0 1843 0.001926 0.00206 0.002315 0.02% MLMG:computeResOfCorrection() 6101 0.001971 0.002136 0.002225 0.02% MLMG::mgVcycle_bottom 3385 0.001758 0.001883 0.001992 0.02% StateDataPhysBCFunct::() 1617 0.001461 0.001783 0.001988 0.02% MLCellLinOp::solutionResidual() 3154 0.00167 0.001802 0.001931 0.02% Castro::apply_tagging_restrictions() 34 0.001414 0.001661 0.001901 0.02% MLMG::mgVcycle_down::1 1843 0.001353 0.001552 0.00187 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001209 0.001547 0.001826 0.02% Castro::clean_state() 1182 0.001394 0.001628 0.001814 0.02% Castro::finalize_advance() 140 0.0009298 0.001228 0.001532 0.01% MLMG::mgVcycle_up::1 1843 0.001215 0.00138 0.001515 0.01% TagBoxArray::collate() 34 0.00062 0.0009326 0.001479 0.01% ClusterList::chop() 4 0 0.0001763 0.00141 0.01% AMRErrorTag::operator() 34 0.0009973 0.001186 0.001349 0.01% MLMG::mgVcycle_up::0 1843 0.00108 0.001204 0.001267 0.01% FabArrayBase::TheFPinfo() 728 0.0006462 0.0009782 0.001258 0.01% Gravity::solve_phi_with_mlmg() 300 0.0009278 0.001094 0.001257 0.01% MLMG::buildFineMask() 360 0.0009259 0.001064 0.00117 0.01% Gravity::actual_multilevel_solve() 20 0.000735 0.0009467 0.001143 0.01% Castro::build_fine_mask() 100 0.0007678 0.0009646 0.001123 0.01% MLPoisson::define() 360 0.0007788 0.0008753 0.0011 0.01% main() 1 0.0006868 0.0008233 0.0009615 0.01% Castro::finalize_do_advance() 140 0.0004544 0.0005819 0.0008349 0.01% MLMG::computeResidual() 1843 0.000695 0.0007736 0.0008302 0.01% Castro::do_new_sources() 260 0.0005731 0.0007332 0.0008241 0.01% FabArrayBase::FB::FB() 299 0.0001986 0.0004465 0.0006725 0.01% Castro::derive() 34 0.0004975 0.0005635 0.0006527 0.01% Castro::apply_source_to_state() 520 0.0003879 0.0005232 0.0006479 0.01% MLMG::miniCycle() 1542 0.0005139 0.0005508 0.0005958 0.01% Amr::grid_places() 23 0.0003098 0.000373 0.0005738 0.01% Castro::subcycle_advance_ctu() 140 0.0003287 0.0004669 0.0005697 0.01% Castro::enforce_speed_limit() 1182 0.0002993 0.000463 0.0005488 0.01% ClusterList::intersect() 4 0 6.49e-05 0.0005192 0.00% Castro::advance() 140 0.000342 0.0004298 0.0004871 0.00% MLMG::mgVcycle_down::2 483 0.0003772 0.0004109 0.0004561 0.00% Castro::do_old_sources() 140 0.0002905 0.0003884 0.0004388 0.00% Amr::InitAmr() 1 0.0002569 0.0002935 0.0004236 0.00% MLMG::mgVcycle_down::4 483 0.0003507 0.0003994 0.0004225 0.00% MLMG::mgVcycle_down::3 483 0.0003387 0.0003716 0.0004094 0.00% MLPoisson::prepareForSolve() 360 0.000302 0.0003333 0.0004014 0.00% MLLinOp::define() 360 0.0002833 0.00035 0.0003969 0.00% MLMG::mgVcycle_down::6 483 0.0003413 0.0003717 0.0003893 0.00% MLMG::mgVcycle_down::5 483 0.0003035 0.0003437 0.0003666 0.00% Gravity::swapTimeLevels() 140 0.000192 0.0002905 0.0003506 0.00% MultiFab::Multiply() 40 0.0002282 0.000292 0.0003274 0.00% MLMG::computeMLResidual() 440 0.000282 0.0002977 0.0003169 0.00% MLMG::mgVcycle_up::2 483 0.0002395 0.0002733 0.0003099 0.00% MLMG::mgVcycle_up::6 483 0.0002643 0.0002864 0.0002971 0.00% AmrMesh-cluster 4 0 3.653e-05 0.0002922 0.00% MLMG::mgVcycle_up::3 483 0.0002099 0.0002484 0.000285 0.00% MLMG::mgVcycle_up::5 483 0.0002342 0.00026 0.0002724 0.00% MLMG::mgVcycle_up::4 483 0.0002128 0.0002358 0.0002458 0.00% makeSFC 350 0.0002233 0.0002315 0.0002449 0.00% AmrLevel::AmrLevel(dm) 35 0.0002151 0.0002299 0.0002425 0.00% Castro::post_timestep() 140 0.0001741 0.0002153 0.0002425 0.00% MLMG::getGradSolution() 360 0.0001865 0.000216 0.0002411 0.00% OwnerMask() 34 0.0001652 0.0001848 0.0002164 0.00% TagBoxArray::mapPRD 34 0.0001916 0.0002022 0.0002141 0.00% Castro::check_for_nan() 280 0.000166 0.0001853 0.0002023 0.00% Castro::avgDown(state_indx) 248 0.0001266 0.00017 0.0001973 0.00% Castro::post_regrid() 66 0.0001339 0.0001702 0.0001964 0.00% DistributionMapping::Distribute() 355 0.0001394 0.0001734 0.0001893 0.00% MLLinOp::makeAgglomeratedDMap 70 0.000159 0.0001717 0.0001848 0.00% FabArray::RecvLayoutMask() 90 9.297e-05 0.0001102 0.0001222 0.00% Amr::FinalizeInit() 1 3.454e-06 1.853e-05 0.0001178 0.00% knapsack() 7 9.746e-05 0.0001044 0.0001142 0.00% Gravity::solve_for_delta_phi 60 7.872e-05 9.669e-05 0.0001126 0.00% Castro::enforce_consistent_e() 7 7.95e-05 9.022e-05 9.782e-05 0.00% Castro::create_source_corrector() 140 5.258e-05 7.7e-05 9.635e-05 0.00% Amr::writeSmallPlotFile() 1 3.334e-05 5.634e-05 8.278e-05 0.00% Castro::avgDown() 62 5.571e-05 7.082e-05 7.974e-05 0.00% BoxList::complementIn 574 6.74e-05 6.97e-05 7.737e-05 0.00% Castro::errorEst() 34 6.719e-05 7.157e-05 7.371e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.825e-05 3.668e-05 6.51e-05 0.00% Castro::retry_advance_ctu() 140 4.167e-05 4.814e-05 5.954e-05 0.00% Amr::bldFineLevels() 1 3.062e-05 4.47e-05 5.952e-05 0.00% Castro::computeNewDt() 28 4.379e-05 4.891e-05 5.363e-05 0.00% Gravity::set_mass_offset() 21 1.265e-05 2.386e-05 3.072e-05 0.00% DistributionMapping::KnapSackDoIt() 7 1.98e-05 2.185e-05 2.591e-05 0.00% Amr::defBaseLevel() 1 1.855e-05 2.063e-05 2.473e-05 0.00% BoxList::parallelComplementIn() 57 1.973e-05 2.185e-05 2.401e-05 0.00% Castro::apply_problem_tags() 34 1.535e-05 1.639e-05 1.705e-05 0.00% Castro::post_init() 3 7.356e-06 8.935e-06 1.303e-05 0.00% Amr::initSubcycle() 1 8.056e-06 8.849e-06 9.24e-06 0.00% Amr::InitializeInit() 1 1.939e-06 2.946e-06 7.872e-06 0.00% Castro::computeInitialDt() 2 3.518e-06 3.793e-06 4.137e-06 0.00% Amr::init() 1 1.518e-06 1.793e-06 2.228e-06 0.00% Amr::initialInit() 1 1.012e-06 1.221e-06 1.444e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.91 10.91 10.91 100.00% Amr::coarseTimeStep() 20 10.72 10.72 10.72 98.25% Amr::timeStep() 140 10.69 10.7 10.71 98.12% Castro::advance() 140 7.848 7.853 7.857 71.99% Castro::subcycle_advance_ctu() 140 7.607 7.65 7.688 70.45% Castro::do_advance_ctu() 140 7.607 7.649 7.688 70.44% Gravity::actual_solve_with_mlmg() 360 5.836 5.846 5.864 53.73% MLMG::solve() 360 5.647 5.658 5.665 51.91% MLMG::oneIter() 1843 5.24 5.27 5.292 48.49% MLMG::mgVcycle() 3385 4.835 4.884 4.927 45.14% Gravity::solve_phi_with_mlmg() 300 4.396 4.415 4.438 40.67% Gravity::solve_for_phi() 280 3.728 3.746 3.766 34.51% MLMG::mgVcycle_bottom 3385 3.297 3.318 3.343 30.63% Castro::construct_new_gravity() 140 2.995 3 3.007 27.55% MLMG::actualBottomSolve() 1843 2.906 2.914 2.933 26.88% MLCGSolver::bicgstab 1420 2.902 2.91 2.928 26.83% Castro::construct_ctu_hydro_source() 140 1.879 2.205 2.491 22.83% Castro::post_timestep() 140 2.041 2.054 2.062 18.89% Castro::reflux() 60 1.904 1.924 1.946 17.83% MLCellLinOp::applyBC() 165252 1.49 1.662 1.858 17.03% MLCellLinOp::smooth() 27488 1.573 1.635 1.69 15.49% FabArray::FillBoundary() 157859 1.181 1.394 1.633 14.96% Gravity::gravity_sync() 60 1.578 1.578 1.578 14.46% Gravity::solve_for_delta_phi 60 1.497 1.498 1.499 13.73% MLCGSolver::ParallelAllReduce 243542 0.9856 1.227 1.478 13.54% MLCellLinOp::apply() 108875 1.149 1.31 1.444 13.23% MLPoisson::Fsmooth() 54976 0.8623 0.9532 1.074 9.84% FabArray::ParallelCopy() 21259 0.6035 0.7877 1.019 9.34% Castro::construct_old_gravity() 140 0.8847 0.897 0.9128 8.36% Amr::regrid() 21 0.8357 0.8421 0.849 7.78% FillBoundary_finish() 157859 0.442 0.653 0.8364 7.66% FillBoundary_nowait() 157859 0.5208 0.6874 0.7828 7.17% FabArray::ParallelCopy_finish() 21259 0.3153 0.5221 0.7567 6.93% Gravity::multilevel_solve_for_new_phi() 20 0.6855 0.6877 0.689 6.31% FillPatchIterator::Initialize 889 0.5064 0.5911 0.6878 6.30% Gravity::actual_multilevel_solve() 20 0.6837 0.6862 0.6877 6.30% Castro::post_regrid() 66 0.6619 0.6656 0.6684 6.12% FillPatchTwoLevels 756 0.4293 0.5088 0.6143 5.63% MLMG::mgVcycle_down::0 1843 0.4845 0.505 0.5239 4.80% MLMG::mgVcycle_up::0 1843 0.4646 0.4752 0.4852 4.45% Castro::clean_state() 1182 0.3727 0.4163 0.4651 4.26% FillPatchSingleLevel 1617 0.2499 0.335 0.4394 4.03% MLMG::miniCycle() 1542 0.3784 0.4047 0.426 3.90% Castro::initialize_do_advance() 140 0.3337 0.3486 0.3751 3.44% Castro::expand_state() 200 0.272 0.3017 0.3424 3.14% MLPoisson::Fapply() 108875 0.2703 0.2988 0.3323 3.04% CGSolver::sxay() 288086 0.2335 0.2656 0.3112 2.85% MLCellLinOp::correctionResidual() 9063 0.2664 0.2957 0.3063 2.81% Castro::do_new_sources() 260 0.2165 0.2587 0.2961 2.71% FabArray::ParallelCopy_nowait() 21259 0.2033 0.2565 0.2838 2.60% Castro::computeTemp() 1189 0.2187 0.2471 0.2754 2.52% MLCellLinOp::solutionResidual() 3154 0.2111 0.2316 0.2476 2.27% MultiFab::LinComb() 288336 0.1698 0.2066 0.2452 2.25% FabArray::setVal() 27604 0.1407 0.1924 0.2451 2.25% MLMG::mgVcycle_down::1 1843 0.2219 0.2321 0.2416 2.21% MultiFab::Dot() 193316 0.1679 0.1913 0.2199 2.01% Castro::estTimeStep() 308 0.1012 0.1625 0.2095 1.92% MLMG::computeResWithCrseSolFineCor() 771 0.1557 0.1804 0.2003 1.84% Castro::initialize_advance() 140 0.1248 0.1617 0.2 1.83% Castro::reset_internal_energy(MultiFab) 1189 0.1551 0.176 0.1941 1.78% Castro::reset_internal_energy(Fab) 5919 0.1527 0.1737 0.1914 1.75% MLMG::mgVcycle_up::1 1843 0.1727 0.1806 0.186 1.70% Amr::init() 1 0.1742 0.1744 0.1744 1.60% amrex::average_down 8093 0.1201 0.1463 0.1738 1.59% Castro::normalize_species() 1182 0.1298 0.1434 0.1601 1.47% Amr::initialInit() 1 0.1593 0.1594 0.1594 1.46% Castro::construct_new_source() 1300 0.1129 0.1357 0.1541 1.41% Amr::FinalizeInit() 1 0.147 0.15 0.1527 1.40% MLMG::addInterpCorrection() 6101 0.08941 0.1207 0.1455 1.33% MLMG::computeResidual() 1843 0.1171 0.1359 0.1443 1.32% MLMG:computeResOfCorrection() 6101 0.1306 0.1331 0.135 1.24% Castro::do_old_sources() 140 0.08421 0.1113 0.1312 1.20% MLPoisson::normalize() 98078 0.1024 0.1141 0.1272 1.17% MLPoisson::define() 360 0.08148 0.09211 0.115 1.05% Castro::avgDown() 62 0.06229 0.08766 0.1142 1.05% Castro::avgDown(state_indx) 248 0.06222 0.08759 0.1141 1.05% amrex::average_down_w_geom 248 0.06204 0.08742 0.114 1.04% MLMG::ResNormInf() 2383 0.05883 0.08727 0.1115 1.02% Gravity::get_new_grav_vector() 263 0.1049 0.1077 0.1106 1.01% MLMG::mgVcycle_up::2 483 0.02812 0.05862 0.1057 0.97% MLMG::computeResWithCrseCorFineCor() 771 0.08339 0.09639 0.09937 0.91% MLCellLinOp::reflux() 951 0.07092 0.0842 0.09453 0.87% Castro::construct_new_gravity_source() 260 0.06753 0.07948 0.09055 0.83% Amr::bldFineLevels() 1 0.07792 0.08103 0.08351 0.77% Castro::init(old) 28 0.05213 0.06602 0.08245 0.76% MLMG::computeMLResidual() 440 0.06028 0.06865 0.08173 0.75% MLCellLinOp::setLevelBC() 450 0.02605 0.05058 0.07848 0.72% MultiFab::Saxpy() 1180 0.05216 0.06747 0.07795 0.71% FillPatchInterp(Fab) 728 0.06678 0.074 0.07623 0.70% FabArrayBase::getCPC() 29741 0.05148 0.06396 0.07331 0.67% CellConservativeLinear::interp() 9059 0.0639 0.07055 0.07267 0.67% MLMG::prepareForSolve() 360 0.06396 0.06774 0.07192 0.66% Gravity::get_old_grav_vector() 140 0.06671 0.0692 0.07126 0.65% Castro::post_init() 3 0.0623 0.06486 0.06803 0.62% MLCellLinOp::updateSolBC() 871 0.04442 0.05734 0.06725 0.62% MLCellLinOp::defineAuxData() 360 0.04652 0.05342 0.06607 0.61% Gravity::GetCrsePhi() 250 0.02728 0.04218 0.06589 0.60% FluxRegister::Reflux() 960 0.05322 0.05897 0.06469 0.59% Castro::initData() 7 0.04807 0.05662 0.06322 0.58% MLCellLinOp::updateCorBC() 771 0.04623 0.05602 0.06183 0.57% Castro::Castro() 35 0.03139 0.04573 0.05935 0.54% MLMG::mgVcycle_up::3 483 0.003718 0.02635 0.05918 0.54% MLMG::interpCorrection_1 771 0.03758 0.04608 0.05873 0.54% Castro::finalize_advance() 140 0.03715 0.04101 0.04552 0.42% Castro::apply_source_to_state() 520 0.02663 0.03729 0.04403 0.40% FabArrayBase::CPC::define() 4099 0.02769 0.03599 0.04277 0.39% Gravity::fill_multipole_BCs() 70 0.02899 0.03223 0.04084 0.37% MLCellLinOp::defineBC() 360 0.02422 0.03003 0.0408 0.37% Castro::construct_old_source() 700 0.02291 0.03439 0.04056 0.37% MultiFab::Xpay() 12217 0.02961 0.03298 0.03657 0.34% MLMG::mgVcycle_down::2 483 0.03036 0.03148 0.03326 0.30% FabArrayBase::getFB() 157859 0.02388 0.02917 0.03273 0.30% MLMG::mgVcycle_up::6 483 0.004084 0.00821 0.03263 0.30% Castro::initMFs() 35 0.01691 0.02466 0.03163 0.29% Castro::FluxRegCrseInit 140 0.02935 0.03093 0.03133 0.29% MLMG::mgVcycle_down::6 483 0.004801 0.008783 0.03111 0.29% Amr::grid_places() 23 0.02042 0.02541 0.03043 0.28% AmrMesh::MakeNewGrids() 23 0.02008 0.02504 0.03012 0.28% Amr::writePlotFile() 2 0.02986 0.02995 0.02999 0.27% Castro::enforce_min_density() 1182 0.02195 0.02491 0.0286 0.26% BndryData::define() 540 0.01558 0.02 0.02803 0.26% VisMF::Write(FabArray) 6 0.007461 0.0102 0.02432 0.22% Castro::check_for_nan() 280 0.01733 0.02023 0.02353 0.22% MultiFab::contains_nan() 280 0.01714 0.02004 0.02334 0.21% MLMG::mgVcycle_down::3 483 0.005523 0.01392 0.02275 0.21% MLMG::getGradSolution() 360 0.01495 0.01694 0.02045 0.19% MLCellLinOp::compGrad() 450 0.01472 0.01672 0.02022 0.19% Gravity::average_fine_ec_onto_crse_ec() 90 0.01696 0.018 0.01929 0.18% Castro::computeNewDt() 28 0.0171 0.01782 0.01867 0.17% Castro::errorEst() 34 0.01002 0.01377 0.01807 0.17% Gravity::update_max_rhs() 30 0.0143 0.01611 0.01771 0.16% AmrLevel::AmrLevel(dm) 35 0.008582 0.01201 0.01537 0.14% StateData::define() 140 0.008362 0.01178 0.01513 0.14% Castro::derive() 34 0.007065 0.01083 0.01494 0.14% MLPoisson::FFlux() 7882 0.007167 0.01078 0.01392 0.13% Castro::FluxRegFineAdd() 140 0.006804 0.008857 0.01269 0.12% Castro::swap_state_time_levels() 140 0.00517 0.008997 0.01264 0.12% Castro::construct_old_gravity_source() 140 0.006654 0.01052 0.01253 0.11% Amr::InitializeInit() 1 0.006747 0.009426 0.01241 0.11% Amr::defBaseLevel() 1 0.006744 0.009423 0.01241 0.11% FabArrayBase::TheFPinfo() 728 0.002343 0.006448 0.01167 0.11% MLMG::MLResNormInf() 440 0.008279 0.009225 0.01069 0.10% FPinfo::FPinfo() 7 0.001393 0.00547 0.01053 0.10% Castro::buildMetrics() 35 0.005101 0.006772 0.0103 0.09% MLMG::mgVcycle_down::4 483 0.004929 0.006253 0.009959 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004069 0.006745 0.008856 0.08% MLLinOp::define() 360 0.007298 0.007782 0.008809 0.08% MultiFab::max() 90 0.003954 0.006486 0.008755 0.08% StateDataPhysBCFunct::() 1617 0.00334 0.005622 0.008575 0.08% MLLinOp::defineGrids() 360 0.006925 0.007432 0.008412 0.08% MLMG::mgVcycle_up::4 483 0.003728 0.004665 0.007995 0.07% FabArray::mult() 1063 0.005689 0.006401 0.00748 0.07% MLMG::mgVcycle_down::5 483 0.004809 0.005633 0.007074 0.06% StateData::FillBoundary(geom) 745 0.001681 0.00384 0.00659 0.06% MLMG::MLRhsNormInf() 360 0.005293 0.005921 0.006506 0.06% Castro::computeInitialDt() 2 0.0008006 0.003769 0.006485 0.06% MLMG::mgVcycle_up::5 483 0.003797 0.004473 0.005652 0.05% MLPoisson::prepareForSolve() 360 0.003346 0.004104 0.005621 0.05% Gravity::applyMetricTerms() 90 0.00481 0.005223 0.005583 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0003078 0.002352 0.005524 0.05% DistributionMapping::SFCProcessorMapDoIt() 5 0.0002924 0.002343 0.0055 0.05% MLCellLinOp::prepareForSolve() 360 0.002945 0.003771 0.005301 0.05% FabArray::setDomainBndry() 1617 0.003322 0.004156 0.005036 0.05% BoxList::parallelComplementIn() 57 0.00044 0.003029 0.005023 0.05% BoxList::pci 22 0.0004097 0.002995 0.004989 0.05% MultiFab::norm0(mask) 270 0.003289 0.00407 0.004888 0.04% Gravity::swapTimeLevels() 140 0.003559 0.004065 0.004476 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.00288 0.003487 0.00426 0.04% MultiFab::Subtract() 420 0.002088 0.002526 0.003351 0.03% MultiFab::Copy() 450 0.001707 0.002113 0.002814 0.03% TagBoxArray::mapPRD 34 0.001255 0.00186 0.002762 0.03% MLLinOp::makeSubCommunicator() 70 0.001483 0.001781 0.002389 0.02% AmrMesh-cluster 4 0 0.0002777 0.002221 0.02% Castro::apply_tagging_restrictions() 34 0.001414 0.001661 0.001901 0.02% MLMG::buildFineMask() 360 0.001249 0.001371 0.001497 0.01% TagBoxArray::collate() 34 0.00062 0.0009326 0.001479 0.01% ClusterList::chop() 4 0 0.0001763 0.00141 0.01% AMRErrorTag::operator() 34 0.0009973 0.001186 0.001349 0.01% Castro::build_fine_mask() 100 0.0007678 0.0009646 0.001123 0.01% Castro::finalize_do_advance() 140 0.0004544 0.0005819 0.0008349 0.01% FabArrayBase::FB::FB() 299 0.0001986 0.0004465 0.0006725 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005198 0.0005662 0.000603 0.01% Castro::enforce_speed_limit() 1182 0.0002993 0.000463 0.0005488 0.01% ClusterList::intersect() 4 0 6.49e-05 0.0005192 0.00% Amr::InitAmr() 1 0.0002652 0.0003023 0.0004327 0.00% makeSFC 350 0.0003556 0.0003945 0.0004239 0.00% MultiFab::Multiply() 40 0.0002282 0.000292 0.0003274 0.00% OwnerMask() 34 0.0001652 0.0001848 0.0002164 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001705 0.0001827 0.0001955 0.00% DistributionMapping::Distribute() 355 0.0001394 0.0001734 0.0001893 0.00% FabArray::RecvLayoutMask() 90 9.297e-05 0.0001102 0.0001222 0.00% knapsack() 7 9.746e-05 0.0001044 0.0001142 0.00% Castro::enforce_consistent_e() 7 7.95e-05 9.022e-05 9.782e-05 0.00% Castro::create_source_corrector() 140 5.258e-05 7.7e-05 9.635e-05 0.00% Amr::writeSmallPlotFile() 1 3.334e-05 5.634e-05 8.278e-05 0.00% BoxList::complementIn 574 6.74e-05 6.97e-05 7.737e-05 0.00% Castro::retry_advance_ctu() 140 4.167e-05 4.814e-05 5.954e-05 0.00% Gravity::set_mass_offset() 21 1.265e-05 2.386e-05 3.072e-05 0.00% Castro::apply_problem_tags() 34 1.535e-05 1.639e-05 1.705e-05 0.00% Amr::initSubcycle() 1 8.056e-06 8.849e-06 9.24e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.06-10-g18d0a2861d31) finalized