MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.02-1-gbf267b095426) initialized Starting run at 06:30:20 UTC on 2022-02-03. Successfully read inputs file ... Castro git describe: 22.02-1-g342411b81 AMReX git describe: 22.02-1-gbf267b095 Microphysics git describe: 22.02 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001012891 new finest: 1 grid_places() time: 0.005791698 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.008116505 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.006705451 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.01376426 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.488449912 [STEP 1] FAB kilobyte spread across MPI nodes: [18083 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000509257 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.522636465 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000724043 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.529995517 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000521569 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.520199301 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000732633 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.494844338 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000495163 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.486797983 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000705773 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.496142814 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000493913 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.486897632 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000701918 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.496428197 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000498688 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.486100279 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000692042 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.493704961 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000501227 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.489981577 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000700256 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.496032706 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000499039 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.491119263 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000693326 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.496504114 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000493888 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.490702689 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000695274 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.496211223 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000490531 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.49123921 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000712504 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.500688972 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000493424 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.497488369 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.013592566 seconds Ending run at 06:30:30 UTC on 2022-02-03. Run time = 10.14005402 Run time without initialization = 9.966675978 Average number of zones advanced per microsecond: 0.884 Average number of zones advanced per microsecond per rank: 0.111 TinyProfiler total time across processes [min...avg...max]: 10.14 ... 10.14 ... 10.14 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.7620 2.0906 2.3220 22.90% MLCGSolver::ParallelAllReduce 243542 0.9116 1.09 1.359 13.41% MLPoisson::Fsmooth() 54976 0.8608 0.9577 1.056 10.41% MultiFab::min() 140 0.2684 0.5075 0.8377 8.26% FillBoundary_finish() 157859 0.4453 0.5953 0.7608 7.50% FillBoundary_nowait() 157859 0.5038 0.6478 0.7349 7.25% FabArray::ParallelCopy_finish() 21119 0.3 0.4245 0.6278 6.19% MLCellLinOp::applyBC() 165252 0.1993 0.2811 0.3576 3.53% MLPoisson::Fapply() 108875 0.2509 0.2851 0.309 3.05% MLCGSolver::bicgstab 1420 0.1962 0.2266 0.2433 2.40% MultiFab::LinComb() 288336 0.156 0.1979 0.2277 2.25% FabArray::ParallelCopy_nowait() 21119 0.1624 0.185 0.2146 2.12% FabArray::setVal() 27604 0.1403 0.1754 0.2006 1.98% MultiFab::Dot() 193316 0.1522 0.1814 0.1984 1.96% Castro::reset_internal_energy() 1189 0.1454 0.1676 0.1829 1.80% Castro::normalize_species() 1182 0.09908 0.112 0.1214 1.20% MLPoisson::normalize() 98078 0.09619 0.1105 0.1191 1.17% Castro::estTimeStep() 228 0.07751 0.09122 0.1126 1.11% MLMG::ResNormInf() 2383 0.05332 0.07638 0.1002 0.99% Castro::construct_new_gravity_source() 260 0.06636 0.07573 0.08232 0.81% Castro::computeTemp() 1189 0.0602 0.06831 0.07514 0.74% amrex::average_down 8093 0.06024 0.0669 0.07298 0.72% CellConservativeLinear::interp() 8794 0.06503 0.06635 0.0676 0.67% MultiFab::Saxpy() 1180 0.05362 0.06191 0.06701 0.66% CGSolver::sxay() 288086 0.06072 0.06436 0.06692 0.66% MLMG::addInterpCorrection() 6101 0.04524 0.04986 0.05497 0.54% Castro::initData() 7 0.04852 0.0513 0.05435 0.54% FabArray::FillBoundary() 157859 0.05168 0.05245 0.05386 0.53% MLCellLinOp::defineAuxData() 360 0.03632 0.04172 0.05036 0.50% FillPatchIterator::Initialize 829 0.04176 0.0448 0.04799 0.47% amrex::average_down_w_geom 248 0.03236 0.03788 0.04331 0.43% MLMG::prepareForSolve() 360 0.03173 0.03562 0.04176 0.41% MLCellLinOp::apply() 108875 0.03741 0.03842 0.04147 0.41% Castro::reflux() 60 0.02974 0.03444 0.04022 0.40% Amr::regrid() 21 0.02586 0.03083 0.03843 0.38% FabArrayBase::CPC::define() 4019 0.02766 0.03315 0.03822 0.38% FillPatchSingleLevel 1517 0.02285 0.03236 0.03675 0.36% Gravity::actual_solve_with_mlmg() 360 0.02217 0.02736 0.03563 0.35% MultiFab::Xpay() 12217 0.02801 0.03114 0.03353 0.33% FluxRegister::Reflux() 960 0.02129 0.02717 0.03217 0.32% FabArrayBase::getFB() 157859 0.02832 0.03004 0.03157 0.31% MLMG::solve() 360 0.009131 0.02041 0.03035 0.30% MLCellLinOp::reflux() 951 0.02393 0.02675 0.03025 0.30% MLMG::interpCorrection_1 771 0.02177 0.02568 0.02969 0.29% Gravity::fill_multipole_BCs() 70 0.02749 0.02799 0.02922 0.29% FabArrayBase::getCPC() 29601 0.0265 0.0278 0.02866 0.28% Castro::initialize_do_advance() 140 0.02071 0.02521 0.02739 0.27% FillPatchTwoLevels 716 0.02562 0.02647 0.02726 0.27% Castro::do_advance_ctu() 140 0.01699 0.02153 0.02423 0.24% Gravity::get_new_grav_vector() 263 0.01639 0.01955 0.02382 0.23% Castro::enforce_min_density() 1182 0.01857 0.02114 0.02367 0.23% MLCellLinOp::updateSolBC() 871 0.01141 0.0165 0.02353 0.23% VisMF::Write(FabArray) 6 0.006745 0.009567 0.02277 0.22% Castro::expand_state() 140 0.01943 0.02115 0.02263 0.22% MLMG::oneIter() 1843 0.01834 0.02064 0.0224 0.22% MultiFab::contains_nan() 280 0.01635 0.0197 0.02232 0.22% Castro::construct_new_source() 1300 0.0203 0.0212 0.02207 0.22% MLCellLinOp::updateCorBC() 771 0.01059 0.01517 0.02152 0.21% Amr::writePlotFile() 2 0.005295 0.01858 0.02144 0.21% BndryData::define() 540 0.01208 0.01567 0.02125 0.21% Castro::finalize_advance() 140 0.01527 0.01813 0.02096 0.21% MLCellLinOp::smooth() 27488 0.01613 0.01654 0.01713 0.17% Gravity::get_old_grav_vector() 140 0.008701 0.01072 0.0146 0.14% MLCellLinOp::setLevelBC() 450 0.007714 0.009935 0.01285 0.13% Castro::initialize_advance() 140 0.008639 0.011 0.01284 0.13% MLPoisson::FFlux() 7882 0.006823 0.01038 0.01262 0.12% StateData::define() 140 0.009623 0.01042 0.0122 0.12% MLCellLinOp::defineBC() 360 0.007963 0.009496 0.01155 0.11% Castro::construct_old_source() 700 0.009981 0.01083 0.01128 0.11% MLCellLinOp::compGrad() 450 0.008765 0.009974 0.01108 0.11% Castro::FluxRegFineAdd() 140 0.005802 0.008065 0.01102 0.11% Castro::construct_old_gravity_source() 140 0.007552 0.009057 0.01005 0.10% Gravity::gravity_sync() 60 0.007843 0.009021 0.009756 0.10% Castro::swap_state_time_levels() 140 0.00554 0.00748 0.009574 0.09% FabArray::ParallelCopy() 21119 0.008563 0.008804 0.008946 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004095 0.006759 0.008684 0.09% FPinfo::FPinfo() 7 0.001178 0.005986 0.008481 0.08% MultiFab::max() 90 0.003694 0.005332 0.007707 0.08% Gravity::solve_for_phi() 280 0.006132 0.006923 0.007437 0.07% FabArray::mult() 1063 0.005342 0.006144 0.007018 0.07% Castro::init(old) 28 0.005326 0.006073 0.006687 0.07% Amr::timeStep() 140 0.003046 0.003968 0.006484 0.06% AmrMesh::MakeNewGrids() 23 0.00264 0.004964 0.00548 0.05% StateData::FillBoundary(geom) 685 0.00112 0.003001 0.005461 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003885 0.004438 0.005338 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0002793 0.002298 0.005241 0.05% MLCellLinOp::prepareForSolve() 360 0.002747 0.003669 0.005026 0.05% MLMG::MLRhsNormInf() 360 0.003914 0.004567 0.005005 0.05% BoxList::pci 22 0.0003838 0.003129 0.004939 0.05% MLLinOp::defineGrids() 360 0.003898 0.004303 0.004848 0.05% Castro::construct_new_gravity() 140 0.003724 0.004134 0.00477 0.05% Gravity::applyMetricTerms() 90 0.003864 0.004288 0.004635 0.05% Castro::construct_old_gravity() 140 0.003476 0.004056 0.004617 0.05% MultiFab::norm0(mask) 270 0.003031 0.003875 0.004597 0.05% MLCellLinOp::correctionResidual() 9063 0.003804 0.004043 0.004306 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.003263 0.003673 0.004299 0.04% MLMG::mgVcycle() 3385 0.003779 0.003922 0.004268 0.04% FabArray::setDomainBndry() 1517 0.00329 0.003587 0.004086 0.04% MLMG::computeResWithCrseCorFineCor() 771 0.002912 0.003288 0.003996 0.04% MLMG::actualBottomSolve() 1843 0.002498 0.002794 0.003531 0.03% Gravity::update_max_rhs() 30 0.002987 0.003206 0.003488 0.03% Amr::bldFineLevels() 1 0.003115 0.00328 0.003418 0.03% FillPatchInterp(Fab) 688 0.002874 0.003171 0.0033 0.03% Gravity::GetCrsePhi() 250 0.001926 0.002447 0.003127 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002044 0.002519 0.002965 0.03% MultiFab::Subtract() 420 0.001935 0.002373 0.002905 0.03% Amr::coarseTimeStep() 20 0.0007577 0.001547 0.002872 0.03% MultiFab::Copy() 450 0.001848 0.002141 0.002533 0.02% MLMG::MLResNormInf() 440 0.0006728 0.001359 0.002496 0.02% MLLinOp::makeSubCommunicator() 70 0.001435 0.001692 0.002346 0.02% MLMG:computeResOfCorrection() 6101 0.002047 0.002127 0.002225 0.02% Amr::defBaseLevel() 1 0.002035 0.002089 0.00219 0.02% MLMG::mgVcycle_bottom 3385 0.00186 0.001923 0.002003 0.02% MLCellLinOp::solutionResidual() 3154 0.001751 0.001802 0.001869 0.02% MLMG::mgVcycle_down::0 1843 0.001729 0.001792 0.001839 0.02% Gravity::solve_phi_with_mlmg() 300 0.0009997 0.00129 0.001637 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001198 0.001421 0.001627 0.02% StateDataPhysBCFunct::() 1517 0.001388 0.001479 0.001564 0.02% Castro::clean_state() 1182 0.001389 0.001465 0.001557 0.02% MLMG::mgVcycle_down::1 1843 0.001414 0.001452 0.00147 0.01% ClusterList::chop() 4 0 0.0001799 0.001439 0.01% AMRErrorTag::operator() 34 0.0009191 0.001161 0.001365 0.01% MLPoisson::define() 360 0.000729 0.0008968 0.00132 0.01% MLMG::mgVcycle_up::1 1843 0.001254 0.001297 0.001319 0.01% TagBoxArray::collate() 34 0.0005655 0.0008204 0.001312 0.01% MLMG::mgVcycle_up::0 1843 0.001113 0.001129 0.001152 0.01% MLMG::buildFineMask() 360 0.0009407 0.0009982 0.001067 0.01% FabArrayBase::TheFPinfo() 688 0.0008363 0.0009136 0.001054 0.01% Gravity::actual_multilevel_solve() 20 0.0007273 0.0008514 0.0009328 0.01% main() 1 0.00074 0.0007832 0.0008617 0.01% MLMG::computeResidual() 1843 0.0007527 0.0007866 0.0008127 0.01% Castro::finalize_do_advance() 140 0.0005044 0.0006245 0.0008096 0.01% FabArrayBase::FB::FB() 299 0.0001883 0.0004376 0.0006766 0.01% MLMG::miniCycle() 1542 0.0005696 0.0006088 0.000669 0.01% Castro::do_new_sources() 260 0.0005954 0.000629 0.0006648 0.01% Amr::grid_places() 23 0.0003098 0.0003744 0.0006057 0.01% Castro::derive() 34 0.0004706 0.0005286 0.0006035 0.01% Castro::build_fine_mask() 40 0.0005177 0.000559 0.0005943 0.01% Castro::apply_tagging_restrictions() 34 0.0004074 0.0004968 0.0005802 0.01% ClusterList::intersect() 4 0 6.538e-05 0.0005231 0.01% MLLinOp::define() 360 0.0004221 0.0004613 0.0005111 0.01% Castro::apply_source_to_state() 520 0.0004169 0.0004432 0.0004746 0.00% Castro::advance() 140 0.0003625 0.0004192 0.0004553 0.00% Castro::subcycle_advance_ctu() 140 0.000342 0.0003893 0.0004225 0.00% Amr::InitAmr() 1 0.0002708 0.0002957 0.0004125 0.00% MLMG::mgVcycle_down::4 483 0.0003701 0.0003872 0.0004058 0.00% MLMG::mgVcycle_down::2 483 0.0003533 0.000375 0.0004025 0.00% MLMG::mgVcycle_down::3 483 0.0003233 0.0003538 0.0003823 0.00% Castro::do_old_sources() 140 0.0003257 0.0003441 0.0003654 0.00% MLPoisson::prepareForSolve() 360 0.0002416 0.000291 0.0003608 0.00% MLMG::computeMLResidual() 440 0.0002754 0.0003013 0.0003545 0.00% MLMG::mgVcycle_down::6 483 0.0003295 0.0003375 0.0003451 0.00% MLMG::mgVcycle_down::5 483 0.0003121 0.0003213 0.0003324 0.00% Castro::enforce_speed_limit() 1182 0.0002932 0.0003092 0.0003267 0.00% MLMG::mgVcycle_up::6 483 0.0002743 0.0002876 0.000312 0.00% Gravity::swapTimeLevels() 140 0.0002264 0.0002696 0.0002964 0.00% MLMG::mgVcycle_up::2 483 0.0002485 0.0002618 0.0002883 0.00% AmrMesh-cluster 4 0 3.586e-05 0.0002869 0.00% MLMG::mgVcycle_up::5 483 0.0002393 0.0002455 0.0002644 0.00% makeSFC 350 0.0002165 0.0002309 0.0002504 0.00% MLMG::mgVcycle_up::3 483 0.0002098 0.0002262 0.0002432 0.00% MLMG::getGradSolution() 360 0.0002246 0.0002301 0.0002395 0.00% AmrLevel::AmrLevel(dm) 35 0.0002074 0.000219 0.0002344 0.00% MLMG::mgVcycle_up::4 483 0.0002164 0.0002232 0.000234 0.00% MultiFab::Multiply() 40 0.0001962 0.000206 0.000223 0.00% OwnerMask() 34 0.0001665 0.0001887 0.0002183 0.00% TagBoxArray::mapPRD 34 0.0001874 0.0001988 0.0002106 0.00% Castro::check_for_nan() 280 0.0001608 0.0001817 0.000209 0.00% Castro::post_regrid() 66 0.0001547 0.0001654 0.0001922 0.00% Castro::post_timestep() 140 0.0001393 0.000161 0.0001841 0.00% Castro::avgDown(state_indx) 248 0.0001624 0.0001688 0.0001798 0.00% DistributionMapping::Distribute() 355 0.0001617 0.0001681 0.0001747 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001418 0.000153 0.0001675 0.00% FabArray::RecvLayoutMask() 90 8.962e-05 0.0001081 0.000131 0.00% Gravity::solve_for_delta_phi 60 8.501e-05 0.0001028 0.0001176 0.00% Amr::FinalizeInit() 1 3.564e-06 1.826e-05 0.0001166 0.00% knapsack() 7 9.629e-05 0.0001017 0.0001095 0.00% Castro::retry_advance_ctu() 140 7.531e-05 8.75e-05 0.0001058 0.00% Castro::enforce_consistent_e() 7 7.546e-05 8.63e-05 9.547e-05 0.00% Castro::create_source_corrector() 140 7.307e-05 8.381e-05 9.008e-05 0.00% Castro::errorEst() 34 6.554e-05 7.18e-05 8.048e-05 0.00% Amr::writeSmallPlotFile() 1 3.35e-05 5.364e-05 7.493e-05 0.00% BoxList::complementIn 574 6.962e-05 7.088e-05 7.252e-05 0.00% Castro::avgDown() 62 5.886e-05 6.156e-05 6.876e-05 0.00% Castro::computeNewDt() 28 3.932e-05 4.344e-05 4.992e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.978e-05 3.367e-05 3.627e-05 0.00% BoxList::parallelComplementIn() 57 2.488e-05 2.61e-05 2.718e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.013e-05 2.323e-05 2.651e-05 0.00% Gravity::set_mass_offset() 21 1.982e-05 2.175e-05 2.457e-05 0.00% Castro::apply_problem_tags() 34 1.661e-05 1.698e-05 1.76e-05 0.00% Amr::initSubcycle() 1 1.186e-05 1.285e-05 1.385e-05 0.00% Castro::post_init() 3 8.243e-06 9.998e-06 1.353e-05 0.00% Amr::InitializeInit() 1 2.025e-06 2.812e-06 6.487e-06 0.00% Castro::computeInitialDt() 2 3.159e-06 3.654e-06 4.411e-06 0.00% Amr::init() 1 1.84e-06 2.087e-06 2.283e-06 0.00% Amr::initialInit() 1 1.121e-06 1.299e-06 1.589e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.14 10.14 10.14 100.00% Amr::coarseTimeStep() 20 9.952 9.952 9.952 98.14% Amr::timeStep() 140 9.919 9.936 9.939 98.02% Castro::advance() 140 7.283 7.286 7.29 71.89% Castro::subcycle_advance_ctu() 140 7.082 7.104 7.142 70.43% Castro::do_advance_ctu() 140 7.081 7.104 7.142 70.43% Gravity::actual_solve_with_mlmg() 360 5.592 5.61 5.647 55.69% MLMG::solve() 360 5.413 5.421 5.429 53.54% MLMG::oneIter() 1843 5.033 5.061 5.077 50.07% MLMG::mgVcycle() 3385 4.65 4.694 4.729 46.63% Gravity::solve_phi_with_mlmg() 300 4.213 4.24 4.265 42.06% Gravity::solve_for_phi() 280 3.563 3.589 3.612 35.62% MLMG::mgVcycle_bottom 3385 3.188 3.208 3.23 31.86% Castro::construct_new_gravity() 140 2.832 2.836 2.843 28.04% MLMG::actualBottomSolve() 1843 2.807 2.815 2.833 27.94% MLCGSolver::bicgstab 1420 2.803 2.811 2.829 27.90% Castro::construct_ctu_hydro_source() 140 1.762 2.091 2.322 22.90% Castro::post_timestep() 140 1.879 1.895 1.902 18.75% Castro::reflux() 60 1.766 1.779 1.792 17.67% MLCellLinOp::applyBC() 165252 1.362 1.558 1.778 17.54% MLCellLinOp::smooth() 27488 1.518 1.578 1.626 16.03% FabArray::FillBoundary() 157859 1.121 1.326 1.574 15.53% Gravity::gravity_sync() 60 1.52 1.521 1.521 15.00% Gravity::solve_for_delta_phi 60 1.446 1.446 1.447 14.27% MLCGSolver::ParallelAllReduce 243542 1.011 1.183 1.437 14.17% MLCellLinOp::apply() 108875 1.118 1.255 1.359 13.40% MLPoisson::Fsmooth() 54976 0.8608 0.9577 1.056 10.41% Castro::construct_old_gravity() 140 0.8611 0.8871 0.9043 8.92% FabArray::ParallelCopy() 21119 0.5595 0.6708 0.8452 8.34% MultiFab::min() 140 0.2684 0.5075 0.8377 8.26% Amr::regrid() 21 0.7938 0.8004 0.808 7.97% FillBoundary_nowait() 157859 0.5324 0.6783 0.7653 7.55% FillBoundary_finish() 157859 0.4453 0.5953 0.7608 7.50% Gravity::multilevel_solve_for_new_phi() 20 0.6671 0.6688 0.6696 6.60% Gravity::actual_multilevel_solve() 20 0.6654 0.6674 0.6684 6.59% Castro::post_regrid() 66 0.6382 0.642 0.6448 6.36% FabArray::ParallelCopy_finish() 21119 0.3 0.4245 0.6278 6.19% FillPatchIterator::Initialize 829 0.4261 0.4645 0.5256 5.18% MLMG::mgVcycle_down::0 1843 0.4613 0.4805 0.4985 4.92% FillPatchTwoLevels 716 0.3681 0.4053 0.4691 4.63% MLMG::mgVcycle_up::0 1843 0.4318 0.4441 0.4517 4.45% MLMG::miniCycle() 1542 0.3704 0.3941 0.4109 4.05% Castro::clean_state() 1182 0.324 0.3697 0.4014 3.96% Castro::initialize_do_advance() 140 0.2709 0.2922 0.3182 3.14% MLPoisson::Fapply() 108875 0.2509 0.2851 0.309 3.05% FillPatchSingleLevel 1517 0.2042 0.2368 0.3086 3.04% MLCellLinOp::correctionResidual() 9063 0.2523 0.2766 0.2918 2.88% CGSolver::sxay() 288086 0.2134 0.2588 0.289 2.85% FabArray::ParallelCopy_nowait() 21119 0.2088 0.2375 0.2702 2.67% Castro::computeTemp() 1189 0.2056 0.2359 0.257 2.53% Castro::do_new_sources() 260 0.2057 0.2339 0.2535 2.50% Castro::expand_state() 140 0.1866 0.2083 0.2466 2.43% MLCellLinOp::solutionResidual() 3154 0.199 0.2138 0.2308 2.28% MultiFab::LinComb() 288336 0.156 0.1979 0.2277 2.25% MLMG::mgVcycle_down::1 1843 0.2096 0.2161 0.227 2.24% FabArray::setVal() 27604 0.1403 0.1754 0.2006 1.98% MultiFab::Dot() 193316 0.1522 0.1814 0.1984 1.96% MLMG::computeResWithCrseSolFineCor() 771 0.1476 0.1699 0.1869 1.84% Castro::reset_internal_energy() 1189 0.1454 0.1676 0.1829 1.80% MLMG::mgVcycle_up::1 1843 0.163 0.1694 0.1742 1.72% Amr::init() 1 0.1728 0.1729 0.1729 1.71% amrex::average_down 8093 0.1071 0.1314 0.1623 1.60% Castro::initialize_advance() 140 0.1109 0.1444 0.1621 1.60% Amr::initialInit() 1 0.1589 0.1589 0.159 1.57% Amr::FinalizeInit() 1 0.1471 0.1499 0.1524 1.50% Castro::construct_new_source() 1300 0.1138 0.1268 0.1361 1.34% MLMG::computeResidual() 1843 0.114 0.1282 0.1352 1.33% MLMG::addInterpCorrection() 6101 0.07439 0.1073 0.1313 1.29% MLMG:computeResOfCorrection() 6101 0.1215 0.1245 0.1278 1.26% Castro::normalize_species() 1182 0.09908 0.112 0.1214 1.20% MLPoisson::normalize() 98078 0.09619 0.1105 0.1191 1.17% Castro::estTimeStep() 228 0.07751 0.09122 0.1126 1.11% Castro::do_old_sources() 140 0.08463 0.09849 0.1101 1.09% MLPoisson::define() 360 0.07725 0.09029 0.1085 1.07% MLCellLinOp::setLevelBC() 450 0.0267 0.05504 0.1048 1.03% MLMG::mgVcycle_up::2 483 0.02651 0.05858 0.1039 1.02% MLMG::ResNormInf() 2383 0.05569 0.07898 0.1023 1.01% Gravity::get_new_grav_vector() 263 0.09728 0.09826 0.1001 0.99% MLMG::computeResWithCrseCorFineCor() 771 0.08348 0.09379 0.09776 0.96% Castro::avgDown() 62 0.06145 0.07835 0.09772 0.96% Castro::avgDown(state_indx) 248 0.06139 0.07828 0.09766 0.96% amrex::average_down_w_geom 248 0.06122 0.07811 0.09749 0.96% MLCellLinOp::reflux() 951 0.06953 0.08088 0.08925 0.88% Gravity::GetCrsePhi() 250 0.0294 0.05474 0.08802 0.87% Amr::bldFineLevels() 1 0.0782 0.081 0.0832 0.82% Castro::construct_new_gravity_source() 260 0.06636 0.07573 0.08232 0.81% MLMG::computeMLResidual() 440 0.05258 0.06239 0.07269 0.72% FillPatchInterp(Fab) 688 0.06817 0.06952 0.0709 0.70% Castro::post_init() 3 0.06282 0.06513 0.06801 0.67% CellConservativeLinear::interp() 8794 0.06503 0.06635 0.0676 0.67% MultiFab::Saxpy() 1180 0.05362 0.06191 0.06701 0.66% FabArrayBase::getCPC() 29601 0.05416 0.06095 0.06688 0.66% MLMG::prepareForSolve() 360 0.05815 0.06319 0.06605 0.65% MLMG::mgVcycle_up::3 483 0.004111 0.0279 0.06334 0.62% Gravity::get_old_grav_vector() 140 0.05973 0.06122 0.06276 0.62% MLCellLinOp::defineAuxData() 360 0.0454 0.05288 0.06273 0.62% MLCellLinOp::updateSolBC() 871 0.0439 0.05517 0.06214 0.61% MLCellLinOp::updateCorBC() 771 0.04618 0.05446 0.06098 0.60% Castro::init(old) 28 0.04754 0.05417 0.05824 0.57% Castro::initData() 7 0.05204 0.05513 0.05821 0.57% MLMG::interpCorrection_1 771 0.0359 0.0441 0.05743 0.57% FluxRegister::Reflux() 960 0.04774 0.05119 0.0539 0.53% Castro::finalize_advance() 140 0.03473 0.03741 0.04074 0.40% MLCellLinOp::defineBC() 360 0.02313 0.02951 0.03833 0.38% FabArrayBase::CPC::define() 4019 0.02766 0.03315 0.03822 0.38% Castro::apply_source_to_state() 520 0.0284 0.03327 0.03677 0.36% Castro::computeNewDt() 28 0.01538 0.01919 0.03472 0.34% MLMG::mgVcycle_down::2 483 0.03109 0.03219 0.03355 0.33% MultiFab::Xpay() 12217 0.02801 0.03114 0.03353 0.33% MLMG::mgVcycle_down::6 483 0.00537 0.009191 0.0329 0.32% MLMG::mgVcycle_up::6 483 0.004551 0.008272 0.03252 0.32% FabArrayBase::getFB() 157859 0.02851 0.03048 0.03225 0.32% Castro::construct_old_source() 700 0.0275 0.02971 0.03178 0.31% Gravity::fill_multipole_BCs() 70 0.02826 0.02876 0.02998 0.30% Amr::writePlotFile() 2 0.02807 0.02815 0.02819 0.28% Amr::grid_places() 23 0.02097 0.02595 0.02768 0.27% AmrMesh::MakeNewGrids() 23 0.02064 0.02557 0.02734 0.27% BndryData::define() 540 0.01493 0.01974 0.02642 0.26% Castro::enforce_min_density() 1182 0.01857 0.02114 0.02367 0.23% MLMG::mgVcycle_down::3 483 0.006176 0.01393 0.02289 0.23% VisMF::Write(FabArray) 6 0.006745 0.009567 0.02277 0.22% Castro::check_for_nan() 280 0.01655 0.01988 0.02253 0.22% MultiFab::contains_nan() 280 0.01635 0.0197 0.02232 0.22% Gravity::average_fine_ec_onto_crse_ec() 90 0.01683 0.01779 0.01903 0.19% MLMG::getGradSolution() 360 0.01409 0.01566 0.01799 0.18% Castro::errorEst() 34 0.01041 0.01469 0.01789 0.18% MLCellLinOp::compGrad() 450 0.01387 0.01543 0.01775 0.18% Castro::derive() 34 0.008995 0.01294 0.016 0.16% Gravity::update_max_rhs() 30 0.01292 0.01386 0.01568 0.15% MLPoisson::FFlux() 7882 0.006823 0.01038 0.01262 0.12% AmrLevel::AmrLevel(dm) 35 0.009831 0.01064 0.01241 0.12% StateData::define() 140 0.009623 0.01042 0.0122 0.12% Amr::InitializeInit() 1 0.006585 0.009046 0.01182 0.12% Amr::defBaseLevel() 1 0.006583 0.009043 0.01181 0.12% MLMG::mgVcycle_down::4 483 0.005596 0.006511 0.01111 0.11% Castro::FluxRegFineAdd() 140 0.005802 0.008065 0.01102 0.11% MLMG::MLResNormInf() 440 0.007523 0.008865 0.01027 0.10% Castro::construct_old_gravity_source() 140 0.007552 0.009057 0.01005 0.10% Castro::swap_state_time_levels() 140 0.00554 0.00748 0.009574 0.09% FabArrayBase::TheFPinfo() 688 0.002331 0.007098 0.009565 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004095 0.006759 0.008684 0.09% FPinfo::FPinfo() 7 0.001379 0.006184 0.008659 0.09% MLMG::mgVcycle_up::4 483 0.004118 0.004745 0.00847 0.08% MLMG::mgVcycle_down::5 483 0.005376 0.005834 0.007988 0.08% MLLinOp::define() 360 0.006422 0.006999 0.007749 0.08% MultiFab::max() 90 0.003694 0.005332 0.007707 0.08% MLLinOp::defineGrids() 360 0.005958 0.006538 0.007238 0.07% StateDataPhysBCFunct::() 1517 0.002515 0.00448 0.007025 0.07% FabArray::mult() 1063 0.005342 0.006144 0.007018 0.07% MLMG::MLRhsNormInf() 360 0.005323 0.005836 0.006462 0.06% MLMG::mgVcycle_up::5 483 0.004243 0.004596 0.006289 0.06% Castro::computeInitialDt() 2 0.0007557 0.003502 0.005982 0.06% StateData::FillBoundary(geom) 685 0.00112 0.003001 0.005461 0.05% MLPoisson::prepareForSolve() 360 0.003108 0.00396 0.005352 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0002793 0.002298 0.005241 0.05% DistributionMapping::SFCProcessorMapDoIt() 5 0.0002424 0.002268 0.00521 0.05% MLCellLinOp::prepareForSolve() 360 0.002747 0.003669 0.005026 0.05% BoxList::parallelComplementIn() 57 0.0004227 0.003168 0.004978 0.05% BoxList::pci 22 0.0003838 0.003129 0.004939 0.05% Gravity::applyMetricTerms() 90 0.003864 0.004288 0.004635 0.05% MultiFab::norm0(mask) 270 0.003031 0.003875 0.004597 0.05% Gravity::swapTimeLevels() 140 0.003041 0.003871 0.004319 0.04% FabArray::setDomainBndry() 1517 0.00329 0.003587 0.004086 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002614 0.003198 0.003772 0.04% MultiFab::Subtract() 420 0.001935 0.002373 0.002905 0.03% MultiFab::Copy() 450 0.001848 0.002141 0.002533 0.02% MLLinOp::makeSubCommunicator() 70 0.001435 0.001692 0.002346 0.02% TagBoxArray::mapPRD 34 0.001181 0.001529 0.002263 0.02% AmrMesh-cluster 4 0 0.0002812 0.002249 0.02% ClusterList::chop() 4 0 0.0001799 0.001439 0.01% MLMG::buildFineMask() 360 0.001219 0.001303 0.001415 0.01% AMRErrorTag::operator() 34 0.0009191 0.001161 0.001365 0.01% TagBoxArray::collate() 34 0.0005655 0.0008204 0.001312 0.01% Castro::finalize_do_advance() 140 0.0005044 0.0006245 0.0008096 0.01% FabArrayBase::FB::FB() 299 0.0001883 0.0004376 0.0006766 0.01% Castro::build_fine_mask() 40 0.0005177 0.000559 0.0005943 0.01% Castro::apply_tagging_restrictions() 34 0.0004074 0.0004968 0.0005802 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005161 0.0005421 0.0005703 0.01% ClusterList::intersect() 4 0 6.538e-05 0.0005231 0.01% Amr::InitAmr() 1 0.0002831 0.0003086 0.0004261 0.00% makeSFC 350 0.0003733 0.0003891 0.0004118 0.00% Castro::enforce_speed_limit() 1182 0.0002932 0.0003092 0.0003267 0.00% MultiFab::Multiply() 40 0.0001962 0.000206 0.000223 0.00% OwnerMask() 34 0.0001665 0.0001887 0.0002183 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001784 0.0001977 0.00021 0.00% DistributionMapping::Distribute() 355 0.0001617 0.0001681 0.0001747 0.00% FabArray::RecvLayoutMask() 90 8.962e-05 0.0001081 0.000131 0.00% knapsack() 7 9.629e-05 0.0001017 0.0001095 0.00% Castro::retry_advance_ctu() 140 7.531e-05 8.75e-05 0.0001058 0.00% Castro::enforce_consistent_e() 7 7.546e-05 8.63e-05 9.547e-05 0.00% Castro::create_source_corrector() 140 7.307e-05 8.381e-05 9.008e-05 0.00% Amr::writeSmallPlotFile() 1 3.35e-05 5.364e-05 7.493e-05 0.00% BoxList::complementIn 574 6.962e-05 7.088e-05 7.252e-05 0.00% Gravity::set_mass_offset() 21 1.982e-05 2.175e-05 2.457e-05 0.00% Castro::apply_problem_tags() 34 1.661e-05 1.698e-05 1.76e-05 0.00% Amr::initSubcycle() 1 1.186e-05 1.285e-05 1.385e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.02-1-gbf267b095426) finalized