MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.07-4-gcbdc6580ee3d) initialized Starting run at 13:56:10 UTC on 2022-07-05. Successfully read inputs file ... Castro git describe: 22.06-16-g4e0e0753c AMReX git describe: 22.07-4-gcbdc6580e Microphysics git describe: 22.07-6-g94202288 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001483771 new finest: 1 grid_places() time: 0.007800852 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.010406868 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.007337844 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.014919039 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.508268142 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000544281 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.531266295 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000773359 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.541377647 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000550855 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.545161899 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000820798 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.532161828 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000526704 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.525376376 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000775383 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.534588794 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000532546 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.52632312 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000788331 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.533623842 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.00054038 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.526178262 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000787115 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.535900511 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000544492 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.528809612 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000790754 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.536949904 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000541761 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.529288383 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000786426 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.539140337 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000527903 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.530843018 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000791995 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.557906309 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000531425 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.535419733 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000792146 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.553116139 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000541452 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.528381011 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.014389477 seconds Ending run at 13:56:21 UTC on 2022-07-05. Run time = 10.90247727 Run time without initialization = 10.6981067 Average number of zones advanced per microsecond: 0.824 Average number of zones advanced per microsecond per rank: 0.103 TinyProfiler total time across processes [min...avg...max]: 10.9 ... 10.9 ... 10.9 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9397 2.3018 2.5858 23.72% MLCGSolver::ParallelAllReduce 243542 0.8108 1.052 1.333 12.23% MLPoisson::Fsmooth() 54976 0.8873 0.9627 1.079 9.90% Castro::do_advance_ctu() 140 0.3411 0.6272 0.986 9.04% FillBoundary_nowait() 157859 0.5089 0.6617 0.7509 6.89% FabArray::ParallelCopy_finish() 21259 0.341 0.5242 0.7217 6.62% FillBoundary_finish() 157859 0.4265 0.6074 0.7179 6.58% MLCellLinOp::applyBC() 165252 0.2125 0.2966 0.3916 3.59% MLPoisson::Fapply() 108875 0.2649 0.2987 0.3295 3.02% MLCGSolver::bicgstab 1420 0.2123 0.2385 0.2591 2.38% MultiFab::LinComb() 288336 0.1687 0.2076 0.2453 2.25% FabArray::setVal() 27604 0.1492 0.1906 0.2414 2.21% FabArray::ParallelCopy_nowait() 21259 0.1633 0.1989 0.2206 2.02% MultiFab::Dot() 193316 0.1678 0.1922 0.2177 2.00% Castro::estTimeStep() 308 0.1011 0.1576 0.1986 1.82% Castro::reset_internal_energy(Fab) 5919 0.1525 0.1748 0.1914 1.76% Castro::normalize_species() 1182 0.1326 0.1449 0.1586 1.45% MLPoisson::normalize() 98078 0.1004 0.1142 0.1257 1.15% MLMG::ResNormInf() 2383 0.05478 0.08124 0.1102 1.01% Castro::construct_new_gravity_source() 260 0.07026 0.07937 0.08907 0.82% amrex::average_down 8093 0.0691 0.07472 0.0827 0.76% Castro::computeTemp() 1189 0.06333 0.07139 0.08069 0.74% MultiFab::Saxpy() 1180 0.05505 0.06761 0.07842 0.72% CellConservativeLinear::interp() 9059 0.06761 0.07064 0.07333 0.67% Castro::initData() 7 0.04898 0.05872 0.07105 0.65% CGSolver::sxay() 288086 0.05731 0.0625 0.06682 0.61% FillPatchIterator::Initialize 889 0.03717 0.05517 0.0656 0.60% FabArray::FillBoundary() 157859 0.04878 0.05445 0.06366 0.58% Castro::reflux() 60 0.03992 0.04839 0.05974 0.55% MLMG::addInterpCorrection() 6101 0.04864 0.05264 0.05921 0.54% MLCellLinOp::defineAuxData() 360 0.03728 0.04274 0.05271 0.48% FillPatchSingleLevel 1617 0.03327 0.04123 0.04891 0.45% amrex::average_down_w_geom 248 0.03528 0.03911 0.04588 0.42% MLCellLinOp::apply() 108875 0.03578 0.03972 0.04566 0.42% MLMG::prepareForSolve() 360 0.03142 0.0376 0.04533 0.42% FabArrayBase::CPC::define() 4099 0.02847 0.03629 0.04202 0.39% Gravity::fill_multipole_BCs() 70 0.02831 0.03171 0.03975 0.36% Gravity::actual_solve_with_mlmg() 360 0.02332 0.02786 0.0381 0.35% FluxRegister::Reflux() 960 0.0274 0.03184 0.03727 0.34% MultiFab::Xpay() 12217 0.02933 0.03284 0.03619 0.33% Castro::initialize_do_advance() 140 0.01652 0.02832 0.03514 0.32% MLCellLinOp::reflux() 951 0.02437 0.02851 0.03364 0.31% Castro::expand_state() 200 0.01962 0.02866 0.03361 0.31% MLMG::solve() 360 0.009598 0.02055 0.03297 0.30% FillPatchTwoLevels 756 0.02313 0.02989 0.03294 0.30% MLMG::interpCorrection_1 771 0.02423 0.02733 0.03163 0.29% Castro::initMFs() 35 0.01785 0.02498 0.03127 0.29% FabArrayBase::getFB() 157859 0.02382 0.02733 0.03043 0.28% FabArrayBase::getCPC() 29741 0.02395 0.02799 0.02997 0.27% Castro::construct_new_source() 1300 0.0182 0.02431 0.02766 0.25% Gravity::get_new_grav_vector() 263 0.01688 0.02095 0.02651 0.24% MLMG::oneIter() 1843 0.02078 0.02329 0.0256 0.23% Castro::enforce_min_density() 1182 0.0201 0.022 0.02489 0.23% VisMF::Write(FabArray) 6 0.007475 0.01029 0.02449 0.22% MLCellLinOp::updateSolBC() 871 0.01194 0.01709 0.02427 0.22% MultiFab::contains_nan() 280 0.0173 0.02017 0.02375 0.22% Castro::FluxRegCrseInit 140 0.01564 0.01926 0.02337 0.21% MLCellLinOp::updateCorBC() 771 0.01117 0.01608 0.02321 0.21% Amr::writePlotFile() 2 0.005883 0.02019 0.02303 0.21% Amr::coarseTimeStep() 20 0.002292 0.005615 0.02232 0.20% BndryData::define() 540 0.01261 0.01615 0.02231 0.20% MLCellLinOp::smooth() 27488 0.01555 0.01694 0.01901 0.17% Gravity::get_old_grav_vector() 140 0.009077 0.01171 0.01728 0.16% Castro::construct_old_source() 700 0.008285 0.01298 0.01516 0.14% Castro::initialize_advance() 140 0.01023 0.01211 0.01485 0.14% StateData::define() 140 0.009572 0.01209 0.01474 0.14% MLPoisson::FFlux() 7882 0.007124 0.01075 0.01349 0.12% MLCellLinOp::setLevelBC() 450 0.00811 0.01015 0.01304 0.12% Castro::FluxRegFineAdd() 140 0.00615 0.008581 0.01257 0.12% MLCellLinOp::compGrad() 450 0.009523 0.01077 0.01255 0.12% Castro::swap_state_time_levels() 140 0.006718 0.009332 0.01238 0.11% Gravity::gravity_sync() 60 0.008585 0.01051 0.0123 0.11% MLCellLinOp::defineBC() 360 0.008221 0.009789 0.01218 0.11% Castro::construct_old_gravity_source() 140 0.007086 0.01039 0.01218 0.11% FabArray::ParallelCopy() 21259 0.008261 0.009021 0.009664 0.09% Castro::buildMetrics() 35 0.004989 0.00674 0.009663 0.09% MultiFab::max() 90 0.004506 0.006383 0.00887 0.08% Gravity::solve_for_phi() 280 0.005742 0.007748 0.008807 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004111 0.006837 0.008804 0.08% FPinfo::FPinfo() 7 0.001437 0.005884 0.008493 0.08% Castro::init(old) 28 0.005008 0.006868 0.00773 0.07% Amr::timeStep() 140 0.003082 0.003846 0.007642 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0002003 0.003116 0.007506 0.07% FabArray::mult() 1063 0.005672 0.006412 0.007376 0.07% BoxList::pci 22 0.000388 0.003873 0.006584 0.06% StateData::FillBoundary(geom) 745 0.001433 0.003855 0.006427 0.06% Amr::regrid() 21 0.003751 0.004795 0.006355 0.06% Castro::construct_old_gravity() 140 0.003749 0.004887 0.005949 0.05% AmrMesh::MakeNewGrids() 23 0.002776 0.005137 0.005744 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003993 0.004581 0.005692 0.05% MLLinOp::defineGrids() 360 0.004344 0.004565 0.005439 0.05% MLMG::MLRhsNormInf() 360 0.004114 0.004703 0.005211 0.05% MLCellLinOp::prepareForSolve() 360 0.00299 0.003804 0.005161 0.05% FabArray::setDomainBndry() 1617 0.003309 0.00413 0.005095 0.05% Castro::construct_new_gravity() 140 0.003741 0.004267 0.004942 0.05% Castro::Castro() 35 0.003469 0.004335 0.004913 0.05% MultiFab::norm0(mask) 270 0.003328 0.004103 0.004884 0.04% MLCellLinOp::correctionResidual() 9063 0.003894 0.004334 0.004833 0.04% Gravity::applyMetricTerms() 90 0.004066 0.004417 0.004723 0.04% MLMG::mgVcycle() 3385 0.003857 0.004093 0.004393 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.002902 0.003267 0.00389 0.04% Gravity::GetCrsePhi() 250 0.002203 0.002801 0.003791 0.03% Gravity::update_max_rhs() 30 0.002989 0.003382 0.003681 0.03% MLMG::actualBottomSolve() 1843 0.002701 0.002934 0.003589 0.03% MLMG::computeResWithCrseCorFineCor() 771 0.002592 0.002921 0.003587 0.03% FillPatchInterp(Fab) 728 0.003135 0.00336 0.00356 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002317 0.002811 0.003391 0.03% MultiFab::Subtract() 420 0.002121 0.002558 0.003388 0.03% Castro::reset_internal_energy(MultiFab) 1189 0.001839 0.00224 0.002846 0.03% MLMG::MLResNormInf() 440 0.0007549 0.001531 0.002668 0.02% MultiFab::Copy() 450 0.001671 0.002105 0.002637 0.02% MLMG:computeResOfCorrection() 6101 0.001971 0.002113 0.002323 0.02% MLLinOp::makeSubCommunicator() 70 0.001421 0.001749 0.002225 0.02% MLMG::mgVcycle_down::0 1843 0.001912 0.002012 0.002106 0.02% TagBoxArray::collate() 34 0.0006445 0.001059 0.002013 0.02% Castro::apply_tagging_restrictions() 34 0.001369 0.001734 0.001958 0.02% MLMG::mgVcycle_bottom 3385 0.001819 0.00189 0.001957 0.02% MLCellLinOp::solutionResidual() 3154 0.001718 0.001813 0.001875 0.02% Castro::clean_state() 1182 0.001369 0.001607 0.001783 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001225 0.001525 0.001763 0.02% StateDataPhysBCFunct::() 1617 0.001291 0.001602 0.001702 0.02% MLMG::mgVcycle_down::1 1843 0.00138 0.001512 0.001587 0.01% Castro::finalize_advance() 140 0.0009005 0.001206 0.001517 0.01% ClusterList::chop() 4 0 0.0001812 0.00145 0.01% MLMG::mgVcycle_up::1 1843 0.001221 0.001335 0.001421 0.01% AMRErrorTag::operator() 34 0.0009196 0.001215 0.001406 0.01% FabArrayBase::TheFPinfo() 728 0.0006933 0.001045 0.00139 0.01% Gravity::solve_phi_with_mlmg() 300 0.001008 0.001145 0.001372 0.01% MLMG::mgVcycle_up::0 1843 0.00109 0.001165 0.001244 0.01% Castro::build_fine_mask() 100 0.0007811 0.0009655 0.001133 0.01% MLMG::buildFineMask() 360 0.0009075 0.001031 0.001092 0.01% Gravity::actual_multilevel_solve() 20 0.0007664 0.0009336 0.001091 0.01% MLPoisson::define() 360 0.0007926 0.0009061 0.001088 0.01% main() 1 0.0006757 0.0007856 0.0009532 0.01% MLMG::computeResidual() 1843 0.0007257 0.0007828 0.0008317 0.01% Castro::finalize_do_advance() 140 0.000472 0.0005954 0.0008209 0.01% Castro::do_new_sources() 260 0.0005728 0.0007011 0.0007826 0.01% Castro::derive() 34 0.0005075 0.0005823 0.0006861 0.01% FabArrayBase::FB::FB() 299 0.0001926 0.0004459 0.0006242 0.01% Amr::grid_places() 23 0.0003135 0.0003734 0.0006193 0.01% Castro::apply_source_to_state() 520 0.0004064 0.0005219 0.0006089 0.01% MLMG::miniCycle() 1542 0.0004928 0.0005531 0.0005872 0.01% Castro::subcycle_advance_ctu() 140 0.0003895 0.0004733 0.0005685 0.01% ClusterList::intersect() 4 0 6.699e-05 0.0005359 0.00% Castro::advance() 140 0.0003663 0.0004441 0.0005033 0.00% Amr::InitAmr() 1 0.0002685 0.0003585 0.0004935 0.00% Castro::enforce_speed_limit() 1182 0.0003112 0.0004067 0.0004486 0.00% MLMG::mgVcycle_down::2 483 0.0003528 0.0004073 0.000437 0.00% Castro::do_old_sources() 140 0.0003034 0.0003843 0.0004215 0.00% MLMG::mgVcycle_down::3 483 0.0003294 0.0003675 0.0004209 0.00% MLMG::mgVcycle_down::4 483 0.0003645 0.0003904 0.0004172 0.00% MLLinOp::define() 360 0.0003371 0.0003735 0.0004006 0.00% MLMG::mgVcycle_down::6 483 0.0003348 0.0003636 0.0003851 0.00% MLMG::mgVcycle_down::5 483 0.0003122 0.0003375 0.0003527 0.00% Gravity::swapTimeLevels() 140 0.0002006 0.0002978 0.0003487 0.00% MLPoisson::prepareForSolve() 360 0.0002396 0.0002751 0.0003441 0.00% MultiFab::Multiply() 40 0.0002269 0.0002883 0.0003255 0.00% AmrMesh-cluster 4 0 3.873e-05 0.0003099 0.00% MLMG::mgVcycle_up::2 483 0.0002329 0.0002666 0.000309 0.00% MLMG::computeMLResidual() 440 0.0002799 0.0002931 0.0003036 0.00% MLMG::mgVcycle_up::6 483 0.000256 0.0002756 0.0002951 0.00% makeSFC 350 0.0002078 0.0002398 0.0002787 0.00% MLMG::mgVcycle_up::5 483 0.0002282 0.0002541 0.0002699 0.00% MLMG::mgVcycle_up::3 483 0.0002093 0.0002391 0.0002653 0.00% Castro::post_timestep() 140 0.0001712 0.000211 0.0002491 0.00% AmrLevel::AmrLevel(dm) 35 0.0001914 0.0002163 0.0002408 0.00% MLMG::getGradSolution() 360 0.0001886 0.0002154 0.0002396 0.00% MLMG::mgVcycle_up::4 483 0.0002066 0.0002283 0.000236 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001589 0.0001964 0.0002314 0.00% TagBoxArray::mapPRD 34 0.0001831 0.0002032 0.0002256 0.00% DistributionMapping::Distribute() 355 0.0001483 0.0001885 0.0002199 0.00% OwnerMask() 34 0.0001584 0.0001855 0.0002175 0.00% Castro::avgDown(state_indx) 248 0.0001368 0.0001776 0.0002077 0.00% Castro::check_for_nan() 280 0.0001499 0.0001723 0.0001888 0.00% Castro::post_regrid() 66 0.000156 0.000163 0.0001685 0.00% Castro::enforce_consistent_e() 7 8.87e-05 0.000113 0.0001537 0.00% Amr::FinalizeInit() 1 4.002e-06 2.09e-05 0.0001346 0.00% FabArray::RecvLayoutMask() 90 9.36e-05 0.0001087 0.0001197 0.00% knapsack() 7 0.0001049 0.0001094 0.0001164 0.00% Gravity::solve_for_delta_phi 60 9.203e-05 0.0001013 0.0001153 0.00% Castro::create_source_corrector() 140 6.077e-05 7.92e-05 9.436e-05 0.00% Castro::avgDown() 62 6.019e-05 7.788e-05 8.804e-05 0.00% BoxList::complementIn 574 6.724e-05 7.164e-05 8.084e-05 0.00% Amr::writeSmallPlotFile() 1 3.252e-05 6.047e-05 8.034e-05 0.00% Castro::errorEst() 34 6.477e-05 7.025e-05 7.918e-05 0.00% Amr::bldFineLevels() 1 2.384e-05 3.123e-05 5.248e-05 0.00% Castro::retry_advance_ctu() 140 4.224e-05 4.701e-05 5.042e-05 0.00% Castro::computeNewDt() 28 4.469e-05 4.667e-05 4.825e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.912e-05 3.457e-05 4.39e-05 0.00% Gravity::set_mass_offset() 21 1.313e-05 2.385e-05 2.884e-05 0.00% BoxList::parallelComplementIn() 57 2.099e-05 2.238e-05 2.848e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.009e-05 2.255e-05 2.626e-05 0.00% Amr::defBaseLevel() 1 1.829e-05 2.002e-05 2.224e-05 0.00% Castro::apply_problem_tags() 34 1.539e-05 1.712e-05 1.873e-05 0.00% Amr::initSubcycle() 1 8.343e-06 1.062e-05 1.419e-05 0.00% Castro::post_init() 3 8.153e-06 9.262e-06 1.056e-05 0.00% Amr::InitializeInit() 1 2.18e-06 3.148e-06 7.401e-06 0.00% Castro::computeInitialDt() 2 3.579e-06 3.967e-06 4.529e-06 0.00% Amr::init() 1 1.588e-06 1.836e-06 2.058e-06 0.00% Amr::initialInit() 1 9.01e-07 1.252e-06 1.911e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.9 10.9 10.9 100.00% Amr::coarseTimeStep() 20 10.68 10.68 10.68 97.98% Amr::timeStep() 140 10.65 10.66 10.67 97.85% Castro::advance() 140 7.862 7.867 7.871 72.20% Castro::subcycle_advance_ctu() 140 7.623 7.664 7.697 70.60% Castro::do_advance_ctu() 140 7.623 7.663 7.696 70.59% Gravity::actual_solve_with_mlmg() 360 5.694 5.704 5.724 52.50% MLMG::solve() 360 5.509 5.519 5.526 50.69% MLMG::oneIter() 1843 5.109 5.14 5.158 47.31% MLMG::mgVcycle() 3385 4.708 4.757 4.795 43.98% Gravity::solve_phi_with_mlmg() 300 4.291 4.309 4.326 39.68% Gravity::solve_for_phi() 280 3.627 3.644 3.658 33.56% MLMG::mgVcycle_bottom 3385 3.213 3.233 3.256 29.87% Castro::construct_new_gravity() 140 2.915 2.919 2.927 26.84% MLMG::actualBottomSolve() 1843 2.824 2.832 2.852 26.16% MLCGSolver::bicgstab 1420 2.82 2.828 2.847 26.11% Castro::construct_ctu_hydro_source() 140 1.94 2.302 2.586 23.72% Castro::post_timestep() 140 2.002 2.018 2.024 18.57% Castro::reflux() 60 1.874 1.888 1.908 17.50% MLCellLinOp::applyBC() 165252 1.413 1.613 1.794 16.46% MLCellLinOp::smooth() 27488 1.549 1.614 1.663 15.25% Gravity::gravity_sync() 60 1.541 1.542 1.542 14.14% FabArray::FillBoundary() 157859 1.123 1.351 1.533 14.06% Gravity::solve_for_delta_phi 60 1.461 1.461 1.462 13.41% MLCellLinOp::apply() 108875 1.123 1.293 1.435 13.16% MLCGSolver::ParallelAllReduce 243542 0.917 1.15 1.419 13.01% MLPoisson::Fsmooth() 54976 0.8873 0.9627 1.079 9.90% FabArray::ParallelCopy() 21259 0.6264 0.788 0.9633 8.84% Castro::construct_old_gravity() 140 0.8665 0.878 0.8927 8.19% Amr::regrid() 21 0.8283 0.8356 0.8429 7.73% FillBoundary_nowait() 157859 0.537 0.6895 0.782 7.17% FabArray::ParallelCopy_finish() 21259 0.341 0.5242 0.7217 6.62% FillBoundary_finish() 157859 0.4265 0.6074 0.7179 6.58% Gravity::multilevel_solve_for_new_phi() 20 0.681 0.6833 0.6844 6.28% Gravity::actual_multilevel_solve() 20 0.6793 0.6817 0.6831 6.27% FillPatchIterator::Initialize 889 0.5228 0.5966 0.6585 6.04% Castro::post_regrid() 66 0.6474 0.6519 0.6549 6.01% FillPatchTwoLevels 756 0.4448 0.5144 0.5808 5.33% MLMG::mgVcycle_down::0 1843 0.4757 0.4963 0.5172 4.74% MLMG::mgVcycle_up::0 1843 0.4456 0.4585 0.4677 4.29% Castro::clean_state() 1182 0.3715 0.416 0.4589 4.21% FillPatchSingleLevel 1617 0.2609 0.3383 0.4511 4.14% MLMG::miniCycle() 1542 0.3766 0.4014 0.4167 3.82% Castro::initialize_do_advance() 140 0.3354 0.3506 0.376 3.45% Castro::expand_state() 200 0.2782 0.3034 0.3435 3.15% MLPoisson::Fapply() 108875 0.2649 0.2987 0.3295 3.02% CGSolver::sxay() 288086 0.2271 0.2662 0.3091 2.84% MLCellLinOp::correctionResidual() 9063 0.2633 0.2875 0.2996 2.75% Castro::do_new_sources() 260 0.2261 0.2577 0.2898 2.66% FabArray::ParallelCopy_nowait() 21259 0.2079 0.2548 0.2811 2.58% Castro::computeTemp() 1189 0.2181 0.2485 0.2747 2.52% MultiFab::LinComb() 288336 0.1687 0.2076 0.2453 2.25% FabArray::setVal() 27604 0.1492 0.1906 0.2414 2.21% MLCellLinOp::solutionResidual() 3154 0.2086 0.224 0.235 2.16% MLMG::mgVcycle_down::1 1843 0.2141 0.2235 0.2333 2.14% MultiFab::Dot() 193316 0.1678 0.1922 0.2177 2.00% Amr::init() 1 0.2037 0.2039 0.204 1.87% Castro::estTimeStep() 308 0.1011 0.1576 0.1986 1.82% MLMG::computeResWithCrseSolFineCor() 771 0.1549 0.1785 0.1974 1.81% Castro::initialize_advance() 140 0.1313 0.1601 0.1968 1.80% Castro::reset_internal_energy(MultiFab) 1189 0.1548 0.1771 0.194 1.78% Castro::reset_internal_energy(Fab) 5919 0.1525 0.1748 0.1914 1.76% Amr::initialInit() 1 0.1885 0.1887 0.1888 1.73% Amr::FinalizeInit() 1 0.175 0.1784 0.182 1.67% MLMG::mgVcycle_up::1 1843 0.1654 0.1734 0.1786 1.64% amrex::average_down 8093 0.1151 0.1409 0.1674 1.54% Castro::normalize_species() 1182 0.1326 0.1449 0.1586 1.45% Castro::construct_new_source() 1300 0.1174 0.1358 0.1513 1.39% MLMG::computeResidual() 1843 0.1183 0.1316 0.1397 1.28% MLMG:computeResOfCorrection() 6101 0.1264 0.1302 0.1337 1.23% MLMG::addInterpCorrection() 6101 0.07657 0.1081 0.1325 1.22% Castro::do_old_sources() 140 0.0911 0.112 0.1308 1.20% MLPoisson::normalize() 98078 0.1004 0.1142 0.1257 1.15% MLPoisson::define() 360 0.08091 0.09258 0.1135 1.04% Castro::avgDown() 62 0.06889 0.09147 0.1129 1.04% Castro::avgDown(state_indx) 248 0.06881 0.09139 0.1129 1.04% amrex::average_down_w_geom 248 0.06863 0.09121 0.1127 1.03% MLMG::ResNormInf() 2383 0.05737 0.084 0.1126 1.03% Gravity::get_new_grav_vector() 263 0.1074 0.11 0.1126 1.03% MLMG::mgVcycle_up::2 483 0.0273 0.05804 0.1049 0.96% Amr::bldFineLevels() 1 0.09031 0.09556 0.1012 0.93% MLMG::computeResWithCrseCorFineCor() 771 0.08459 0.0952 0.09884 0.91% MLCellLinOp::reflux() 951 0.07074 0.08452 0.09453 0.87% Castro::construct_new_gravity_source() 260 0.07026 0.07937 0.08907 0.82% Castro::post_init() 3 0.07221 0.07819 0.08364 0.77% MLCellLinOp::setLevelBC() 450 0.02536 0.04849 0.07854 0.72% MultiFab::Saxpy() 1180 0.05505 0.06761 0.07842 0.72% Castro::init(old) 28 0.05094 0.06389 0.07794 0.71% Castro::initData() 7 0.053 0.06363 0.07753 0.71% FillPatchInterp(Fab) 728 0.07082 0.074 0.07688 0.71% MLMG::computeMLResidual() 440 0.0601 0.06759 0.07357 0.67% CellConservativeLinear::interp() 9059 0.06761 0.07064 0.07333 0.67% FabArrayBase::getCPC() 29741 0.05242 0.06428 0.07181 0.66% MLMG::prepareForSolve() 360 0.0642 0.0676 0.07073 0.65% Gravity::get_old_grav_vector() 140 0.06635 0.06858 0.07043 0.65% MLCellLinOp::defineAuxData() 360 0.04724 0.05394 0.06556 0.60% FluxRegister::Reflux() 960 0.05345 0.05983 0.06459 0.59% MLCellLinOp::updateSolBC() 871 0.04396 0.05491 0.06373 0.58% Gravity::GetCrsePhi() 250 0.02693 0.04172 0.06144 0.56% MLCellLinOp::updateCorBC() 771 0.04659 0.0549 0.0611 0.56% MLMG::mgVcycle_up::3 483 0.003825 0.02663 0.05993 0.55% Castro::Castro() 35 0.03285 0.04594 0.05803 0.53% MLMG::interpCorrection_1 771 0.03749 0.0455 0.05778 0.53% Castro::finalize_advance() 140 0.03887 0.04286 0.04728 0.43% Castro::apply_source_to_state() 520 0.02802 0.03697 0.04424 0.41% FabArrayBase::CPC::define() 4099 0.02847 0.03629 0.04202 0.39% Gravity::fill_multipole_BCs() 70 0.02898 0.03231 0.04023 0.37% MLCellLinOp::defineBC() 360 0.02403 0.03043 0.04017 0.37% Castro::construct_old_source() 700 0.02465 0.03422 0.03969 0.36% Amr::grid_places() 23 0.02243 0.03122 0.0363 0.33% MultiFab::Xpay() 12217 0.02933 0.03284 0.03619 0.33% AmrMesh::MakeNewGrids() 23 0.02207 0.03085 0.03597 0.33% MLMG::mgVcycle_down::2 483 0.03075 0.03214 0.03431 0.31% Castro::FluxRegCrseInit 140 0.03182 0.03307 0.03351 0.31% MLMG::mgVcycle_up::6 483 0.004133 0.008215 0.03305 0.30% MLMG::mgVcycle_down::6 483 0.004875 0.008808 0.03139 0.29% Castro::initMFs() 35 0.01785 0.02498 0.03127 0.29% FabArrayBase::getFB() 157859 0.0241 0.02778 0.03105 0.28% Amr::writePlotFile() 2 0.03037 0.03048 0.03052 0.28% BndryData::define() 540 0.01552 0.0203 0.0276 0.25% Castro::enforce_min_density() 1182 0.0201 0.022 0.02489 0.23% VisMF::Write(FabArray) 6 0.007475 0.01029 0.02449 0.22% Castro::check_for_nan() 280 0.01747 0.02034 0.02394 0.22% MultiFab::contains_nan() 280 0.0173 0.02017 0.02375 0.22% Castro::errorEst() 34 0.01086 0.01824 0.02355 0.22% MLMG::mgVcycle_down::3 483 0.005579 0.01378 0.02231 0.20% Castro::derive() 34 0.007419 0.0152 0.0203 0.19% MLMG::getGradSolution() 360 0.01443 0.01656 0.01974 0.18% MLCellLinOp::compGrad() 450 0.01422 0.01634 0.01952 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01716 0.01806 0.01926 0.18% Castro::computeNewDt() 28 0.01606 0.01685 0.01766 0.16% Gravity::update_max_rhs() 30 0.0139 0.01525 0.01703 0.16% AmrLevel::AmrLevel(dm) 35 0.009763 0.01231 0.01496 0.14% StateData::define() 140 0.009572 0.01209 0.01474 0.14% Amr::InitializeInit() 1 0.006779 0.01031 0.01369 0.13% Amr::defBaseLevel() 1 0.006777 0.01031 0.01369 0.13% MLPoisson::FFlux() 7882 0.007124 0.01075 0.01349 0.12% Castro::FluxRegFineAdd() 140 0.00615 0.008581 0.01257 0.12% Castro::swap_state_time_levels() 140 0.006718 0.009332 0.01238 0.11% Castro::construct_old_gravity_source() 140 0.007086 0.01039 0.01218 0.11% MLMG::MLResNormInf() 440 0.00796 0.009242 0.01065 0.10% MLMG::mgVcycle_down::4 483 0.005074 0.006231 0.01013 0.09% FabArrayBase::TheFPinfo() 728 0.002427 0.007132 0.01009 0.09% Castro::buildMetrics() 35 0.005102 0.006862 0.009817 0.09% MultiFab::max() 90 0.004506 0.006383 0.00887 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004111 0.006837 0.008804 0.08% FPinfo::FPinfo() 7 0.001639 0.006087 0.008697 0.08% MLLinOp::define() 360 0.006786 0.0073 0.008313 0.08% StateDataPhysBCFunct::() 1617 0.002724 0.005457 0.008129 0.07% MLLinOp::defineGrids() 360 0.006425 0.006927 0.007916 0.07% Castro::computeInitialDt() 2 0.0008621 0.004161 0.007793 0.07% MLMG::mgVcycle_up::4 483 0.003811 0.004618 0.007789 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0002003 0.003116 0.007506 0.07% DistributionMapping::SFCProcessorMapDoIt() 5 0.0001932 0.003092 0.00747 0.07% FabArray::mult() 1063 0.005672 0.006412 0.007376 0.07% MLMG::mgVcycle_down::5 483 0.004935 0.005612 0.00714 0.07% BoxList::parallelComplementIn() 57 0.0004206 0.003907 0.006616 0.06% BoxList::pci 22 0.000388 0.003873 0.006584 0.06% MLMG::MLRhsNormInf() 360 0.005639 0.006047 0.006576 0.06% StateData::FillBoundary(geom) 745 0.001433 0.003855 0.006427 0.06% MLMG::mgVcycle_up::5 483 0.003873 0.004451 0.005676 0.05% MLPoisson::prepareForSolve() 360 0.003334 0.004079 0.005428 0.05% MLCellLinOp::prepareForSolve() 360 0.00299 0.003804 0.005161 0.05% FabArray::setDomainBndry() 1617 0.003309 0.00413 0.005095 0.05% MultiFab::norm0(mask) 270 0.003328 0.004103 0.004884 0.04% Gravity::applyMetricTerms() 90 0.004066 0.004417 0.004723 0.04% Gravity::swapTimeLevels() 140 0.003616 0.004025 0.0044 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002954 0.003524 0.004253 0.04% TagBoxArray::mapPRD 34 0.001242 0.002098 0.003436 0.03% MultiFab::Subtract() 420 0.002121 0.002558 0.003388 0.03% MultiFab::Copy() 450 0.001671 0.002105 0.002637 0.02% AmrMesh-cluster 4 0 0.000287 0.002296 0.02% MLLinOp::makeSubCommunicator() 70 0.001421 0.001749 0.002225 0.02% TagBoxArray::collate() 34 0.0006445 0.001059 0.002013 0.02% Castro::apply_tagging_restrictions() 34 0.001369 0.001734 0.001958 0.02% ClusterList::chop() 4 0 0.0001812 0.00145 0.01% MLMG::buildFineMask() 360 0.001188 0.001326 0.001444 0.01% AMRErrorTag::operator() 34 0.0009196 0.001215 0.001406 0.01% Castro::build_fine_mask() 100 0.0007811 0.0009655 0.001133 0.01% Castro::finalize_do_advance() 140 0.000472 0.0005954 0.0008209 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005061 0.0006122 0.0006727 0.01% FabArrayBase::FB::FB() 299 0.0001926 0.0004459 0.0006242 0.01% ClusterList::intersect() 4 0 6.699e-05 0.0005359 0.00% Amr::InitAmr() 1 0.000277 0.0003691 0.0005035 0.00% Castro::enforce_speed_limit() 1182 0.0003112 0.0004067 0.0004486 0.00% makeSFC 350 0.0003421 0.0004159 0.0004452 0.00% MultiFab::Multiply() 40 0.0002269 0.0002883 0.0003255 0.00% DistributionMapping::Distribute() 355 0.0001483 0.0001885 0.0002199 0.00% OwnerMask() 34 0.0001584 0.0001855 0.0002175 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001921 0.0002029 0.0002078 0.00% Castro::enforce_consistent_e() 7 8.87e-05 0.000113 0.0001537 0.00% FabArray::RecvLayoutMask() 90 9.36e-05 0.0001087 0.0001197 0.00% knapsack() 7 0.0001049 0.0001094 0.0001164 0.00% Castro::create_source_corrector() 140 6.077e-05 7.92e-05 9.436e-05 0.00% BoxList::complementIn 574 6.724e-05 7.164e-05 8.084e-05 0.00% Amr::writeSmallPlotFile() 1 3.252e-05 6.047e-05 8.034e-05 0.00% Castro::retry_advance_ctu() 140 4.224e-05 4.701e-05 5.042e-05 0.00% Gravity::set_mass_offset() 21 1.313e-05 2.385e-05 2.884e-05 0.00% Castro::apply_problem_tags() 34 1.539e-05 1.712e-05 1.873e-05 0.00% Amr::initSubcycle() 1 8.343e-06 1.062e-05 1.419e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.07-4-gcbdc6580ee3d) finalized