MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.06-15-ge113ff7dcf29) initialized Starting run at 05:37:33 UTC on 2022-06-10. Successfully read inputs file ... Castro git describe: 22.06-11-gef6a933cb AMReX git describe: 22.06-15-ge113ff7dc Microphysics git describe: 22.06-1-gb8e427c1 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001117881 new finest: 1 grid_places() time: 0.007346361 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.004927046 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.008160042 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.016530751 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.489191899 [STEP 1] FAB kilobyte spread across MPI nodes: [18072 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000523568 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.519180295 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000785448 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.53292578 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000543058 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.541118482 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000844804 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.526385365 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000551793 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.520433838 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000807297 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.529441502 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000559177 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.534443695 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000790172 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.532448241 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000535614 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.535963724 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.001138549 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.56061475 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000550441 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.528027783 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.00078876 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.530570206 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000530024 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.525065563 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000792565 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.545336542 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.00056099 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.520039086 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000772128 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.521727031 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000533748 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.505439663 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.00077418 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.517224766 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000531228 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.512779579 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.014596186 seconds Ending run at 05:37:44 UTC on 2022-06-10. Run time = 10.72576639 Run time without initialization = 10.54625651 Average number of zones advanced per microsecond: 0.836 Average number of zones advanced per microsecond per rank: 0.104 TinyProfiler total time across processes [min...avg...max]: 10.73 ... 10.73 ... 10.73 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.8168 2.2194 2.4804 23.13% MLCGSolver::ParallelAllReduce 243542 0.7848 1.056 1.43 13.34% MLPoisson::Fsmooth() 54976 0.7931 0.9256 1.037 9.67% Castro::do_advance_ctu() 140 0.3172 0.5822 0.9817 9.15% FabArray::ParallelCopy_finish() 21259 0.3449 0.5136 0.881 8.21% FillBoundary_finish() 157859 0.4547 0.6296 0.8725 8.13% FillBoundary_nowait() 157859 0.4954 0.6535 0.7663 7.14% MLCellLinOp::applyBC() 165252 0.1935 0.2964 0.4009 3.74% MLPoisson::Fapply() 108875 0.2466 0.2969 0.3255 3.03% MLCGSolver::bicgstab 1420 0.1964 0.2375 0.2615 2.44% MultiFab::LinComb() 288336 0.1542 0.2062 0.24 2.24% FabArray::setVal() 27604 0.1389 0.1956 0.2384 2.22% FabArray::ParallelCopy_nowait() 21259 0.1611 0.1995 0.2255 2.10% Castro::estTimeStep() 308 0.1057 0.1588 0.2221 2.07% MultiFab::Dot() 193316 0.1556 0.1927 0.2123 1.98% Castro::reset_internal_energy(Fab) 5919 0.1434 0.1722 0.1886 1.76% Castro::normalize_species() 1182 0.1217 0.1442 0.1593 1.49% MLPoisson::normalize() 98078 0.09293 0.1139 0.1244 1.16% MLMG::ResNormInf() 2383 0.05657 0.08269 0.1111 1.04% Castro::construct_new_gravity_source() 260 0.06266 0.07908 0.08739 0.81% amrex::average_down 8093 0.06644 0.07788 0.08447 0.79% Castro::computeTemp() 1189 0.05935 0.07043 0.08007 0.75% MultiFab::Saxpy() 1180 0.04829 0.06622 0.07474 0.70% CellConservativeLinear::interp() 9059 0.06853 0.07044 0.07256 0.68% CGSolver::sxay() 288086 0.05651 0.06215 0.06618 0.62% FillPatchIterator::Initialize 889 0.03285 0.05385 0.06544 0.61% Castro::initData() 7 0.04468 0.05188 0.06079 0.57% MLMG::addInterpCorrection() 6101 0.04566 0.05313 0.05971 0.56% FabArray::FillBoundary() 157859 0.04945 0.05424 0.05662 0.53% Castro::reflux() 60 0.0339 0.04697 0.05605 0.52% MLCellLinOp::defineAuxData() 360 0.03271 0.0424 0.052 0.48% FillPatchSingleLevel 1617 0.03109 0.0421 0.04895 0.46% MLMG::prepareForSolve() 360 0.02808 0.03744 0.04454 0.42% amrex::average_down_w_geom 248 0.02846 0.03737 0.04377 0.41% MLCellLinOp::apply() 108875 0.03839 0.04056 0.04375 0.41% FabArrayBase::CPC::define() 4099 0.0264 0.03567 0.04122 0.38% Gravity::actual_solve_with_mlmg() 360 0.01975 0.02826 0.03782 0.35% Gravity::fill_multipole_BCs() 70 0.02879 0.03166 0.03707 0.35% MultiFab::Xpay() 12217 0.02799 0.03286 0.03583 0.33% FluxRegister::Reflux() 960 0.02313 0.03014 0.0346 0.32% Castro::expand_state() 200 0.01811 0.028 0.03359 0.31% MLMG::solve() 360 0.009461 0.02099 0.03309 0.31% Castro::initialize_do_advance() 140 0.01561 0.02791 0.03297 0.31% FillPatchTwoLevels 756 0.02326 0.0289 0.03203 0.30% MLMG::interpCorrection_1 771 0.02181 0.02718 0.03135 0.29% FabArrayBase::getFB() 157859 0.02566 0.02798 0.03074 0.29% MLCellLinOp::reflux() 951 0.02213 0.02551 0.02994 0.28% FabArrayBase::getCPC() 29741 0.02394 0.02795 0.02987 0.28% Castro::initMFs() 35 0.01603 0.02382 0.02921 0.27% Castro::enforce_min_density() 1182 0.02018 0.02486 0.02831 0.26% Castro::construct_new_source() 1300 0.01729 0.02359 0.02675 0.25% VisMF::Write(FabArray) 6 0.007829 0.01041 0.02622 0.24% Gravity::get_new_grav_vector() 263 0.01557 0.02056 0.02557 0.24% Amr::coarseTimeStep() 20 0.002666 0.005954 0.02472 0.23% Amr::writePlotFile() 2 0.005799 0.02171 0.02434 0.23% MLCellLinOp::updateSolBC() 871 0.01146 0.01715 0.02405 0.22% MLMG::oneIter() 1843 0.01849 0.02165 0.02358 0.22% MLCellLinOp::updateCorBC() 771 0.01058 0.0161 0.02293 0.21% MultiFab::contains_nan() 280 0.01546 0.01997 0.02287 0.21% Castro::FluxRegCrseInit 140 0.012 0.01831 0.02231 0.21% BndryData::define() 540 0.0112 0.01594 0.02199 0.21% MLCellLinOp::smooth() 27488 0.01583 0.01678 0.018 0.17% Gravity::get_old_grav_vector() 140 0.008052 0.01135 0.01646 0.15% Castro::initialize_advance() 140 0.008265 0.01177 0.01437 0.13% Castro::construct_old_source() 700 0.008136 0.01224 0.01433 0.13% StateData::define() 140 0.008364 0.01148 0.0138 0.13% MLCellLinOp::setLevelBC() 450 0.007443 0.01013 0.01323 0.12% MLPoisson::FFlux() 7882 0.006949 0.01061 0.01297 0.12% Castro::construct_old_gravity_source() 140 0.005806 0.01027 0.01223 0.11% MLCellLinOp::compGrad() 450 0.008611 0.01075 0.01221 0.11% Castro::FluxRegFineAdd() 140 0.005046 0.008882 0.01213 0.11% MLCellLinOp::defineBC() 360 0.007292 0.009721 0.01196 0.11% Castro::swap_state_time_levels() 140 0.004646 0.008575 0.01181 0.11% Gravity::gravity_sync() 60 0.007133 0.01016 0.01164 0.11% FPinfo::FPinfo() 7 0.001484 0.005616 0.01078 0.10% MultiFab::max() 90 0.003534 0.005931 0.01028 0.10% FabArray::ParallelCopy() 21259 0.008284 0.008966 0.009232 0.09% Castro::buildMetrics() 35 0.00489 0.006443 0.008834 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003573 0.00686 0.008784 0.08% Gravity::solve_for_phi() 280 0.005216 0.007546 0.008705 0.08% Amr::timeStep() 140 0.003114 0.004087 0.007786 0.07% Castro::init(old) 28 0.004293 0.006703 0.007749 0.07% FabArray::mult() 1063 0.005263 0.006412 0.007473 0.07% BoxList::pci 22 0.0004183 0.004422 0.006365 0.06% Amr::regrid() 21 0.003127 0.004758 0.006202 0.06% DistributionMapping::LeastUsedCPUs() 12 9.958e-05 0.003046 0.006138 0.06% Gravity::applyMetricTerms() 90 0.004714 0.005326 0.00583 0.05% AmrMesh::MakeNewGrids() 23 0.002742 0.005079 0.0057 0.05% Castro::construct_old_gravity() 140 0.003157 0.004621 0.005515 0.05% StateData::FillBoundary(geom) 745 0.001556 0.003694 0.005511 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003657 0.004446 0.005457 0.05% MLLinOp::defineGrids() 360 0.004322 0.004886 0.005337 0.05% MLMG::MLRhsNormInf() 360 0.003941 0.004719 0.00527 0.05% MLCellLinOp::prepareForSolve() 360 0.002726 0.003794 0.005181 0.05% MultiFab::norm0(mask) 270 0.003251 0.004121 0.004989 0.05% Castro::construct_new_gravity() 140 0.003132 0.004179 0.004883 0.05% Castro::Castro() 35 0.003229 0.004151 0.004793 0.04% FabArray::setDomainBndry() 1617 0.003655 0.004036 0.004595 0.04% MLCellLinOp::correctionResidual() 9063 0.003833 0.004302 0.004488 0.04% MLMG::mgVcycle() 3385 0.003973 0.004268 0.004466 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.002755 0.003348 0.003978 0.04% Gravity::update_max_rhs() 30 0.002595 0.003402 0.003829 0.04% FillPatchInterp(Fab) 728 0.003072 0.003408 0.003658 0.03% MLMG::computeResWithCrseCorFineCor() 771 0.002418 0.002994 0.003623 0.03% Gravity::GetCrsePhi() 250 0.001876 0.002771 0.003511 0.03% MLMG::actualBottomSolve() 1843 0.00262 0.002881 0.003338 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.001956 0.002756 0.003274 0.03% MLLinOp::makeSubCommunicator() 70 0.001547 0.002128 0.00324 0.03% MultiFab::Subtract() 420 0.001779 0.002504 0.003162 0.03% Castro::reset_internal_energy(MultiFab) 1189 0.001649 0.002284 0.00289 0.03% MultiFab::Copy() 450 0.001571 0.002113 0.002651 0.02% MLMG::MLResNormInf() 440 0.0006002 0.001444 0.002606 0.02% MLMG:computeResOfCorrection() 6101 0.001944 0.00214 0.002223 0.02% MLMG::mgVcycle_down::0 1843 0.001877 0.002012 0.002139 0.02% MLMG::mgVcycle_bottom 3385 0.001773 0.001853 0.00194 0.02% MLCellLinOp::solutionResidual() 3154 0.001672 0.001799 0.001878 0.02% Castro::apply_tagging_restrictions() 34 0.001298 0.001576 0.001866 0.02% Castro::clean_state() 1182 0.001368 0.001603 0.001813 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001045 0.001492 0.001724 0.02% Castro::finalize_advance() 140 0.0008172 0.001235 0.001705 0.02% StateDataPhysBCFunct::() 1617 0.001384 0.001553 0.001703 0.02% MLMG::mgVcycle_down::1 1843 0.001399 0.001501 0.00157 0.01% ClusterList::chop() 4 0 0.0001845 0.001476 0.01% Gravity::solve_phi_with_mlmg() 300 0.0008071 0.00114 0.001435 0.01% AMRErrorTag::operator() 34 0.0009436 0.001175 0.001424 0.01% TagBoxArray::collate() 34 0.000685 0.001046 0.001422 0.01% MLMG::mgVcycle_up::1 1843 0.001251 0.00134 0.001405 0.01% MLMG::mgVcycle_up::0 1843 0.001151 0.001251 0.001332 0.01% Castro::build_fine_mask() 100 0.0008266 0.0009989 0.001156 0.01% Gravity::actual_multilevel_solve() 20 0.0006455 0.0009449 0.001114 0.01% MLMG::buildFineMask() 360 0.0008966 0.001032 0.001113 0.01% FabArrayBase::TheFPinfo() 728 0.000766 0.0009612 0.001087 0.01% MLPoisson::define() 360 0.0007051 0.000813 0.0009286 0.01% MLMG::computeResidual() 1843 0.0007648 0.0008398 0.0008679 0.01% Castro::finalize_do_advance() 140 0.0004146 0.0005923 0.0007876 0.01% main() 1 0.0006686 0.0007147 0.0007743 0.01% Castro::do_new_sources() 260 0.0005713 0.0006943 0.0007687 0.01% FabArrayBase::FB::FB() 299 0.0001862 0.0004557 0.0007214 0.01% Amr::grid_places() 23 0.0003121 0.0003761 0.0006499 0.01% Castro::derive() 34 0.0004503 0.0005499 0.0006473 0.01% MLMG::miniCycle() 1542 0.0005066 0.0005663 0.0006194 0.01% Castro::apply_source_to_state() 520 0.0003133 0.0005088 0.0005939 0.01% ClusterList::intersect() 4 0 6.852e-05 0.0005482 0.01% Castro::subcycle_advance_ctu() 140 0.0003298 0.0004494 0.0005398 0.01% Castro::enforce_speed_limit() 1182 0.0003406 0.000445 0.0005066 0.00% Castro::advance() 140 0.0003384 0.0004086 0.0004543 0.00% MLMG::mgVcycle_down::2 483 0.0003596 0.0003905 0.0004265 0.00% MLMG::mgVcycle_down::4 483 0.0003641 0.0003921 0.0004198 0.00% MLLinOp::define() 360 0.0002985 0.0003596 0.0004185 0.00% Amr::InitAmr() 1 0.0002595 0.000282 0.000414 0.00% Castro::do_old_sources() 140 0.0003032 0.0003715 0.0004138 0.00% MLPoisson::prepareForSolve() 360 0.0002986 0.0003395 0.0004032 0.00% MLMG::mgVcycle_down::6 483 0.0003389 0.0003643 0.000399 0.00% MLMG::mgVcycle_down::3 483 0.0003394 0.000365 0.0003846 0.00% MLMG::mgVcycle_down::5 483 0.0003096 0.0003342 0.0003634 0.00% Gravity::swapTimeLevels() 140 0.000203 0.0002786 0.0003319 0.00% MultiFab::Multiply() 40 0.0002361 0.0002804 0.0003202 0.00% AmrMesh-cluster 4 0 3.95e-05 0.000316 0.00% MLMG::computeMLResidual() 440 0.0002726 0.0002928 0.0003084 0.00% MLMG::mgVcycle_up::6 483 0.0002713 0.0002818 0.0002947 0.00% MLMG::mgVcycle_up::2 483 0.0002458 0.0002681 0.0002818 0.00% MLMG::mgVcycle_up::5 483 0.000249 0.0002613 0.0002736 0.00% MLMG::mgVcycle_up::3 483 0.0002159 0.0002451 0.0002701 0.00% MLMG::getGradSolution() 360 0.0001988 0.0002302 0.0002505 0.00% makeSFC 350 0.0001984 0.0002215 0.000244 0.00% MLMG::mgVcycle_up::4 483 0.0002191 0.0002335 0.0002433 0.00% Castro::post_timestep() 140 0.0001667 0.0002123 0.0002419 0.00% OwnerMask() 34 0.0001587 0.000184 0.0002245 0.00% AmrLevel::AmrLevel(dm) 35 0.0001911 0.0002061 0.0002214 0.00% TagBoxArray::mapPRD 34 0.0001844 0.0002 0.0002189 0.00% Castro::check_for_nan() 280 0.0001614 0.000177 0.0002043 0.00% Castro::avgDown(state_indx) 248 0.0001352 0.0001702 0.0001972 0.00% Castro::post_regrid() 66 0.0001231 0.0001633 0.000197 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001531 0.0001708 0.0001844 0.00% DistributionMapping::Distribute() 355 0.0001402 0.0001586 0.0001729 0.00% FabArray::RecvLayoutMask() 90 9.633e-05 0.0001112 0.0001237 0.00% Amr::FinalizeInit() 1 3.498e-06 1.849e-05 0.0001184 0.00% knapsack() 7 9.07e-05 0.0001037 0.0001137 0.00% Gravity::solve_for_delta_phi 60 8.889e-05 9.968e-05 0.0001105 0.00% Castro::enforce_consistent_e() 7 7.488e-05 8.31e-05 9.846e-05 0.00% Castro::create_source_corrector() 140 5.526e-05 7.565e-05 9.599e-05 0.00% BoxList::complementIn 574 6.351e-05 7.005e-05 7.953e-05 0.00% Amr::writeSmallPlotFile() 1 3.547e-05 6.344e-05 7.675e-05 0.00% Castro::errorEst() 34 6.603e-05 7.155e-05 7.463e-05 0.00% Castro::avgDown() 62 5.452e-05 6.424e-05 7.33e-05 0.00% Castro::computeNewDt() 28 4.452e-05 4.959e-05 5.72e-05 0.00% Castro::retry_advance_ctu() 140 4.215e-05 4.82e-05 5.322e-05 0.00% Amr::bldFineLevels() 1 2.986e-05 3.981e-05 4.498e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 3.093e-05 3.342e-05 3.544e-05 0.00% Amr::defBaseLevel() 1 1.85e-05 2.447e-05 3.097e-05 0.00% Gravity::set_mass_offset() 21 1.716e-05 2.31e-05 2.689e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.256e-05 2.407e-05 2.564e-05 0.00% BoxList::parallelComplementIn() 57 2.121e-05 2.276e-05 2.554e-05 0.00% Castro::apply_problem_tags() 34 1.388e-05 1.671e-05 2.254e-05 0.00% Amr::initSubcycle() 1 8.39e-06 9.031e-06 9.563e-06 0.00% Castro::post_init() 3 7.545e-06 8.263e-06 9.25e-06 0.00% Amr::InitializeInit() 1 2.102e-06 3.061e-06 6.948e-06 0.00% Castro::computeInitialDt() 2 3.554e-06 3.945e-06 4.226e-06 0.00% Amr::init() 1 1.77e-06 2.051e-06 2.435e-06 0.00% Amr::initialInit() 1 9.11e-07 1.235e-06 1.9e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.73 10.73 10.73 100.00% Amr::coarseTimeStep() 20 10.53 10.53 10.53 98.18% Amr::timeStep() 140 10.49 10.51 10.52 98.04% Castro::advance() 140 7.707 7.712 7.716 71.94% Castro::subcycle_advance_ctu() 140 7.475 7.512 7.565 70.54% Castro::do_advance_ctu() 140 7.475 7.511 7.565 70.53% Gravity::actual_solve_with_mlmg() 360 5.679 5.687 5.698 53.13% MLMG::solve() 360 5.494 5.502 5.514 51.41% MLMG::oneIter() 1843 5.091 5.122 5.141 47.93% MLMG::mgVcycle() 3385 4.69 4.744 4.783 44.59% Gravity::solve_phi_with_mlmg() 300 4.285 4.301 4.328 40.35% Gravity::solve_for_phi() 280 3.622 3.637 3.661 34.14% MLMG::mgVcycle_bottom 3385 3.207 3.227 3.247 30.28% Castro::construct_new_gravity() 140 2.901 2.905 2.914 27.17% MLMG::actualBottomSolve() 1843 2.826 2.835 2.851 26.58% MLCGSolver::bicgstab 1420 2.822 2.831 2.847 26.54% Castro::construct_ctu_hydro_source() 140 1.817 2.219 2.48 23.13% Castro::post_timestep() 140 1.994 2.012 2.018 18.82% Castro::reflux() 60 1.859 1.884 1.903 17.74% MLCellLinOp::applyBC() 165252 1.418 1.628 1.892 17.64% FabArray::FillBoundary() 157859 1.149 1.366 1.677 15.63% MLCellLinOp::smooth() 27488 1.522 1.586 1.639 15.28% Gravity::gravity_sync() 60 1.532 1.533 1.533 14.29% MLCGSolver::ParallelAllReduce 243542 0.8919 1.155 1.51 14.08% MLCellLinOp::apply() 108875 1.098 1.297 1.469 13.69% Gravity::solve_for_delta_phi 60 1.452 1.453 1.453 13.55% FabArray::ParallelCopy() 21259 0.6284 0.7774 1.094 10.20% MLPoisson::Fsmooth() 54976 0.7931 0.9256 1.037 9.67% Castro::construct_old_gravity() 140 0.8713 0.8808 0.8977 8.37% FabArray::ParallelCopy_finish() 21259 0.3449 0.5136 0.881 8.21% FillBoundary_finish() 157859 0.4547 0.6296 0.8725 8.13% Amr::regrid() 21 0.8259 0.8332 0.8434 7.86% FillBoundary_nowait() 157859 0.5221 0.6819 0.7953 7.41% FillPatchIterator::Initialize 889 0.5037 0.5774 0.6984 6.51% Gravity::multilevel_solve_for_new_phi() 20 0.6797 0.6817 0.6835 6.37% Gravity::actual_multilevel_solve() 20 0.678 0.6803 0.6825 6.36% Castro::post_regrid() 66 0.6579 0.6616 0.6642 6.19% FillPatchTwoLevels 756 0.4289 0.499 0.6309 5.88% MLMG::mgVcycle_down::0 1843 0.4626 0.4905 0.5116 4.77% FillPatchSingleLevel 1617 0.2552 0.3268 0.4773 4.45% Castro::clean_state() 1182 0.3472 0.4149 0.4602 4.29% MLMG::mgVcycle_up::0 1843 0.4346 0.449 0.4584 4.27% MLMG::miniCycle() 1542 0.3668 0.3932 0.4103 3.83% Castro::initialize_do_advance() 140 0.3249 0.3417 0.3658 3.41% Castro::expand_state() 200 0.267 0.2949 0.3464 3.23% MLPoisson::Fapply() 108875 0.2466 0.2969 0.3255 3.03% MLCellLinOp::correctionResidual() 9063 0.2665 0.2921 0.3096 2.89% CGSolver::sxay() 288086 0.2095 0.2643 0.3032 2.83% Castro::do_new_sources() 260 0.2059 0.2589 0.2864 2.67% FabArray::ParallelCopy_nowait() 21259 0.2046 0.2548 0.285 2.66% Castro::computeTemp() 1189 0.2047 0.2449 0.2716 2.53% MLMG::mgVcycle_down::1 1843 0.2197 0.229 0.2443 2.28% MultiFab::LinComb() 288336 0.1542 0.2062 0.24 2.24% FabArray::setVal() 27604 0.1389 0.1956 0.2384 2.22% MLCellLinOp::solutionResidual() 3154 0.2114 0.2259 0.2372 2.21% Castro::estTimeStep() 308 0.1057 0.1588 0.2221 2.07% MultiFab::Dot() 193316 0.1556 0.1927 0.2123 1.98% MLMG::computeResWithCrseSolFineCor() 771 0.152 0.176 0.1966 1.83% Castro::reset_internal_energy(MultiFab) 1189 0.1454 0.1745 0.1915 1.79% Castro::initialize_advance() 140 0.1108 0.1586 0.1909 1.78% Castro::reset_internal_energy(Fab) 5919 0.1434 0.1722 0.1886 1.76% Amr::init() 1 0.1789 0.1791 0.1791 1.67% MLMG::mgVcycle_up::1 1843 0.1643 0.173 0.1782 1.66% amrex::average_down 8093 0.1161 0.1431 0.1768 1.65% Amr::initialInit() 1 0.1622 0.1623 0.1623 1.51% Castro::normalize_species() 1182 0.1217 0.1442 0.1593 1.49% Amr::FinalizeInit() 1 0.1497 0.153 0.1554 1.45% Castro::construct_new_source() 1300 0.1072 0.1363 0.1506 1.40% MLMG::computeResidual() 1843 0.1195 0.1332 0.1415 1.32% MLMG::addInterpCorrection() 6101 0.07599 0.1103 0.1343 1.25% MLMG:computeResOfCorrection() 6101 0.1288 0.1316 0.1339 1.25% Castro::do_old_sources() 140 0.0794 0.11 0.1279 1.19% MLPoisson::normalize() 98078 0.09293 0.1139 0.1244 1.16% Castro::avgDown() 62 0.06427 0.0885 0.1231 1.15% Castro::avgDown(state_indx) 248 0.06421 0.08844 0.123 1.15% amrex::average_down_w_geom 248 0.06403 0.08827 0.1229 1.15% Gravity::get_new_grav_vector() 263 0.1068 0.109 0.1133 1.06% MLMG::ResNormInf() 2383 0.05915 0.08547 0.1133 1.06% MLPoisson::define() 360 0.07103 0.09239 0.1128 1.05% MLMG::mgVcycle_up::2 483 0.0277 0.05938 0.1059 0.99% MLMG::computeResWithCrseCorFineCor() 771 0.08429 0.09672 0.1008 0.94% MLCellLinOp::reflux() 951 0.06808 0.08168 0.09274 0.86% Amr::bldFineLevels() 1 0.07968 0.08262 0.08829 0.82% Castro::construct_new_gravity_source() 260 0.06266 0.07908 0.08739 0.81% MLMG::computeMLResidual() 440 0.05514 0.06651 0.0792 0.74% MLCellLinOp::setLevelBC() 450 0.02609 0.04754 0.07689 0.72% Castro::init(old) 28 0.05107 0.0622 0.07687 0.72% FillPatchInterp(Fab) 728 0.0716 0.07385 0.07622 0.71% MultiFab::Saxpy() 1180 0.04829 0.06622 0.07474 0.70% CellConservativeLinear::interp() 9059 0.06853 0.07044 0.07256 0.68% FabArrayBase::getCPC() 29741 0.05034 0.06362 0.07046 0.66% Gravity::GetCrsePhi() 250 0.02147 0.04106 0.06994 0.65% Gravity::get_old_grav_vector() 140 0.06507 0.06703 0.06989 0.65% MLMG::prepareForSolve() 360 0.06133 0.06642 0.06931 0.65% Castro::post_init() 3 0.06018 0.06603 0.06904 0.64% FluxRegister::Reflux() 960 0.0535 0.06198 0.06806 0.63% Castro::initData() 7 0.04852 0.05599 0.06543 0.61% MLCellLinOp::defineAuxData() 360 0.04068 0.05352 0.06466 0.60% MLCellLinOp::updateCorBC() 771 0.04601 0.05616 0.06415 0.60% MLCellLinOp::updateSolBC() 871 0.04523 0.05642 0.06298 0.59% MLMG::mgVcycle_up::3 483 0.003972 0.02734 0.06169 0.58% MLMG::interpCorrection_1 771 0.03789 0.04619 0.05793 0.54% Castro::Castro() 35 0.03014 0.0442 0.05593 0.52% Castro::finalize_advance() 140 0.03733 0.04173 0.04562 0.43% Castro::apply_source_to_state() 520 0.02557 0.03708 0.04287 0.40% FabArrayBase::CPC::define() 4099 0.0264 0.03567 0.04122 0.38% MLCellLinOp::defineBC() 360 0.02136 0.03014 0.03961 0.37% Castro::construct_old_source() 700 0.02238 0.0335 0.03827 0.36% Gravity::fill_multipole_BCs() 70 0.02943 0.03225 0.03759 0.35% MLMG::mgVcycle_down::6 483 0.005035 0.009511 0.03612 0.34% MultiFab::Xpay() 12217 0.02799 0.03286 0.03583 0.33% MLMG::mgVcycle_down::2 483 0.03073 0.03166 0.03266 0.30% Amr::writePlotFile() 2 0.03201 0.03212 0.03217 0.30% Castro::FluxRegCrseInit 140 0.03024 0.03162 0.03213 0.30% FabArrayBase::getFB() 157859 0.02601 0.02843 0.03146 0.29% Amr::grid_places() 23 0.02277 0.02701 0.03124 0.29% AmrMesh::MakeNewGrids() 23 0.02212 0.02663 0.03093 0.29% MLMG::mgVcycle_up::6 483 0.004314 0.007884 0.03048 0.28% Castro::initMFs() 35 0.01603 0.02382 0.02921 0.27% Castro::enforce_min_density() 1182 0.02018 0.02486 0.02831 0.26% BndryData::define() 540 0.01374 0.02002 0.02718 0.25% VisMF::Write(FabArray) 6 0.007829 0.01041 0.02622 0.24% Castro::check_for_nan() 280 0.01563 0.02015 0.02306 0.21% MultiFab::contains_nan() 280 0.01546 0.01997 0.02287 0.21% MLMG::mgVcycle_down::3 483 0.005628 0.0137 0.02286 0.21% MLMG::getGradSolution() 360 0.01348 0.01659 0.01945 0.18% MLCellLinOp::compGrad() 450 0.01328 0.01636 0.0192 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01711 0.01792 0.01919 0.18% Castro::computeNewDt() 28 0.01652 0.01755 0.01866 0.17% Gravity::update_max_rhs() 30 0.01414 0.01571 0.01853 0.17% Castro::errorEst() 34 0.009926 0.01374 0.01624 0.15% AmrLevel::AmrLevel(dm) 35 0.008555 0.01169 0.014 0.13% StateData::define() 140 0.008364 0.01148 0.0138 0.13% Castro::derive() 34 0.007594 0.0109 0.0134 0.12% MLPoisson::FFlux() 7882 0.006949 0.01061 0.01297 0.12% Amr::InitializeInit() 1 0.006902 0.009285 0.01258 0.12% Amr::defBaseLevel() 1 0.006899 0.009282 0.01258 0.12% Castro::construct_old_gravity_source() 140 0.005806 0.01027 0.01223 0.11% Castro::FluxRegFineAdd() 140 0.005046 0.008882 0.01213 0.11% Castro::swap_state_time_levels() 140 0.004646 0.008575 0.01181 0.11% FabArrayBase::TheFPinfo() 728 0.002637 0.006768 0.01174 0.11% MLMG::mgVcycle_down::4 483 0.005133 0.006319 0.01131 0.11% FPinfo::FPinfo() 7 0.001678 0.005807 0.01097 0.10% MLMG::MLResNormInf() 440 0.00773 0.009136 0.0106 0.10% MultiFab::max() 90 0.003534 0.005931 0.01028 0.10% Castro::buildMetrics() 35 0.004989 0.006559 0.008973 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003573 0.00686 0.008784 0.08% MLMG::mgVcycle_up::4 483 0.003944 0.004718 0.008774 0.08% MLLinOp::define() 360 0.007381 0.007914 0.008344 0.08% MLMG::mgVcycle_down::5 483 0.004956 0.005676 0.008096 0.08% MLLinOp::defineGrids() 360 0.007058 0.007555 0.008046 0.08% FabArray::mult() 1063 0.005263 0.006412 0.007473 0.07% StateDataPhysBCFunct::() 1617 0.003027 0.005246 0.007074 0.07% MLMG::MLRhsNormInf() 360 0.005133 0.006062 0.006612 0.06% MLMG::mgVcycle_up::5 483 0.004019 0.004523 0.006406 0.06% BoxList::parallelComplementIn() 57 0.0004515 0.004456 0.006399 0.06% Castro::computeInitialDt() 2 0.000711 0.003989 0.006395 0.06% BoxList::pci 22 0.0004183 0.004422 0.006365 0.06% DistributionMapping::LeastUsedCPUs() 12 9.958e-05 0.003046 0.006138 0.06% DistributionMapping::SFCProcessorMapDoIt() 5 9.696e-05 0.003027 0.00612 0.06% Gravity::applyMetricTerms() 90 0.004714 0.005326 0.00583 0.05% MLPoisson::prepareForSolve() 360 0.003068 0.004134 0.005561 0.05% StateData::FillBoundary(geom) 745 0.001556 0.003694 0.005511 0.05% MLCellLinOp::prepareForSolve() 360 0.002726 0.003794 0.005181 0.05% MultiFab::norm0(mask) 270 0.003251 0.004121 0.004989 0.05% Gravity::swapTimeLevels() 140 0.003316 0.004092 0.004646 0.04% FabArray::setDomainBndry() 1617 0.003655 0.004036 0.004595 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002534 0.003484 0.004154 0.04% MLLinOp::makeSubCommunicator() 70 0.001547 0.002128 0.00324 0.03% MultiFab::Subtract() 420 0.001779 0.002504 0.003162 0.03% TagBoxArray::mapPRD 34 0.001348 0.001888 0.002891 0.03% MultiFab::Copy() 450 0.001571 0.002113 0.002651 0.02% AmrMesh-cluster 4 0 0.0002925 0.00234 0.02% Castro::apply_tagging_restrictions() 34 0.001298 0.001576 0.001866 0.02% MLMG::buildFineMask() 360 0.001175 0.001337 0.001483 0.01% ClusterList::chop() 4 0 0.0001845 0.001476 0.01% AMRErrorTag::operator() 34 0.0009436 0.001175 0.001424 0.01% TagBoxArray::collate() 34 0.000685 0.001046 0.001422 0.01% Castro::build_fine_mask() 100 0.0008266 0.0009989 0.001156 0.01% Castro::finalize_do_advance() 140 0.0004146 0.0005923 0.0007876 0.01% FabArrayBase::FB::FB() 299 0.0001862 0.0004557 0.0007214 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0004833 0.0005406 0.0005821 0.01% ClusterList::intersect() 4 0 6.852e-05 0.0005482 0.01% Castro::enforce_speed_limit() 1182 0.0003406 0.000445 0.0005066 0.00% Amr::InitAmr() 1 0.0002681 0.0002911 0.0004235 0.00% makeSFC 350 0.0003282 0.0003698 0.0004001 0.00% MultiFab::Multiply() 40 0.0002361 0.0002804 0.0003202 0.00% OwnerMask() 34 0.0001587 0.000184 0.0002245 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001825 0.0001907 0.0001972 0.00% DistributionMapping::Distribute() 355 0.0001402 0.0001586 0.0001729 0.00% FabArray::RecvLayoutMask() 90 9.633e-05 0.0001112 0.0001237 0.00% knapsack() 7 9.07e-05 0.0001037 0.0001137 0.00% Castro::enforce_consistent_e() 7 7.488e-05 8.31e-05 9.846e-05 0.00% Castro::create_source_corrector() 140 5.526e-05 7.565e-05 9.599e-05 0.00% BoxList::complementIn 574 6.351e-05 7.005e-05 7.953e-05 0.00% Amr::writeSmallPlotFile() 1 3.547e-05 6.344e-05 7.675e-05 0.00% Castro::retry_advance_ctu() 140 4.215e-05 4.82e-05 5.322e-05 0.00% Gravity::set_mass_offset() 21 1.716e-05 2.31e-05 2.689e-05 0.00% Castro::apply_problem_tags() 34 1.388e-05 1.671e-05 2.254e-05 0.00% Amr::initSubcycle() 1 8.39e-06 9.031e-06 9.563e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.06-15-ge113ff7dcf29) finalized