MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.04-3-g8a2ec577e107) initialized Starting run at 05:36:05 UTC on 2022-04-04. Successfully read inputs file ... Castro git describe: 22.04 AMReX git describe: 22.04-3-g8a2ec577e Microphysics git describe: 22.04 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001371563 new finest: 1 grid_places() time: 0.004719131 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.013124295 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.005220901 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.014029866 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.476688216 [STEP 1] FAB kilobyte spread across MPI nodes: [18083 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000520461 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.526881296 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000741521 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.53505274 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000530236 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.54386574 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000745572 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.497530359 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000512432 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.484140231 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000712163 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.485675413 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000504292 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.493716268 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000705544 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.514188303 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000494878 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.490910956 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000691209 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.494271032 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000502296 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.49127436 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000720039 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.495114266 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000510926 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.491517127 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000713014 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.496208659 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000501366 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.498318094 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000704067 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.497528488 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000491882 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.489431499 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.00069613 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.495996761 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000498185 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.493253992 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.013968594 seconds Ending run at 05:36:15 UTC on 2022-04-04. Run time = 10.18713367 Run time without initialization = 10.00660908 Average number of zones advanced per microsecond: 0.881 Average number of zones advanced per microsecond per rank: 0.110 TinyProfiler total time across processes [min...avg...max]: 10.19 ... 10.19 ... 10.19 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.7780 2.1031 2.3305 22.88% MLCGSolver::ParallelAllReduce 243542 0.9102 1.099 1.336 13.12% MLPoisson::Fsmooth() 54976 0.8137 0.8859 0.9689 9.51% MultiFab::min() 140 0.2586 0.4921 0.8179 8.03% FillBoundary_nowait() 157859 0.5139 0.6755 0.7816 7.67% FillBoundary_finish() 157859 0.4562 0.5942 0.747 7.33% FabArray::ParallelCopy_finish() 21119 0.2872 0.4244 0.6395 6.28% MLCellLinOp::applyBC() 165252 0.2089 0.2848 0.3652 3.59% MLPoisson::Fapply() 108875 0.258 0.2888 0.3107 3.05% MLCGSolver::bicgstab 1420 0.2017 0.2328 0.2502 2.46% MultiFab::LinComb() 288336 0.1631 0.2023 0.2339 2.30% FabArray::setVal() 27604 0.1477 0.1755 0.2041 2.00% FabArray::ParallelCopy_nowait() 21119 0.1545 0.1861 0.2013 1.98% MultiFab::Dot() 193316 0.1585 0.184 0.199 1.95% Castro::reset_internal_energy() 1189 0.1466 0.1679 0.1798 1.77% Castro::normalize_species() 1182 0.1343 0.1489 0.1632 1.60% MLPoisson::normalize() 98078 0.09858 0.1117 0.1192 1.17% Castro::estTimeStep() 228 0.08252 0.09211 0.1092 1.07% MLMG::ResNormInf() 2383 0.05347 0.07481 0.09603 0.94% Castro::construct_new_gravity_source() 260 0.06791 0.07565 0.08309 0.82% amrex::average_down 8093 0.06935 0.07574 0.08158 0.80% Castro::computeTemp() 1189 0.06081 0.06846 0.07374 0.72% CGSolver::sxay() 288086 0.06318 0.06605 0.06911 0.68% CellConservativeLinear::interp() 8794 0.06542 0.06695 0.069 0.68% MultiFab::Saxpy() 1180 0.05414 0.0612 0.06562 0.64% FabArray::FillBoundary() 157859 0.05312 0.05555 0.06263 0.61% Castro::initData() 7 0.04991 0.05331 0.06003 0.59% MLMG::addInterpCorrection() 6101 0.04913 0.05292 0.05826 0.57% MLCellLinOp::defineAuxData() 360 0.03637 0.04212 0.05057 0.50% FillPatchIterator::Initialize 829 0.04363 0.0457 0.04797 0.47% MLCellLinOp::apply() 108875 0.04005 0.04213 0.04435 0.44% MLMG::prepareForSolve() 360 0.03047 0.03546 0.04207 0.41% amrex::average_down_w_geom 248 0.03118 0.03629 0.04136 0.41% FillPatchSingleLevel 1517 0.02677 0.03267 0.03845 0.38% Castro::reflux() 60 0.02664 0.03427 0.0384 0.38% Amr::regrid() 21 0.02816 0.03136 0.03816 0.37% FabArrayBase::CPC::define() 4019 0.02829 0.03318 0.03809 0.37% Gravity::actual_solve_with_mlmg() 360 0.02252 0.02772 0.03641 0.36% MultiFab::Xpay() 12217 0.02817 0.03145 0.03357 0.33% FabArrayBase::getFB() 157859 0.02959 0.03074 0.03209 0.31% FluxRegister::Reflux() 960 0.0214 0.02716 0.03116 0.31% MLCellLinOp::reflux() 951 0.02431 0.02714 0.03023 0.30% MLMG::interpCorrection_1 771 0.02223 0.02588 0.03016 0.30% FabArrayBase::getCPC() 29601 0.02744 0.02845 0.03008 0.30% Gravity::fill_multipole_BCs() 70 0.0275 0.02856 0.0299 0.29% MLMG::solve() 360 0.008886 0.01914 0.02808 0.28% Castro::initialize_do_advance() 140 0.02125 0.02586 0.02794 0.27% FillPatchTwoLevels 716 0.02551 0.0266 0.02738 0.27% Castro::do_advance_ctu() 140 0.01847 0.02158 0.02476 0.24% Gravity::get_new_grav_vector() 263 0.016 0.01954 0.02403 0.24% Castro::enforce_min_density() 1182 0.01894 0.02118 0.02379 0.23% MultiFab::contains_nan() 280 0.01662 0.01949 0.02366 0.23% VisMF::Write(FabArray) 6 0.007769 0.009969 0.02332 0.23% MLCellLinOp::updateSolBC() 871 0.01164 0.01651 0.02325 0.23% Castro::expand_state() 140 0.01965 0.02148 0.02281 0.22% MLMG::oneIter() 1843 0.01846 0.02075 0.02276 0.22% Castro::construct_new_source() 1300 0.02025 0.02122 0.02175 0.21% BndryData::define() 540 0.01226 0.01598 0.02169 0.21% MLCellLinOp::updateCorBC() 771 0.01086 0.0152 0.02161 0.21% Amr::writePlotFile() 2 0.005468 0.01891 0.02113 0.21% Castro::finalize_advance() 140 0.0153 0.01819 0.02022 0.20% MLCellLinOp::smooth() 27488 0.01646 0.01718 0.01797 0.18% Gravity::get_old_grav_vector() 140 0.008634 0.01066 0.01435 0.14% Castro::initialize_advance() 140 0.009006 0.01112 0.01389 0.14% MLCellLinOp::setLevelBC() 450 0.007892 0.01007 0.01302 0.13% Castro::FluxRegFineAdd() 140 0.005438 0.008445 0.01293 0.13% MLPoisson::FFlux() 7882 0.007119 0.01061 0.0128 0.13% StateData::define() 140 0.009909 0.01086 0.01238 0.12% Castro::construct_old_source() 700 0.01004 0.01097 0.01192 0.12% MLCellLinOp::defineBC() 360 0.007967 0.009641 0.01177 0.12% MLCellLinOp::compGrad() 450 0.008861 0.01005 0.01168 0.11% Castro::construct_old_gravity_source() 140 0.007232 0.0091 0.01015 0.10% Gravity::gravity_sync() 60 0.007512 0.009055 0.009871 0.10% Castro::swap_state_time_levels() 140 0.006182 0.007509 0.009512 0.09% FabArray::ParallelCopy() 21119 0.008632 0.008881 0.009388 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004012 0.006878 0.008801 0.09% Amr::timeStep() 140 0.002916 0.004102 0.007535 0.07% Gravity::solve_for_phi() 280 0.006112 0.006707 0.007355 0.07% MultiFab::max() 90 0.003631 0.005004 0.007353 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0001183 0.003402 0.007147 0.07% Castro::init(old) 28 0.00531 0.00613 0.006593 0.06% FPinfo::FPinfo() 7 0.001129 0.00451 0.006375 0.06% AmrMesh::MakeNewGrids() 23 0.003019 0.005299 0.005845 0.06% StateData::FillBoundary(geom) 685 0.001126 0.003154 0.005595 0.05% FabArray::mult() 1063 0.0039 0.004541 0.005273 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003876 0.00437 0.005222 0.05% MLCellLinOp::prepareForSolve() 360 0.002813 0.003725 0.005065 0.05% MLLinOp::defineGrids() 360 0.00392 0.004405 0.005063 0.05% MLMG::MLRhsNormInf() 360 0.003818 0.004428 0.004946 0.05% Amr::bldFineLevels() 1 0.003096 0.003619 0.004725 0.05% MultiFab::norm0(mask) 270 0.003027 0.003877 0.004594 0.05% Gravity::applyMetricTerms() 90 0.004012 0.00426 0.004507 0.04% Castro::construct_new_gravity() 140 0.003553 0.004064 0.004487 0.04% Castro::construct_old_gravity() 140 0.003422 0.004079 0.004454 0.04% MLCellLinOp::correctionResidual() 9063 0.003898 0.004059 0.004344 0.04% MLMG::mgVcycle() 3385 0.003913 0.004042 0.004225 0.04% FabArray::setDomainBndry() 1517 0.003295 0.00362 0.004176 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.002889 0.003257 0.003816 0.04% BoxList::pci 22 0.0003678 0.002578 0.003639 0.04% Gravity::update_max_rhs() 30 0.002791 0.003172 0.003514 0.03% MLMG::actualBottomSolve() 1843 0.002525 0.002755 0.003514 0.03% FillPatchInterp(Fab) 688 0.002883 0.003199 0.003429 0.03% MLMG::computeResWithCrseCorFineCor() 771 0.002437 0.002815 0.003395 0.03% Amr::coarseTimeStep() 20 0.0008292 0.001633 0.003311 0.03% Amr::defBaseLevel() 1 0.00201 0.002292 0.002943 0.03% MultiFab::Subtract() 420 0.001969 0.002476 0.002939 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002171 0.002554 0.002857 0.03% Gravity::GetCrsePhi() 250 0.001927 0.002415 0.002841 0.03% MLLinOp::makeSubCommunicator() 70 0.001417 0.001742 0.002437 0.02% MLMG::MLResNormInf() 440 0.0007428 0.001375 0.002399 0.02% MultiFab::Copy() 450 0.0017 0.001988 0.00239 0.02% MLMG:computeResOfCorrection() 6101 0.002 0.002124 0.002282 0.02% MLMG::mgVcycle_bottom 3385 0.001889 0.001939 0.002085 0.02% MLCellLinOp::solutionResidual() 3154 0.001817 0.001902 0.002037 0.02% MLMG::mgVcycle_down::0 1843 0.001805 0.001869 0.001923 0.02% Gravity::solve_phi_with_mlmg() 300 0.0009086 0.001246 0.00175 0.02% MLMG::mgVcycle_down::1 1843 0.001492 0.001547 0.001621 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001176 0.001424 0.001604 0.02% StateDataPhysBCFunct::() 1517 0.001354 0.001477 0.001591 0.02% TagBoxArray::collate() 34 0.0005862 0.0008386 0.00155 0.02% Castro::clean_state() 1182 0.00138 0.001438 0.001479 0.01% ClusterList::chop() 4 0 0.0001775 0.00142 0.01% MLMG::mgVcycle_up::1 1843 0.001313 0.001344 0.001382 0.01% AMRErrorTag::operator() 34 0.0009651 0.001232 0.001378 0.01% MLMG::mgVcycle_up::0 1843 0.001058 0.001102 0.001158 0.01% FabArrayBase::TheFPinfo() 688 0.0008598 0.0009493 0.00114 0.01% MLMG::buildFineMask() 360 0.0009432 0.0009896 0.001093 0.01% MLPoisson::define() 360 0.0007609 0.0008993 0.001028 0.01% Gravity::actual_multilevel_solve() 20 0.0007045 0.000847 0.0009102 0.01% MLMG::computeResidual() 1843 0.0007659 0.0008078 0.0008287 0.01% Castro::finalize_do_advance() 140 0.0004869 0.0006291 0.0008147 0.01% main() 1 0.000658 0.0007166 0.000784 0.01% FabArrayBase::FB::FB() 299 0.0001931 0.0004357 0.0006806 0.01% Castro::do_new_sources() 260 0.0005869 0.0006416 0.0006798 0.01% MLMG::miniCycle() 1542 0.0005871 0.0006102 0.0006364 0.01% Castro::build_fine_mask() 40 0.0005165 0.0005713 0.0006165 0.01% Amr::grid_places() 23 0.0003022 0.0003667 0.0005942 0.01% Castro::derive() 34 0.000466 0.0005365 0.0005842 0.01% Castro::apply_tagging_restrictions() 34 0.0004265 0.0005149 0.0005813 0.01% ClusterList::intersect() 4 0 6.767e-05 0.0005414 0.01% Castro::advance() 140 0.0003779 0.0004137 0.0004891 0.00% Amr::InitAmr() 1 0.0002776 0.0003417 0.0004773 0.00% Castro::apply_source_to_state() 520 0.0003989 0.0004355 0.0004602 0.00% MLLinOp::define() 360 0.0004131 0.0004387 0.00046 0.00% Castro::subcycle_advance_ctu() 140 0.0003688 0.000409 0.0004416 0.00% MLMG::mgVcycle_down::4 483 0.0003846 0.000402 0.0004276 0.00% MLMG::mgVcycle_down::2 483 0.000362 0.0003885 0.0004252 0.00% MLMG::mgVcycle_down::3 483 0.0003423 0.0003678 0.0004132 0.00% MLMG::mgVcycle_down::6 483 0.0003439 0.0003547 0.0003702 0.00% Castro::do_old_sources() 140 0.0003245 0.0003432 0.0003621 0.00% MLMG::mgVcycle_down::5 483 0.000323 0.0003361 0.000355 0.00% MLPoisson::prepareForSolve() 360 0.0002437 0.0002824 0.0003488 0.00% Castro::enforce_speed_limit() 1182 0.0003117 0.0003295 0.0003471 0.00% MLMG::mgVcycle_up::6 483 0.0002886 0.000304 0.0003257 0.00% MLMG::computeMLResidual() 440 0.0002781 0.0002973 0.0003213 0.00% AmrMesh-cluster 4 0 3.885e-05 0.0003108 0.00% Gravity::swapTimeLevels() 140 0.0002572 0.0002671 0.0002989 0.00% MLMG::mgVcycle_up::2 483 0.0002587 0.0002729 0.0002922 0.00% MLMG::mgVcycle_up::3 483 0.0002139 0.0002417 0.0002681 0.00% MLMG::mgVcycle_up::5 483 0.0002429 0.0002527 0.0002672 0.00% MLMG::mgVcycle_up::4 483 0.0002234 0.0002368 0.0002495 0.00% makeSFC 350 0.0002129 0.0002294 0.0002484 0.00% MLMG::getGradSolution() 360 0.0002101 0.0002224 0.0002392 0.00% TagBoxArray::mapPRD 34 0.0001949 0.0002068 0.0002214 0.00% OwnerMask() 34 0.0001747 0.0001901 0.0002181 0.00% AmrLevel::AmrLevel(dm) 35 0.0001776 0.00019 0.0002093 0.00% DistributionMapping::Distribute() 355 0.0001656 0.0001729 0.000189 0.00% Castro::post_regrid() 66 0.0001385 0.0001712 0.000185 0.00% Castro::check_for_nan() 280 0.0001579 0.0001712 0.0001828 0.00% Castro::post_timestep() 140 0.0001531 0.0001697 0.0001809 0.00% Castro::avgDown(state_indx) 248 0.0001578 0.0001707 0.0001792 0.00% MultiFab::Multiply() 40 0.0001546 0.0001659 0.0001749 0.00% MLLinOp::makeAgglomeratedDMap 70 0.000149 0.000158 0.0001693 0.00% Castro::enforce_consistent_e() 7 7.825e-05 9.436e-05 0.000142 0.00% FabArray::RecvLayoutMask() 90 8.795e-05 0.0001087 0.0001193 0.00% knapsack() 7 9.802e-05 0.0001045 0.0001166 0.00% Amr::FinalizeInit() 1 3.522e-06 1.772e-05 0.0001134 0.00% Castro::create_source_corrector() 140 8.052e-05 9.021e-05 0.0001055 0.00% Gravity::solve_for_delta_phi 60 8.564e-05 9.332e-05 0.0001034 0.00% Castro::retry_advance_ctu() 140 7.964e-05 8.907e-05 9.557e-05 0.00% BoxList::complementIn 574 6.763e-05 7.21e-05 7.941e-05 0.00% Castro::errorEst() 34 6.326e-05 6.881e-05 7.886e-05 0.00% Castro::avgDown() 62 6.36e-05 6.769e-05 7.462e-05 0.00% Amr::writeSmallPlotFile() 1 3.212e-05 4.953e-05 7.105e-05 0.00% Castro::computeNewDt() 28 3.97e-05 4.623e-05 5.522e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.79e-05 3.357e-05 4.331e-05 0.00% BoxList::parallelComplementIn() 57 2.513e-05 2.658e-05 2.939e-05 0.00% Gravity::set_mass_offset() 21 2.116e-05 2.339e-05 2.774e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.064e-05 2.288e-05 2.523e-05 0.00% Castro::apply_problem_tags() 34 1.626e-05 1.847e-05 2.423e-05 0.00% Amr::initSubcycle() 1 8.191e-06 1.036e-05 1.496e-05 0.00% Castro::post_init() 3 6.761e-06 8.509e-06 1.296e-05 0.00% Amr::InitializeInit() 1 2.048e-06 2.744e-06 5.41e-06 0.00% Castro::computeInitialDt() 2 2.653e-06 3.122e-06 3.727e-06 0.00% Amr::init() 1 1.307e-06 1.847e-06 2.427e-06 0.00% Amr::initialInit() 1 8.98e-07 1.133e-06 1.371e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.19 10.19 10.19 100.00% Amr::coarseTimeStep() 20 9.991 9.991 9.991 98.08% Amr::timeStep() 140 9.961 9.976 9.979 97.95% Castro::advance() 140 7.327 7.332 7.335 72.00% Castro::subcycle_advance_ctu() 140 7.118 7.146 7.174 70.43% Castro::do_advance_ctu() 140 7.118 7.145 7.174 70.42% Gravity::actual_solve_with_mlmg() 360 5.595 5.612 5.645 55.41% MLMG::solve() 360 5.417 5.425 5.434 53.34% MLMG::oneIter() 1843 5.043 5.067 5.083 49.89% MLMG::mgVcycle() 3385 4.665 4.703 4.734 46.47% Gravity::solve_phi_with_mlmg() 300 4.227 4.252 4.273 41.94% Gravity::solve_for_phi() 280 3.585 3.608 3.629 35.62% MLMG::mgVcycle_bottom 3385 3.229 3.246 3.268 32.08% MLMG::actualBottomSolve() 1843 2.87 2.877 2.897 28.44% MLCGSolver::bicgstab 1420 2.866 2.873 2.892 28.39% Castro::construct_new_gravity() 140 2.848 2.851 2.857 28.05% Castro::construct_ctu_hydro_source() 140 1.778 2.103 2.331 22.88% Castro::post_timestep() 140 1.878 1.893 1.899 18.64% Castro::reflux() 60 1.762 1.775 1.787 17.55% MLCellLinOp::applyBC() 165252 1.39 1.593 1.778 17.45% FabArray::FillBoundary() 157859 1.145 1.356 1.566 15.37% MLCellLinOp::smooth() 27488 1.458 1.51 1.555 15.26% Gravity::gravity_sync() 60 1.51 1.51 1.51 14.83% Gravity::solve_for_delta_phi 60 1.436 1.436 1.437 14.10% MLCGSolver::ParallelAllReduce 243542 1.01 1.193 1.418 13.92% MLCellLinOp::apply() 108875 1.177 1.294 1.405 13.79% MLPoisson::Fsmooth() 54976 0.8137 0.8859 0.9689 9.51% Castro::construct_old_gravity() 140 0.8673 0.8919 0.9074 8.91% FabArray::ParallelCopy() 21119 0.5508 0.6725 0.8504 8.35% MultiFab::min() 140 0.2586 0.4921 0.8179 8.03% FillBoundary_nowait() 157859 0.5456 0.7067 0.8118 7.97% Amr::regrid() 21 0.7903 0.8017 0.8116 7.97% FillBoundary_finish() 157859 0.4562 0.5942 0.747 7.33% Gravity::multilevel_solve_for_new_phi() 20 0.6588 0.6605 0.6615 6.49% Gravity::actual_multilevel_solve() 20 0.6572 0.6591 0.6603 6.48% Castro::post_regrid() 66 0.6345 0.6383 0.641 6.29% FabArray::ParallelCopy_finish() 21119 0.2872 0.4244 0.6395 6.28% FillPatchIterator::Initialize 829 0.4278 0.4733 0.5196 5.10% MLMG::mgVcycle_down::0 1843 0.4511 0.4662 0.4817 4.73% FillPatchTwoLevels 716 0.3695 0.4126 0.4616 4.53% Castro::clean_state() 1182 0.361 0.407 0.4369 4.29% MLMG::mgVcycle_up::0 1843 0.4172 0.4279 0.434 4.26% MLMG::miniCycle() 1542 0.35 0.3692 0.3831 3.76% Castro::initialize_do_advance() 140 0.283 0.3046 0.3215 3.16% MLPoisson::Fapply() 108875 0.258 0.2888 0.3107 3.05% FillPatchSingleLevel 1517 0.2044 0.2434 0.3014 2.96% CGSolver::sxay() 288086 0.2255 0.2648 0.2976 2.92% MLCellLinOp::correctionResidual() 9063 0.255 0.2773 0.2902 2.85% Castro::do_new_sources() 260 0.2181 0.2428 0.2651 2.60% FabArray::ParallelCopy_nowait() 21119 0.2022 0.2392 0.2567 2.52% Castro::computeTemp() 1189 0.2074 0.2364 0.2523 2.48% Castro::expand_state() 140 0.1908 0.214 0.2445 2.40% MultiFab::LinComb() 288336 0.1631 0.2023 0.2339 2.30% MLCellLinOp::solutionResidual() 3154 0.2008 0.2138 0.2297 2.26% MLMG::mgVcycle_down::1 1843 0.21 0.2153 0.2227 2.19% FabArray::setVal() 27604 0.1477 0.1755 0.2041 2.00% MultiFab::Dot() 193316 0.1585 0.184 0.199 1.95% MLMG::computeResWithCrseSolFineCor() 771 0.1504 0.17 0.183 1.80% Amr::init() 1 0.1799 0.18 0.1801 1.77% Castro::reset_internal_energy() 1189 0.1466 0.1679 0.1798 1.77% MLMG::mgVcycle_up::1 1843 0.1625 0.1682 0.1726 1.69% Castro::initialize_advance() 140 0.1229 0.1484 0.171 1.68% amrex::average_down 8093 0.1167 0.1401 0.1664 1.63% Amr::initialInit() 1 0.1655 0.1658 0.1659 1.63% Castro::normalize_species() 1182 0.1343 0.1489 0.1632 1.60% Amr::FinalizeInit() 1 0.1515 0.1557 0.1592 1.56% Castro::construct_new_source() 1300 0.1148 0.1269 0.1368 1.34% MLMG::addInterpCorrection() 6101 0.07795 0.1114 0.1363 1.34% MLMG::computeResidual() 1843 0.1148 0.1283 0.1346 1.32% MLMG:computeResOfCorrection() 6101 0.1232 0.125 0.1275 1.25% MLPoisson::normalize() 98078 0.09858 0.1117 0.1192 1.17% Castro::do_old_sources() 140 0.0892 0.1023 0.1128 1.11% MLPoisson::define() 360 0.07775 0.0916 0.1101 1.08% Castro::estTimeStep() 228 0.08252 0.09211 0.1092 1.07% MLMG::mgVcycle_up::2 483 0.02789 0.05993 0.1068 1.05% Gravity::get_new_grav_vector() 263 0.09618 0.09864 0.1015 1.00% MLMG::ResNormInf() 2383 0.05596 0.07742 0.09817 0.96% MLCellLinOp::setLevelBC() 450 0.02526 0.05111 0.09703 0.95% MLMG::computeResWithCrseCorFineCor() 771 0.08184 0.09204 0.09654 0.95% Castro::avgDown() 62 0.05979 0.07504 0.09537 0.94% Castro::avgDown(state_indx) 248 0.05973 0.07497 0.09529 0.94% amrex::average_down_w_geom 248 0.05957 0.0748 0.09511 0.93% Amr::bldFineLevels() 1 0.08484 0.08752 0.08989 0.88% MLCellLinOp::reflux() 951 0.07012 0.08169 0.08974 0.88% Gravity::GetCrsePhi() 250 0.02709 0.0537 0.08356 0.82% Castro::construct_new_gravity_source() 260 0.06791 0.07565 0.08309 0.82% MLMG::computeMLResidual() 440 0.05322 0.06284 0.07354 0.72% FillPatchInterp(Fab) 688 0.0683 0.07015 0.07224 0.71% CellConservativeLinear::interp() 8794 0.06542 0.06695 0.069 0.68% FabArrayBase::getCPC() 29601 0.05573 0.06162 0.0674 0.66% MLMG::prepareForSolve() 360 0.05945 0.06328 0.06628 0.65% MultiFab::Saxpy() 1180 0.05414 0.0612 0.06562 0.64% Castro::post_init() 3 0.0604 0.06284 0.06562 0.64% Castro::initData() 7 0.05394 0.05768 0.06542 0.64% MLMG::mgVcycle_up::3 483 0.004201 0.0286 0.06473 0.64% MLCellLinOp::defineAuxData() 360 0.04561 0.05344 0.06313 0.62% Gravity::get_old_grav_vector() 140 0.0589 0.06043 0.06196 0.61% MLCellLinOp::updateSolBC() 871 0.04513 0.05461 0.06144 0.60% MLCellLinOp::updateCorBC() 771 0.04533 0.05306 0.05934 0.58% Castro::init(old) 28 0.0474 0.05431 0.05853 0.57% FluxRegister::Reflux() 960 0.04692 0.05154 0.0562 0.55% MLMG::interpCorrection_1 771 0.03607 0.04401 0.05577 0.55% Castro::finalize_advance() 140 0.03348 0.03694 0.04224 0.41% MLCellLinOp::defineBC() 360 0.02336 0.03012 0.03916 0.38% FabArrayBase::CPC::define() 4019 0.02829 0.03318 0.03809 0.37% Castro::apply_source_to_state() 520 0.02942 0.03317 0.03568 0.35% MLMG::mgVcycle_down::2 483 0.03117 0.03246 0.03411 0.33% MLMG::mgVcycle_up::6 483 0.004609 0.00853 0.03378 0.33% MultiFab::Xpay() 12217 0.02817 0.03145 0.03357 0.33% Castro::computeNewDt() 28 0.01517 0.01923 0.03302 0.32% FabArrayBase::getFB() 157859 0.02997 0.03118 0.03265 0.32% Amr::grid_places() 23 0.01975 0.02859 0.03245 0.32% MLMG::mgVcycle_down::6 483 0.005428 0.009251 0.03239 0.32% AmrMesh::MakeNewGrids() 23 0.01941 0.02822 0.03211 0.32% Castro::construct_old_source() 700 0.02649 0.02969 0.03141 0.31% Gravity::fill_multipole_BCs() 70 0.02823 0.02929 0.03059 0.30% Amr::writePlotFile() 2 0.02879 0.02888 0.02892 0.28% BndryData::define() 540 0.01514 0.02014 0.02702 0.27% Castro::check_for_nan() 280 0.01681 0.01967 0.02384 0.23% Castro::enforce_min_density() 1182 0.01894 0.02118 0.02379 0.23% MultiFab::contains_nan() 280 0.01662 0.01949 0.02366 0.23% MLMG::mgVcycle_down::3 483 0.006225 0.01431 0.02339 0.23% VisMF::Write(FabArray) 6 0.007769 0.009969 0.02332 0.23% Castro::errorEst() 34 0.00824 0.01724 0.02253 0.22% Castro::derive() 34 0.006516 0.0154 0.02061 0.20% Gravity::average_fine_ec_onto_crse_ec() 90 0.01685 0.01763 0.01888 0.19% MLMG::getGradSolution() 360 0.01397 0.01583 0.0187 0.18% MLCellLinOp::compGrad() 450 0.01374 0.01561 0.01846 0.18% Gravity::update_max_rhs() 30 0.01218 0.01323 0.01489 0.15% Amr::InitializeInit() 1 0.006658 0.01002 0.01407 0.14% Amr::defBaseLevel() 1 0.006653 0.01001 0.01407 0.14% Castro::FluxRegFineAdd() 140 0.005438 0.008445 0.01293 0.13% MLPoisson::FFlux() 7882 0.007119 0.01061 0.0128 0.13% AmrLevel::AmrLevel(dm) 35 0.01009 0.01105 0.01256 0.12% StateData::define() 140 0.009909 0.01086 0.01238 0.12% MLMG::mgVcycle_down::4 483 0.005707 0.006715 0.01113 0.11% MLMG::MLResNormInf() 440 0.007543 0.008761 0.01059 0.10% Castro::construct_old_gravity_source() 140 0.007232 0.0091 0.01015 0.10% Castro::swap_state_time_levels() 140 0.006182 0.007509 0.009512 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004012 0.006878 0.008801 0.09% MLMG::mgVcycle_up::4 483 0.004212 0.004902 0.008611 0.08% Castro::computeInitialDt() 2 0.0008122 0.005029 0.008454 0.08% MLMG::mgVcycle_down::5 483 0.005532 0.006035 0.00812 0.08% MLLinOp::define() 360 0.006575 0.007135 0.007772 0.08% FabArrayBase::TheFPinfo() 688 0.002241 0.005659 0.007635 0.07% MultiFab::max() 90 0.003631 0.005004 0.007353 0.07% MLLinOp::defineGrids() 360 0.006162 0.006696 0.007321 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0001183 0.003402 0.007147 0.07% StateDataPhysBCFunct::() 1517 0.002589 0.004631 0.007141 0.07% DistributionMapping::SFCProcessorMapDoIt() 5 0.0001169 0.003375 0.007112 0.07% FPinfo::FPinfo() 7 0.001336 0.004709 0.006583 0.06% MLMG::mgVcycle_up::5 483 0.004316 0.004735 0.006411 0.06% MLMG::MLRhsNormInf() 360 0.005185 0.005692 0.006222 0.06% StateData::FillBoundary(geom) 685 0.001126 0.003154 0.005595 0.05% MLPoisson::prepareForSolve() 360 0.003162 0.004008 0.005354 0.05% FabArray::mult() 1063 0.0039 0.004541 0.005273 0.05% MLCellLinOp::prepareForSolve() 360 0.002813 0.003725 0.005065 0.05% MultiFab::norm0(mask) 270 0.003027 0.003877 0.004594 0.05% Gravity::applyMetricTerms() 90 0.004012 0.00426 0.004507 0.04% Gravity::swapTimeLevels() 140 0.00347 0.003818 0.004299 0.04% FabArray::setDomainBndry() 1517 0.003295 0.00362 0.004176 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002836 0.00334 0.003776 0.04% BoxList::parallelComplementIn() 57 0.000404 0.002617 0.003679 0.04% BoxList::pci 22 0.0003678 0.002578 0.003639 0.04% MultiFab::Subtract() 420 0.001969 0.002476 0.002939 0.03% TagBoxArray::mapPRD 34 0.001377 0.001823 0.002714 0.03% MLLinOp::makeSubCommunicator() 70 0.001417 0.001742 0.002437 0.02% MultiFab::Copy() 450 0.0017 0.001988 0.00239 0.02% AmrMesh-cluster 4 0 0.000284 0.002272 0.02% TagBoxArray::collate() 34 0.0005862 0.0008386 0.00155 0.02% MLMG::buildFineMask() 360 0.001202 0.001309 0.001432 0.01% ClusterList::chop() 4 0 0.0001775 0.00142 0.01% AMRErrorTag::operator() 34 0.0009651 0.001232 0.001378 0.01% Castro::finalize_do_advance() 140 0.0004869 0.0006291 0.0008147 0.01% FabArrayBase::FB::FB() 299 0.0001931 0.0004357 0.0006806 0.01% Castro::build_fine_mask() 40 0.0005165 0.0005713 0.0006165 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005272 0.0005491 0.0005874 0.01% Castro::apply_tagging_restrictions() 34 0.0004265 0.0005149 0.0005813 0.01% ClusterList::intersect() 4 0 6.767e-05 0.0005414 0.01% Amr::InitAmr() 1 0.0002858 0.0003521 0.0004922 0.00% makeSFC 350 0.0003708 0.0003911 0.000427 0.00% Castro::enforce_speed_limit() 1182 0.0003117 0.0003295 0.0003471 0.00% OwnerMask() 34 0.0001747 0.0001901 0.0002181 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001867 0.0001996 0.0002085 0.00% DistributionMapping::Distribute() 355 0.0001656 0.0001729 0.000189 0.00% MultiFab::Multiply() 40 0.0001546 0.0001659 0.0001749 0.00% Castro::enforce_consistent_e() 7 7.825e-05 9.436e-05 0.000142 0.00% FabArray::RecvLayoutMask() 90 8.795e-05 0.0001087 0.0001193 0.00% knapsack() 7 9.802e-05 0.0001045 0.0001166 0.00% Castro::create_source_corrector() 140 8.052e-05 9.021e-05 0.0001055 0.00% Castro::retry_advance_ctu() 140 7.964e-05 8.907e-05 9.557e-05 0.00% BoxList::complementIn 574 6.763e-05 7.21e-05 7.941e-05 0.00% Amr::writeSmallPlotFile() 1 3.212e-05 4.953e-05 7.105e-05 0.00% Gravity::set_mass_offset() 21 2.116e-05 2.339e-05 2.774e-05 0.00% Castro::apply_problem_tags() 34 1.626e-05 1.847e-05 2.423e-05 0.00% Amr::initSubcycle() 1 8.191e-06 1.036e-05 1.496e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-3-g8a2ec577e107) finalized