MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.04-27-g034b43ac787f) initialized Starting run at 05:36:18 UTC on 2022-04-21. Successfully read inputs file ... Castro git describe: 22.04-13-ge738d8fe1 AMReX git describe: 22.04-27-g034b43ac7 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001333545 new finest: 1 grid_places() time: 0.007348531 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.008748678 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.01114228 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.013982737 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.475199016 [STEP 1] FAB kilobyte spread across MPI nodes: [18083 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000499212 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.507970349 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000716912 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.512110277 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.00051822 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.526221325 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000722204 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.49036194 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000485782 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.485994042 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000683331 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.49158306 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000487836 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.488159876 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000678118 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.491499625 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000489112 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.488135832 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.00070203 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.488988365 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000492635 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.489057857 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000691897 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.494498323 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.00049537 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.490265764 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000691792 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.495567698 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000487407 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.4885597 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000718148 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.492725991 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000503451 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.488282864 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000682175 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.493468012 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000483736 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.494197028 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.014002994 seconds Ending run at 05:36:28 UTC on 2022-04-21. Run time = 10.07346213 Run time without initialization = 9.888155009 Average number of zones advanced per microsecond: 0.891 Average number of zones advanced per microsecond per rank: 0.111 TinyProfiler total time across processes [min...avg...max]: 10.07 ... 10.07 ... 10.07 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.7440 2.0813 2.3171 23.00% MLCGSolver::ParallelAllReduce 243542 0.8808 1.076 1.364 13.54% MLPoisson::Fsmooth() 54976 0.8374 0.9348 1.031 10.24% MultiFab::min() 140 0.2516 0.4951 0.8346 8.29% FillBoundary_finish() 157859 0.4382 0.5792 0.7526 7.47% FillBoundary_nowait() 157859 0.4764 0.6342 0.7244 7.19% FabArray::ParallelCopy_finish() 21119 0.3 0.4138 0.634 6.29% MLCellLinOp::applyBC() 165252 0.2026 0.2792 0.3613 3.59% MLPoisson::Fapply() 108875 0.2437 0.2849 0.3094 3.07% MLCGSolver::bicgstab 1420 0.1935 0.2239 0.2419 2.40% MultiFab::LinComb() 288336 0.1569 0.1973 0.226 2.24% FabArray::setVal() 27604 0.1569 0.1829 0.211 2.09% FabArray::ParallelCopy_nowait() 21119 0.1548 0.1792 0.204 2.03% MultiFab::Dot() 193316 0.1538 0.1797 0.1962 1.95% Castro::reset_internal_energy() 1189 0.1427 0.167 0.1822 1.81% Castro::normalize_species() 1182 0.1325 0.147 0.1586 1.57% MLPoisson::normalize() 98078 0.09123 0.1102 0.1201 1.19% Castro::estTimeStep() 228 0.08329 0.09438 0.1168 1.16% MLMG::ResNormInf() 2383 0.05271 0.07563 0.1009 1.00% Castro::construct_new_gravity_source() 260 0.06697 0.07577 0.08137 0.81% Castro::computeTemp() 1189 0.05865 0.06761 0.07459 0.74% amrex::average_down 8093 0.05922 0.06607 0.07232 0.72% CellConservativeLinear::interp() 8794 0.06471 0.06622 0.06774 0.67% CGSolver::sxay() 288086 0.06213 0.06413 0.06565 0.65% MultiFab::Saxpy() 1180 0.05323 0.06125 0.06529 0.65% Castro::initData() 7 0.04356 0.05523 0.0634 0.63% FabArray::FillBoundary() 157859 0.05222 0.05374 0.05558 0.55% MLMG::addInterpCorrection() 6101 0.04497 0.04973 0.05473 0.54% MLCellLinOp::defineAuxData() 360 0.03625 0.04154 0.04956 0.49% FillPatchIterator::Initialize 829 0.04247 0.04545 0.04906 0.49% amrex::average_down_w_geom 248 0.03118 0.03714 0.04273 0.42% MLMG::prepareForSolve() 360 0.03121 0.03521 0.0405 0.40% MLCellLinOp::apply() 108875 0.03855 0.03921 0.04025 0.40% Amr::regrid() 21 0.0268 0.03123 0.03788 0.38% Castro::reflux() 60 0.02918 0.0338 0.03781 0.38% FabArrayBase::CPC::define() 4019 0.02754 0.03322 0.03756 0.37% FillPatchSingleLevel 1517 0.02059 0.03233 0.03656 0.36% Gravity::actual_solve_with_mlmg() 360 0.02214 0.02733 0.03492 0.35% MultiFab::Xpay() 12217 0.02738 0.03094 0.03308 0.33% FabArrayBase::getFB() 157859 0.02996 0.03094 0.03294 0.33% MLMG::interpCorrection_1 771 0.02114 0.02541 0.02913 0.29% Castro::initialize_do_advance() 140 0.02198 0.02608 0.02906 0.29% FluxRegister::Reflux() 960 0.01966 0.02539 0.02903 0.29% FabArrayBase::getCPC() 29601 0.02684 0.02795 0.02892 0.29% MLMG::solve() 360 0.009465 0.01974 0.02881 0.29% MLCellLinOp::reflux() 951 0.02221 0.02528 0.02872 0.29% Gravity::fill_multipole_BCs() 70 0.0263 0.02736 0.02846 0.28% FillPatchTwoLevels 716 0.02566 0.02655 0.02776 0.28% MLMG::oneIter() 1843 0.02006 0.02284 0.02471 0.25% Castro::expand_state() 140 0.01883 0.02173 0.02374 0.24% Castro::enforce_min_density() 1182 0.0188 0.02127 0.02344 0.23% VisMF::Write(FabArray) 6 0.00771 0.01002 0.02329 0.23% Castro::do_advance_ctu() 140 0.0185 0.02173 0.02325 0.23% MLCellLinOp::updateSolBC() 871 0.01136 0.01636 0.02308 0.23% Gravity::get_new_grav_vector() 263 0.01618 0.01896 0.02301 0.23% Castro::construct_new_source() 1300 0.02068 0.02125 0.02179 0.22% MLCellLinOp::updateCorBC() 771 0.01053 0.01508 0.02117 0.21% BndryData::define() 540 0.01203 0.01558 0.0211 0.21% Amr::writePlotFile() 2 0.0054 0.01873 0.02105 0.21% Castro::finalize_advance() 140 0.01485 0.01772 0.01974 0.20% MultiFab::contains_nan() 280 0.01375 0.01658 0.01869 0.19% MLCellLinOp::smooth() 27488 0.01649 0.01696 0.0173 0.17% Gravity::get_old_grav_vector() 140 0.00884 0.01057 0.01449 0.14% FPinfo::FPinfo() 7 0.001331 0.007621 0.01354 0.13% MLPoisson::FFlux() 7882 0.006813 0.01034 0.01268 0.13% MLCellLinOp::setLevelBC() 450 0.007922 0.009955 0.01265 0.13% Castro::initialize_advance() 140 0.009716 0.01089 0.01256 0.12% StateData::define() 140 0.009514 0.01068 0.01204 0.12% Castro::construct_old_source() 700 0.009885 0.01081 0.01168 0.12% MLCellLinOp::defineBC() 360 0.008145 0.009439 0.01146 0.11% MLCellLinOp::compGrad() 450 0.009256 0.009965 0.01096 0.11% Castro::FluxRegFineAdd() 140 0.006497 0.008335 0.01082 0.11% Castro::construct_old_gravity_source() 140 0.007069 0.009156 0.01063 0.11% Gravity::gravity_sync() 60 0.007813 0.009064 0.009571 0.10% Castro::swap_state_time_levels() 140 0.006233 0.007482 0.009465 0.09% FabArray::ParallelCopy() 21119 0.008556 0.008827 0.009078 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.00403 0.006785 0.00875 0.09% Gravity::solve_for_phi() 280 0.006127 0.006776 0.007436 0.07% MultiFab::max() 90 0.003457 0.004865 0.007316 0.07% Amr::timeStep() 140 0.002973 0.004012 0.00726 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0003511 0.003671 0.006608 0.07% Castro::init(old) 28 0.005307 0.006011 0.00644 0.06% BoxList::pci 22 0.0004075 0.003278 0.006255 0.06% MLLinOp::defineGrids() 360 0.004444 0.004901 0.005985 0.06% AmrMesh::MakeNewGrids() 23 0.002747 0.005067 0.005706 0.06% StateData::FillBoundary(geom) 685 0.00108 0.0031 0.005533 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003816 0.004382 0.005228 0.05% FabArray::mult() 1063 0.003807 0.004476 0.005226 0.05% MLCellLinOp::prepareForSolve() 360 0.002971 0.003735 0.005053 0.05% MLMG::MLRhsNormInf() 360 0.003906 0.00444 0.004886 0.05% Castro::construct_new_gravity() 140 0.003618 0.004182 0.004767 0.05% Amr::bldFineLevels() 1 0.003013 0.003568 0.004496 0.04% MultiFab::norm0(mask) 270 0.003039 0.003805 0.00446 0.04% Castro::construct_old_gravity() 140 0.0035 0.004062 0.004437 0.04% Gravity::applyMetricTerms() 90 0.003954 0.004179 0.004414 0.04% MLCellLinOp::correctionResidual() 9063 0.004003 0.004111 0.004341 0.04% MLMG::mgVcycle() 3385 0.003757 0.003947 0.00406 0.04% FabArray::setDomainBndry() 1517 0.003369 0.003608 0.003882 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.002673 0.003086 0.00362 0.04% MLMG::computeResWithCrseCorFineCor() 771 0.002296 0.002717 0.00339 0.03% FillPatchInterp(Fab) 688 0.002966 0.003178 0.003332 0.03% Gravity::update_max_rhs() 30 0.00292 0.003112 0.003283 0.03% MLMG::actualBottomSolve() 1843 0.002385 0.002682 0.003252 0.03% MultiFab::Subtract() 420 0.001903 0.002434 0.002899 0.03% Amr::defBaseLevel() 1 0.002019 0.002334 0.002871 0.03% Amr::coarseTimeStep() 20 0.0007634 0.001632 0.00287 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002029 0.002447 0.002786 0.03% Gravity::GetCrsePhi() 250 0.001814 0.002399 0.002767 0.03% MLMG::MLResNormInf() 440 0.00071 0.0014 0.002555 0.03% MultiFab::Copy() 450 0.001667 0.002005 0.002335 0.02% MLLinOp::makeSubCommunicator() 70 0.00148 0.001722 0.002311 0.02% MLMG:computeResOfCorrection() 6101 0.002108 0.002168 0.002246 0.02% MLMG::mgVcycle_down::0 1843 0.001896 0.001945 0.002035 0.02% MLMG::mgVcycle_bottom 3385 0.001847 0.001922 0.002023 0.02% Gravity::solve_phi_with_mlmg() 300 0.001104 0.001374 0.001924 0.02% MLCellLinOp::solutionResidual() 3154 0.001813 0.001856 0.001912 0.02% StateDataPhysBCFunct::() 1517 0.001298 0.001469 0.001646 0.02% MLMG::mgVcycle_down::1 1843 0.001487 0.001524 0.001574 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001226 0.001411 0.001553 0.02% Castro::clean_state() 1182 0.001381 0.001446 0.001515 0.02% ClusterList::chop() 4 0 0.0001843 0.001474 0.01% MLMG::mgVcycle_up::1 1843 0.001294 0.001356 0.001395 0.01% AMRErrorTag::operator() 34 0.0009405 0.001176 0.001344 0.01% MLMG::mgVcycle_up::0 1843 0.001112 0.001165 0.001245 0.01% TagBoxArray::collate() 34 0.0006336 0.0007921 0.001147 0.01% MLPoisson::define() 360 0.0007315 0.0008756 0.001109 0.01% FabArrayBase::TheFPinfo() 688 0.0008083 0.0009164 0.001105 0.01% MLMG::buildFineMask() 360 0.0008971 0.001008 0.001072 0.01% Gravity::actual_multilevel_solve() 20 0.0007229 0.0008432 0.0009022 0.01% MLMG::computeResidual() 1843 0.0008006 0.0008387 0.0008957 0.01% Castro::finalize_do_advance() 140 0.00049 0.0006117 0.0007638 0.01% main() 1 0.0006913 0.0007199 0.0007445 0.01% MLMG::miniCycle() 1542 0.0006078 0.0006286 0.0006735 0.01% FabArrayBase::FB::FB() 299 0.0001944 0.0004355 0.0006576 0.01% Castro::do_new_sources() 260 0.0006164 0.0006352 0.0006547 0.01% Castro::build_fine_mask() 40 0.0005127 0.0005625 0.0006053 0.01% Amr::grid_places() 23 0.0003157 0.0003672 0.0005908 0.01% Castro::derive() 34 0.0004819 0.0005352 0.0005831 0.01% Castro::apply_tagging_restrictions() 34 0.0004158 0.0005066 0.0005764 0.01% ClusterList::intersect() 4 0 6.858e-05 0.0005486 0.01% Castro::advance() 140 0.0003862 0.0004341 0.000496 0.00% Amr::InitAmr() 1 0.000279 0.0003585 0.0004876 0.00% Castro::apply_source_to_state() 520 0.0004267 0.0004481 0.0004778 0.00% Castro::subcycle_advance_ctu() 140 0.000361 0.0004054 0.0004688 0.00% MLLinOp::define() 360 0.0003844 0.0004066 0.0004508 0.00% MLMG::mgVcycle_down::2 483 0.0003612 0.0003897 0.0004301 0.00% MLMG::mgVcycle_down::4 483 0.0003717 0.0003939 0.0004141 0.00% MLMG::mgVcycle_down::3 483 0.0003372 0.0003596 0.0003923 0.00% MLPoisson::prepareForSolve() 360 0.0002578 0.0002894 0.0003781 0.00% Castro::enforce_speed_limit() 1182 0.00032 0.0003359 0.0003601 0.00% MLMG::computeMLResidual() 440 0.0002827 0.0003097 0.0003586 0.00% MLMG::mgVcycle_down::6 483 0.0003377 0.0003445 0.000355 0.00% MLMG::mgVcycle_down::5 483 0.0003182 0.0003292 0.0003496 0.00% Castro::do_old_sources() 140 0.0003168 0.0003373 0.0003478 0.00% MLMG::mgVcycle_up::6 483 0.0002951 0.0003031 0.0003224 0.00% AmrMesh-cluster 4 0 3.772e-05 0.0003018 0.00% MLMG::mgVcycle_up::2 483 0.0002624 0.0002792 0.0002935 0.00% Gravity::swapTimeLevels() 140 0.0002511 0.0002666 0.0002855 0.00% MLMG::mgVcycle_up::3 483 0.0002144 0.0002365 0.0002634 0.00% MLMG::mgVcycle_up::5 483 0.0002391 0.0002499 0.000261 0.00% MLMG::getGradSolution() 360 0.0002086 0.0002251 0.000242 0.00% makeSFC 350 0.0002008 0.0002287 0.0002415 0.00% MLMG::mgVcycle_up::4 483 0.0002214 0.0002317 0.0002389 0.00% OwnerMask() 34 0.0001683 0.0001914 0.0002119 0.00% AmrLevel::AmrLevel(dm) 35 0.0001851 0.0001959 0.0002115 0.00% Castro::check_for_nan() 280 0.0001766 0.0001914 0.0002113 0.00% TagBoxArray::mapPRD 34 0.0001901 0.0001984 0.0002082 0.00% Castro::avgDown(state_indx) 248 0.0001561 0.0001702 0.0001937 0.00% Castro::post_regrid() 66 0.0001525 0.0001696 0.0001935 0.00% DistributionMapping::Distribute() 355 0.0001567 0.0001725 0.0001877 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001449 0.0001579 0.0001759 0.00% Castro::post_timestep() 140 0.0001533 0.0001621 0.0001727 0.00% MultiFab::Multiply() 40 0.000153 0.0001641 0.000169 0.00% FabArray::RecvLayoutMask() 90 9.066e-05 0.0001069 0.0001177 0.00% Castro::enforce_consistent_e() 7 7.086e-05 9.819e-05 0.0001109 0.00% knapsack() 7 9.722e-05 0.0001041 0.0001099 0.00% Gravity::solve_for_delta_phi 60 8.953e-05 9.695e-05 0.0001068 0.00% Castro::create_source_corrector() 140 7.77e-05 8.952e-05 9.949e-05 0.00% Castro::retry_advance_ctu() 140 7.326e-05 8.393e-05 9.691e-05 0.00% Amr::FinalizeInit() 1 3.514e-06 1.529e-05 9.481e-05 0.00% Castro::errorEst() 34 6.558e-05 6.882e-05 7.672e-05 0.00% Amr::writeSmallPlotFile() 1 3.229e-05 5.26e-05 7.485e-05 0.00% Castro::computeNewDt() 28 4.072e-05 5.089e-05 7.401e-05 0.00% Castro::avgDown() 62 6.262e-05 6.831e-05 7.397e-05 0.00% BoxList::complementIn 574 6.799e-05 7.013e-05 7.148e-05 0.00% BoxList::parallelComplementIn() 57 2.54e-05 2.886e-05 4.129e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 3.002e-05 3.187e-05 3.373e-05 0.00% Gravity::set_mass_offset() 21 1.954e-05 2.208e-05 2.664e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2e-05 2.189e-05 2.418e-05 0.00% Castro::apply_problem_tags() 34 1.543e-05 1.677e-05 1.883e-05 0.00% Amr::initSubcycle() 1 8.719e-06 1.101e-05 1.547e-05 0.00% Castro::post_init() 3 7.395e-06 8.626e-06 1.264e-05 0.00% Amr::InitializeInit() 1 2.212e-06 4.111e-06 7.737e-06 0.00% Castro::computeInitialDt() 2 2.758e-06 3.423e-06 3.905e-06 0.00% Amr::init() 1 1.739e-06 1.887e-06 2.194e-06 0.00% Amr::initialInit() 1 1.184e-06 1.377e-06 1.583e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.07 10.07 10.07 100.00% Amr::coarseTimeStep() 20 9.873 9.873 9.873 98.01% Amr::timeStep() 140 9.841 9.857 9.86 97.88% Castro::advance() 140 7.244 7.248 7.251 71.98% Castro::subcycle_advance_ctu() 140 7.039 7.062 7.092 70.40% Castro::do_advance_ctu() 140 7.038 7.062 7.092 70.40% Gravity::actual_solve_with_mlmg() 360 5.509 5.526 5.565 55.24% MLMG::solve() 360 5.332 5.34 5.347 53.08% MLMG::oneIter() 1843 4.957 4.985 5.001 49.65% MLMG::mgVcycle() 3385 4.58 4.626 4.662 46.28% Gravity::solve_phi_with_mlmg() 300 4.161 4.187 4.21 41.80% Gravity::solve_for_phi() 280 3.525 3.549 3.572 35.46% MLMG::mgVcycle_bottom 3385 3.146 3.167 3.189 31.66% Castro::construct_new_gravity() 140 2.806 2.81 2.817 27.96% MLMG::actualBottomSolve() 1843 2.775 2.783 2.802 27.81% MLCGSolver::bicgstab 1420 2.771 2.779 2.797 27.77% Castro::construct_ctu_hydro_source() 140 1.744 2.081 2.317 23.00% Castro::post_timestep() 140 1.851 1.867 1.873 18.59% Castro::reflux() 60 1.736 1.75 1.763 17.51% MLCellLinOp::applyBC() 165252 1.335 1.529 1.744 17.31% MLCellLinOp::smooth() 27488 1.483 1.545 1.594 15.82% FabArray::FillBoundary() 157859 1.1 1.299 1.542 15.31% Gravity::gravity_sync() 60 1.487 1.487 1.488 14.77% MLCGSolver::ParallelAllReduce 243542 0.9789 1.169 1.443 14.32% Gravity::solve_for_delta_phi 60 1.415 1.415 1.415 14.05% MLCellLinOp::apply() 108875 1.078 1.238 1.36 13.50% MLPoisson::Fsmooth() 54976 0.8374 0.9348 1.031 10.24% Castro::construct_old_gravity() 140 0.8462 0.871 0.8902 8.84% FabArray::ParallelCopy() 21119 0.5451 0.6546 0.8439 8.38% MultiFab::min() 140 0.2516 0.4951 0.8346 8.29% Amr::regrid() 21 0.7879 0.7927 0.8014 7.96% FillBoundary_nowait() 157859 0.5075 0.6656 0.755 7.49% FillBoundary_finish() 157859 0.4382 0.5792 0.7526 7.47% Gravity::multilevel_solve_for_new_phi() 20 0.6524 0.654 0.6548 6.50% Gravity::actual_multilevel_solve() 20 0.6509 0.6526 0.6536 6.49% Castro::post_regrid() 66 0.6276 0.6312 0.6343 6.30% FabArray::ParallelCopy_finish() 21119 0.3 0.4138 0.634 6.29% FillPatchIterator::Initialize 829 0.4237 0.4675 0.5275 5.24% MLMG::mgVcycle_down::0 1843 0.4513 0.4708 0.489 4.85% FillPatchTwoLevels 716 0.3656 0.4077 0.4701 4.67% MLMG::mgVcycle_up::0 1843 0.4227 0.435 0.4428 4.40% Castro::clean_state() 1182 0.3535 0.4034 0.4349 4.32% MLMG::miniCycle() 1542 0.3606 0.3842 0.4018 3.99% Castro::initialize_do_advance() 140 0.2792 0.3041 0.3205 3.18% MLPoisson::Fapply() 108875 0.2437 0.2849 0.3094 3.07% FillPatchSingleLevel 1517 0.2035 0.2393 0.3061 3.04% CGSolver::sxay() 288086 0.2172 0.258 0.2877 2.86% MLCellLinOp::correctionResidual() 9063 0.2475 0.271 0.2855 2.83% Castro::do_new_sources() 260 0.2175 0.2439 0.2614 2.60% FabArray::ParallelCopy_nowait() 21119 0.2013 0.232 0.2561 2.54% Castro::computeTemp() 1189 0.2013 0.2346 0.2551 2.53% Castro::expand_state() 140 0.1888 0.2137 0.2435 2.42% MultiFab::LinComb() 288336 0.1569 0.1973 0.226 2.24% MLCellLinOp::solutionResidual() 3154 0.1975 0.2105 0.2245 2.23% MLMG::mgVcycle_down::1 1843 0.206 0.2126 0.2221 2.20% FabArray::setVal() 27604 0.1569 0.1829 0.211 2.09% MultiFab::Dot() 193316 0.1538 0.1797 0.1962 1.95% Amr::init() 1 0.1847 0.1848 0.1849 1.84% MLMG::computeResWithCrseSolFineCor() 771 0.1436 0.1664 0.1843 1.83% Castro::reset_internal_energy() 1189 0.1427 0.167 0.1822 1.81% Amr::initialInit() 1 0.1704 0.1706 0.1707 1.69% Castro::initialize_advance() 140 0.1228 0.1494 0.1707 1.69% MLMG::mgVcycle_up::1 1843 0.1599 0.1661 0.1705 1.69% Amr::FinalizeInit() 1 0.1539 0.1601 0.1638 1.63% Castro::normalize_species() 1182 0.1325 0.147 0.1586 1.57% amrex::average_down 8093 0.1031 0.1274 0.1567 1.56% Castro::construct_new_source() 1300 0.1159 0.1292 0.1368 1.36% MLMG::computeResidual() 1843 0.1123 0.1259 0.1333 1.32% MLMG::addInterpCorrection() 6101 0.07435 0.1065 0.1303 1.29% MLMG:computeResOfCorrection() 6101 0.1199 0.1226 0.1262 1.25% MLPoisson::normalize() 98078 0.09123 0.1102 0.1201 1.19% Castro::estTimeStep() 228 0.08329 0.09438 0.1168 1.16% Castro::do_old_sources() 140 0.08762 0.1028 0.1146 1.14% MLPoisson::define() 360 0.07839 0.09065 0.1081 1.07% MLMG::ResNormInf() 2383 0.05507 0.07819 0.103 1.02% MLMG::mgVcycle_up::2 483 0.02696 0.05831 0.103 1.02% MLCellLinOp::setLevelBC() 450 0.02481 0.05264 0.103 1.02% Gravity::get_new_grav_vector() 263 0.09432 0.09536 0.09742 0.97% Castro::avgDown() 62 0.05911 0.07506 0.09594 0.95% Castro::avgDown(state_indx) 248 0.05905 0.075 0.09588 0.95% amrex::average_down_w_geom 248 0.05889 0.07483 0.09568 0.95% MLMG::computeResWithCrseCorFineCor() 771 0.07871 0.08938 0.09273 0.92% Amr::bldFineLevels() 1 0.08636 0.08915 0.09141 0.91% MLCellLinOp::reflux() 951 0.0669 0.07935 0.08903 0.88% Gravity::GetCrsePhi() 250 0.02956 0.05426 0.08589 0.85% Castro::construct_new_gravity_source() 260 0.06697 0.07577 0.08137 0.81% FillPatchInterp(Fab) 688 0.06768 0.0694 0.07107 0.71% MLMG::computeMLResidual() 440 0.05245 0.06139 0.06931 0.69% Castro::initData() 7 0.04727 0.05966 0.06826 0.68% CellConservativeLinear::interp() 8794 0.06471 0.06622 0.06774 0.67% Castro::post_init() 3 0.06119 0.06358 0.06651 0.66% FabArrayBase::getCPC() 29601 0.05438 0.06117 0.0663 0.66% MultiFab::Saxpy() 1180 0.05323 0.06125 0.06529 0.65% MLMG::prepareForSolve() 360 0.05913 0.06219 0.06391 0.63% MLMG::mgVcycle_up::3 483 0.004178 0.02776 0.06233 0.62% MLCellLinOp::defineAuxData() 360 0.04535 0.0527 0.06202 0.62% Gravity::get_old_grav_vector() 140 0.05847 0.05968 0.06127 0.61% MLCellLinOp::updateSolBC() 871 0.04312 0.05332 0.06014 0.60% MLCellLinOp::updateCorBC() 771 0.04304 0.05185 0.05847 0.58% Castro::init(old) 28 0.04603 0.05308 0.05717 0.57% MLMG::interpCorrection_1 771 0.03603 0.04367 0.05525 0.55% FluxRegister::Reflux() 960 0.04675 0.05014 0.05304 0.53% Castro::finalize_advance() 140 0.03373 0.03587 0.03856 0.38% MLCellLinOp::defineBC() 360 0.02333 0.0295 0.03825 0.38% FabArrayBase::CPC::define() 4019 0.02754 0.03322 0.03756 0.37% Amr::grid_places() 23 0.02205 0.02845 0.0368 0.37% AmrMesh::MakeNewGrids() 23 0.02174 0.02808 0.03648 0.36% Castro::apply_source_to_state() 520 0.02924 0.03349 0.03595 0.36% Castro::computeNewDt() 28 0.01529 0.01958 0.03483 0.35% FabArrayBase::getFB() 157859 0.03055 0.03137 0.03349 0.33% MLMG::mgVcycle_down::6 483 0.005523 0.009268 0.03323 0.33% Castro::construct_old_source() 700 0.02567 0.03034 0.03319 0.33% MultiFab::Xpay() 12217 0.02738 0.03094 0.03308 0.33% MLMG::mgVcycle_down::2 483 0.03034 0.0314 0.0329 0.33% MLMG::mgVcycle_up::6 483 0.004674 0.008301 0.03237 0.32% Gravity::fill_multipole_BCs() 70 0.02704 0.02809 0.02914 0.29% Amr::writePlotFile() 2 0.02869 0.02876 0.02879 0.29% BndryData::define() 540 0.01485 0.01968 0.02633 0.26% Castro::enforce_min_density() 1182 0.0188 0.02127 0.02344 0.23% VisMF::Write(FabArray) 6 0.00771 0.01002 0.02329 0.23% MLMG::mgVcycle_down::3 483 0.006157 0.01387 0.02282 0.23% Castro::errorEst() 34 0.01095 0.01681 0.02242 0.22% Castro::derive() 34 0.009506 0.01505 0.02064 0.20% Castro::check_for_nan() 280 0.01395 0.01678 0.01891 0.19% MultiFab::contains_nan() 280 0.01375 0.01658 0.01869 0.19% Gravity::average_fine_ec_onto_crse_ec() 90 0.01614 0.01698 0.01822 0.18% MLMG::getGradSolution() 360 0.01391 0.01551 0.01783 0.18% MLCellLinOp::compGrad() 450 0.01368 0.01529 0.01759 0.17% Amr::InitializeInit() 1 0.006853 0.01052 0.01654 0.16% Amr::defBaseLevel() 1 0.00685 0.01052 0.01654 0.16% Gravity::update_max_rhs() 30 0.01182 0.01293 0.01491 0.15% FabArrayBase::TheFPinfo() 688 0.002333 0.008726 0.01454 0.14% FPinfo::FPinfo() 7 0.001525 0.00781 0.01372 0.14% MLPoisson::FFlux() 7882 0.006813 0.01034 0.01268 0.13% AmrLevel::AmrLevel(dm) 35 0.009705 0.01087 0.01223 0.12% StateData::define() 140 0.009514 0.01068 0.01204 0.12% MLMG::mgVcycle_down::4 483 0.005677 0.006575 0.01099 0.11% Castro::FluxRegFineAdd() 140 0.006497 0.008335 0.01082 0.11% Castro::computeInitialDt() 2 0.0008379 0.007 0.01076 0.11% Castro::construct_old_gravity_source() 140 0.007069 0.009156 0.01063 0.11% MLMG::MLResNormInf() 440 0.007488 0.008623 0.009946 0.10% Castro::swap_state_time_levels() 140 0.006233 0.007482 0.009465 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.00403 0.006785 0.00875 0.09% MLLinOp::define() 360 0.007071 0.007578 0.0086 0.09% MLMG::mgVcycle_up::4 483 0.004203 0.004811 0.008514 0.08% MLLinOp::defineGrids() 360 0.006687 0.007171 0.008176 0.08% MLMG::mgVcycle_down::5 483 0.005509 0.005897 0.007921 0.08% MultiFab::max() 90 0.003457 0.004865 0.007316 0.07% StateDataPhysBCFunct::() 1517 0.002378 0.004568 0.007035 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0003511 0.003671 0.006608 0.07% DistributionMapping::SFCProcessorMapDoIt() 5 0.0003276 0.003651 0.00659 0.07% BoxList::parallelComplementIn() 57 0.0004601 0.00332 0.006294 0.06% BoxList::pci 22 0.0004075 0.003278 0.006255 0.06% MLMG::mgVcycle_up::5 483 0.004352 0.004645 0.006244 0.06% MLMG::MLRhsNormInf() 360 0.005205 0.005679 0.006119 0.06% StateData::FillBoundary(geom) 685 0.00108 0.0031 0.005533 0.05% MLPoisson::prepareForSolve() 360 0.003349 0.004024 0.005333 0.05% FabArray::mult() 1063 0.003807 0.004476 0.005226 0.05% MLCellLinOp::prepareForSolve() 360 0.002971 0.003735 0.005053 0.05% MultiFab::norm0(mask) 270 0.003039 0.003805 0.00446 0.04% Gravity::applyMetricTerms() 90 0.003954 0.004179 0.004414 0.04% Gravity::swapTimeLevels() 140 0.003623 0.003879 0.004393 0.04% FabArray::setDomainBndry() 1517 0.003369 0.003608 0.003882 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002671 0.003219 0.003712 0.04% MultiFab::Subtract() 420 0.001903 0.002434 0.002899 0.03% TagBoxArray::mapPRD 34 0.001156 0.001677 0.002365 0.02% MultiFab::Copy() 450 0.001667 0.002005 0.002335 0.02% AmrMesh-cluster 4 0 0.0002906 0.002325 0.02% MLLinOp::makeSubCommunicator() 70 0.00148 0.001722 0.002311 0.02% ClusterList::chop() 4 0 0.0001843 0.001474 0.01% MLMG::buildFineMask() 360 0.001149 0.001316 0.001385 0.01% AMRErrorTag::operator() 34 0.0009405 0.001176 0.001344 0.01% TagBoxArray::collate() 34 0.0006336 0.0007921 0.001147 0.01% Castro::finalize_do_advance() 140 0.00049 0.0006117 0.0007638 0.01% FabArrayBase::FB::FB() 299 0.0001944 0.0004355 0.0006576 0.01% Castro::build_fine_mask() 40 0.0005127 0.0005625 0.0006053 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005048 0.000548 0.0005829 0.01% Castro::apply_tagging_restrictions() 34 0.0004158 0.0005066 0.0005764 0.01% ClusterList::intersect() 4 0 6.858e-05 0.0005486 0.01% Amr::InitAmr() 1 0.0002877 0.0003695 0.0005031 0.00% makeSFC 350 0.0003463 0.00039 0.000407 0.00% Castro::enforce_speed_limit() 1182 0.00032 0.0003359 0.0003601 0.00% OwnerMask() 34 0.0001683 0.0001914 0.0002119 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001741 0.0001886 0.0001974 0.00% DistributionMapping::Distribute() 355 0.0001567 0.0001725 0.0001877 0.00% MultiFab::Multiply() 40 0.000153 0.0001641 0.000169 0.00% FabArray::RecvLayoutMask() 90 9.066e-05 0.0001069 0.0001177 0.00% Castro::enforce_consistent_e() 7 7.086e-05 9.819e-05 0.0001109 0.00% knapsack() 7 9.722e-05 0.0001041 0.0001099 0.00% Castro::create_source_corrector() 140 7.77e-05 8.952e-05 9.949e-05 0.00% Castro::retry_advance_ctu() 140 7.326e-05 8.393e-05 9.691e-05 0.00% Amr::writeSmallPlotFile() 1 3.229e-05 5.26e-05 7.485e-05 0.00% BoxList::complementIn 574 6.799e-05 7.013e-05 7.148e-05 0.00% Gravity::set_mass_offset() 21 1.954e-05 2.208e-05 2.664e-05 0.00% Castro::apply_problem_tags() 34 1.543e-05 1.677e-05 1.883e-05 0.00% Amr::initSubcycle() 1 8.719e-06 1.101e-05 1.547e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-27-g034b43ac787f) finalized