MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.04-6-g917afc0e1896) initialized Starting run at 05:36:08 UTC on 2022-04-05. Successfully read inputs file ... Castro git describe: 22.04-1-gabf8dcbcc AMReX git describe: 22.04-6-g917afc0e1 Microphysics git describe: 22.04-1-gef526ccd reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.00128249 new finest: 1 grid_places() time: 0.006857553 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.010953254 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.0161629 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.012317014 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.470764106 [STEP 1] FAB kilobyte spread across MPI nodes: [18083 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000506625 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.5346658 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000725286 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.549702474 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000534209 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.551933079 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000733676 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.521860871 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.00048429 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.49027038 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000685622 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.492532969 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000489856 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.490155705 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000676878 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.538668178 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000497444 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.511914644 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000692494 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.505131141 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000495572 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.506252047 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000683519 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.511792114 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.00048613 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.515667131 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000687404 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.521486603 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000493337 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.510196182 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000682309 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.49936689 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000488981 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.512985351 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000676396 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.524001504 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000483889 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.498106158 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.014099037 seconds Ending run at 05:36:19 UTC on 2022-04-05. Run time = 10.5028663 Run time without initialization = 10.27204979 Average number of zones advanced per microsecond: 0.858 Average number of zones advanced per microsecond per rank: 0.107 TinyProfiler total time across processes [min...avg...max]: 10.5 ... 10.5 ... 10.5 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.7946 2.1062 2.3866 22.72% MLCGSolver::ParallelAllReduce 243542 0.8871 1.139 1.429 13.61% MLPoisson::Fsmooth() 54976 0.8444 0.9631 1.075 10.24% FillBoundary_finish() 157859 0.5005 0.6648 0.8587 8.18% MultiFab::min() 140 0.2546 0.5434 0.8556 8.15% FillBoundary_nowait() 157859 0.4822 0.6613 0.8066 7.68% FabArray::ParallelCopy_finish() 21119 0.2802 0.4729 0.7419 7.06% MLCellLinOp::applyBC() 165252 0.2042 0.2916 0.3822 3.64% MLPoisson::Fapply() 108875 0.2547 0.2927 0.3207 3.05% MLCGSolver::bicgstab 1420 0.1971 0.2306 0.2527 2.41% MultiFab::LinComb() 288336 0.1607 0.2021 0.2385 2.27% FabArray::setVal() 27604 0.152 0.1808 0.211 2.01% MultiFab::Dot() 193316 0.1537 0.1849 0.2108 2.01% FabArray::ParallelCopy_nowait() 21119 0.1528 0.1833 0.2051 1.95% Castro::reset_internal_energy() 1189 0.1497 0.1702 0.1868 1.78% Castro::normalize_species() 1182 0.1324 0.1494 0.1671 1.59% MLPoisson::normalize() 98078 0.09648 0.1134 0.1252 1.19% Castro::estTimeStep() 228 0.08506 0.1002 0.1184 1.13% MLMG::ResNormInf() 2383 0.05563 0.0831 0.1106 1.05% Castro::construct_new_gravity_source() 260 0.06753 0.07551 0.08285 0.79% amrex::average_down 8093 0.06353 0.07316 0.08196 0.78% Castro::computeTemp() 1189 0.06174 0.06918 0.07892 0.75% Castro::initData() 7 0.0443 0.05696 0.07322 0.70% CGSolver::sxay() 288086 0.06373 0.06649 0.06919 0.66% CellConservativeLinear::interp() 8794 0.06424 0.06689 0.06861 0.65% MultiFab::Saxpy() 1180 0.05437 0.06138 0.06708 0.64% MLMG::addInterpCorrection() 6101 0.04517 0.05141 0.0578 0.55% FabArray::FillBoundary() 157859 0.05293 0.05549 0.05768 0.55% MLCellLinOp::defineAuxData() 360 0.03554 0.04181 0.05137 0.49% FillPatchIterator::Initialize 829 0.04326 0.04517 0.04677 0.45% amrex::average_down_w_geom 248 0.03198 0.03688 0.04329 0.41% MLMG::prepareForSolve() 360 0.03017 0.03552 0.04282 0.41% MLCellLinOp::apply() 108875 0.03782 0.04035 0.04266 0.41% Amr::regrid() 21 0.0264 0.03121 0.04023 0.38% FabArrayBase::CPC::define() 4019 0.02807 0.03365 0.03938 0.37% Castro::reflux() 60 0.02526 0.0334 0.03901 0.37% FillPatchSingleLevel 1517 0.025 0.03224 0.03672 0.35% Gravity::actual_solve_with_mlmg() 360 0.02151 0.02765 0.03649 0.35% MultiFab::Xpay() 12217 0.02805 0.03185 0.03527 0.34% FabArrayBase::getFB() 157859 0.03108 0.03227 0.03352 0.32% MLMG::solve() 360 0.009058 0.0206 0.03133 0.30% MLMG::interpCorrection_1 771 0.02216 0.02609 0.0312 0.30% Gravity::fill_multipole_BCs() 70 0.02832 0.02907 0.03112 0.30% FabArrayBase::getCPC() 29601 0.02651 0.02854 0.03035 0.29% MLCellLinOp::reflux() 951 0.0226 0.02576 0.03002 0.29% FluxRegister::Reflux() 960 0.02052 0.02538 0.0298 0.28% Castro::initialize_do_advance() 140 0.02192 0.02584 0.02757 0.26% FillPatchTwoLevels 716 0.02524 0.02657 0.0274 0.26% MLMG::oneIter() 1843 0.01953 0.02286 0.02556 0.24% Gravity::get_new_grav_vector() 263 0.01519 0.01935 0.02471 0.24% Castro::do_advance_ctu() 140 0.0177 0.02099 0.02469 0.24% Castro::enforce_min_density() 1182 0.01916 0.0213 0.02455 0.23% MLCellLinOp::updateSolBC() 871 0.0111 0.01662 0.02436 0.23% MultiFab::contains_nan() 280 0.01598 0.0194 0.02332 0.22% Castro::construct_new_source() 1300 0.02006 0.02129 0.02249 0.21% MLCellLinOp::updateCorBC() 771 0.01027 0.01531 0.02237 0.21% Castro::finalize_advance() 140 0.01443 0.01833 0.0221 0.21% Castro::expand_state() 140 0.01952 0.02092 0.02202 0.21% BndryData::define() 540 0.01191 0.01579 0.02183 0.21% VisMF::Write(FabArray) 6 0.007539 0.009694 0.02168 0.21% Amr::writePlotFile() 2 0.005366 0.01737 0.01953 0.19% MLCellLinOp::smooth() 27488 0.01642 0.01734 0.01818 0.17% FPinfo::FPinfo() 7 0.0009354 0.01068 0.01762 0.17% Gravity::get_old_grav_vector() 140 0.008208 0.0107 0.0149 0.14% StateData::define() 140 0.009262 0.0107 0.01389 0.13% Castro::initialize_advance() 140 0.008663 0.01068 0.01347 0.13% MLPoisson::FFlux() 7882 0.007004 0.01068 0.01304 0.12% MLCellLinOp::setLevelBC() 450 0.007774 0.01001 0.0128 0.12% MLCellLinOp::defineBC() 360 0.007757 0.009462 0.01186 0.11% Castro::construct_old_source() 700 0.009849 0.01089 0.01176 0.11% Castro::swap_state_time_levels() 140 0.006641 0.007885 0.01172 0.11% MLCellLinOp::compGrad() 450 0.008597 0.0101 0.01167 0.11% Castro::FluxRegFineAdd() 140 0.005356 0.007806 0.01127 0.11% Gravity::gravity_sync() 60 0.007898 0.009122 0.01011 0.10% FabArray::ParallelCopy() 21119 0.008567 0.009047 0.009552 0.09% Castro::construct_old_gravity_source() 140 0.007274 0.009044 0.009516 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003906 0.006899 0.00904 0.09% MultiFab::max() 90 0.003932 0.005887 0.009017 0.09% Gravity::solve_for_phi() 280 0.005938 0.006646 0.007488 0.07% Amr::timeStep() 140 0.002826 0.003909 0.007405 0.07% Castro::init(old) 28 0.005379 0.006052 0.006765 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0001435 0.002951 0.005792 0.06% BoxList::pci 22 0.000464 0.00328 0.005786 0.06% AmrMesh::MakeNewGrids() 23 0.002715 0.005028 0.005656 0.05% StateData::FillBoundary(geom) 685 0.001067 0.003135 0.005652 0.05% Gravity::applyMetricTerms() 90 0.00458 0.005134 0.005604 0.05% FabArray::mult() 1063 0.003823 0.004587 0.005498 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003699 0.004382 0.005373 0.05% MLLinOp::defineGrids() 360 0.004304 0.004744 0.005207 0.05% MLCellLinOp::prepareForSolve() 360 0.002697 0.003689 0.005055 0.05% MLMG::MLRhsNormInf() 360 0.004004 0.004488 0.005002 0.05% Amr::bldFineLevels() 1 0.003086 0.00364 0.004836 0.05% Castro::construct_new_gravity() 140 0.003573 0.004195 0.004763 0.05% MultiFab::norm0(mask) 270 0.003 0.003934 0.004704 0.04% MLCellLinOp::correctionResidual() 9063 0.003981 0.004279 0.004564 0.04% Castro::construct_old_gravity() 140 0.003371 0.004077 0.004561 0.04% MLMG::mgVcycle() 3385 0.003754 0.004211 0.004533 0.04% FabArray::setDomainBndry() 1517 0.003225 0.003544 0.003998 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.002724 0.003202 0.003912 0.04% MLMG::actualBottomSolve() 1843 0.00246 0.002852 0.003774 0.04% Gravity::update_max_rhs() 30 0.002694 0.003147 0.003519 0.03% MLMG::computeResWithCrseCorFineCor() 771 0.002302 0.002783 0.003495 0.03% FillPatchInterp(Fab) 688 0.002905 0.003212 0.003477 0.03% Amr::coarseTimeStep() 20 0.0008779 0.001722 0.003123 0.03% MultiFab::Subtract() 420 0.002046 0.002492 0.003106 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002067 0.002552 0.002985 0.03% Amr::defBaseLevel() 1 0.002012 0.002305 0.002964 0.03% Gravity::GetCrsePhi() 250 0.00203 0.002408 0.00279 0.03% MLMG::MLResNormInf() 440 0.0006375 0.001531 0.002559 0.02% MultiFab::Copy() 450 0.001619 0.002001 0.002421 0.02% MLLinOp::makeSubCommunicator() 70 0.001359 0.001727 0.002341 0.02% MLMG:computeResOfCorrection() 6101 0.002057 0.002182 0.002299 0.02% MLMG::mgVcycle_bottom 3385 0.001858 0.001978 0.002127 0.02% MLMG::mgVcycle_down::0 1843 0.001852 0.001976 0.002099 0.02% MLCellLinOp::solutionResidual() 3154 0.001789 0.00186 0.001929 0.02% MLMG::mgVcycle_down::1 1843 0.001476 0.001552 0.00162 0.02% StateDataPhysBCFunct::() 1517 0.001331 0.001479 0.001587 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001124 0.001402 0.001586 0.02% Gravity::solve_phi_with_mlmg() 300 0.0009982 0.001204 0.001541 0.01% Castro::clean_state() 1182 0.001406 0.001467 0.001516 0.01% ClusterList::chop() 4 0 0.0001821 0.001457 0.01% MLMG::mgVcycle_up::1 1843 0.001245 0.001325 0.001434 0.01% AMRErrorTag::operator() 34 0.001007 0.001228 0.001408 0.01% TagBoxArray::collate() 34 0.0006717 0.0009209 0.001324 0.01% MLMG::mgVcycle_up::0 1843 0.001098 0.001166 0.001198 0.01% MLPoisson::define() 360 0.0007501 0.0008907 0.001102 0.01% MLMG::buildFineMask() 360 0.0009444 0.001007 0.001084 0.01% FabArrayBase::TheFPinfo() 688 0.0008376 0.0009012 0.0009938 0.01% Gravity::actual_multilevel_solve() 20 0.000663 0.0008248 0.000929 0.01% MLMG::computeResidual() 1843 0.0007576 0.00082 0.0008726 0.01% main() 1 0.0006662 0.0007153 0.0007962 0.01% Castro::finalize_do_advance() 140 0.0004882 0.0006218 0.0007926 0.01% Castro::do_new_sources() 260 0.0005593 0.0006323 0.0006858 0.01% MLMG::miniCycle() 1542 0.0006007 0.0006324 0.0006765 0.01% FabArrayBase::FB::FB() 299 0.0002046 0.0004485 0.0006664 0.01% Amr::grid_places() 23 0.000305 0.0003672 0.0006104 0.01% Castro::build_fine_mask() 40 0.0005298 0.0005673 0.0006011 0.01% Castro::derive() 34 0.000461 0.0005412 0.0005957 0.01% Castro::apply_tagging_restrictions() 34 0.0004394 0.0005173 0.000587 0.01% Castro::apply_source_to_state() 520 0.0004327 0.0004706 0.0005774 0.01% ClusterList::intersect() 4 0 6.974e-05 0.0005579 0.01% Amr::InitAmr() 1 0.0002661 0.0003435 0.0004693 0.00% Castro::subcycle_advance_ctu() 140 0.0003888 0.0004329 0.000469 0.00% MLLinOp::define() 360 0.0003851 0.0004183 0.0004583 0.00% MLMG::mgVcycle_down::4 483 0.0003782 0.0004085 0.0004467 0.00% Castro::advance() 140 0.0003603 0.0004003 0.0004284 0.00% MLMG::mgVcycle_down::2 483 0.0003794 0.000404 0.0004224 0.00% MLMG::mgVcycle_down::3 483 0.0003442 0.0003709 0.0004067 0.00% Castro::enforce_speed_limit() 1182 0.0003297 0.0003542 0.0003789 0.00% MLMG::mgVcycle_down::6 483 0.000341 0.0003583 0.0003783 0.00% MLMG::mgVcycle_down::5 483 0.0003189 0.0003412 0.0003647 0.00% Castro::do_old_sources() 140 0.0003158 0.000338 0.0003607 0.00% MLMG::computeMLResidual() 440 0.0002696 0.0003068 0.0003483 0.00% MLMG::mgVcycle_up::6 483 0.0002711 0.0002946 0.0003255 0.00% MLPoisson::prepareForSolve() 360 0.0002515 0.0002812 0.0003145 0.00% AmrMesh-cluster 4 0 3.836e-05 0.0003069 0.00% Gravity::swapTimeLevels() 140 0.0002462 0.0002659 0.000299 0.00% MLMG::mgVcycle_up::2 483 0.0002612 0.0002706 0.0002838 0.00% MLMG::mgVcycle_up::5 483 0.0002413 0.0002566 0.0002737 0.00% MLMG::mgVcycle_up::3 483 0.0002163 0.0002381 0.0002663 0.00% MLMG::getGradSolution() 360 0.0002281 0.0002404 0.0002583 0.00% MLMG::mgVcycle_up::4 483 0.0002249 0.0002381 0.0002562 0.00% makeSFC 350 0.0002142 0.0002263 0.0002496 0.00% OwnerMask() 34 0.0001561 0.0001884 0.0002192 0.00% TagBoxArray::mapPRD 34 0.0001753 0.000198 0.0002087 0.00% AmrLevel::AmrLevel(dm) 35 0.0001786 0.0001923 0.0002076 0.00% Castro::post_regrid() 66 0.0001471 0.00017 0.0002002 0.00% Castro::check_for_nan() 280 0.0001584 0.0001702 0.0001857 0.00% Castro::avgDown(state_indx) 248 0.0001625 0.000172 0.0001812 0.00% DistributionMapping::Distribute() 355 0.0001615 0.0001724 0.0001806 0.00% MultiFab::Multiply() 40 0.0001578 0.0001649 0.0001717 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001447 0.0001511 0.0001695 0.00% Castro::enforce_consistent_e() 7 8.052e-05 0.0001126 0.0001694 0.00% Castro::post_timestep() 140 0.0001479 0.000157 0.0001683 0.00% FabArray::RecvLayoutMask() 90 9.179e-05 0.0001069 0.0001191 0.00% knapsack() 7 9.857e-05 0.0001038 0.0001107 0.00% Gravity::solve_for_delta_phi 60 8.796e-05 9.706e-05 0.0001065 0.00% Castro::retry_advance_ctu() 140 7.449e-05 9.029e-05 0.0001045 0.00% Castro::create_source_corrector() 140 8.354e-05 9.005e-05 9.684e-05 0.00% BoxList::complementIn 574 6.92e-05 7.621e-05 8.42e-05 0.00% Castro::errorEst() 34 6.486e-05 7.166e-05 8.072e-05 0.00% Amr::writeSmallPlotFile() 1 3.213e-05 4.68e-05 7.454e-05 0.00% Castro::avgDown() 62 5.947e-05 6.511e-05 7.259e-05 0.00% Amr::FinalizeInit() 1 3.594e-06 1.205e-05 6.852e-05 0.00% Castro::computeNewDt() 28 4.123e-05 4.352e-05 4.809e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.898e-05 3.272e-05 4.1e-05 0.00% BoxList::parallelComplementIn() 57 2.659e-05 2.804e-05 2.937e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.03e-05 2.349e-05 2.562e-05 0.00% Gravity::set_mass_offset() 21 2.186e-05 2.324e-05 2.474e-05 0.00% Castro::apply_problem_tags() 34 1.522e-05 1.727e-05 1.885e-05 0.00% Castro::post_init() 3 6.345e-06 9.123e-06 1.601e-05 0.00% Amr::initSubcycle() 1 8.566e-06 1.091e-05 1.555e-05 0.00% Amr::InitializeInit() 1 2.066e-06 2.916e-06 6.47e-06 0.00% Castro::computeInitialDt() 2 2.605e-06 3.068e-06 3.715e-06 0.00% Amr::init() 1 1.49e-06 1.684e-06 1.979e-06 0.00% Amr::initialInit() 1 1.044e-06 1.279e-06 1.468e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.5 10.5 10.5 100.00% Amr::coarseTimeStep() 20 10.26 10.26 10.26 97.66% Amr::timeStep() 140 10.22 10.24 10.24 97.53% Castro::advance() 140 7.517 7.522 7.526 71.65% Castro::subcycle_advance_ctu() 140 7.303 7.335 7.361 70.09% Castro::do_advance_ctu() 140 7.303 7.334 7.361 70.08% Gravity::actual_solve_with_mlmg() 360 5.806 5.824 5.862 55.81% MLMG::solve() 360 5.624 5.634 5.642 53.72% MLMG::oneIter() 1843 5.224 5.256 5.276 50.23% MLMG::mgVcycle() 3385 4.81 4.868 4.911 46.76% Gravity::solve_phi_with_mlmg() 300 4.387 4.418 4.439 42.26% Gravity::solve_for_phi() 280 3.695 3.724 3.744 35.64% MLMG::mgVcycle_bottom 3385 3.299 3.325 3.35 31.90% Castro::construct_new_gravity() 140 2.946 2.95 2.957 28.15% MLMG::actualBottomSolve() 1843 2.908 2.916 2.936 27.95% MLCGSolver::bicgstab 1420 2.904 2.912 2.931 27.90% Castro::construct_ctu_hydro_source() 140 1.795 2.106 2.387 22.72% Castro::post_timestep() 140 1.934 1.949 1.957 18.63% Castro::reflux() 60 1.812 1.827 1.843 17.54% MLCellLinOp::applyBC() 165252 1.428 1.654 1.838 17.50% MLCellLinOp::smooth() 27488 1.562 1.635 1.692 16.11% FabArray::FillBoundary() 157859 1.175 1.414 1.616 15.39% Gravity::gravity_sync() 60 1.561 1.562 1.562 14.87% MLCGSolver::ParallelAllReduce 243542 0.9887 1.233 1.509 14.36% Gravity::solve_for_delta_phi 60 1.486 1.487 1.487 14.16% MLCellLinOp::apply() 108875 1.164 1.308 1.462 13.92% MLPoisson::Fsmooth() 54976 0.8444 0.9631 1.075 10.24% FabArray::ParallelCopy() 21119 0.5484 0.7189 0.9501 9.05% Castro::construct_old_gravity() 140 0.8818 0.9106 0.9286 8.84% FillBoundary_finish() 157859 0.5005 0.6648 0.8587 8.18% MultiFab::min() 140 0.2546 0.5434 0.8556 8.15% FillBoundary_nowait() 157859 0.5135 0.694 0.84 8.00% Amr::regrid() 21 0.8195 0.8272 0.8382 7.98% FabArray::ParallelCopy_finish() 21119 0.2802 0.4729 0.7419 7.06% Gravity::multilevel_solve_for_new_phi() 20 0.7091 0.7111 0.7122 6.78% Gravity::actual_multilevel_solve() 20 0.7075 0.7097 0.7111 6.77% Castro::post_regrid() 66 0.6544 0.6569 0.6595 6.28% FillPatchIterator::Initialize 829 0.4261 0.4907 0.5445 5.18% MLMG::mgVcycle_down::0 1843 0.4703 0.4947 0.5158 4.91% FillPatchTwoLevels 716 0.3671 0.4301 0.4871 4.64% MLMG::mgVcycle_up::0 1843 0.4451 0.4598 0.468 4.46% Castro::clean_state() 1182 0.3666 0.4106 0.4572 4.35% MLMG::miniCycle() 1542 0.3778 0.4092 0.4302 4.10% Castro::initialize_do_advance() 140 0.2943 0.3087 0.3257 3.10% MLPoisson::Fapply() 108875 0.2547 0.2927 0.3207 3.05% FillPatchSingleLevel 1517 0.198 0.2502 0.3118 2.97% MLCellLinOp::correctionResidual() 9063 0.2642 0.2893 0.3075 2.93% CGSolver::sxay() 288086 0.2215 0.2651 0.3028 2.88% Castro::do_new_sources() 260 0.2187 0.2456 0.2708 2.58% Castro::computeTemp() 1189 0.2114 0.2394 0.2657 2.53% FabArray::ParallelCopy_nowait() 21119 0.1996 0.237 0.2623 2.50% Castro::expand_state() 140 0.2006 0.2179 0.2472 2.35% MLCellLinOp::solutionResidual() 3154 0.2094 0.2271 0.2464 2.35% MLMG::mgVcycle_down::1 1843 0.2208 0.2281 0.2407 2.29% MultiFab::LinComb() 288336 0.1607 0.2021 0.2385 2.27% Amr::init() 1 0.2302 0.2303 0.2304 2.19% Amr::initialInit() 1 0.2177 0.2179 0.2179 2.07% Amr::FinalizeInit() 1 0.2016 0.2078 0.2113 2.01% FabArray::setVal() 27604 0.152 0.1808 0.211 2.01% MultiFab::Dot() 193316 0.1537 0.1849 0.2108 2.01% MLMG::computeResWithCrseSolFineCor() 771 0.1553 0.1806 0.2039 1.94% Castro::reset_internal_energy() 1189 0.1497 0.1702 0.1868 1.78% MLMG::mgVcycle_up::1 1843 0.1677 0.1758 0.1804 1.72% Castro::initialize_advance() 140 0.1261 0.1496 0.1759 1.68% amrex::average_down 8093 0.1168 0.1432 0.174 1.66% Castro::normalize_species() 1182 0.1324 0.1494 0.1671 1.59% MLMG::computeResidual() 1843 0.1186 0.1353 0.1434 1.36% Castro::construct_new_source() 1300 0.117 0.1296 0.1406 1.34% MLMG::addInterpCorrection() 6101 0.078 0.112 0.1371 1.31% MLMG:computeResOfCorrection() 6101 0.128 0.1303 0.1337 1.27% MLPoisson::normalize() 98078 0.09648 0.1134 0.1252 1.19% Castro::do_old_sources() 140 0.09182 0.1039 0.1186 1.13% Castro::estTimeStep() 228 0.08506 0.1002 0.1184 1.13% Castro::avgDown() 62 0.06031 0.08747 0.1141 1.09% Castro::avgDown(state_indx) 248 0.06025 0.0874 0.1141 1.09% amrex::average_down_w_geom 248 0.06008 0.08723 0.1139 1.08% MLMG::ResNormInf() 2383 0.05815 0.08576 0.1127 1.07% MLPoisson::define() 360 0.07632 0.09123 0.1118 1.06% MLMG::mgVcycle_up::2 483 0.02893 0.06232 0.1113 1.06% Castro::post_init() 3 0.09547 0.1037 0.1094 1.04% MLCellLinOp::setLevelBC() 450 0.02571 0.05566 0.1082 1.03% Amr::bldFineLevels() 1 0.09115 0.09663 0.1045 0.99% Gravity::get_new_grav_vector() 263 0.09846 0.1007 0.1038 0.99% MLMG::computeResWithCrseCorFineCor() 771 0.08509 0.09637 0.1002 0.95% MLCellLinOp::reflux() 951 0.0707 0.08369 0.09262 0.88% Gravity::GetCrsePhi() 250 0.02826 0.05766 0.08591 0.82% Castro::construct_new_gravity_source() 260 0.06753 0.07551 0.08285 0.79% Castro::initData() 7 0.04825 0.06172 0.07959 0.76% MLMG::computeMLResidual() 440 0.05488 0.06414 0.07576 0.72% FillPatchInterp(Fab) 688 0.06715 0.0701 0.07179 0.68% FabArrayBase::getCPC() 29601 0.05458 0.06219 0.06946 0.66% CellConservativeLinear::interp() 8794 0.06424 0.06689 0.06861 0.65% MLMG::prepareForSolve() 360 0.06013 0.06465 0.06743 0.64% MLCellLinOp::updateSolBC() 871 0.04741 0.05861 0.06737 0.64% MultiFab::Saxpy() 1180 0.05437 0.06138 0.06708 0.64% MLMG::mgVcycle_up::3 483 0.004145 0.02896 0.0666 0.63% MLCellLinOp::defineAuxData() 360 0.0445 0.05313 0.06439 0.61% MLCellLinOp::updateCorBC() 771 0.04793 0.05649 0.06365 0.61% Gravity::get_old_grav_vector() 140 0.06023 0.06143 0.06329 0.60% Castro::init(old) 28 0.04769 0.05462 0.05839 0.56% MLMG::interpCorrection_1 771 0.03709 0.04542 0.05774 0.55% FluxRegister::Reflux() 960 0.04682 0.05082 0.05548 0.53% Castro::finalize_advance() 140 0.03467 0.03768 0.04195 0.40% Amr::grid_places() 23 0.01697 0.0334 0.04178 0.40% AmrMesh::MakeNewGrids() 23 0.01664 0.03303 0.04147 0.39% MLCellLinOp::defineBC() 360 0.02278 0.02979 0.03951 0.38% FabArrayBase::CPC::define() 4019 0.02807 0.03365 0.03938 0.37% Castro::apply_source_to_state() 520 0.02952 0.03321 0.03654 0.35% Castro::computeNewDt() 28 0.01579 0.02012 0.03535 0.34% MultiFab::Xpay() 12217 0.02805 0.03185 0.03527 0.34% MLMG::mgVcycle_down::6 483 0.005423 0.009659 0.03523 0.34% MLMG::mgVcycle_down::2 483 0.03234 0.03346 0.03493 0.33% FabArrayBase::getFB() 157859 0.03135 0.03272 0.03411 0.32% MLMG::mgVcycle_up::6 483 0.004545 0.008582 0.03392 0.32% Castro::construct_old_source() 700 0.02741 0.03034 0.03265 0.31% Gravity::fill_multipole_BCs() 70 0.02906 0.0298 0.03182 0.30% Castro::errorEst() 34 0.008082 0.0215 0.02758 0.26% BndryData::define() 540 0.0147 0.01995 0.02719 0.26% Amr::writePlotFile() 2 0.02702 0.02707 0.0271 0.26% Castro::derive() 34 0.00636 0.01966 0.02578 0.25% Castro::enforce_min_density() 1182 0.01916 0.0213 0.02455 0.23% MLMG::mgVcycle_down::3 483 0.006198 0.01456 0.02356 0.22% Castro::check_for_nan() 280 0.01615 0.01957 0.02348 0.22% MultiFab::contains_nan() 280 0.01598 0.0194 0.02332 0.22% VisMF::Write(FabArray) 6 0.007539 0.009694 0.02168 0.21% MLMG::getGradSolution() 360 0.01333 0.0159 0.01887 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01684 0.0177 0.01878 0.18% FabArrayBase::TheFPinfo() 688 0.002003 0.01179 0.01871 0.18% MLCellLinOp::compGrad() 450 0.01309 0.01566 0.01861 0.18% FPinfo::FPinfo() 7 0.001124 0.01089 0.01783 0.17% Gravity::update_max_rhs() 30 0.01377 0.01495 0.01696 0.16% Amr::InitializeInit() 1 0.006564 0.01009 0.0161 0.15% Amr::defBaseLevel() 1 0.006558 0.01009 0.01609 0.15% AmrLevel::AmrLevel(dm) 35 0.009453 0.01089 0.0141 0.13% StateData::define() 140 0.009262 0.0107 0.01389 0.13% MLPoisson::FFlux() 7882 0.007004 0.01068 0.01304 0.12% Castro::swap_state_time_levels() 140 0.006641 0.007885 0.01172 0.11% MLMG::mgVcycle_down::4 483 0.005669 0.006782 0.01155 0.11% Castro::FluxRegFineAdd() 140 0.005356 0.007806 0.01127 0.11% Castro::computeInitialDt() 2 0.0008127 0.006964 0.01047 0.10% MLMG::MLResNormInf() 440 0.007943 0.008971 0.01045 0.10% Castro::construct_old_gravity_source() 140 0.007274 0.009044 0.009516 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003906 0.006899 0.00904 0.09% MultiFab::max() 90 0.003932 0.005887 0.009017 0.09% MLMG::mgVcycle_up::4 483 0.004148 0.004934 0.008844 0.08% MLMG::mgVcycle_down::5 483 0.005484 0.006083 0.008365 0.08% MLLinOp::define() 360 0.006817 0.007427 0.008233 0.08% MLLinOp::defineGrids() 360 0.006418 0.007009 0.007775 0.07% StateDataPhysBCFunct::() 1517 0.002398 0.004613 0.007238 0.07% MLMG::mgVcycle_up::5 483 0.004269 0.004784 0.006506 0.06% MLMG::MLRhsNormInf() 360 0.005094 0.005765 0.006318 0.06% BoxList::parallelComplementIn() 57 0.000508 0.003321 0.005826 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0001435 0.002951 0.005792 0.06% BoxList::pci 22 0.000464 0.00328 0.005786 0.06% DistributionMapping::SFCProcessorMapDoIt() 5 0.0001176 0.002918 0.005748 0.05% StateData::FillBoundary(geom) 685 0.001067 0.003135 0.005652 0.05% Gravity::applyMetricTerms() 90 0.00458 0.005134 0.005604 0.05% FabArray::mult() 1063 0.003823 0.004587 0.005498 0.05% MLPoisson::prepareForSolve() 360 0.003004 0.00397 0.005352 0.05% MLCellLinOp::prepareForSolve() 360 0.002697 0.003689 0.005055 0.05% MultiFab::norm0(mask) 270 0.003 0.003934 0.004704 0.04% Gravity::swapTimeLevels() 140 0.003374 0.00373 0.004251 0.04% FabArray::setDomainBndry() 1517 0.003225 0.003544 0.003998 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002719 0.003345 0.003961 0.04% MultiFab::Subtract() 420 0.002046 0.002492 0.003106 0.03% MultiFab::Copy() 450 0.001619 0.002001 0.002421 0.02% TagBoxArray::mapPRD 34 0.001355 0.001853 0.002341 0.02% MLLinOp::makeSubCommunicator() 70 0.001359 0.001727 0.002341 0.02% AmrMesh-cluster 4 0 0.0002902 0.002321 0.02% MLMG::buildFineMask() 360 0.001196 0.001317 0.001459 0.01% ClusterList::chop() 4 0 0.0001821 0.001457 0.01% AMRErrorTag::operator() 34 0.001007 0.001228 0.001408 0.01% TagBoxArray::collate() 34 0.0006717 0.0009209 0.001324 0.01% Castro::finalize_do_advance() 140 0.0004882 0.0006218 0.0007926 0.01% FabArrayBase::FB::FB() 299 0.0002046 0.0004485 0.0006664 0.01% Castro::build_fine_mask() 40 0.0005298 0.0005673 0.0006011 0.01% Castro::apply_tagging_restrictions() 34 0.0004394 0.0005173 0.000587 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005173 0.0005382 0.0005818 0.01% ClusterList::intersect() 4 0 6.974e-05 0.0005579 0.01% Amr::InitAmr() 1 0.0002761 0.0003544 0.0004847 0.00% makeSFC 350 0.000369 0.0003872 0.0004124 0.00% Castro::enforce_speed_limit() 1182 0.0003297 0.0003542 0.0003789 0.00% OwnerMask() 34 0.0001561 0.0001884 0.0002192 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001885 0.0002047 0.0002152 0.00% DistributionMapping::Distribute() 355 0.0001615 0.0001724 0.0001806 0.00% MultiFab::Multiply() 40 0.0001578 0.0001649 0.0001717 0.00% Castro::enforce_consistent_e() 7 8.052e-05 0.0001126 0.0001694 0.00% FabArray::RecvLayoutMask() 90 9.179e-05 0.0001069 0.0001191 0.00% knapsack() 7 9.857e-05 0.0001038 0.0001107 0.00% Castro::retry_advance_ctu() 140 7.449e-05 9.029e-05 0.0001045 0.00% Castro::create_source_corrector() 140 8.354e-05 9.005e-05 9.684e-05 0.00% BoxList::complementIn 574 6.92e-05 7.621e-05 8.42e-05 0.00% Amr::writeSmallPlotFile() 1 3.213e-05 4.68e-05 7.454e-05 0.00% Gravity::set_mass_offset() 21 2.186e-05 2.324e-05 2.474e-05 0.00% Castro::apply_problem_tags() 34 1.522e-05 1.727e-05 1.885e-05 0.00% Amr::initSubcycle() 1 8.566e-06 1.091e-05 1.555e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-6-g917afc0e1896) finalized