MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.09-16-g826cd378f8ba) initialized Starting run at 05:38:29 UTC on 2022-09-19. Successfully read inputs file ... Castro git describe: 22.09 AMReX git describe: 22.09-16-g826cd378f Microphysics git describe: 22.08-13-g1adf1bdb reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001606134 new finest: 1 grid_places() time: 0.005651242 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.014303903 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.009048903 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.015710813 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.504540456 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000530271 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.527429558 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000790425 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.537535435 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000540266 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.553580552 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.001149252 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.534003531 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000545737 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.526914023 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000790127 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.539017998 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000532076 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.534279734 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000802117 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.540032606 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.00055806 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.530957543 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000796966 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.543168864 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000551253 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.530780893 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000775165 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.541213187 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000526007 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.525461632 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000838236 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.534609475 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000533892 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.524979734 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000793416 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.533647669 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000533457 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.523132236 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000784664 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.531798239 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000541316 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.527621145 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.015520764 seconds Ending run at 05:38:40 UTC on 2022-09-19. Run time = 10.86090394 Run time without initialization = 10.66451963 Average number of zones advanced per microsecond: 0.826 Average number of zones advanced per microsecond per rank: 0.103 TinyProfiler total time across processes [min...avg...max]: 10.86 ... 10.86 ... 10.86 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9532 2.2877 2.5667 23.63% MLCGSolver::ParallelAllReduce 243542 0.8497 1.086 1.346 12.39% MLPoisson::Fsmooth() 54976 0.8906 0.9534 1.002 9.22% Castro::do_advance_ctu() 140 0.2981 0.5801 0.9107 8.39% FillBoundary_nowait() 157859 0.5397 0.664 0.749 6.90% FabArray::ParallelCopy_finish() 21259 0.3196 0.5103 0.7151 6.58% FillBoundary_finish() 157859 0.5157 0.6056 0.7018 6.46% MLCellLinOp::applyBC() 165252 0.2123 0.2931 0.3858 3.55% MLPoisson::Fapply() 108875 0.2679 0.2955 0.3151 2.90% MLCGSolver::bicgstab 1420 0.2155 0.2409 0.2679 2.47% FabArray::setVal() 27514 0.1597 0.2025 0.2557 2.35% MultiFab::LinComb() 288206 0.1675 0.204 0.2429 2.24% FabArray::ParallelCopy_nowait() 21259 0.1576 0.1995 0.222 2.04% Castro::estTimeStep() 308 0.09775 0.1583 0.208 1.92% MultiFab::Dot() 193316 0.1661 0.1889 0.2072 1.91% Castro::reset_internal_energy(Fab) 5919 0.1536 0.1737 0.1882 1.73% Castro::normalize_species() 1182 0.1326 0.1443 0.1614 1.49% MLPoisson::normalize() 98078 0.1027 0.114 0.1228 1.13% MLMG::ResNormInf() 2383 0.05541 0.07957 0.1027 0.95% Castro::construct_new_gravity_source() 260 0.07243 0.07909 0.08895 0.82% amrex::average_down 8093 0.06901 0.07465 0.08348 0.77% Castro::computeTemp() 1189 0.06414 0.07127 0.07983 0.74% CellConservativeLinear::interp() 9059 0.06496 0.07062 0.07521 0.69% MultiFab::Saxpy() 1180 0.05727 0.06732 0.07511 0.69% MLMG::addInterpCorrection() 6101 0.06168 0.06597 0.06943 0.64% CGSolver::sxay() 288086 0.05558 0.06255 0.06786 0.62% Castro::initData() 7 0.04892 0.05474 0.06716 0.62% FillPatchIterator::Initialize 889 0.03654 0.05475 0.06378 0.59% FabArray::FillBoundary() 157859 0.04811 0.05474 0.05855 0.54% MLCellLinOp::defineAuxData() 360 0.03656 0.04299 0.05358 0.49% Castro::reflux() 60 0.03989 0.04749 0.05354 0.49% FillPatchSingleLevel 1617 0.03372 0.04209 0.04965 0.46% MLMG::prepareForSolve() 360 0.03336 0.03957 0.04885 0.45% amrex::average_down_w_geom 248 0.03398 0.03796 0.04499 0.41% MLCellLinOp::apply() 108875 0.03465 0.03923 0.04262 0.39% Gravity::actual_solve_with_mlmg() 360 0.02553 0.03097 0.04222 0.39% FabArrayBase::CPC::define() 4099 0.02759 0.03589 0.04179 0.38% Gravity::fill_multipole_BCs() 70 0.02698 0.03104 0.04005 0.37% MultiFab::Xpay() 12217 0.03018 0.03292 0.0362 0.33% FluxRegister::Reflux() 960 0.02743 0.0318 0.03556 0.33% Castro::initialize_do_advance() 140 0.01641 0.0283 0.03483 0.32% Castro::expand_state() 200 0.01929 0.02876 0.03352 0.31% MLMG::solve() 360 0.00874 0.02041 0.03311 0.30% Castro::initMFs() 35 0.01899 0.02648 0.03303 0.30% FillPatchTwoLevels 756 0.02207 0.02972 0.03295 0.30% MLMG::interpCorrection_1 771 0.02432 0.02786 0.03289 0.30% MLCellLinOp::reflux() 951 0.02245 0.02748 0.0319 0.29% FabArrayBase::getCPC() 29651 0.02416 0.02833 0.03046 0.28% FabArrayBase::getFB() 157859 0.02437 0.02713 0.02994 0.28% Castro::enforce_min_density() 1182 0.02287 0.02497 0.02875 0.26% Gravity::get_new_grav_vector() 263 0.01692 0.02068 0.02728 0.25% Castro::construct_new_source() 1300 0.01791 0.02404 0.02722 0.25% VisMF::Write(FabArray) 6 0.008866 0.01133 0.02673 0.25% MLCellLinOp::updateSolBC() 871 0.0122 0.01708 0.02426 0.22% Amr::writePlotFile() 2 0.005826 0.02132 0.02379 0.22% MultiFab::contains_nan() 280 0.01702 0.01986 0.02322 0.21% MLCellLinOp::updateCorBC() 771 0.01123 0.01584 0.02297 0.21% MultiFab::Add() 4370 0.01849 0.02039 0.0229 0.21% BndryData::define() 540 0.0125 0.01579 0.02223 0.20% Castro::FluxRegCrseInit 140 0.01643 0.01921 0.02157 0.20% Amr::coarseTimeStep() 20 0.002054 0.005165 0.01893 0.17% Gravity::get_old_grav_vector() 140 0.009005 0.01169 0.0179 0.16% MLCellLinOp::smooth() 27488 0.01461 0.01614 0.01755 0.16% StateData::define() 140 0.01013 0.01299 0.01577 0.15% Castro::construct_old_source() 700 0.008169 0.01288 0.01528 0.14% Castro::initialize_advance() 140 0.009837 0.01194 0.01488 0.14% MLPoisson::FFlux() 7882 0.00717 0.01076 0.01348 0.12% MLCellLinOp::setLevelBC() 450 0.00807 0.009888 0.01309 0.12% Castro::FluxRegFineAdd() 140 0.005998 0.008702 0.01283 0.12% MLCellLinOp::compGrad() 450 0.009903 0.01092 0.01263 0.12% Castro::swap_state_time_levels() 140 0.007053 0.009157 0.01238 0.11% Castro::construct_old_gravity_source() 140 0.007111 0.01041 0.01231 0.11% Gravity::gravity_sync() 60 0.008336 0.01039 0.01217 0.11% MLCellLinOp::defineBC() 360 0.008215 0.00946 0.01212 0.11% FPinfo::FPinfo() 7 0.0009497 0.005076 0.01069 0.10% Castro::buildMetrics() 35 0.005359 0.007171 0.01016 0.09% FabArray::ParallelCopy() 21259 0.00826 0.009088 0.009724 0.09% MultiFab::Copy() 1992 0.006323 0.007356 0.009386 0.09% Gravity::solve_for_phi() 280 0.005203 0.007718 0.009123 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003899 0.006602 0.008569 0.08% Castro::init(old) 28 0.005226 0.006866 0.007627 0.07% MultiFab::max() 90 0.003286 0.005216 0.007368 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0001254 0.003177 0.007098 0.07% Amr::regrid() 21 0.00343 0.004813 0.006426 0.06% MLMG::MLRhsNormInf() 360 0.005498 0.005928 0.006316 0.06% StateData::FillBoundary(geom) 745 0.001465 0.003668 0.006296 0.06% Amr::timeStep() 140 0.002678 0.00361 0.006 0.06% AmrMesh::MakeNewGrids() 23 0.002836 0.005169 0.00578 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003983 0.004512 0.005658 0.05% Castro::construct_old_gravity() 140 0.003497 0.004797 0.005623 0.05% FabArray::mult() 1063 0.00414 0.004684 0.00553 0.05% Gravity::applyMetricTerms() 90 0.004842 0.005215 0.005483 0.05% MLLinOp::defineGrids() 360 0.004162 0.0046 0.005453 0.05% Castro::Castro() 35 0.003306 0.00449 0.005423 0.05% MLCellLinOp::prepareForSolve() 360 0.002953 0.003807 0.00534 0.05% FabArray::setDomainBndry() 1617 0.003182 0.004121 0.004893 0.05% Castro::construct_new_gravity() 140 0.003548 0.004114 0.004598 0.04% MLCellLinOp::correctionResidual() 9063 0.003772 0.004213 0.004538 0.04% BoxList::pci 22 0.0004396 0.002663 0.004417 0.04% MLMG::mgVcycle() 3385 0.00356 0.003935 0.004255 0.04% Gravity::GetCrsePhi() 250 0.002923 0.003523 0.004085 0.04% Gravity::update_max_rhs() 30 0.002978 0.003356 0.003759 0.03% FillPatchInterp(Fab) 728 0.003102 0.003435 0.003757 0.03% MLMG::actualBottomSolve() 1843 0.002277 0.002455 0.003089 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002343 0.002742 0.00301 0.03% MultiFab::Subtract() 420 0.002246 0.002672 0.003001 0.03% MLMG::oneIter() 1843 0.002574 0.002807 0.002942 0.03% Castro::reset_internal_energy(MultiFab) 1189 0.001877 0.002242 0.002902 0.03% MLMG:computeResOfCorrection() 6101 0.002271 0.002542 0.002806 0.03% MLMG::mgVcycle_down::0 1843 0.002136 0.002335 0.002441 0.02% MLMG::MLResNormInf() 440 0.0007143 0.0014 0.002435 0.02% MLLinOp::makeSubCommunicator() 70 0.001313 0.001685 0.002271 0.02% MLMG::mgVcycle_bottom 3385 0.001971 0.002152 0.002257 0.02% MLCellLinOp::solutionResidual() 3154 0.001654 0.001761 0.001878 0.02% MLMG::mgVcycle_down::1 1843 0.001608 0.001777 0.001871 0.02% Castro::apply_tagging_restrictions() 34 0.001355 0.001696 0.001828 0.02% TagBoxArray::collate() 34 0.0007697 0.001033 0.001789 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.00122 0.001529 0.001765 0.02% Castro::clean_state() 1182 0.00129 0.001591 0.001722 0.02% MLMG::mgVcycle_up::1 1843 0.001373 0.00155 0.001684 0.02% MLMG::computeResWithCrseSolFineCor() 771 0.001417 0.001537 0.001623 0.01% StateDataPhysBCFunct::() 1617 0.001182 0.001463 0.00162 0.01% Castro::finalize_advance() 140 0.0008539 0.001209 0.001544 0.01% MLMG::mgVcycle_up::0 1843 0.001329 0.001452 0.001523 0.01% Gravity::solve_phi_with_mlmg() 300 0.0008784 0.001165 0.001445 0.01% ClusterList::chop() 4 0 0.0001731 0.001385 0.01% AMRErrorTag::operator() 34 0.0009405 0.001202 0.001341 0.01% main() 1 0.0006825 0.0009394 0.001327 0.01% FabArrayBase::TheFPinfo() 728 0.0007313 0.001034 0.001242 0.01% MLMG::computeResidual() 1843 0.000978 0.001064 0.001139 0.01% Gravity::actual_multilevel_solve() 20 0.0007447 0.0009513 0.001112 0.01% MLPoisson::define() 360 0.0007081 0.0008476 0.001051 0.01% Castro::build_fine_mask() 100 0.0007556 0.0009579 0.001044 0.01% MLMG::computeResWithCrseCorFineCor() 771 0.000694 0.0007579 0.0008356 0.01% Castro::finalize_do_advance() 140 0.0004395 0.0005805 0.0008247 0.01% Castro::do_new_sources() 260 0.0005723 0.0007109 0.0008131 0.01% Castro::derive() 34 0.0005371 0.0005913 0.0006728 0.01% FabArrayBase::FB::FB() 299 0.0002098 0.0004322 0.0006478 0.01% MLMG::computeMLResidual() 440 0.0005011 0.0005568 0.0006088 0.01% MLMG::miniCycle() 1542 0.0004726 0.0005348 0.0005873 0.01% Castro::apply_source_to_state() 520 0.0003744 0.0005082 0.0005834 0.01% Castro::subcycle_advance_ctu() 140 0.0003317 0.0004697 0.0005678 0.01% MLMG::mgVcycle_down::2 483 0.0004423 0.0005044 0.0005594 0.01% ClusterList::intersect() 4 0 6.592e-05 0.0005274 0.00% Castro::enforce_speed_limit() 1182 0.0002937 0.0004503 0.000522 0.00% Amr::grid_places() 23 0.0003074 0.0003527 0.0005084 0.00% MLMG::mgVcycle_down::3 483 0.0004071 0.0004367 0.0004987 0.00% Amr::InitAmr() 1 0.000263 0.0003448 0.0004931 0.00% Castro::advance() 140 0.0003333 0.0004385 0.0004922 0.00% MLMG::mgVcycle_down::6 483 0.0004015 0.000451 0.0004846 0.00% MLMG::mgVcycle_down::4 483 0.0003651 0.0004043 0.0004453 0.00% Castro::do_old_sources() 140 0.0003029 0.0003829 0.0004211 0.00% MLMG::mgVcycle_down::5 483 0.0003357 0.0003782 0.0004192 0.00% MLLinOp::define() 360 0.0002826 0.0003416 0.0003813 0.00% MLPoisson::prepareForSolve() 360 0.0002714 0.0003015 0.0003608 0.00% Gravity::swapTimeLevels() 140 0.0001892 0.0002885 0.0003607 0.00% MLMG::mgVcycle_up::2 483 0.0002585 0.0002996 0.0003282 0.00% MLMG::mgVcycle_up::6 483 0.0002734 0.0003038 0.0003212 0.00% MultiFab::Multiply() 40 0.0002091 0.0002788 0.0003189 0.00% MLMG::mgVcycle_up::3 483 0.0002584 0.0002741 0.0003097 0.00% MLMG::mgVcycle_up::5 483 0.0002518 0.0002825 0.0003007 0.00% AmrMesh-cluster 4 0 3.686e-05 0.0002949 0.00% MLMG::getGradSolution() 360 0.0002485 0.0002726 0.0002933 0.00% MLMG::mgVcycle_up::4 483 0.0002295 0.0002652 0.0002868 0.00% makeSFC 350 0.0001893 0.0002186 0.0002391 0.00% Castro::post_timestep() 140 0.000139 0.0001919 0.0002332 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001461 0.0001801 0.0002287 0.00% AmrLevel::AmrLevel(dm) 35 0.0001808 0.0002036 0.0002273 0.00% TagBoxArray::mapPRD 34 0.0001842 0.0002027 0.0002234 0.00% OwnerMask() 34 0.0001664 0.0001879 0.0002064 0.00% Castro::check_for_nan() 280 0.0001621 0.0001789 0.0002 0.00% Castro::avgDown(state_indx) 248 0.0001256 0.0001703 0.0001963 0.00% Castro::post_regrid() 66 0.0001237 0.0001633 0.0001933 0.00% DistributionMapping::Distribute() 355 0.0001294 0.0001718 0.000192 0.00% FabArray::RecvLayoutMask() 90 8.96e-05 0.0001088 0.0001278 0.00% Castro::enforce_consistent_e() 7 8.056e-05 0.0001012 0.0001239 0.00% knapsack() 7 9.338e-05 0.0001047 0.0001182 0.00% Gravity::solve_for_delta_phi 60 8.291e-05 9.441e-05 0.0001149 0.00% Amr::FinalizeInit() 1 3.51e-06 1.738e-05 0.0001094 0.00% Castro::create_source_corrector() 140 6.186e-05 8.199e-05 0.0001027 0.00% BoxList::complementIn 574 6.612e-05 7.048e-05 7.927e-05 0.00% Castro::avgDown() 62 5.748e-05 7.024e-05 7.834e-05 0.00% Amr::writeSmallPlotFile() 1 3.078e-05 4.397e-05 7.666e-05 0.00% Castro::errorEst() 34 6.487e-05 7.246e-05 7.61e-05 0.00% Castro::retry_advance_ctu() 140 3.842e-05 4.306e-05 4.806e-05 0.00% Castro::computeNewDt() 28 4.067e-05 4.313e-05 4.494e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.946e-05 3.302e-05 4.121e-05 0.00% Amr::defBaseLevel() 1 1.85e-05 2.892e-05 3.995e-05 0.00% Amr::bldFineLevels() 1 2.264e-05 2.79e-05 3.49e-05 0.00% Gravity::set_mass_offset() 21 1.346e-05 2.36e-05 2.74e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.114e-05 2.389e-05 2.736e-05 0.00% Castro::apply_problem_tags() 34 1.573e-05 1.784e-05 2.496e-05 0.00% BoxList::parallelComplementIn() 57 1.871e-05 2.302e-05 2.427e-05 0.00% Castro::post_init() 3 7.337e-06 9.346e-06 1.395e-05 0.00% Amr::initSubcycle() 1 7.922e-06 9.709e-06 1.369e-05 0.00% Castro::computeInitialDt() 2 3.395e-06 4.089e-06 7.633e-06 0.00% Amr::InitializeInit() 1 1.937e-06 2.629e-06 4.993e-06 0.00% Amr::init() 1 1.422e-06 1.751e-06 2.269e-06 0.00% Amr::initialInit() 1 1.091e-06 1.306e-06 1.531e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.86 10.86 10.86 100.00% Amr::coarseTimeStep() 20 10.65 10.65 10.65 98.03% Amr::timeStep() 140 10.62 10.63 10.63 97.90% Castro::advance() 140 7.815 7.82 7.824 72.04% Castro::subcycle_advance_ctu() 140 7.577 7.619 7.651 70.45% Castro::do_advance_ctu() 140 7.576 7.618 7.65 70.44% Gravity::actual_solve_with_mlmg() 360 5.733 5.745 5.762 53.06% MLMG::solve() 360 5.548 5.558 5.565 51.24% MLMG::oneIter() 1843 5.152 5.18 5.196 47.84% MLMG::mgVcycle() 3385 4.756 4.795 4.829 44.46% Gravity::solve_phi_with_mlmg() 300 4.324 4.338 4.359 40.14% Gravity::solve_for_phi() 280 3.661 3.671 3.689 33.97% MLMG::mgVcycle_bottom 3385 3.254 3.272 3.293 30.32% Castro::construct_new_gravity() 140 2.936 2.939 2.947 27.13% MLMG::actualBottomSolve() 1843 2.863 2.871 2.89 26.61% MLCGSolver::bicgstab 1420 2.859 2.867 2.885 26.56% Castro::construct_ctu_hydro_source() 140 1.953 2.288 2.567 23.63% Castro::post_timestep() 140 2.007 2.02 2.027 18.66% Castro::reflux() 60 1.881 1.893 1.903 17.52% MLCellLinOp::applyBC() 165252 1.494 1.613 1.794 16.52% MLCellLinOp::smooth() 27488 1.543 1.597 1.641 15.10% Gravity::gravity_sync() 60 1.549 1.549 1.549 14.27% FabArray::FillBoundary() 157859 1.242 1.352 1.535 14.13% Gravity::solve_for_delta_phi 60 1.469 1.47 1.471 13.54% MLCGSolver::ParallelAllReduce 243542 0.9553 1.182 1.43 13.17% MLCellLinOp::apply() 108875 1.14 1.296 1.422 13.09% MLPoisson::Fsmooth() 54976 0.8906 0.9534 1.002 9.22% FabArray::ParallelCopy() 21259 0.6061 0.775 0.9253 8.52% Castro::construct_old_gravity() 140 0.8711 0.8817 0.8979 8.27% Amr::regrid() 21 0.8315 0.8434 0.8531 7.85% FillBoundary_nowait() 157859 0.5673 0.6916 0.7769 7.15% FabArray::ParallelCopy_finish() 21259 0.3196 0.5103 0.7151 6.58% FillBoundary_finish() 157859 0.5157 0.6056 0.7018 6.46% Gravity::multilevel_solve_for_new_phi() 20 0.6836 0.6859 0.6876 6.33% Gravity::actual_multilevel_solve() 20 0.6818 0.6844 0.6863 6.32% Castro::post_regrid() 66 0.6567 0.6608 0.6637 6.11% FillPatchIterator::Initialize 889 0.5092 0.5891 0.652 6.00% FillPatchTwoLevels 756 0.4325 0.5077 0.5761 5.30% MLMG::mgVcycle_down::0 1843 0.4709 0.4866 0.5045 4.65% MLMG::mgVcycle_up::0 1843 0.4507 0.4603 0.4663 4.29% Castro::clean_state() 1182 0.3765 0.4173 0.462 4.25% FillPatchSingleLevel 1617 0.2555 0.3315 0.4173 3.84% MLMG::miniCycle() 1542 0.3801 0.4018 0.4163 3.83% Castro::initialize_do_advance() 140 0.3354 0.3436 0.3725 3.43% Castro::expand_state() 200 0.2688 0.2957 0.3388 3.12% MLPoisson::Fapply() 108875 0.2679 0.2955 0.3151 2.90% CGSolver::sxay() 288086 0.2287 0.2645 0.3066 2.82% Castro::do_new_sources() 260 0.2326 0.2603 0.2967 2.73% MLCellLinOp::correctionResidual() 9063 0.2669 0.2835 0.294 2.71% FabArray::ParallelCopy_nowait() 21259 0.2019 0.2555 0.2831 2.61% Castro::computeTemp() 1189 0.22 0.2472 0.2709 2.49% FabArray::setVal() 27514 0.1597 0.2025 0.2557 2.35% MultiFab::LinComb() 288206 0.1675 0.204 0.2429 2.24% MLCellLinOp::solutionResidual() 3154 0.2122 0.2234 0.2324 2.14% MLMG::mgVcycle_down::1 1843 0.214 0.2193 0.2276 2.10% Castro::estTimeStep() 308 0.09775 0.1583 0.208 1.92% MultiFab::Dot() 193316 0.1661 0.1889 0.2072 1.91% Castro::initialize_advance() 140 0.1304 0.1593 0.1965 1.81% Amr::init() 1 0.1957 0.1959 0.196 1.80% MLMG::computeResWithCrseSolFineCor() 771 0.156 0.178 0.1923 1.77% Castro::reset_internal_energy(MultiFab) 1189 0.1559 0.176 0.1911 1.76% Castro::reset_internal_energy(Fab) 5919 0.1536 0.1737 0.1882 1.73% MLMG::mgVcycle_up::1 1843 0.1722 0.1786 0.1833 1.69% Amr::initialInit() 1 0.1797 0.1799 0.18 1.66% amrex::average_down 8093 0.1179 0.143 0.1732 1.59% Amr::FinalizeInit() 1 0.162 0.1689 0.1725 1.59% Castro::normalize_species() 1182 0.1326 0.1443 0.1614 1.49% Castro::construct_new_source() 1300 0.1231 0.1377 0.1525 1.40% MLMG::addInterpCorrection() 6101 0.0914 0.1222 0.1489 1.37% MLMG::computeResidual() 1843 0.1208 0.1332 0.1409 1.30% Castro::do_old_sources() 140 0.09238 0.1125 0.1332 1.23% MLMG:computeResOfCorrection() 6101 0.1241 0.1272 0.1299 1.20% MLPoisson::normalize() 98078 0.1027 0.114 0.1228 1.13% MLPoisson::define() 360 0.07952 0.09172 0.1141 1.05% Gravity::get_new_grav_vector() 263 0.1062 0.1084 0.1104 1.02% MLMG::mgVcycle_up::2 483 0.02967 0.06047 0.1054 0.97% MLMG::ResNormInf() 2383 0.05541 0.07957 0.1027 0.95% MLMG::computeResWithCrseCorFineCor() 771 0.08783 0.09573 0.1002 0.92% Castro::avgDown() 62 0.06207 0.08483 0.09915 0.91% Castro::avgDown(state_indx) 248 0.062 0.08476 0.09907 0.91% amrex::average_down_w_geom 248 0.06182 0.08459 0.0989 0.91% Amr::bldFineLevels() 1 0.0902 0.09306 0.09587 0.88% MLCellLinOp::reflux() 951 0.07133 0.08429 0.09139 0.84% Castro::construct_new_gravity_source() 260 0.07243 0.07909 0.08895 0.82% FillPatchInterp(Fab) 728 0.06807 0.07405 0.07897 0.73% Castro::init(old) 28 0.05082 0.0639 0.0778 0.72% MLMG::prepareForSolve() 360 0.06821 0.071 0.07631 0.70% MLMG::computeMLResidual() 440 0.0601 0.06707 0.07532 0.69% CellConservativeLinear::interp() 9059 0.06496 0.07062 0.07521 0.69% MultiFab::Saxpy() 1180 0.05727 0.06732 0.07511 0.69% MLCellLinOp::setLevelBC() 450 0.02527 0.04724 0.07458 0.69% Castro::initData() 7 0.05306 0.05925 0.07241 0.67% FabArrayBase::getCPC() 29651 0.05174 0.06421 0.07224 0.67% Castro::post_init() 3 0.06485 0.06771 0.07065 0.65% Gravity::get_old_grav_vector() 140 0.06561 0.06777 0.06907 0.64% MLCellLinOp::defineAuxData() 360 0.04634 0.05399 0.06628 0.61% MLMG::mgVcycle_up::3 483 0.004446 0.02782 0.06548 0.60% FluxRegister::Reflux() 960 0.05292 0.05938 0.06467 0.60% MLCellLinOp::updateSolBC() 871 0.04676 0.05624 0.06373 0.59% Castro::Castro() 35 0.03453 0.04814 0.06028 0.55% MLMG::interpCorrection_1 771 0.04082 0.04714 0.05888 0.54% MLCellLinOp::updateCorBC() 771 0.05026 0.0547 0.0578 0.53% Gravity::GetCrsePhi() 250 0.0237 0.03771 0.05666 0.52% Castro::finalize_advance() 140 0.03751 0.04192 0.04647 0.43% FabArrayBase::CPC::define() 4099 0.02759 0.03589 0.04179 0.38% Castro::apply_source_to_state() 520 0.02877 0.03685 0.04126 0.38% Gravity::fill_multipole_BCs() 70 0.02764 0.03164 0.0405 0.37% Castro::construct_old_source() 700 0.02537 0.03477 0.04035 0.37% MLCellLinOp::defineBC() 360 0.02393 0.0297 0.04004 0.37% Amr::grid_places() 23 0.02271 0.03153 0.03634 0.33% MultiFab::Xpay() 12217 0.03018 0.03292 0.0362 0.33% AmrMesh::MakeNewGrids() 23 0.02239 0.03118 0.03597 0.33% MLMG::mgVcycle_down::2 483 0.03119 0.03252 0.03434 0.32% MLMG::mgVcycle_up::6 483 0.004459 0.008718 0.03341 0.31% Castro::initMFs() 35 0.01899 0.02648 0.03303 0.30% MLMG::mgVcycle_down::6 483 0.004881 0.009081 0.03269 0.30% Amr::writePlotFile() 2 0.03256 0.03264 0.03268 0.30% Castro::FluxRegCrseInit 140 0.03066 0.03201 0.03242 0.30% FabArrayBase::getFB() 157859 0.0249 0.02756 0.03031 0.28% Castro::enforce_min_density() 1182 0.02287 0.02497 0.02875 0.26% BndryData::define() 540 0.01535 0.01985 0.02745 0.25% VisMF::Write(FabArray) 6 0.008866 0.01133 0.02673 0.25% Castro::errorEst() 34 0.01103 0.01981 0.02568 0.24% MLMG::mgVcycle_down::3 483 0.006062 0.01441 0.02373 0.22% Castro::check_for_nan() 280 0.0172 0.02004 0.02342 0.22% MultiFab::contains_nan() 280 0.01702 0.01986 0.02322 0.21% MultiFab::Add() 4370 0.01849 0.02039 0.0229 0.21% Castro::derive() 34 0.008275 0.01683 0.02254 0.21% MLMG::getGradSolution() 360 0.0151 0.01711 0.02005 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01724 0.01826 0.01993 0.18% MLCellLinOp::compGrad() 450 0.01483 0.01684 0.01975 0.18% Amr::InitializeInit() 1 0.00742 0.01107 0.01775 0.16% Amr::defBaseLevel() 1 0.007415 0.01107 0.01775 0.16% Castro::computeNewDt() 28 0.01631 0.01682 0.01743 0.16% Gravity::update_max_rhs() 30 0.01358 0.01477 0.01644 0.15% AmrLevel::AmrLevel(dm) 35 0.01033 0.01319 0.01598 0.15% StateData::define() 140 0.01013 0.01299 0.01577 0.15% MLPoisson::FFlux() 7882 0.00717 0.01076 0.01348 0.12% Castro::FluxRegFineAdd() 140 0.005998 0.008702 0.01283 0.12% Castro::swap_state_time_levels() 140 0.007053 0.009157 0.01238 0.11% Castro::construct_old_gravity_source() 140 0.007111 0.01041 0.01231 0.11% FabArrayBase::TheFPinfo() 728 0.002166 0.0063 0.0121 0.11% Castro::computeInitialDt() 2 0.0008215 0.007674 0.01127 0.10% FPinfo::FPinfo() 7 0.001131 0.005266 0.01088 0.10% MLMG::MLResNormInf() 440 0.008037 0.009214 0.01047 0.10% Castro::buildMetrics() 35 0.00547 0.007287 0.0103 0.09% MLMG::mgVcycle_down::4 483 0.005214 0.006269 0.009987 0.09% MultiFab::Copy() 1992 0.006323 0.007356 0.009386 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003899 0.006602 0.008569 0.08% MLLinOp::define() 360 0.006765 0.007186 0.008045 0.07% MLMG::mgVcycle_up::4 483 0.003875 0.004878 0.00798 0.07% StateDataPhysBCFunct::() 1617 0.002868 0.005131 0.007848 0.07% MLLinOp::defineGrids() 360 0.006414 0.006844 0.007666 0.07% MultiFab::max() 90 0.003286 0.005216 0.007368 0.07% MLMG::mgVcycle_down::5 483 0.004869 0.0057 0.007108 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0001254 0.003177 0.007098 0.07% DistributionMapping::SFCProcessorMapDoIt() 5 0.000122 0.003161 0.007083 0.07% MLMG::MLRhsNormInf() 360 0.005498 0.005928 0.006316 0.06% StateData::FillBoundary(geom) 745 0.001465 0.003668 0.006296 0.06% MLMG::mgVcycle_up::5 483 0.003999 0.004748 0.005872 0.05% MLPoisson::prepareForSolve() 360 0.003313 0.004108 0.005663 0.05% FabArray::mult() 1063 0.00414 0.004684 0.00553 0.05% Gravity::applyMetricTerms() 90 0.004842 0.005215 0.005483 0.05% MLCellLinOp::prepareForSolve() 360 0.002953 0.003807 0.00534 0.05% FabArray::setDomainBndry() 1617 0.003182 0.004121 0.004893 0.05% BoxList::parallelComplementIn() 57 0.0004692 0.002698 0.004452 0.04% BoxList::pci 22 0.0004396 0.002663 0.004417 0.04% Gravity::swapTimeLevels() 140 0.003603 0.003966 0.004394 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.003053 0.003566 0.003879 0.04% TagBoxArray::mapPRD 34 0.001326 0.002059 0.003175 0.03% MultiFab::Subtract() 420 0.002246 0.002672 0.003001 0.03% MLLinOp::makeSubCommunicator() 70 0.001313 0.001685 0.002271 0.02% AmrMesh-cluster 4 0 0.0002759 0.002207 0.02% Castro::apply_tagging_restrictions() 34 0.001355 0.001696 0.001828 0.02% TagBoxArray::collate() 34 0.0007697 0.001033 0.001789 0.02% ClusterList::chop() 4 0 0.0001731 0.001385 0.01% AMRErrorTag::operator() 34 0.0009405 0.001202 0.001341 0.01% Castro::build_fine_mask() 100 0.0007556 0.0009579 0.001044 0.01% Castro::finalize_do_advance() 140 0.0004395 0.0005805 0.0008247 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0004652 0.0005591 0.00065 0.01% FabArrayBase::FB::FB() 299 0.0002098 0.0004322 0.0006478 0.01% ClusterList::intersect() 4 0 6.592e-05 0.0005274 0.00% Castro::enforce_speed_limit() 1182 0.0002937 0.0004503 0.000522 0.00% Amr::InitAmr() 1 0.0002719 0.0003545 0.0005068 0.00% makeSFC 350 0.0003182 0.0003789 0.0004213 0.00% MultiFab::Multiply() 40 0.0002091 0.0002788 0.0003189 0.00% OwnerMask() 34 0.0001664 0.0001879 0.0002064 0.00% DistributionMapping::KnapSackDoIt() 7 0.000181 0.0001896 0.0001955 0.00% DistributionMapping::Distribute() 355 0.0001294 0.0001718 0.000192 0.00% FabArray::RecvLayoutMask() 90 8.96e-05 0.0001088 0.0001278 0.00% Castro::enforce_consistent_e() 7 8.056e-05 0.0001012 0.0001239 0.00% knapsack() 7 9.338e-05 0.0001047 0.0001182 0.00% Castro::create_source_corrector() 140 6.186e-05 8.199e-05 0.0001027 0.00% BoxList::complementIn 574 6.612e-05 7.048e-05 7.927e-05 0.00% Amr::writeSmallPlotFile() 1 3.078e-05 4.397e-05 7.666e-05 0.00% Castro::retry_advance_ctu() 140 3.842e-05 4.306e-05 4.806e-05 0.00% Gravity::set_mass_offset() 21 1.346e-05 2.36e-05 2.74e-05 0.00% Castro::apply_problem_tags() 34 1.573e-05 1.784e-05 2.496e-05 0.00% Amr::initSubcycle() 1 7.922e-06 9.709e-06 1.369e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.09-16-g826cd378f8ba) finalized