MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.11-14-ge0afc82f63ce) initialized Starting run at 19:14:12 UTC on 2022-11-11. Successfully read inputs file ... Castro git describe: 22.11-8-gb1a507d03 AMReX git describe: 22.11-14-ge0afc82f6 Microphysics git describe: 22.11-12-gc073a11e reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001865583 new finest: 1 grid_places() time: 0.010319856 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.010473571 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.012796849 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.017800014 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.503601292 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000578916 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.522257451 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000834992 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.533667447 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000575622 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.543608106 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.00085571 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.529648536 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000560724 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.531187001 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000835553 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.539854352 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000573251 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.532937816 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000837069 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.539216165 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000580706 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.532936462 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000842584 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.540064149 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000590121 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.535142793 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.00083316 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.543500404 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000579773 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.53634419 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000837826 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.544121467 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000563666 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.536819031 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000872718 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.545843564 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000557528 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.53584589 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.00081065 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.543260592 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000569781 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.540038255 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.017768095 seconds Ending run at 19:14:23 UTC on 2022-11-11. Run time = 10.95973984 Run time without initialization = 10.7312112 Average number of zones advanced per microsecond: 0.821 Average number of zones advanced per microsecond per rank: 0.103 TinyProfiler total time across processes [min...avg...max]: 10.96 ... 10.96 ... 10.96 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9487 2.2939 2.5519 23.28% MLCGSolver::ParallelAllReduce 243542 0.863 1.101 1.487 13.57% MLPoisson::Fsmooth() 54976 0.7678 0.9229 1.026 9.36% FabArray::ParallelCopy_finish() 21259 0.3512 0.52 0.9399 8.58% Castro::do_advance_ctu() 140 0.33 0.5901 0.9316 8.50% FillBoundary_finish() 157859 0.4366 0.6057 0.8474 7.73% FillBoundary_nowait() 157859 0.5482 0.6732 0.7611 6.94% MLCellLinOp::applyBC() 165252 0.2002 0.2963 0.3902 3.56% MLPoisson::Fapply() 108875 0.236 0.2971 0.3241 2.96% MLCGSolver::bicgstab 1420 0.1937 0.2449 0.2691 2.46% FabArray::setVal() 27514 0.1374 0.2044 0.2545 2.32% MultiFab::LinComb() 288206 0.1485 0.2073 0.2469 2.25% Castro::estTimeStep() 308 0.1187 0.1739 0.242 2.21% FabArray::ParallelCopy_nowait() 21259 0.1621 0.2037 0.2252 2.05% MultiFab::Dot() 193316 0.1484 0.1926 0.2167 1.98% Castro::reset_internal_energy(Fab) 5919 0.1478 0.1733 0.1857 1.69% Castro::normalize_species() 1182 0.1249 0.1446 0.1603 1.46% MLPoisson::normalize() 98078 0.0889 0.114 0.1236 1.13% MLMG::ResNormInf() 2383 0.05805 0.08197 0.1086 0.99% Castro::construct_new_gravity_source() 260 0.06282 0.0793 0.08892 0.81% amrex::average_down 8093 0.06468 0.07849 0.08561 0.78% Castro::computeTemp() 1189 0.06188 0.07092 0.07856 0.72% MultiFab::Saxpy() 1180 0.04732 0.06747 0.0772 0.70% MLMG::addInterpCorrection() 6101 0.05573 0.06708 0.07522 0.69% Castro::initData() 7 0.04459 0.06163 0.07404 0.68% CellConservativeLinear::interp() 9059 0.06599 0.07009 0.07254 0.66% CGSolver::sxay() 288086 0.05819 0.06438 0.06947 0.63% FillPatchIterator::Initialize 889 0.03265 0.05612 0.06837 0.62% Castro::reflux() 60 0.03272 0.04853 0.05894 0.54% FabArray::FillBoundary() 157859 0.049 0.0547 0.05886 0.54% MLCellLinOp::defineAuxData() 360 0.0323 0.04322 0.05339 0.49% FillPatchSingleLevel 1617 0.02715 0.04305 0.05154 0.47% MLMG::prepareForSolve() 360 0.02968 0.04013 0.04823 0.44% amrex::average_down_w_geom 248 0.03048 0.03791 0.0448 0.41% MLCellLinOp::apply() 108875 0.03582 0.03978 0.04306 0.39% FabArrayBase::CPC::define() 4099 0.02536 0.03602 0.04142 0.38% Gravity::actual_solve_with_mlmg() 360 0.02123 0.03101 0.0412 0.38% Gravity::fill_multipole_BCs() 70 0.0281 0.03194 0.0402 0.37% Castro::expand_state() 200 0.01658 0.02991 0.03737 0.34% MultiFab::Xpay() 12217 0.02671 0.03323 0.03637 0.33% FluxRegister::Reflux() 960 0.02273 0.03106 0.03609 0.33% Castro::initialize_do_advance() 140 0.01407 0.02839 0.03468 0.32% MLMG::interpCorrection_1 771 0.02409 0.02894 0.03355 0.31% FabArrayBase::getFB() 157859 0.02472 0.02804 0.03334 0.30% FillPatchTwoLevels 756 0.02073 0.02948 0.03293 0.30% Castro::initMFs() 35 0.02002 0.02739 0.03289 0.30% MLMG::solve() 360 0.009187 0.02033 0.03167 0.29% MLCellLinOp::reflux() 951 0.02157 0.02552 0.03013 0.27% FabArrayBase::getCPC() 29651 0.02287 0.02771 0.02992 0.27% VisMF::Write(FabArray) 6 0.008453 0.01156 0.02984 0.27% Amr::writePlotFile() 2 0.00696 0.02533 0.02844 0.26% Castro::construct_new_source() 1300 0.01525 0.02424 0.02841 0.26% Gravity::get_new_grav_vector() 263 0.0147 0.02091 0.02694 0.25% Castro::enforce_min_density() 1182 0.0182 0.0222 0.02533 0.23% MLCellLinOp::updateSolBC() 871 0.01106 0.01703 0.02391 0.22% Castro::FluxRegCrseInit 140 0.01123 0.01895 0.02364 0.22% MLCellLinOp::updateCorBC() 771 0.01032 0.01629 0.02349 0.21% MultiFab::Add() 4370 0.01672 0.02055 0.02296 0.21% BndryData::define() 540 0.01093 0.01591 0.02222 0.20% Amr::coarseTimeStep() 20 0.002163 0.005431 0.02147 0.20% MultiFab::contains_nan() 280 0.01352 0.01703 0.01986 0.18% MLCellLinOp::smooth() 27488 0.01532 0.01721 0.01801 0.16% Gravity::get_old_grav_vector() 140 0.008361 0.01197 0.01782 0.16% StateData::define() 140 0.01058 0.01331 0.01593 0.15% Castro::initialize_advance() 140 0.007191 0.01231 0.01561 0.14% Castro::construct_old_source() 700 0.007632 0.01298 0.01537 0.14% Castro::FluxRegFineAdd() 140 0.00421 0.009065 0.01503 0.14% FPinfo::FPinfo() 7 0.001236 0.006517 0.01443 0.13% MLCellLinOp::setLevelBC() 450 0.007383 0.01006 0.01316 0.12% Castro::construct_old_gravity_source() 140 0.006732 0.01071 0.01308 0.12% MLPoisson::FFlux() 7882 0.007147 0.01073 0.01305 0.12% Castro::swap_state_time_levels() 140 0.004336 0.009554 0.01294 0.12% MLCellLinOp::compGrad() 450 0.00878 0.01098 0.01259 0.11% Gravity::gravity_sync() 60 0.006623 0.01049 0.01223 0.11% MLCellLinOp::defineBC() 360 0.007125 0.009581 0.01206 0.11% MultiFab::max() 90 0.003495 0.00601 0.01048 0.10% MultiFab::Copy() 1992 0.006881 0.008592 0.01041 0.09% Castro::buildMetrics() 35 0.005689 0.007304 0.009743 0.09% FabArray::ParallelCopy() 21259 0.008067 0.009069 0.009641 0.09% Gravity::solve_for_phi() 280 0.00502 0.00803 0.009215 0.08% DistributionMapping::LeastUsedCPUs() 12 0.0001072 0.004003 0.009049 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003352 0.006656 0.008823 0.08% BoxList::pci 22 0.0003818 0.005325 0.008547 0.08% Castro::init(old) 28 0.004263 0.006963 0.008271 0.08% Castro::finalize_advance() 140 0.003288 0.006136 0.00751 0.07% FabArray::mult() 1063 0.005126 0.00642 0.007461 0.07% Amr::timeStep() 140 0.00288 0.003949 0.006721 0.06% StateData::FillBoundary(geom) 745 0.00155 0.003734 0.006665 0.06% MLMG::MLRhsNormInf() 360 0.004941 0.005964 0.006638 0.06% AmrMesh::MakeNewGrids() 23 0.003191 0.005677 0.006501 0.06% Amr::regrid() 21 0.003419 0.004868 0.006394 0.06% Castro::construct_old_gravity() 140 0.003019 0.004956 0.006072 0.06% Castro::Castro() 35 0.003388 0.004564 0.005433 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.00353 0.004437 0.005406 0.05% MLCellLinOp::prepareForSolve() 360 0.002764 0.003871 0.005368 0.05% MLLinOp::defineGrids() 360 0.004353 0.004649 0.005254 0.05% FabArray::setDomainBndry() 1617 0.003201 0.004158 0.005067 0.05% Castro::construct_new_gravity() 140 0.002955 0.004128 0.004825 0.04% Gravity::applyMetricTerms() 90 0.003924 0.004382 0.004805 0.04% MLCellLinOp::correctionResidual() 9063 0.003882 0.004408 0.004799 0.04% Gravity::GetCrsePhi() 250 0.002272 0.003739 0.004738 0.04% MLMG::mgVcycle() 3385 0.00354 0.003981 0.004328 0.04% Gravity::update_max_rhs() 30 0.002633 0.003463 0.003779 0.03% FillPatchInterp(Fab) 728 0.00288 0.003413 0.003656 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.001948 0.002822 0.003461 0.03% MultiFab::Subtract() 420 0.001625 0.002513 0.00331 0.03% MLMG::oneIter() 1843 0.002474 0.002777 0.003166 0.03% MLMG:computeResOfCorrection() 6101 0.002363 0.002622 0.003067 0.03% Castro::reset_internal_energy(MultiFab) 1189 0.001605 0.002328 0.002937 0.03% MLMG::actualBottomSolve() 1843 0.002043 0.002276 0.002913 0.03% MLMG::mgVcycle_down::0 1843 0.002249 0.00242 0.002653 0.02% MLMG::MLResNormInf() 440 0.0005357 0.001376 0.002453 0.02% MLMG::mgVcycle_bottom 3385 0.001966 0.002245 0.002429 0.02% MLLinOp::makeSubCommunicator() 70 0.001401 0.001727 0.002349 0.02% MLCellLinOp::solutionResidual() 3154 0.001644 0.001817 0.002092 0.02% Castro::apply_tagging_restrictions() 34 0.001323 0.001771 0.002076 0.02% MLMG::mgVcycle_down::1 1843 0.00158 0.001803 0.002031 0.02% Castro::clean_state() 1182 0.001264 0.001661 0.001914 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.0009868 0.001541 0.001827 0.02% StateDataPhysBCFunct::() 1617 0.001255 0.001541 0.001784 0.02% Gravity::solve_phi_with_mlmg() 300 0.0009534 0.001223 0.001724 0.02% MLMG::computeResWithCrseSolFineCor() 771 0.001345 0.001474 0.001671 0.02% ClusterList::chop() 4 0 0.0002082 0.001666 0.02% MLMG::mgVcycle_up::1 1843 0.001428 0.001555 0.001611 0.01% MLMG::mgVcycle_up::0 1843 0.001349 0.001463 0.001553 0.01% AMRErrorTag::operator() 34 0.001023 0.001307 0.001536 0.01% FabArrayBase::TheFPinfo() 728 0.0006532 0.001105 0.001341 0.01% MLMG::computeResidual() 1843 0.00102 0.001123 0.001204 0.01% TagBoxArray::collate() 34 0.0008227 0.0009731 0.001196 0.01% Gravity::actual_multilevel_solve() 20 0.0006014 0.0009863 0.001181 0.01% Castro::build_fine_mask() 100 0.0007808 0.000967 0.001105 0.01% MLPoisson::define() 360 0.0007895 0.0009306 0.001039 0.01% main() 1 0.0007005 0.0007569 0.0008507 0.01% MLMG::computeResWithCrseCorFineCor() 771 0.0006751 0.0007594 0.0008382 0.01% Castro::do_new_sources() 260 0.0005398 0.0007335 0.0008145 0.01% Castro::finalize_do_advance() 140 0.0003541 0.0006032 0.0008028 0.01% Castro::derive() 34 0.0005314 0.0006464 0.0007654 0.01% FabArrayBase::FB::FB() 299 0.0001965 0.0004465 0.000722 0.01% Amr::InitAmr() 1 0.0003105 0.0004403 0.0006771 0.01% Castro::apply_source_to_state() 520 0.0003779 0.000518 0.0006763 0.01% MLMG::computeMLResidual() 440 0.00048 0.0005798 0.0006238 0.01% ClusterList::intersect() 4 0 7.56e-05 0.0006048 0.01% Amr::grid_places() 23 0.0003011 0.0003681 0.0005948 0.01% MLMG::miniCycle() 1542 0.0004882 0.0005213 0.0005786 0.01% MLMG::mgVcycle_down::2 483 0.0004878 0.0005153 0.0005634 0.01% Castro::subcycle_advance_ctu() 140 0.0003119 0.0004614 0.0005619 0.01% MLMG::mgVcycle_down::3 483 0.0003921 0.0004542 0.0005141 0.00% Castro::enforce_speed_limit() 1182 0.0003191 0.0004342 0.0004939 0.00% MLMG::mgVcycle_down::4 483 0.0003668 0.0004307 0.0004919 0.00% MLMG::mgVcycle_down::6 483 0.0004134 0.0004656 0.0004907 0.00% Castro::advance() 140 0.0003238 0.0004365 0.0004902 0.00% Castro::do_old_sources() 140 0.0003023 0.0004019 0.0004557 0.00% MLMG::mgVcycle_down::5 483 0.000348 0.0003954 0.000444 0.00% MLLinOp::define() 360 0.0002988 0.0003712 0.00044 0.00% Gravity::swapTimeLevels() 140 0.0001814 0.0003122 0.0003867 0.00% AmrMesh-cluster 4 0 4.6e-05 0.000368 0.00% MLPoisson::prepareForSolve() 360 0.0003255 0.0003417 0.0003675 0.00% MLMG::mgVcycle_up::6 483 0.0002858 0.0003236 0.0003665 0.00% MultiFab::Multiply() 40 0.0002248 0.000299 0.0003546 0.00% MLMG::mgVcycle_up::3 483 0.0002317 0.0002836 0.0003225 0.00% MLMG::mgVcycle_up::2 483 0.0002725 0.0002998 0.0003201 0.00% MLMG::mgVcycle_up::5 483 0.0002545 0.0002842 0.0003099 0.00% MLMG::getGradSolution() 360 0.0002504 0.0002768 0.0003022 0.00% MLMG::mgVcycle_up::4 483 0.000244 0.000267 0.0002832 0.00% makeSFC 350 0.0002157 0.0002378 0.0002761 0.00% Castro::post_timestep() 140 0.0001507 0.0002183 0.0002575 0.00% AmrLevel::AmrLevel(dm) 35 0.0002025 0.0002273 0.0002574 0.00% TagBoxArray::mapPRD 34 0.0001892 0.0002113 0.0002356 0.00% OwnerMask() 34 0.0001683 0.0001939 0.0002252 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001667 0.0001884 0.0002248 0.00% DistributionMapping::Distribute() 355 0.0001367 0.0001803 0.0002234 0.00% Castro::post_regrid() 66 0.0001357 0.000184 0.0002198 0.00% Castro::avgDown(state_indx) 248 0.0001315 0.0001794 0.0002107 0.00% Castro::check_for_nan() 280 0.0001637 0.0001784 0.0001903 0.00% Castro::enforce_consistent_e() 7 7.634e-05 0.0001273 0.0001796 0.00% Amr::FinalizeInit() 1 3.807e-06 2.088e-05 0.0001352 0.00% FabArray::RecvLayoutMask() 90 9.001e-05 0.0001066 0.0001255 0.00% Gravity::solve_for_delta_phi 60 9.605e-05 0.0001063 0.0001195 0.00% knapsack() 7 0.000103 0.0001073 0.0001122 0.00% Castro::create_source_corrector() 140 5.619e-05 8.214e-05 9.79e-05 0.00% Castro::avgDown() 62 6.338e-05 7.938e-05 9.591e-05 0.00% BoxList::complementIn 574 7.016e-05 7.768e-05 8.901e-05 0.00% Castro::errorEst() 34 6.966e-05 7.536e-05 8.034e-05 0.00% Amr::writeSmallPlotFile() 1 3.057e-05 5.003e-05 7.916e-05 0.00% Castro::computeNewDt() 28 4.226e-05 5.469e-05 7.138e-05 0.00% Castro::retry_advance_ctu() 140 3.759e-05 3.945e-05 4.549e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 3.021e-05 3.304e-05 3.892e-05 0.00% Amr::defBaseLevel() 1 1.954e-05 2.453e-05 3.686e-05 0.00% Amr::bldFineLevels() 1 2.432e-05 3.191e-05 3.618e-05 0.00% Gravity::set_mass_offset() 21 1.447e-05 2.436e-05 2.858e-05 0.00% BoxList::parallelComplementIn() 57 2.277e-05 2.436e-05 2.756e-05 0.00% DistributionMapping::KnapSackDoIt() 7 1.972e-05 2.232e-05 2.676e-05 0.00% Castro::apply_problem_tags() 34 1.471e-05 1.754e-05 1.907e-05 0.00% Amr::initSubcycle() 1 9.011e-06 1.248e-05 1.528e-05 0.00% Castro::post_init() 3 8.557e-06 9.356e-06 1.049e-05 0.00% Castro::computeInitialDt() 2 3.394e-06 4.76e-06 1.045e-05 0.00% Amr::InitializeInit() 1 2.137e-06 3.27e-06 7.151e-06 0.00% Amr::initialInit() 1 1.252e-06 1.976e-06 6.06e-06 0.00% Amr::init() 1 1.541e-06 1.752e-06 1.912e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.96 10.96 10.96 100.00% Amr::coarseTimeStep() 20 10.71 10.71 10.71 97.74% Amr::timeStep() 140 10.68 10.69 10.69 97.58% Castro::advance() 140 7.881 7.885 7.887 71.96% Castro::subcycle_advance_ctu() 140 7.636 7.676 7.729 70.52% Castro::do_advance_ctu() 140 7.635 7.676 7.729 70.52% Gravity::actual_solve_with_mlmg() 360 5.761 5.768 5.779 52.73% MLMG::solve() 360 5.571 5.581 5.594 51.04% MLMG::oneIter() 1843 5.168 5.2 5.218 47.61% MLMG::mgVcycle() 3385 4.768 4.818 4.854 44.29% Gravity::solve_phi_with_mlmg() 300 4.352 4.368 4.398 40.12% Gravity::solve_for_phi() 280 3.682 3.698 3.722 33.96% MLMG::mgVcycle_bottom 3385 3.275 3.293 3.316 30.26% Castro::construct_new_gravity() 140 2.947 2.951 2.958 26.99% MLMG::actualBottomSolve() 1843 2.895 2.903 2.922 26.66% MLCGSolver::bicgstab 1420 2.892 2.899 2.917 26.62% Castro::construct_ctu_hydro_source() 140 1.949 2.294 2.552 23.28% Castro::post_timestep() 140 2.006 2.022 2.028 18.50% Castro::reflux() 60 1.863 1.895 1.913 17.46% MLCellLinOp::applyBC() 165252 1.41 1.624 1.807 16.48% MLCellLinOp::smooth() 27488 1.515 1.572 1.619 14.77% FabArray::FillBoundary() 157859 1.133 1.362 1.582 14.44% MLCGSolver::ParallelAllReduce 243542 0.9693 1.199 1.563 14.26% Gravity::gravity_sync() 60 1.544 1.544 1.544 14.09% Gravity::solve_for_delta_phi 60 1.465 1.465 1.466 13.37% MLCellLinOp::apply() 108875 1.129 1.304 1.435 13.09% FabArray::ParallelCopy() 21259 0.6217 0.7883 1.152 10.51% MLPoisson::Fsmooth() 54976 0.7678 0.9229 1.026 9.36% FabArray::ParallelCopy_finish() 21259 0.3512 0.52 0.9399 8.58% Castro::construct_old_gravity() 140 0.8849 0.8953 0.9169 8.37% Amr::regrid() 21 0.8366 0.8442 0.857 7.82% FillBoundary_finish() 157859 0.4366 0.6057 0.8474 7.73% FillBoundary_nowait() 157859 0.5734 0.7017 0.786 7.17% FillPatchIterator::Initialize 889 0.5214 0.5972 0.7019 6.40% Gravity::multilevel_solve_for_new_phi() 20 0.6875 0.6895 0.6915 6.31% Gravity::actual_multilevel_solve() 20 0.6857 0.6879 0.6905 6.30% Castro::post_regrid() 66 0.6485 0.6537 0.6564 5.99% FillPatchTwoLevels 756 0.4401 0.5133 0.6261 5.71% MLMG::mgVcycle_down::0 1843 0.4631 0.4892 0.5074 4.63% FillPatchSingleLevel 1617 0.2652 0.344 0.494 4.51% MLMG::mgVcycle_up::0 1843 0.4439 0.458 0.466 4.25% Castro::clean_state() 1182 0.3541 0.4139 0.4539 4.14% MLMG::miniCycle() 1542 0.3668 0.3909 0.4063 3.71% Castro::initialize_do_advance() 140 0.3309 0.3518 0.374 3.41% Castro::expand_state() 200 0.2765 0.3071 0.3482 3.18% MLPoisson::Fapply() 108875 0.236 0.2971 0.3241 2.96% CGSolver::sxay() 288086 0.2053 0.2696 0.3123 2.85% MLCellLinOp::correctionResidual() 9063 0.2639 0.2884 0.3082 2.81% Castro::do_new_sources() 260 0.2 0.2597 0.2922 2.67% FabArray::ParallelCopy_nowait() 21259 0.2037 0.2592 0.2839 2.59% Castro::computeTemp() 1189 0.2113 0.2466 0.2672 2.44% FabArray::setVal() 27514 0.1374 0.2044 0.2545 2.32% MultiFab::LinComb() 288206 0.1485 0.2073 0.2469 2.25% Castro::estTimeStep() 308 0.1187 0.1739 0.242 2.21% MLMG::mgVcycle_down::1 1843 0.2151 0.2237 0.2374 2.17% MLCellLinOp::solutionResidual() 3154 0.2069 0.224 0.2356 2.15% Amr::init() 1 0.2276 0.2279 0.2281 2.08% MultiFab::Dot() 193316 0.1484 0.1926 0.2167 1.98% Amr::initialInit() 1 0.2097 0.2099 0.2101 1.92% Amr::FinalizeInit() 1 0.1921 0.1977 0.2026 1.85% Castro::initialize_advance() 140 0.1181 0.1615 0.197 1.80% MLMG::computeResWithCrseSolFineCor() 771 0.1531 0.175 0.1938 1.77% Castro::reset_internal_energy(MultiFab) 1189 0.1494 0.1756 0.1887 1.72% Castro::reset_internal_energy(Fab) 5919 0.1478 0.1733 0.1857 1.69% MLMG::mgVcycle_up::1 1843 0.1668 0.1755 0.1806 1.65% amrex::average_down 8093 0.1182 0.1438 0.1713 1.56% Castro::normalize_species() 1182 0.1249 0.1446 0.1603 1.46% Castro::construct_new_source() 1300 0.1056 0.1381 0.1542 1.41% MLMG::addInterpCorrection() 6101 0.09263 0.1274 0.1504 1.37% MLMG::computeResidual() 1843 0.1185 0.1324 0.1391 1.27% MLMG:computeResOfCorrection() 6101 0.128 0.1297 0.1325 1.21% Castro::do_old_sources() 140 0.08279 0.1121 0.1307 1.19% Castro::avgDown() 62 0.06476 0.09119 0.1302 1.19% Castro::avgDown(state_indx) 248 0.06468 0.09111 0.1301 1.19% amrex::average_down_w_geom 248 0.06448 0.09093 0.13 1.19% MLPoisson::normalize() 98078 0.0889 0.114 0.1236 1.13% MLPoisson::define() 360 0.06988 0.09249 0.1138 1.04% Amr::bldFineLevels() 1 0.09849 0.1055 0.1133 1.03% MLMG::mgVcycle_up::2 483 0.02716 0.06084 0.111 1.01% Gravity::get_new_grav_vector() 263 0.1028 0.1056 0.1107 1.01% MLMG::ResNormInf() 2383 0.05805 0.08197 0.1086 0.99% MLMG::computeResWithCrseCorFineCor() 771 0.08651 0.09722 0.1019 0.93% Castro::post_init() 3 0.07687 0.08513 0.09241 0.84% MLCellLinOp::reflux() 951 0.06991 0.08167 0.09212 0.84% Castro::construct_new_gravity_source() 260 0.06282 0.0793 0.08892 0.81% Castro::init(old) 28 0.0509 0.06433 0.08262 0.75% MLMG::computeMLResidual() 440 0.05556 0.06745 0.082 0.75% Castro::initData() 7 0.04835 0.06693 0.08078 0.74% MultiFab::Saxpy() 1180 0.04732 0.06747 0.0772 0.70% FillPatchInterp(Fab) 728 0.06887 0.0735 0.076 0.69% MLMG::prepareForSolve() 360 0.0681 0.07108 0.07563 0.69% MLCellLinOp::setLevelBC() 450 0.02545 0.04623 0.0746 0.68% CellConservativeLinear::interp() 9059 0.06599 0.07009 0.07254 0.66% Gravity::get_old_grav_vector() 140 0.06753 0.06912 0.07201 0.66% FabArrayBase::getCPC() 29651 0.04824 0.06373 0.0708 0.65% FluxRegister::Reflux() 960 0.05507 0.06145 0.06824 0.62% MLCellLinOp::defineAuxData() 360 0.04006 0.05426 0.06603 0.60% MLMG::mgVcycle_up::3 483 0.003979 0.02896 0.06594 0.60% MLCellLinOp::updateCorBC() 771 0.04722 0.05566 0.0645 0.59% MLCellLinOp::updateSolBC() 871 0.04541 0.05585 0.06294 0.57% Gravity::GetCrsePhi() 250 0.01806 0.04035 0.06269 0.57% Castro::Castro() 35 0.03465 0.04921 0.06035 0.55% MLMG::interpCorrection_1 771 0.03838 0.048 0.06011 0.55% Castro::finalize_advance() 140 0.03856 0.04655 0.05268 0.48% Amr::grid_places() 23 0.0266 0.03543 0.04741 0.43% AmrMesh::MakeNewGrids() 23 0.02626 0.03506 0.04708 0.43% Castro::apply_source_to_state() 520 0.02362 0.03704 0.04377 0.40% FabArrayBase::CPC::define() 4099 0.02536 0.03602 0.04142 0.38% Castro::construct_old_source() 700 0.02328 0.03519 0.04109 0.37% Gravity::fill_multipole_BCs() 70 0.02877 0.03256 0.04071 0.37% MLCellLinOp::defineBC() 360 0.02079 0.02995 0.04003 0.37% Amr::writePlotFile() 2 0.0368 0.0369 0.03694 0.34% MultiFab::Xpay() 12217 0.02671 0.03323 0.03637 0.33% FabArrayBase::getFB() 157859 0.02495 0.02849 0.03406 0.31% MLMG::mgVcycle_down::6 483 0.004934 0.009341 0.03402 0.31% MLMG::mgVcycle_up::6 483 0.004552 0.008723 0.03353 0.31% Castro::initMFs() 35 0.02002 0.02739 0.03289 0.30% MLMG::mgVcycle_down::2 483 0.03022 0.03127 0.03244 0.30% Castro::FluxRegCrseInit 140 0.0301 0.03135 0.03173 0.29% VisMF::Write(FabArray) 6 0.008453 0.01156 0.02984 0.27% Castro::errorEst() 34 0.009956 0.02022 0.02949 0.27% BndryData::define() 540 0.01335 0.01998 0.02748 0.25% Castro::derive() 34 0.007178 0.01705 0.02633 0.24% Castro::enforce_min_density() 1182 0.0182 0.0222 0.02533 0.23% Castro::computeNewDt() 28 0.02034 0.02172 0.023 0.21% MultiFab::Add() 4370 0.01672 0.02055 0.02296 0.21% MLMG::mgVcycle_down::3 483 0.005526 0.01347 0.02274 0.21% Castro::check_for_nan() 280 0.01368 0.0172 0.02003 0.18% MLMG::getGradSolution() 360 0.01449 0.0173 0.02 0.18% MultiFab::contains_nan() 280 0.01352 0.01703 0.01986 0.18% MLCellLinOp::compGrad() 450 0.01424 0.01703 0.01974 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01686 0.01771 0.01894 0.17% Gravity::update_max_rhs() 30 0.01316 0.0149 0.01794 0.16% Amr::InitializeInit() 1 0.007425 0.01221 0.01762 0.16% Amr::defBaseLevel() 1 0.007422 0.0122 0.01761 0.16% AmrLevel::AmrLevel(dm) 35 0.0108 0.01354 0.01616 0.15% FabArrayBase::TheFPinfo() 728 0.002609 0.007823 0.01597 0.15% StateData::define() 140 0.01058 0.01331 0.01593 0.15% Castro::FluxRegFineAdd() 140 0.00421 0.009065 0.01503 0.14% FPinfo::FPinfo() 7 0.001443 0.006718 0.01463 0.13% Castro::construct_old_gravity_source() 140 0.006732 0.01071 0.01308 0.12% MLPoisson::FFlux() 7882 0.007147 0.01073 0.01305 0.12% Castro::swap_state_time_levels() 140 0.004336 0.009554 0.01294 0.12% Castro::computeInitialDt() 2 0.001119 0.006668 0.01161 0.11% MLMG::mgVcycle_down::4 483 0.00504 0.006458 0.01159 0.11% MLMG::MLResNormInf() 440 0.007932 0.009022 0.01049 0.10% MultiFab::max() 90 0.003495 0.00601 0.01048 0.10% MultiFab::Copy() 1992 0.006881 0.008592 0.01041 0.09% Castro::buildMetrics() 35 0.005791 0.007432 0.009883 0.09% MLMG::mgVcycle_up::4 483 0.003999 0.005007 0.009291 0.08% DistributionMapping::LeastUsedCPUs() 12 0.0001072 0.004003 0.009049 0.08% DistributionMapping::SFCProcessorMapDoIt() 5 8.272e-05 0.003977 0.009007 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003352 0.006656 0.008823 0.08% BoxList::parallelComplementIn() 57 0.0004164 0.005362 0.008583 0.08% BoxList::pci 22 0.0003818 0.005325 0.008547 0.08% StateDataPhysBCFunct::() 1617 0.003041 0.005275 0.008376 0.08% MLMG::mgVcycle_down::5 483 0.004897 0.005784 0.008324 0.08% MLLinOp::define() 360 0.006853 0.007341 0.008149 0.07% MLLinOp::defineGrids() 360 0.006504 0.00697 0.007809 0.07% FabArray::mult() 1063 0.005126 0.00642 0.007461 0.07% MLMG::mgVcycle_up::5 483 0.004114 0.004846 0.006977 0.06% StateData::FillBoundary(geom) 745 0.00155 0.003734 0.006665 0.06% MLMG::MLRhsNormInf() 360 0.004941 0.005964 0.006638 0.06% MLPoisson::prepareForSolve() 360 0.003129 0.004213 0.005707 0.05% MLCellLinOp::prepareForSolve() 360 0.002764 0.003871 0.005368 0.05% FabArray::setDomainBndry() 1617 0.003201 0.004158 0.005067 0.05% Gravity::applyMetricTerms() 90 0.003924 0.004382 0.004805 0.04% Gravity::swapTimeLevels() 140 0.003237 0.004075 0.004594 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002504 0.003538 0.004263 0.04% TagBoxArray::mapPRD 34 0.001392 0.002356 0.003721 0.03% MultiFab::Subtract() 420 0.001625 0.002513 0.00331 0.03% AmrMesh-cluster 4 0 0.0003298 0.002639 0.02% MLLinOp::makeSubCommunicator() 70 0.001401 0.001727 0.002349 0.02% Castro::apply_tagging_restrictions() 34 0.001323 0.001771 0.002076 0.02% ClusterList::chop() 4 0 0.0002082 0.001666 0.02% AMRErrorTag::operator() 34 0.001023 0.001307 0.001536 0.01% TagBoxArray::collate() 34 0.0008227 0.0009731 0.001196 0.01% Castro::build_fine_mask() 100 0.0007808 0.000967 0.001105 0.01% Castro::finalize_do_advance() 140 0.0003541 0.0006032 0.0008028 0.01% FabArrayBase::FB::FB() 299 0.0001965 0.0004465 0.000722 0.01% Amr::InitAmr() 1 0.0003195 0.0004528 0.0006924 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005191 0.0005939 0.0006841 0.01% ClusterList::intersect() 4 0 7.56e-05 0.0006048 0.01% Castro::enforce_speed_limit() 1182 0.0003191 0.0004342 0.0004939 0.00% makeSFC 350 0.0003455 0.0004054 0.00049 0.00% MultiFab::Multiply() 40 0.0002248 0.000299 0.0003546 0.00% OwnerMask() 34 0.0001683 0.0001939 0.0002252 0.00% DistributionMapping::Distribute() 355 0.0001367 0.0001803 0.0002234 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001908 0.0002011 0.0002119 0.00% Castro::enforce_consistent_e() 7 7.634e-05 0.0001273 0.0001796 0.00% FabArray::RecvLayoutMask() 90 9.001e-05 0.0001066 0.0001255 0.00% knapsack() 7 0.000103 0.0001073 0.0001122 0.00% Castro::create_source_corrector() 140 5.619e-05 8.214e-05 9.79e-05 0.00% BoxList::complementIn 574 7.016e-05 7.768e-05 8.901e-05 0.00% Amr::writeSmallPlotFile() 1 3.057e-05 5.003e-05 7.916e-05 0.00% Castro::retry_advance_ctu() 140 3.759e-05 3.945e-05 4.549e-05 0.00% Gravity::set_mass_offset() 21 1.447e-05 2.436e-05 2.858e-05 0.00% Castro::apply_problem_tags() 34 1.471e-05 1.754e-05 1.907e-05 0.00% Amr::initSubcycle() 1 9.011e-06 1.248e-05 1.528e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.11-14-ge0afc82f63ce) finalized