MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.05-25-g0540fed3576f) initialized Starting run at 05:37:10 UTC on 2022-05-23. Successfully read inputs file ... Castro git describe: 22.05-29-gf507f242f AMReX git describe: 22.05-25-g0540fed35 Microphysics git describe: 22.05-1-g39742967 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001250449 new finest: 1 grid_places() time: 0.005502298 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.008810033 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.007256934 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.015042535 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.482869275 [STEP 1] FAB kilobyte spread across MPI nodes: [18072 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000552675 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.516900033 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.00084117 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.53089544 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000536482 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.535384666 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000882655 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.522749636 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.00056886 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.514718178 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000841322 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.529713746 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000560296 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.525015818 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000865411 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.531956137 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000555189 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.52518819 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000842036 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.534600254 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000560316 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.527639964 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.00082184 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.535006642 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000563578 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.529356583 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000848637 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.537824066 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.00055771 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.526920874 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.00083421 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.532595381 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000602192 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.527234982 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000818347 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.533180874 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.0005493 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.52822176 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.015131551 seconds Ending run at 05:37:20 UTC on 2022-05-23. Run time = 10.72406671 Run time without initialization = 10.54642492 Average number of zones advanced per microsecond: 0.836 Average number of zones advanced per microsecond per rank: 0.104 TinyProfiler total time across processes [min...avg...max]: 10.72 ... 10.72 ... 10.72 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.8876 2.2079 2.4765 23.09% MLCGSolver::ParallelAllReduce 243542 0.9027 1.146 1.512 14.10% MLPoisson::Fsmooth() 54976 0.7515 0.9218 1.048 9.77% FabArray::ParallelCopy_finish() 21119 0.324 0.5188 0.9747 9.09% FillBoundary_finish() 157859 0.4333 0.6476 0.9381 8.75% Castro::do_advance_ctu() 140 0.3139 0.5892 0.9045 8.43% FillBoundary_nowait() 157859 0.5069 0.6497 0.754 7.03% MLCellLinOp::applyBC() 165252 0.1973 0.2978 0.391 3.65% MLPoisson::Fapply() 108875 0.2296 0.2948 0.3327 3.10% MLCGSolver::bicgstab 1420 0.188 0.236 0.2604 2.43% FabArray::setVal() 27604 0.1235 0.1937 0.2442 2.28% MultiFab::LinComb() 288336 0.15 0.2068 0.2437 2.27% MultiFab::Dot() 193316 0.1471 0.1906 0.2157 2.01% FabArray::ParallelCopy_nowait() 21119 0.1457 0.1894 0.2116 1.97% Castro::reset_internal_energy(Fab) 5919 0.1455 0.1736 0.1941 1.81% Castro::normalize_species() 1182 0.1196 0.1443 0.1626 1.52% Castro::estTimeStep() 228 0.07122 0.09833 0.1389 1.30% MLPoisson::normalize() 98078 0.08707 0.1136 0.1289 1.20% MLMG::ResNormInf() 2383 0.05498 0.08079 0.1126 1.05% Castro::construct_new_gravity_source() 260 0.06095 0.07948 0.08943 0.83% MultiFab::Saxpy() 1180 0.04888 0.06829 0.07894 0.74% Castro::computeTemp() 1189 0.0607 0.07078 0.07858 0.73% amrex::average_down 8093 0.05601 0.06903 0.0767 0.72% CellConservativeLinear::interp() 8794 0.06294 0.06769 0.06993 0.65% CGSolver::sxay() 288086 0.05333 0.06134 0.06525 0.61% MLMG::addInterpCorrection() 6101 0.04295 0.05335 0.06033 0.56% FillPatchIterator::Initialize 829 0.03047 0.05047 0.06028 0.56% Castro::initData() 7 0.05 0.05343 0.05815 0.54% FabArray::FillBoundary() 157859 0.04674 0.05196 0.05586 0.52% MLCellLinOp::defineAuxData() 360 0.03084 0.04223 0.0525 0.49% Castro::reflux() 60 0.02815 0.04261 0.05211 0.49% amrex::average_down_w_geom 248 0.03086 0.04008 0.04747 0.44% MLMG::prepareForSolve() 360 0.02674 0.0378 0.04648 0.43% FillPatchSingleLevel 1517 0.02363 0.036 0.04377 0.41% MLCellLinOp::apply() 108875 0.03473 0.03906 0.04148 0.39% FabArrayBase::CPC::define() 4019 0.02445 0.0348 0.04069 0.38% FluxRegister::Reflux() 960 0.02385 0.03347 0.03957 0.37% Gravity::fill_multipole_BCs() 70 0.02843 0.03216 0.0394 0.37% Gravity::actual_solve_with_mlmg() 360 0.01832 0.02793 0.03788 0.35% Castro::initialize_do_advance() 140 0.01369 0.02836 0.03652 0.34% MultiFab::Xpay() 12217 0.0253 0.03255 0.03568 0.33% MLCellLinOp::reflux() 951 0.02539 0.02886 0.03362 0.31% MLMG::solve() 360 0.009946 0.0209 0.0328 0.31% MLMG::interpCorrection_1 771 0.02188 0.02689 0.03159 0.29% Castro::initMFs() 35 0.01589 0.02472 0.03125 0.29% Castro::expand_state() 140 0.01448 0.02541 0.03107 0.29% FillPatchTwoLevels 716 0.02074 0.02797 0.03099 0.29% FabArrayBase::getCPC() 29601 0.0226 0.02761 0.02979 0.28% FabArrayBase::getFB() 157859 0.02483 0.02747 0.02942 0.27% Castro::construct_new_source() 1300 0.01602 0.02466 0.02878 0.27% Gravity::get_new_grav_vector() 263 0.01462 0.02063 0.02691 0.25% MLMG::oneIter() 1843 0.01877 0.02343 0.02576 0.24% Castro::enforce_min_density() 1182 0.01749 0.02201 0.02523 0.24% VisMF::Write(FabArray) 6 0.007476 0.01012 0.02461 0.23% Amr::coarseTimeStep() 20 0.002071 0.005983 0.02442 0.23% Castro::FluxRegCrseInit 140 0.01172 0.01947 0.02402 0.22% MLCellLinOp::updateSolBC() 871 0.01079 0.01677 0.02399 0.22% Amr::writePlotFile() 2 0.006496 0.02106 0.02375 0.22% MLCellLinOp::updateCorBC() 771 0.01012 0.01586 0.02297 0.21% MultiFab::contains_nan() 280 0.01397 0.0179 0.02239 0.21% BndryData::define() 540 0.01051 0.01588 0.02217 0.21% Gravity::get_old_grav_vector() 140 0.008 0.0118 0.01785 0.17% MLCellLinOp::smooth() 27488 0.01466 0.0162 0.01704 0.16% Castro::initialize_advance() 140 0.007278 0.01215 0.0158 0.15% Castro::construct_old_source() 700 0.00813 0.01314 0.01548 0.14% StateData::define() 140 0.008507 0.01201 0.01483 0.14% MLPoisson::FFlux() 7882 0.007282 0.01067 0.01374 0.13% Castro::construct_old_gravity_source() 140 0.00668 0.01085 0.01317 0.12% MLCellLinOp::setLevelBC() 450 0.006998 0.01001 0.01309 0.12% Castro::swap_state_time_levels() 140 0.005435 0.009321 0.01264 0.12% Castro::FluxRegFineAdd() 140 0.004267 0.008596 0.01248 0.12% MLCellLinOp::compGrad() 450 0.008652 0.01073 0.01244 0.12% MLCellLinOp::defineBC() 360 0.006913 0.009649 0.01226 0.11% Gravity::gravity_sync() 60 0.006547 0.0104 0.01206 0.11% MultiFab::max() 90 0.003814 0.006009 0.01106 0.10% Castro::buildMetrics() 35 0.004553 0.006665 0.009686 0.09% FabArray::ParallelCopy() 21119 0.007952 0.008751 0.009352 0.09% FPinfo::FPinfo() 7 0.00126 0.004849 0.008964 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003369 0.006819 0.008942 0.08% Gravity::solve_for_phi() 280 0.004767 0.007157 0.008674 0.08% Castro::init(old) 28 0.004474 0.007027 0.008204 0.08% Amr::timeStep() 140 0.002889 0.004181 0.007729 0.07% Amr::regrid() 21 0.002758 0.00468 0.00645 0.06% StateData::FillBoundary(geom) 685 0.001195 0.00319 0.006017 0.06% AmrMesh::MakeNewGrids() 23 0.003078 0.00536 0.00599 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0002949 0.002506 0.005741 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003641 0.004519 0.005619 0.05% FabArray::mult() 1063 0.003493 0.004706 0.005583 0.05% Castro::construct_old_gravity() 140 0.002906 0.004612 0.005502 0.05% MLLinOp::defineGrids() 360 0.004446 0.004899 0.005301 0.05% MLMG::MLRhsNormInf() 360 0.003802 0.004639 0.005158 0.05% MLCellLinOp::prepareForSolve() 360 0.002508 0.003712 0.005136 0.05% Castro::construct_new_gravity() 140 0.003104 0.004201 0.005037 0.05% Castro::Castro() 35 0.002873 0.004344 0.00503 0.05% MultiFab::norm0(mask) 270 0.002846 0.004073 0.004963 0.05% Gravity::applyMetricTerms() 90 0.003635 0.004384 0.004841 0.05% BoxList::pci 22 0.000369 0.003119 0.004557 0.04% FabArray::setDomainBndry() 1517 0.002902 0.003823 0.004545 0.04% MLCellLinOp::correctionResidual() 9063 0.003753 0.004199 0.00452 0.04% MLMG::mgVcycle() 3385 0.003869 0.004134 0.004343 0.04% Gravity::update_max_rhs() 30 0.002614 0.003493 0.003964 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.002679 0.003289 0.003874 0.04% Gravity::GetCrsePhi() 250 0.001716 0.002756 0.003682 0.03% MLMG::actualBottomSolve() 1843 0.002521 0.002802 0.003575 0.03% MLMG::computeResWithCrseCorFineCor() 771 0.002231 0.002852 0.003483 0.03% FillPatchInterp(Fab) 688 0.002906 0.003213 0.003444 0.03% MultiFab::Subtract() 420 0.001714 0.002649 0.00343 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.001853 0.002775 0.003316 0.03% MLMG::MLResNormInf() 440 0.0008946 0.001736 0.003103 0.03% Castro::reset_internal_energy(MultiFab) 1189 0.001561 0.002216 0.002823 0.03% MultiFab::Copy() 450 0.001492 0.002106 0.002602 0.02% MLLinOp::makeSubCommunicator() 70 0.001476 0.001947 0.002571 0.02% MLMG:computeResOfCorrection() 6101 0.001888 0.002137 0.002306 0.02% MLMG::mgVcycle_down::0 1843 0.001902 0.002088 0.002184 0.02% Castro::apply_tagging_restrictions() 34 0.001323 0.00165 0.001971 0.02% MLCellLinOp::solutionResidual() 3154 0.001565 0.0018 0.001948 0.02% MLMG::mgVcycle_bottom 3385 0.001596 0.001788 0.00189 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.0009867 0.001549 0.001885 0.02% Castro::clean_state() 1182 0.001292 0.001628 0.001855 0.02% MLMG::mgVcycle_down::1 1843 0.001408 0.001568 0.001628 0.02% StateDataPhysBCFunct::() 1517 0.001307 0.001475 0.001623 0.02% Castro::finalize_advance() 140 0.0007726 0.001197 0.001609 0.02% Gravity::solve_phi_with_mlmg() 300 0.000766 0.001103 0.001527 0.01% ClusterList::chop() 4 0 0.0001887 0.001509 0.01% TagBoxArray::collate() 34 0.000613 0.0009245 0.001477 0.01% MLMG::mgVcycle_up::1 1843 0.001226 0.001359 0.001423 0.01% AMRErrorTag::operator() 34 0.0009486 0.001171 0.001379 0.01% MLMG::mgVcycle_up::0 1843 0.001046 0.001169 0.001234 0.01% Gravity::actual_multilevel_solve() 20 0.0006152 0.0009866 0.001165 0.01% MLMG::buildFineMask() 360 0.0008179 0.001017 0.001151 0.01% Castro::build_fine_mask() 100 0.0007489 0.0009784 0.001149 0.01% FabArrayBase::TheFPinfo() 688 0.0006004 0.0009071 0.001076 0.01% MLPoisson::define() 360 0.0006545 0.0008366 0.0009842 0.01% Castro::finalize_do_advance() 140 0.0004319 0.0006037 0.0008454 0.01% MLMG::computeResidual() 1843 0.0006999 0.0007763 0.0008112 0.01% main() 1 0.0006241 0.0007179 0.0007883 0.01% Castro::do_new_sources() 260 0.0005377 0.0007044 0.0007843 0.01% Amr::grid_places() 23 0.0003076 0.0003952 0.0006966 0.01% FabArrayBase::FB::FB() 299 0.0001762 0.0004371 0.0006761 0.01% Castro::derive() 34 0.0004429 0.0005576 0.0006587 0.01% Castro::apply_source_to_state() 520 0.0003782 0.0005204 0.0005959 0.01% Castro::subcycle_advance_ctu() 140 0.000331 0.000484 0.0005683 0.01% MLMG::miniCycle() 1542 0.0004838 0.0005276 0.000563 0.01% ClusterList::intersect() 4 0 6.879e-05 0.0005503 0.01% Castro::enforce_speed_limit() 1182 0.0002931 0.0004307 0.0005357 0.00% Castro::advance() 140 0.0002895 0.0004072 0.0004632 0.00% MLMG::mgVcycle_down::4 483 0.0003348 0.0003942 0.0004392 0.00% MLMG::mgVcycle_down::2 483 0.0003528 0.0003939 0.0004385 0.00% Castro::do_old_sources() 140 0.0002927 0.0003778 0.0004099 0.00% MLLinOp::define() 360 0.0002794 0.0003639 0.0004096 0.00% MLMG::mgVcycle_down::3 483 0.0003352 0.0003759 0.000409 0.00% MLMG::mgVcycle_down::6 483 0.0003153 0.0003611 0.0003871 0.00% Amr::InitAmr() 1 0.0002544 0.0002823 0.0003845 0.00% Gravity::swapTimeLevels() 140 0.0001909 0.0003024 0.0003659 0.00% MLMG::mgVcycle_down::5 483 0.000288 0.0003324 0.000361 0.00% MLMG::computeMLResidual() 440 0.0002743 0.0002955 0.0003186 0.00% MLPoisson::prepareForSolve() 360 0.0002373 0.0002747 0.0003096 0.00% AmrMesh-cluster 4 0 3.738e-05 0.000299 0.00% MLMG::mgVcycle_up::6 483 0.000241 0.000273 0.0002932 0.00% MultiFab::Multiply() 40 0.0001868 0.0002519 0.0002852 0.00% MLMG::mgVcycle_up::2 483 0.0002497 0.0002676 0.0002823 0.00% MLMG::mgVcycle_up::5 483 0.0002211 0.0002544 0.0002731 0.00% makeSFC 350 0.0002072 0.0002325 0.0002666 0.00% MLMG::mgVcycle_up::3 483 0.0002022 0.0002396 0.0002636 0.00% MLMG::mgVcycle_up::4 483 0.0002023 0.0002309 0.0002448 0.00% MLMG::getGradSolution() 360 0.0001935 0.000215 0.0002346 0.00% TagBoxArray::mapPRD 34 0.0001853 0.0002042 0.0002283 0.00% Castro::post_timestep() 140 0.000155 0.0002029 0.000227 0.00% AmrLevel::AmrLevel(dm) 35 0.0001768 0.0002015 0.0002245 0.00% OwnerMask() 34 0.0001536 0.0001825 0.0002231 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001563 0.0001805 0.0001958 0.00% Castro::check_for_nan() 280 0.0001471 0.0001648 0.0001926 0.00% Castro::avgDown(state_indx) 248 0.0001282 0.0001722 0.0001903 0.00% Castro::post_regrid() 66 0.0001167 0.0001655 0.0001847 0.00% DistributionMapping::Distribute() 355 0.0001448 0.0001712 0.0001829 0.00% FabArray::RecvLayoutMask() 90 8.852e-05 0.0001036 0.0001184 0.00% knapsack() 7 0.0001037 0.0001091 0.0001135 0.00% Gravity::solve_for_delta_phi 60 9.304e-05 9.996e-05 0.0001083 0.00% Amr::FinalizeInit() 1 3.682e-06 1.703e-05 0.0001076 0.00% Castro::create_source_corrector() 140 5.635e-05 8.174e-05 0.0001062 0.00% Castro::enforce_consistent_e() 7 7.638e-05 8.839e-05 9.748e-05 0.00% Castro::avgDown() 62 6.038e-05 7.233e-05 7.907e-05 0.00% Amr::writeSmallPlotFile() 1 3.281e-05 4.951e-05 7.597e-05 0.00% Castro::errorEst() 34 6.07e-05 6.764e-05 7.404e-05 0.00% BoxList::complementIn 574 6.101e-05 6.777e-05 7.247e-05 0.00% Castro::computeNewDt() 28 3.938e-05 4.454e-05 5.329e-05 0.00% Castro::retry_advance_ctu() 140 4.123e-05 4.625e-05 5.209e-05 0.00% Amr::defBaseLevel() 1 1.74e-05 2.339e-05 3.666e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.792e-05 3.147e-05 3.579e-05 0.00% Amr::bldFineLevels() 1 2.189e-05 2.616e-05 3.183e-05 0.00% Gravity::set_mass_offset() 21 1.265e-05 2.416e-05 3.103e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.313e-05 2.453e-05 2.812e-05 0.00% BoxList::parallelComplementIn() 57 1.854e-05 2.152e-05 2.375e-05 0.00% Castro::apply_problem_tags() 34 1.355e-05 1.633e-05 1.89e-05 0.00% Castro::post_init() 3 8.082e-06 9.148e-06 1.201e-05 0.00% Amr::initSubcycle() 1 8.211e-06 8.844e-06 9.532e-06 0.00% Amr::InitializeInit() 1 1.999e-06 3.013e-06 6.908e-06 0.00% Castro::computeInitialDt() 2 3.252e-06 4.038e-06 6.745e-06 0.00% Amr::init() 1 1.503e-06 1.728e-06 2.022e-06 0.00% Amr::initialInit() 1 9.72e-07 1.332e-06 1.733e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.72 10.72 10.72 100.00% Amr::coarseTimeStep() 20 10.53 10.53 10.53 98.19% Amr::timeStep() 140 10.49 10.51 10.52 98.06% Castro::advance() 140 7.737 7.741 7.745 72.22% Castro::subcycle_advance_ctu() 140 7.494 7.536 7.595 70.82% Castro::do_advance_ctu() 140 7.494 7.536 7.595 70.82% Gravity::actual_solve_with_mlmg() 360 5.731 5.753 5.785 53.94% MLMG::solve() 360 5.549 5.559 5.574 51.98% MLMG::oneIter() 1843 5.147 5.18 5.2 48.49% MLMG::mgVcycle() 3385 4.744 4.802 4.842 45.15% Gravity::solve_phi_with_mlmg() 300 4.341 4.377 4.435 41.36% Gravity::solve_for_phi() 280 3.683 3.716 3.77 35.16% MLMG::mgVcycle_bottom 3385 3.284 3.306 3.33 31.05% Castro::construct_new_gravity() 140 2.927 2.932 2.939 27.41% MLMG::actualBottomSolve() 1843 2.911 2.919 2.939 27.40% MLCGSolver::bicgstab 1420 2.907 2.915 2.934 27.36% Castro::construct_ctu_hydro_source() 140 1.888 2.208 2.476 23.09% Castro::post_timestep() 140 1.966 1.984 1.991 18.57% Castro::reflux() 60 1.819 1.851 1.873 17.47% MLCellLinOp::applyBC() 165252 1.387 1.613 1.78 16.59% MLCellLinOp::smooth() 27488 1.502 1.569 1.622 15.12% FabArray::FillBoundary() 157859 1.115 1.377 1.591 14.84% MLCGSolver::ParallelAllReduce 243542 1.008 1.244 1.588 14.81% Gravity::gravity_sync() 60 1.549 1.55 1.55 14.45% Gravity::solve_for_delta_phi 60 1.469 1.47 1.47 13.71% MLCellLinOp::apply() 108875 1.132 1.291 1.431 13.34% FabArray::ParallelCopy() 21119 0.5939 0.7711 1.169 10.90% MLPoisson::Fsmooth() 54976 0.7515 0.9218 1.048 9.77% Castro::construct_old_gravity() 140 0.8976 0.9309 0.9821 9.16% FabArray::ParallelCopy_finish() 21119 0.324 0.5188 0.9747 9.09% FillBoundary_finish() 157859 0.4333 0.6476 0.9381 8.75% Amr::regrid() 21 0.8268 0.8342 0.8428 7.86% FillBoundary_nowait() 157859 0.5332 0.6776 0.7827 7.30% Gravity::multilevel_solve_for_new_phi() 20 0.6764 0.6786 0.6807 6.35% Gravity::actual_multilevel_solve() 20 0.6746 0.677 0.6797 6.34% Castro::post_regrid() 66 0.6513 0.6556 0.6585 6.14% FillPatchIterator::Initialize 829 0.4776 0.5482 0.6576 6.13% FillPatchTwoLevels 716 0.4114 0.4775 0.5916 5.52% MLMG::mgVcycle_down::0 1843 0.4508 0.4807 0.5018 4.68% FillPatchSingleLevel 1517 0.2369 0.3104 0.462 4.31% Castro::clean_state() 1182 0.3452 0.4138 0.4575 4.27% MLMG::mgVcycle_up::0 1843 0.4298 0.4471 0.4557 4.25% MLMG::miniCycle() 1542 0.3599 0.3871 0.4041 3.77% Castro::initialize_do_advance() 140 0.326 0.3492 0.3749 3.50% MLPoisson::Fapply() 108875 0.2296 0.2948 0.3327 3.10% MLCellLinOp::correctionResidual() 9063 0.2601 0.2872 0.3074 2.87% CGSolver::sxay() 288086 0.2005 0.2644 0.3065 2.86% Castro::expand_state() 140 0.2255 0.256 0.2942 2.74% Castro::do_new_sources() 260 0.1959 0.258 0.2906 2.71% Castro::computeTemp() 1189 0.2077 0.2466 0.2747 2.56% FabArray::ParallelCopy_nowait() 21119 0.186 0.2435 0.2714 2.53% MLCellLinOp::solutionResidual() 3154 0.2062 0.2235 0.2506 2.34% FabArray::setVal() 27604 0.1235 0.1937 0.2442 2.28% MultiFab::LinComb() 288336 0.15 0.2068 0.2437 2.27% MLMG::mgVcycle_down::1 1843 0.2129 0.2205 0.2367 2.21% MultiFab::Dot() 193316 0.1471 0.1906 0.2157 2.01% Castro::initialize_advance() 140 0.1129 0.1631 0.2005 1.87% MLMG::computeResWithCrseSolFineCor() 771 0.1533 0.177 0.1982 1.85% Castro::reset_internal_energy(MultiFab) 1189 0.147 0.1759 0.1963 1.83% Castro::reset_internal_energy(Fab) 5919 0.1455 0.1736 0.1941 1.81% Amr::init() 1 0.1771 0.1772 0.1772 1.65% MLMG::mgVcycle_up::1 1843 0.1625 0.1714 0.1767 1.65% amrex::average_down 8093 0.1073 0.1355 0.1644 1.53% Castro::normalize_species() 1182 0.1196 0.1443 0.1626 1.52% Amr::initialInit() 1 0.1619 0.1619 0.162 1.51% Amr::FinalizeInit() 1 0.1496 0.1524 0.1551 1.45% Castro::construct_new_source() 1300 0.1019 0.1363 0.1537 1.43% Castro::estTimeStep() 228 0.07122 0.09833 0.1389 1.30% MLMG::computeResidual() 1843 0.1158 0.1311 0.1388 1.29% MLMG::addInterpCorrection() 6101 0.07882 0.1124 0.1374 1.28% MLMG:computeResOfCorrection() 6101 0.1266 0.1297 0.133 1.24% Castro::avgDown() 62 0.06382 0.08899 0.1306 1.22% Castro::avgDown(state_indx) 248 0.06375 0.08892 0.1306 1.22% amrex::average_down_w_geom 248 0.06357 0.08875 0.1304 1.22% Castro::do_old_sources() 140 0.08296 0.1124 0.1295 1.21% MLPoisson::normalize() 98078 0.08707 0.1136 0.1289 1.20% Gravity::GetCrsePhi() 250 0.02977 0.06831 0.1165 1.09% MLMG::ResNormInf() 2383 0.05754 0.08354 0.1146 1.07% MLPoisson::define() 360 0.06769 0.09195 0.114 1.06% MLCellLinOp::setLevelBC() 450 0.02574 0.05716 0.1108 1.03% Gravity::get_new_grav_vector() 263 0.1037 0.106 0.1108 1.03% MLMG::mgVcycle_up::2 483 0.02748 0.05976 0.11 1.03% MLMG::computeResWithCrseCorFineCor() 771 0.08256 0.09475 0.09971 0.93% MLCellLinOp::reflux() 951 0.07147 0.0845 0.0964 0.90% Castro::construct_new_gravity_source() 260 0.06095 0.07948 0.08943 0.83% MLMG::computeMLResidual() 440 0.05539 0.06797 0.08664 0.81% Amr::bldFineLevels() 1 0.08123 0.08419 0.08631 0.80% Castro::init(old) 28 0.05209 0.06512 0.08328 0.78% MultiFab::Saxpy() 1180 0.04888 0.06829 0.07894 0.74% FillPatchInterp(Fab) 688 0.06584 0.0709 0.07336 0.68% Gravity::get_old_grav_vector() 140 0.06634 0.06787 0.0712 0.66% MLMG::prepareForSolve() 360 0.06069 0.06789 0.07089 0.66% FabArrayBase::getCPC() 29601 0.04704 0.0624 0.07049 0.66% CellConservativeLinear::interp() 8794 0.06294 0.06769 0.06993 0.65% FluxRegister::Reflux() 960 0.05716 0.06218 0.06873 0.64% MLMG::mgVcycle_up::3 483 0.003696 0.02855 0.06778 0.63% Castro::post_init() 3 0.06208 0.0643 0.06731 0.63% MLCellLinOp::defineAuxData() 360 0.03852 0.05333 0.06535 0.61% MLCellLinOp::updateCorBC() 771 0.04639 0.05533 0.06506 0.61% MLCellLinOp::updateSolBC() 871 0.04373 0.05531 0.06445 0.60% Castro::initData() 7 0.0542 0.05766 0.06227 0.58% Castro::Castro() 35 0.02903 0.04589 0.05898 0.55% MLMG::interpCorrection_1 771 0.03664 0.04527 0.05718 0.53% Castro::finalize_advance() 140 0.03639 0.04131 0.04579 0.43% Castro::apply_source_to_state() 520 0.02484 0.0375 0.04482 0.42% Castro::construct_old_source() 700 0.02325 0.03482 0.04109 0.38% FabArrayBase::CPC::define() 4019 0.02445 0.0348 0.04069 0.38% MLCellLinOp::defineBC() 360 0.02009 0.03 0.04028 0.38% Gravity::fill_multipole_BCs() 70 0.02901 0.03271 0.03984 0.37% MultiFab::Xpay() 12217 0.0253 0.03255 0.03568 0.33% MLMG::mgVcycle_down::6 483 0.004672 0.009076 0.03356 0.31% MLMG::mgVcycle_down::2 483 0.0306 0.03191 0.03333 0.31% MLMG::mgVcycle_up::6 483 0.004019 0.008126 0.03286 0.31% Castro::FluxRegCrseInit 140 0.03044 0.03152 0.03189 0.30% Castro::initMFs() 35 0.01589 0.02472 0.03125 0.29% Amr::writePlotFile() 2 0.03111 0.03118 0.03123 0.29% FabArrayBase::getFB() 157859 0.02538 0.02791 0.03002 0.28% Amr::grid_places() 23 0.0234 0.02757 0.02987 0.28% AmrMesh::MakeNewGrids() 23 0.02305 0.02718 0.02955 0.28% BndryData::define() 540 0.01295 0.02001 0.02763 0.26% Castro::enforce_min_density() 1182 0.01749 0.02201 0.02523 0.24% VisMF::Write(FabArray) 6 0.007476 0.01012 0.02461 0.23% MLMG::mgVcycle_down::3 483 0.005611 0.01381 0.02261 0.21% Castro::check_for_nan() 280 0.01412 0.01807 0.02255 0.21% MultiFab::contains_nan() 280 0.01397 0.0179 0.02239 0.21% MLMG::getGradSolution() 360 0.01376 0.01654 0.01945 0.18% Castro::errorEst() 34 0.009451 0.01541 0.01943 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.0169 0.01808 0.01938 0.18% MLCellLinOp::compGrad() 450 0.01357 0.01632 0.01921 0.18% Castro::computeNewDt() 28 0.01647 0.01753 0.01898 0.18% Gravity::update_max_rhs() 30 0.01343 0.01485 0.01809 0.17% Castro::derive() 34 0.007066 0.0125 0.01627 0.15% AmrLevel::AmrLevel(dm) 35 0.008684 0.01221 0.01506 0.14% StateData::define() 140 0.008507 0.01201 0.01483 0.14% MLPoisson::FFlux() 7882 0.007282 0.01067 0.01374 0.13% Castro::construct_old_gravity_source() 140 0.00668 0.01085 0.01317 0.12% Castro::swap_state_time_levels() 140 0.005435 0.009321 0.01264 0.12% Castro::FluxRegFineAdd() 140 0.004267 0.008596 0.01248 0.12% Amr::InitializeInit() 1 0.006793 0.009501 0.01237 0.12% Amr::defBaseLevel() 1 0.006786 0.009498 0.01237 0.12% MLMG::MLResNormInf() 440 0.008072 0.009498 0.01133 0.11% MLMG::mgVcycle_down::4 483 0.004831 0.006289 0.01129 0.11% MultiFab::max() 90 0.003814 0.006009 0.01106 0.10% FabArrayBase::TheFPinfo() 688 0.002407 0.005971 0.01021 0.10% Castro::buildMetrics() 35 0.004642 0.006785 0.009826 0.09% FPinfo::FPinfo() 7 0.001467 0.005064 0.009173 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003369 0.006819 0.008942 0.08% MLMG::mgVcycle_up::4 483 0.0037 0.004684 0.008764 0.08% MLLinOp::define() 360 0.00723 0.007783 0.008451 0.08% MLMG::mgVcycle_down::5 483 0.004694 0.005624 0.008079 0.08% MLLinOp::defineGrids() 360 0.006873 0.007419 0.008061 0.08% StateDataPhysBCFunct::() 1517 0.002604 0.004665 0.00764 0.07% MLMG::MLRhsNormInf() 360 0.004763 0.005967 0.006697 0.06% MLMG::mgVcycle_up::5 483 0.003772 0.004485 0.006367 0.06% Castro::computeInitialDt() 2 0.0007538 0.003603 0.006205 0.06% StateData::FillBoundary(geom) 685 0.001195 0.00319 0.006017 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0002949 0.002506 0.005741 0.05% DistributionMapping::SFCProcessorMapDoIt() 5 0.0002428 0.002466 0.005714 0.05% FabArray::mult() 1063 0.003493 0.004706 0.005583 0.05% MLPoisson::prepareForSolve() 360 0.002811 0.003987 0.005398 0.05% MLCellLinOp::prepareForSolve() 360 0.002508 0.003712 0.005136 0.05% MultiFab::norm0(mask) 270 0.002846 0.004073 0.004963 0.05% Gravity::applyMetricTerms() 90 0.003635 0.004384 0.004841 0.05% BoxList::parallelComplementIn() 57 0.0004027 0.003152 0.004587 0.04% Gravity::swapTimeLevels() 140 0.003154 0.004103 0.004566 0.04% BoxList::pci 22 0.000369 0.003119 0.004557 0.04% FabArray::setDomainBndry() 1517 0.002902 0.003823 0.004545 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002431 0.00357 0.004299 0.04% MultiFab::Subtract() 420 0.001714 0.002649 0.00343 0.03% TagBoxArray::mapPRD 34 0.00136 0.001914 0.002911 0.03% MultiFab::Copy() 450 0.001492 0.002106 0.002602 0.02% MLLinOp::makeSubCommunicator() 70 0.001476 0.001947 0.002571 0.02% AmrMesh-cluster 4 0 0.0002948 0.002359 0.02% Castro::apply_tagging_restrictions() 34 0.001323 0.00165 0.001971 0.02% ClusterList::chop() 4 0 0.0001887 0.001509 0.01% TagBoxArray::collate() 34 0.000613 0.0009245 0.001477 0.01% MLMG::buildFineMask() 360 0.001061 0.001316 0.001477 0.01% AMRErrorTag::operator() 34 0.0009486 0.001171 0.001379 0.01% Castro::build_fine_mask() 100 0.0007489 0.0009784 0.001149 0.01% Castro::finalize_do_advance() 140 0.0004319 0.0006037 0.0008454 0.01% FabArrayBase::FB::FB() 299 0.0001762 0.0004371 0.0006761 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005059 0.0005735 0.000618 0.01% ClusterList::intersect() 4 0 6.879e-05 0.0005503 0.01% Castro::enforce_speed_limit() 1182 0.0002931 0.0004307 0.0005357 0.00% makeSFC 350 0.0003496 0.000393 0.0004314 0.00% Amr::InitAmr() 1 0.0002632 0.0002911 0.000393 0.00% MultiFab::Multiply() 40 0.0001868 0.0002519 0.0002852 0.00% DistributionMapping::KnapSackDoIt() 7 0.0002072 0.0002154 0.0002241 0.00% OwnerMask() 34 0.0001536 0.0001825 0.0002231 0.00% DistributionMapping::Distribute() 355 0.0001448 0.0001712 0.0001829 0.00% FabArray::RecvLayoutMask() 90 8.852e-05 0.0001036 0.0001184 0.00% knapsack() 7 0.0001037 0.0001091 0.0001135 0.00% Castro::create_source_corrector() 140 5.635e-05 8.174e-05 0.0001062 0.00% Castro::enforce_consistent_e() 7 7.638e-05 8.839e-05 9.748e-05 0.00% Amr::writeSmallPlotFile() 1 3.281e-05 4.951e-05 7.597e-05 0.00% BoxList::complementIn 574 6.101e-05 6.777e-05 7.247e-05 0.00% Castro::retry_advance_ctu() 140 4.123e-05 4.625e-05 5.209e-05 0.00% Gravity::set_mass_offset() 21 1.265e-05 2.416e-05 3.103e-05 0.00% Castro::apply_problem_tags() 34 1.355e-05 1.633e-05 1.89e-05 0.00% Amr::initSubcycle() 1 8.211e-06 8.844e-06 9.532e-06 0.00% -------------------------------------------------------------------------------------------- AMReX (22.05-25-g0540fed3576f) finalized