MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.04-28-g56661522b4cd) initialized Starting run at 19:53:29 UTC on 2022-04-23. Successfully read inputs file ... Castro git describe: 22.04-16-ga01656b12 AMReX git describe: 22.04-28-g56661522b Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001453587 new finest: 1 grid_places() time: 0.006766713 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.006749982 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.008299598 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.014026526 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.480588275 [STEP 1] FAB kilobyte spread across MPI nodes: [18083 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000510975 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.561109026 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000717667 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.537578073 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000511001 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.522370146 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.00074952 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.495601902 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000487384 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.486688763 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000683785 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.498082939 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000494992 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.488605497 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000680884 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.495596934 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000484251 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.486574012 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000693191 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.496172619 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000484724 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.489940096 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000710863 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.508862922 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000589528 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.50446704 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000701836 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.496489696 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000509352 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.505729438 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000707469 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.504712932 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.00050427 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.499864828 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000701592 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.50720146 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000507362 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.504858867 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.014321765 seconds Ending run at 19:53:39 UTC on 2022-04-23. Run time = 10.25702654 Run time without initialization = 10.08526322 Average number of zones advanced per microsecond: 0.874 Average number of zones advanced per microsecond per rank: 0.109 TinyProfiler total time across processes [min...avg...max]: 10.26 ... 10.26 ... 10.26 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.7721 2.1133 2.3411 22.82% MLCGSolver::ParallelAllReduce 243542 0.8477 1.04 1.345 13.12% MLPoisson::Fsmooth() 54976 0.8354 0.93 1.026 10.00% Castro::do_advance_ctu() 140 0.3147 0.5463 0.8844 8.62% FillBoundary_finish() 157859 0.4588 0.6065 0.7811 7.62% FillBoundary_nowait() 157859 0.5103 0.668 0.7641 7.45% FabArray::ParallelCopy_finish() 21119 0.2986 0.4452 0.6481 6.32% MLCellLinOp::applyBC() 165252 0.2059 0.2874 0.3662 3.57% MLPoisson::Fapply() 108875 0.2565 0.2919 0.3135 3.06% MLCGSolver::bicgstab 1420 0.2041 0.2338 0.2468 2.41% MultiFab::LinComb() 288336 0.1629 0.2026 0.2307 2.25% FabArray::setVal() 27604 0.1395 0.1751 0.2088 2.04% FabArray::ParallelCopy_nowait() 21119 0.1615 0.1835 0.2049 2.00% MultiFab::Dot() 193316 0.1571 0.1841 0.2017 1.97% Castro::reset_internal_energy() 1189 0.1463 0.1701 0.1835 1.79% Castro::normalize_species() 1182 0.1304 0.1486 0.1609 1.57% MLPoisson::normalize() 98078 0.0996 0.1141 0.1235 1.20% Castro::estTimeStep() 228 0.0855 0.09509 0.1203 1.17% MLMG::ResNormInf() 2383 0.05422 0.07702 0.1012 0.99% Castro::construct_new_gravity_source() 260 0.0658 0.07648 0.08421 0.82% amrex::average_down 8093 0.0653 0.073 0.07894 0.77% Castro::computeTemp() 1189 0.06073 0.06941 0.07549 0.74% CGSolver::sxay() 288086 0.06316 0.06614 0.06941 0.68% CellConservativeLinear::interp() 8794 0.06653 0.06711 0.06756 0.66% MultiFab::Saxpy() 1180 0.05367 0.06222 0.0664 0.65% MLMG::addInterpCorrection() 6101 0.04679 0.05137 0.05648 0.55% FabArray::FillBoundary() 157859 0.05411 0.05514 0.0562 0.55% Castro::initData() 7 0.04347 0.05106 0.05448 0.53% MLCellLinOp::defineAuxData() 360 0.03713 0.0426 0.05101 0.50% FillPatchIterator::Initialize 829 0.04376 0.04607 0.05032 0.49% MLMG::prepareForSolve() 360 0.03155 0.03573 0.04219 0.41% MLCellLinOp::apply() 108875 0.03939 0.04049 0.04196 0.41% amrex::average_down_w_geom 248 0.03121 0.0368 0.04124 0.40% FabArrayBase::CPC::define() 4019 0.02863 0.03387 0.03859 0.38% Amr::regrid() 21 0.02684 0.03136 0.03856 0.38% Castro::reflux() 60 0.02871 0.03362 0.0371 0.36% FillPatchSingleLevel 1517 0.02737 0.03382 0.03646 0.36% Gravity::actual_solve_with_mlmg() 360 0.02253 0.02799 0.03579 0.35% MultiFab::Xpay() 12217 0.02798 0.03189 0.0342 0.33% FabArrayBase::getFB() 157859 0.03018 0.03102 0.03223 0.31% MLMG::solve() 360 0.009385 0.02023 0.03047 0.30% Gravity::fill_multipole_BCs() 70 0.02794 0.02894 0.03 0.29% MLMG::interpCorrection_1 771 0.022 0.02599 0.0297 0.29% FluxRegister::Reflux() 960 0.02032 0.02541 0.02936 0.29% FabArrayBase::getCPC() 29601 0.02762 0.02845 0.02899 0.28% MLCellLinOp::reflux() 951 0.02158 0.0252 0.02895 0.28% Castro::initialize_do_advance() 140 0.02196 0.02599 0.02814 0.27% FillPatchTwoLevels 716 0.02559 0.02675 0.02783 0.27% Castro::enforce_min_density() 1182 0.0197 0.02226 0.0245 0.24% Gravity::get_new_grav_vector() 263 0.01675 0.01981 0.02431 0.24% VisMF::Write(FabArray) 6 0.007971 0.01018 0.02361 0.23% Castro::expand_state() 140 0.01979 0.02196 0.02339 0.23% MLCellLinOp::updateSolBC() 871 0.01141 0.01663 0.02325 0.23% MLMG::oneIter() 1843 0.01864 0.02127 0.023 0.22% Castro::construct_new_source() 1300 0.02118 0.0218 0.02226 0.22% BndryData::define() 540 0.01216 0.01585 0.02165 0.21% MLCellLinOp::updateCorBC() 771 0.0107 0.0154 0.02144 0.21% Amr::writePlotFile() 2 0.005433 0.01896 0.02119 0.21% Castro::finalize_advance() 140 0.01542 0.01803 0.02078 0.20% MultiFab::contains_nan() 280 0.01344 0.01685 0.01961 0.19% MLCellLinOp::smooth() 27488 0.01681 0.01728 0.01758 0.17% Gravity::get_old_grav_vector() 140 0.008875 0.01083 0.01489 0.15% Castro::initialize_advance() 140 0.008644 0.01115 0.01384 0.13% StateData::define() 140 0.00916 0.01074 0.01367 0.13% Castro::FluxRegFineAdd() 140 0.0068 0.008592 0.0131 0.13% MLPoisson::FFlux() 7882 0.00692 0.01066 0.01308 0.13% MLCellLinOp::setLevelBC() 450 0.007691 0.01009 0.01285 0.13% Castro::construct_old_source() 700 0.0102 0.01124 0.01285 0.13% MLCellLinOp::compGrad() 450 0.008913 0.01019 0.01186 0.12% MLCellLinOp::defineBC() 360 0.007946 0.00954 0.01174 0.11% Castro::construct_old_gravity_source() 140 0.007587 0.009227 0.01 0.10% Gravity::gravity_sync() 60 0.007841 0.009156 0.009987 0.10% FPinfo::FPinfo() 7 0.001281 0.005536 0.009951 0.10% Castro::swap_state_time_levels() 140 0.006016 0.007627 0.009595 0.09% FabArray::ParallelCopy() 21119 0.008792 0.008944 0.009176 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004182 0.006796 0.008765 0.09% MultiFab::max() 90 0.003599 0.005226 0.007728 0.08% Gravity::solve_for_phi() 280 0.006213 0.006925 0.007585 0.07% Amr::timeStep() 140 0.003185 0.004095 0.006786 0.07% Castro::init(old) 28 0.005452 0.006142 0.006697 0.07% BoxList::pci 22 0.0004737 0.003478 0.005878 0.06% MLLinOp::defineGrids() 360 0.00462 0.005039 0.005706 0.06% StateData::FillBoundary(geom) 685 0.001128 0.003159 0.005671 0.06% AmrMesh::MakeNewGrids() 23 0.002676 0.005022 0.005546 0.05% FabArray::mult() 1063 0.003904 0.004575 0.00527 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003832 0.00445 0.005215 0.05% MLCellLinOp::prepareForSolve() 360 0.002733 0.003765 0.005109 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0003411 0.002373 0.004973 0.05% MLMG::MLRhsNormInf() 360 0.003822 0.004492 0.004897 0.05% Amr::bldFineLevels() 1 0.00309 0.003606 0.004831 0.05% Castro::construct_old_gravity() 140 0.003441 0.004192 0.004617 0.05% Gravity::applyMetricTerms() 90 0.003863 0.004249 0.004594 0.04% MultiFab::norm0(mask) 270 0.00309 0.00392 0.004593 0.04% MLCellLinOp::correctionResidual() 9063 0.004169 0.004292 0.00456 0.04% Castro::construct_new_gravity() 140 0.003728 0.004125 0.004483 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.00328 0.003757 0.004289 0.04% FabArray::setDomainBndry() 1517 0.003346 0.003672 0.004243 0.04% MLMG::mgVcycle() 3385 0.003774 0.003994 0.004103 0.04% MLMG::computeResWithCrseCorFineCor() 771 0.002877 0.003319 0.003893 0.04% Gravity::update_max_rhs() 30 0.003002 0.003225 0.003452 0.03% MLMG::actualBottomSolve() 1843 0.002574 0.002815 0.003418 0.03% FillPatchInterp(Fab) 688 0.002958 0.003212 0.003384 0.03% Amr::coarseTimeStep() 20 0.0008759 0.001666 0.003084 0.03% MultiFab::Subtract() 420 0.002025 0.00254 0.003023 0.03% Amr::defBaseLevel() 1 0.001948 0.00225 0.002933 0.03% Gravity::GetCrsePhi() 250 0.001972 0.002487 0.00286 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002094 0.002519 0.002817 0.03% MultiFab::Copy() 450 0.001861 0.002179 0.002585 0.03% MLLinOp::makeSubCommunicator() 70 0.001465 0.001829 0.00242 0.02% MLMG::MLResNormInf() 440 0.0007602 0.001414 0.002382 0.02% MLMG:computeResOfCorrection() 6101 0.002096 0.002142 0.002222 0.02% MLMG::mgVcycle_down::0 1843 0.00184 0.001921 0.002048 0.02% MLCellLinOp::solutionResidual() 3154 0.001875 0.001921 0.002014 0.02% MLMG::mgVcycle_bottom 3385 0.001847 0.001891 0.00192 0.02% Gravity::solve_phi_with_mlmg() 300 0.0009672 0.001386 0.001907 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001181 0.001432 0.001638 0.02% StateDataPhysBCFunct::() 1517 0.001335 0.001471 0.001624 0.02% Castro::clean_state() 1182 0.001426 0.001532 0.00162 0.02% MLMG::mgVcycle_down::1 1843 0.001474 0.001527 0.001577 0.02% ClusterList::chop() 4 0 0.0001791 0.001433 0.01% MLMG::mgVcycle_up::1 1843 0.001288 0.001353 0.001401 0.01% AMRErrorTag::operator() 34 0.001013 0.001187 0.001341 0.01% TagBoxArray::collate() 34 0.0006288 0.0008308 0.001327 0.01% MLMG::mgVcycle_up::0 1843 0.001122 0.001165 0.001191 0.01% MLMG::buildFineMask() 360 0.0009751 0.001027 0.001092 0.01% FabArrayBase::TheFPinfo() 688 0.000759 0.0008687 0.001004 0.01% MLPoisson::define() 360 0.000753 0.0008761 0.001 0.01% Gravity::actual_multilevel_solve() 20 0.0007193 0.0008524 0.0009162 0.01% MLMG::computeResidual() 1843 0.0007484 0.0008124 0.0008456 0.01% Castro::finalize_do_advance() 140 0.0005026 0.000616 0.0008355 0.01% main() 1 0.0006947 0.0007382 0.0008031 0.01% MLMG::miniCycle() 1542 0.0006139 0.0006439 0.000687 0.01% Castro::do_new_sources() 260 0.0006087 0.0006494 0.0006856 0.01% FabArrayBase::FB::FB() 299 0.0001992 0.0004473 0.0006573 0.01% Castro::apply_tagging_restrictions() 34 0.0004472 0.000534 0.0006224 0.01% Castro::build_fine_mask() 40 0.0005147 0.0005671 0.0006162 0.01% Amr::grid_places() 23 0.0003156 0.000374 0.0006093 0.01% Castro::derive() 34 0.0004856 0.0005487 0.000595 0.01% ClusterList::intersect() 4 0 6.671e-05 0.0005337 0.01% MLLinOp::define() 360 0.0003998 0.0004265 0.0004869 0.00% Castro::apply_source_to_state() 520 0.0004173 0.0004406 0.0004657 0.00% Amr::InitAmr() 1 0.0002732 0.0003353 0.0004611 0.00% Castro::advance() 140 0.0003717 0.0004045 0.0004454 0.00% Castro::subcycle_advance_ctu() 140 0.0003501 0.000409 0.000444 0.00% MLMG::mgVcycle_down::2 483 0.0003836 0.0003946 0.0004095 0.00% MLMG::mgVcycle_down::4 483 0.0003924 0.0004015 0.0004069 0.00% Castro::enforce_speed_limit() 1182 0.000327 0.0003452 0.000373 0.00% MLMG::mgVcycle_down::6 483 0.0003374 0.0003524 0.0003721 0.00% MLMG::mgVcycle_down::3 483 0.0003537 0.0003634 0.0003715 0.00% MLPoisson::prepareForSolve() 360 0.0002525 0.0003062 0.0003633 0.00% Castro::do_old_sources() 140 0.0003262 0.0003437 0.0003588 0.00% MLMG::mgVcycle_down::5 483 0.0003252 0.0003348 0.0003528 0.00% MLMG::computeMLResidual() 440 0.0003129 0.0003239 0.0003329 0.00% Gravity::swapTimeLevels() 140 0.0002477 0.0002704 0.0003143 0.00% MLMG::mgVcycle_up::6 483 0.0002801 0.0002966 0.0003141 0.00% AmrMesh-cluster 4 0 3.659e-05 0.0002927 0.00% MLMG::mgVcycle_up::2 483 0.0002649 0.0002763 0.0002896 0.00% MLMG::mgVcycle_up::5 483 0.000242 0.0002532 0.0002743 0.00% MLMG::mgVcycle_up::4 483 0.000232 0.0002395 0.0002705 0.00% MLMG::getGradSolution() 360 0.0002239 0.0002394 0.0002654 0.00% MLMG::mgVcycle_up::3 483 0.0002231 0.000239 0.0002622 0.00% makeSFC 350 0.0002192 0.0002353 0.0002513 0.00% AmrLevel::AmrLevel(dm) 35 0.0002037 0.0002157 0.0002375 0.00% OwnerMask() 34 0.0001681 0.0001878 0.0002182 0.00% TagBoxArray::mapPRD 34 0.0001896 0.0001989 0.0002117 0.00% Castro::check_for_nan() 280 0.0001746 0.0001884 0.0002012 0.00% Castro::post_regrid() 66 0.0001428 0.0001703 0.0002009 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001458 0.0001582 0.0001941 0.00% Castro::avgDown(state_indx) 248 0.0001509 0.000173 0.0001895 0.00% DistributionMapping::Distribute() 355 0.0001595 0.0001723 0.0001848 0.00% Castro::post_timestep() 140 0.000153 0.0001672 0.0001756 0.00% MultiFab::Multiply() 40 0.00015 0.000163 0.0001745 0.00% Gravity::solve_for_delta_phi 60 8.89e-05 0.0001016 0.0001276 0.00% FabArray::RecvLayoutMask() 90 9.932e-05 0.0001118 0.0001257 0.00% Castro::enforce_consistent_e() 7 7.146e-05 8.787e-05 0.0001223 0.00% Amr::FinalizeInit() 1 4.047e-06 1.896e-05 0.00012 0.00% knapsack() 7 0.0001001 0.0001037 0.0001103 0.00% Castro::retry_advance_ctu() 140 7.842e-05 9.498e-05 0.0001072 0.00% Castro::create_source_corrector() 140 7.846e-05 9.204e-05 9.941e-05 0.00% Castro::errorEst() 34 6.649e-05 7.191e-05 8.745e-05 0.00% Castro::avgDown() 62 5.907e-05 6.803e-05 7.712e-05 0.00% Amr::writeSmallPlotFile() 1 3.389e-05 5.292e-05 7.361e-05 0.00% BoxList::complementIn 574 6.815e-05 7.025e-05 7.356e-05 0.00% Castro::computeNewDt() 28 4.279e-05 4.871e-05 5.863e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.941e-05 3.236e-05 3.587e-05 0.00% BoxList::parallelComplementIn() 57 2.436e-05 2.721e-05 3.075e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.275e-05 2.499e-05 2.851e-05 0.00% Gravity::set_mass_offset() 21 1.936e-05 2.168e-05 2.561e-05 0.00% Castro::apply_problem_tags() 34 1.623e-05 1.719e-05 1.791e-05 0.00% Amr::initSubcycle() 1 8.416e-06 1.093e-05 1.548e-05 0.00% Castro::post_init() 3 9.138e-06 9.882e-06 1.144e-05 0.00% Amr::InitializeInit() 1 2.083e-06 3.057e-06 6.342e-06 0.00% Castro::computeInitialDt() 2 2.964e-06 3.269e-06 3.619e-06 0.00% Amr::init() 1 1.872e-06 2.016e-06 2.306e-06 0.00% Amr::initialInit() 1 1.245e-06 1.45e-06 1.624e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.26 10.26 10.26 100.00% Amr::coarseTimeStep() 20 10.07 10.07 10.07 98.17% Amr::timeStep() 140 10.03 10.05 10.06 98.05% Castro::advance() 140 7.382 7.386 7.389 72.04% Castro::subcycle_advance_ctu() 140 7.167 7.198 7.239 70.58% Castro::do_advance_ctu() 140 7.167 7.198 7.239 70.57% Gravity::actual_solve_with_mlmg() 360 5.598 5.617 5.654 55.12% MLMG::solve() 360 5.418 5.426 5.434 52.98% MLMG::oneIter() 1843 5.032 5.059 5.076 49.49% MLMG::mgVcycle() 3385 4.642 4.686 4.72 46.02% Gravity::solve_phi_with_mlmg() 300 4.22 4.247 4.274 41.67% Gravity::solve_for_phi() 280 3.573 3.599 3.625 35.34% MLMG::mgVcycle_bottom 3385 3.175 3.194 3.216 31.35% Castro::construct_new_gravity() 140 2.844 2.848 2.855 27.84% MLMG::actualBottomSolve() 1843 2.801 2.809 2.829 27.58% MLCGSolver::bicgstab 1420 2.797 2.805 2.824 27.53% Castro::construct_ctu_hydro_source() 140 1.772 2.113 2.341 22.82% Castro::post_timestep() 140 1.892 1.911 1.917 18.69% MLCellLinOp::applyBC() 165252 1.414 1.598 1.808 17.63% Castro::reflux() 60 1.775 1.788 1.802 17.57% MLCellLinOp::smooth() 27488 1.511 1.568 1.615 15.75% FabArray::FillBoundary() 157859 1.166 1.361 1.606 15.66% Gravity::gravity_sync() 60 1.524 1.524 1.525 14.86% Gravity::solve_for_delta_phi 60 1.448 1.448 1.449 14.12% MLCGSolver::ParallelAllReduce 243542 0.9474 1.134 1.426 13.90% MLCellLinOp::apply() 108875 1.108 1.286 1.413 13.78% MLPoisson::Fsmooth() 54976 0.8354 0.93 1.026 10.00% Castro::construct_old_gravity() 140 0.8602 0.8872 0.9067 8.84% FabArray::ParallelCopy() 21119 0.5627 0.6914 0.8664 8.45% Amr::regrid() 21 0.7946 0.8009 0.8093 7.89% FillBoundary_nowait() 157859 0.5412 0.6995 0.7956 7.76% FillBoundary_finish() 157859 0.4588 0.6065 0.7811 7.62% Gravity::multilevel_solve_for_new_phi() 20 0.6635 0.6652 0.666 6.49% Gravity::actual_multilevel_solve() 20 0.6619 0.6638 0.6648 6.48% FabArray::ParallelCopy_finish() 21119 0.2986 0.4452 0.6481 6.32% Castro::post_regrid() 66 0.639 0.6429 0.6459 6.30% FillPatchIterator::Initialize 829 0.4319 0.4836 0.5537 5.40% MLMG::mgVcycle_down::0 1843 0.4618 0.4809 0.4993 4.87% FillPatchTwoLevels 716 0.3717 0.4225 0.4944 4.82% MLMG::mgVcycle_up::0 1843 0.431 0.4424 0.4499 4.39% Castro::clean_state() 1182 0.3582 0.4111 0.4407 4.30% MLMG::miniCycle() 1542 0.3624 0.3854 0.4012 3.91% Castro::initialize_do_advance() 140 0.2947 0.3142 0.3416 3.33% FillPatchSingleLevel 1517 0.2054 0.2531 0.332 3.24% MLPoisson::Fapply() 108875 0.2565 0.2919 0.3135 3.06% MLCellLinOp::correctionResidual() 9063 0.2581 0.2824 0.298 2.91% CGSolver::sxay() 288086 0.2228 0.2652 0.2945 2.87% Castro::do_new_sources() 260 0.2145 0.2455 0.2672 2.61% Castro::expand_state() 140 0.2009 0.2229 0.2633 2.57% FabArray::ParallelCopy_nowait() 21119 0.2096 0.2372 0.2581 2.52% Castro::computeTemp() 1189 0.207 0.2395 0.2574 2.51% MLCellLinOp::solutionResidual() 3154 0.2037 0.2183 0.2327 2.27% MultiFab::LinComb() 288336 0.1629 0.2026 0.2307 2.25% MLMG::mgVcycle_down::1 1843 0.2127 0.2202 0.2305 2.25% FabArray::setVal() 27604 0.1395 0.1751 0.2088 2.04% MultiFab::Dot() 193316 0.1571 0.1841 0.2017 1.97% MLMG::computeResWithCrseSolFineCor() 771 0.1512 0.1728 0.1898 1.85% Castro::reset_internal_energy() 1189 0.1463 0.1701 0.1835 1.79% MLMG::mgVcycle_up::1 1843 0.1643 0.1708 0.1756 1.71% Castro::initialize_advance() 140 0.1137 0.1496 0.1754 1.71% Amr::init() 1 0.1711 0.1713 0.1713 1.67% amrex::average_down 8093 0.1154 0.139 0.1685 1.64% Castro::normalize_species() 1182 0.1304 0.1486 0.1609 1.57% Amr::initialInit() 1 0.1568 0.157 0.157 1.53% Amr::FinalizeInit() 1 0.1449 0.1472 0.1505 1.47% Castro::construct_new_source() 1300 0.1132 0.1283 0.1385 1.35% MLMG::computeResidual() 1843 0.1164 0.1313 0.1381 1.35% MLMG::addInterpCorrection() 6101 0.07511 0.1086 0.1325 1.29% MLMG:computeResOfCorrection() 6101 0.123 0.1273 0.1309 1.28% MLPoisson::normalize() 98078 0.0996 0.1141 0.1235 1.20% Castro::estTimeStep() 228 0.0855 0.09509 0.1203 1.17% Castro::do_old_sources() 140 0.08809 0.1035 0.1147 1.12% MLPoisson::define() 360 0.0795 0.09245 0.1107 1.08% MLCellLinOp::setLevelBC() 450 0.02618 0.05424 0.1038 1.01% MLMG::ResNormInf() 2383 0.05662 0.07966 0.1034 1.01% MLMG::mgVcycle_up::2 483 0.02651 0.05817 0.1033 1.01% Gravity::get_new_grav_vector() 263 0.09827 0.09988 0.102 0.99% Castro::avgDown() 62 0.06124 0.07913 0.1002 0.98% Castro::avgDown(state_indx) 248 0.06118 0.07907 0.1002 0.98% amrex::average_down_w_geom 248 0.06103 0.07889 0.09998 0.97% MLMG::computeResWithCrseCorFineCor() 771 0.08488 0.0948 0.09795 0.95% Gravity::GetCrsePhi() 250 0.02886 0.05639 0.09131 0.89% MLCellLinOp::reflux() 951 0.06842 0.08066 0.08948 0.87% Castro::construct_new_gravity_source() 260 0.0658 0.07648 0.08421 0.82% Amr::bldFineLevels() 1 0.07783 0.08055 0.08279 0.81% MLMG::computeMLResidual() 440 0.05403 0.06343 0.07309 0.71% FillPatchInterp(Fab) 688 0.06949 0.07033 0.07092 0.69% CellConservativeLinear::interp() 8794 0.06653 0.06711 0.06756 0.66% MLMG::prepareForSolve() 360 0.06021 0.06477 0.06743 0.66% FabArrayBase::getCPC() 29601 0.05625 0.06232 0.06707 0.65% MultiFab::Saxpy() 1180 0.05367 0.06222 0.0664 0.65% Castro::post_init() 3 0.06087 0.06318 0.066 0.64% MLMG::mgVcycle_up::3 483 0.004294 0.02824 0.06368 0.62% MLCellLinOp::defineAuxData() 360 0.0467 0.05395 0.0635 0.62% MLCellLinOp::updateSolBC() 871 0.04451 0.05576 0.06311 0.62% Gravity::get_old_grav_vector() 140 0.05946 0.06075 0.06218 0.61% MLCellLinOp::updateCorBC() 771 0.04672 0.05503 0.06103 0.59% Castro::init(old) 28 0.04785 0.05538 0.06035 0.59% Castro::initData() 7 0.04711 0.05519 0.05946 0.58% MLMG::interpCorrection_1 771 0.03702 0.04495 0.05683 0.55% FluxRegister::Reflux() 960 0.0448 0.04929 0.05271 0.51% Castro::finalize_advance() 140 0.03527 0.03753 0.04318 0.42% MLCellLinOp::defineBC() 360 0.02321 0.02978 0.03896 0.38% FabArrayBase::CPC::define() 4019 0.02863 0.03387 0.03859 0.38% Castro::computeNewDt() 28 0.01547 0.02008 0.03821 0.37% Castro::apply_source_to_state() 520 0.02894 0.03371 0.03615 0.35% MLMG::mgVcycle_down::2 483 0.03132 0.03261 0.03421 0.33% MultiFab::Xpay() 12217 0.02798 0.03189 0.0342 0.33% MLMG::mgVcycle_up::6 483 0.004747 0.008531 0.03333 0.32% FabArrayBase::getFB() 157859 0.03073 0.03147 0.0326 0.32% Castro::construct_old_source() 700 0.02665 0.03017 0.0324 0.32% MLMG::mgVcycle_down::6 483 0.005623 0.009239 0.03174 0.31% Gravity::fill_multipole_BCs() 70 0.02868 0.02967 0.03074 0.30% Amr::grid_places() 23 0.01629 0.02516 0.03018 0.29% AmrMesh::MakeNewGrids() 23 0.01598 0.02479 0.02987 0.29% Amr::writePlotFile() 2 0.02905 0.02914 0.02918 0.28% BndryData::define() 540 0.01503 0.01995 0.02687 0.26% Castro::enforce_min_density() 1182 0.0197 0.02226 0.0245 0.24% VisMF::Write(FabArray) 6 0.007971 0.01018 0.02361 0.23% MLMG::mgVcycle_down::3 483 0.00657 0.01411 0.02298 0.22% Castro::check_for_nan() 280 0.01364 0.01704 0.01981 0.19% MultiFab::contains_nan() 280 0.01344 0.01685 0.01961 0.19% Gravity::average_fine_ec_onto_crse_ec() 90 0.01728 0.01797 0.01917 0.19% MLMG::getGradSolution() 360 0.01421 0.01596 0.01884 0.18% MLCellLinOp::compGrad() 450 0.01399 0.01572 0.01858 0.18% Castro::errorEst() 34 0.007471 0.01323 0.01666 0.16% Gravity::update_max_rhs() 30 0.01241 0.01348 0.01551 0.15% Castro::derive() 34 0.005906 0.01142 0.01472 0.14% AmrLevel::AmrLevel(dm) 35 0.009365 0.01095 0.01389 0.14% StateData::define() 140 0.00916 0.01074 0.01367 0.13% Castro::FluxRegFineAdd() 140 0.0068 0.008592 0.0131 0.13% MLPoisson::FFlux() 7882 0.00692 0.01066 0.01308 0.13% Amr::InitializeInit() 1 0.006534 0.009793 0.01192 0.12% Amr::defBaseLevel() 1 0.006527 0.00979 0.01192 0.12% MLMG::mgVcycle_down::4 483 0.005881 0.006769 0.01119 0.11% FabArrayBase::TheFPinfo() 688 0.002255 0.006593 0.01112 0.11% MLMG::MLResNormInf() 440 0.007607 0.008814 0.0105 0.10% FPinfo::FPinfo() 7 0.001469 0.005724 0.01014 0.10% Castro::construct_old_gravity_source() 140 0.007587 0.009227 0.01 0.10% Castro::swap_state_time_levels() 140 0.006016 0.007627 0.009595 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.004182 0.006796 0.008765 0.09% MLLinOp::define() 360 0.007435 0.00785 0.008593 0.08% MLMG::mgVcycle_up::4 483 0.004318 0.004911 0.008567 0.08% MLLinOp::defineGrids() 360 0.007035 0.007423 0.008172 0.08% MLMG::mgVcycle_down::5 483 0.005697 0.006075 0.008138 0.08% MultiFab::max() 90 0.003599 0.005226 0.007728 0.08% StateDataPhysBCFunct::() 1517 0.002527 0.004629 0.007296 0.07% Castro::computeInitialDt() 2 0.0008743 0.00315 0.006375 0.06% MLMG::mgVcycle_up::5 483 0.00441 0.004755 0.00637 0.06% MLMG::MLRhsNormInf() 360 0.005225 0.005769 0.006249 0.06% BoxList::parallelComplementIn() 57 0.0005167 0.003518 0.00592 0.06% BoxList::pci 22 0.0004737 0.003478 0.005878 0.06% StateData::FillBoundary(geom) 685 0.001128 0.003159 0.005671 0.06% MLPoisson::prepareForSolve() 360 0.003096 0.004071 0.005396 0.05% FabArray::mult() 1063 0.003904 0.004575 0.00527 0.05% MLCellLinOp::prepareForSolve() 360 0.002733 0.003765 0.005109 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0003411 0.002373 0.004973 0.05% DistributionMapping::SFCProcessorMapDoIt() 5 0.0003318 0.002356 0.004965 0.05% Gravity::applyMetricTerms() 90 0.003863 0.004249 0.004594 0.04% MultiFab::norm0(mask) 270 0.00309 0.00392 0.004593 0.04% Gravity::swapTimeLevels() 140 0.00302 0.00379 0.004367 0.04% FabArray::setDomainBndry() 1517 0.003346 0.003672 0.004243 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.0028 0.003336 0.003784 0.04% MultiFab::Subtract() 420 0.002025 0.00254 0.003023 0.03% MultiFab::Copy() 450 0.001861 0.002179 0.002585 0.03% MLLinOp::makeSubCommunicator() 70 0.001465 0.001829 0.00242 0.02% AmrMesh-cluster 4 0 0.0002824 0.002259 0.02% TagBoxArray::mapPRD 34 0.001228 0.001792 0.002202 0.02% ClusterList::chop() 4 0 0.0001791 0.001433 0.01% MLMG::buildFineMask() 360 0.001214 0.001337 0.001406 0.01% AMRErrorTag::operator() 34 0.001013 0.001187 0.001341 0.01% TagBoxArray::collate() 34 0.0006288 0.0008308 0.001327 0.01% Castro::finalize_do_advance() 140 0.0005026 0.000616 0.0008355 0.01% FabArrayBase::FB::FB() 299 0.0001992 0.0004473 0.0006573 0.01% Castro::apply_tagging_restrictions() 34 0.0004472 0.000534 0.0006224 0.01% Castro::build_fine_mask() 40 0.0005147 0.0005671 0.0006162 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005233 0.0005553 0.000584 0.01% ClusterList::intersect() 4 0 6.671e-05 0.0005337 0.01% Amr::InitAmr() 1 0.0002818 0.0003462 0.0004763 0.00% makeSFC 350 0.0003693 0.0003971 0.0004243 0.00% Castro::enforce_speed_limit() 1182 0.000327 0.0003452 0.000373 0.00% OwnerMask() 34 0.0001681 0.0001878 0.0002182 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001795 0.0001885 0.0001959 0.00% DistributionMapping::Distribute() 355 0.0001595 0.0001723 0.0001848 0.00% MultiFab::Multiply() 40 0.00015 0.000163 0.0001745 0.00% FabArray::RecvLayoutMask() 90 9.932e-05 0.0001118 0.0001257 0.00% Castro::enforce_consistent_e() 7 7.146e-05 8.787e-05 0.0001223 0.00% knapsack() 7 0.0001001 0.0001037 0.0001103 0.00% Castro::retry_advance_ctu() 140 7.842e-05 9.498e-05 0.0001072 0.00% Castro::create_source_corrector() 140 7.846e-05 9.204e-05 9.941e-05 0.00% Amr::writeSmallPlotFile() 1 3.389e-05 5.292e-05 7.361e-05 0.00% BoxList::complementIn 574 6.815e-05 7.025e-05 7.356e-05 0.00% Gravity::set_mass_offset() 21 1.936e-05 2.168e-05 2.561e-05 0.00% Castro::apply_problem_tags() 34 1.623e-05 1.719e-05 1.791e-05 0.00% Amr::initSubcycle() 1 8.416e-06 1.093e-05 1.548e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-28-g56661522b4cd) finalized