MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.05-29-g76d6d344e12d) initialized Starting run at 05:30:28 UTC on 2023-05-29. Successfully read inputs file ... Castro git describe: 23.05-30-g283f15d69 AMReX git describe: 23.05-29-g76d6d344e Microphysics git describe: 23.05-13-gbf803460 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001471761 new finest: 1 grid_places() time: 0.008238938 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.006765339 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.010471979 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.019742001 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.594854271 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.00070981 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.612485316 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000811549 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.594439242 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000558003 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.532415877 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000760202 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.525317523 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.00051379 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.519633593 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000772194 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.528109865 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000507119 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.518632402 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000755629 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.527661623 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000528264 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.520500292 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000749747 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.538192312 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000553597 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.552632885 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000781984 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.554753806 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000586359 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.54333576 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000788922 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.553857835 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000509249 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.539208256 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000808226 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.543403083 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000522498 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.576692601 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000787562 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.550186928 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000511037 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.551902037 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.909433602 seconds Ending run at 05:30:40 UTC on 2023-05-29. Run time = 12.09330014 Run time without initialization = 11.89116971 Average number of zones advanced per microsecond: 0.741 Average number of zones advanced per microsecond per rank: 0.093 TinyProfiler total time across processes [min...avg...max]: 12.09 ... 12.09 ... 12.09 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9891 2.3926 2.6706 22.08% MLCGSolver::ParallelAllReduce 243542 0.9671 1.228 1.533 12.68% MLPoisson::Fsmooth() 54976 0.9576 1.066 1.162 9.61% Castro::do_advance_ctu() 140 0.3113 0.5971 1.003 8.29% Amr::writePlotFile() 2 0.8978 0.9177 0.9213 7.62% FillBoundary_finish() 157859 0.5175 0.6648 0.8482 7.01% FillBoundary_nowait() 157859 0.5505 0.6769 0.7955 6.58% FabArray::ParallelCopy_finish() 21259 0.3385 0.494 0.6808 5.63% MLCellLinOp::applyBC() 165252 0.2268 0.3239 0.4299 3.56% MLPoisson::Fapply() 108875 0.2502 0.2838 0.3032 2.51% FabArray::ParallelCopy_nowait() 21259 0.1723 0.1884 0.2174 1.80% FabArray::setVal() 27514 0.1381 0.1724 0.2058 1.70% amrex::Dot() 193316 0.1618 0.1889 0.2048 1.69% Castro::estTimeStep() 308 0.1093 0.1627 0.2022 1.67% Castro::reset_internal_energy(Fab) 5919 0.1462 0.1711 0.1855 1.53% FabArray::Saxpy() 145223 0.1355 0.1589 0.1801 1.49% amrex::Copy() 106562 0.134 0.1556 0.1769 1.46% Castro::normalize_species() 1182 0.1245 0.1429 0.1579 1.31% MLCGSolver::bicgstab 1420 0.1185 0.1268 0.136 1.12% FabArray::norminf() 100641 0.1083 0.1226 0.1317 1.09% MLPoisson::normalize() 98078 0.09838 0.1123 0.121 1.00% Castro::construct_new_gravity_source() 260 0.07475 0.08738 0.09802 0.81% MLMG::ResNormInf() 2383 0.02237 0.0534 0.08468 0.70% amrex::average_down 8093 0.06775 0.0761 0.08364 0.69% FabArray::LinComb() 96778 0.05561 0.07002 0.08333 0.69% Castro::computeTemp() 1189 0.06394 0.07334 0.08209 0.68% FabArray::Xpay() 59602 0.04887 0.05918 0.06778 0.56% FillPatchInterp(MF) 728 0.06614 0.06698 0.06773 0.56% Castro::initData() 7 0.04792 0.05401 0.06004 0.50% FabArray::FillBoundary() 157859 0.05345 0.05507 0.05669 0.47% FillPatchIterator::Initialize 889 0.04701 0.05063 0.05584 0.46% MLMG::addInterpCorrection() 6101 0.04474 0.04889 0.05337 0.44% MLCellLinOp::defineAuxData() 360 0.03699 0.04221 0.05061 0.42% amrex::Add() 7701 0.041 0.04605 0.05057 0.42% MLMG::prepareForSolve() 360 0.0354 0.03891 0.0457 0.38% FillPatchSingleLevel 1617 0.0286 0.03774 0.04173 0.35% amrex::average_down_w_geom 248 0.03079 0.0362 0.04143 0.34% FabArrayBase::CPC::define() 4099 0.03078 0.03616 0.04114 0.34% MLCellLinOp::apply() 108875 0.03504 0.03633 0.03825 0.32% Gravity::actual_solve_with_mlmg() 360 0.02315 0.02791 0.0369 0.31% Castro::reflux() 60 0.02619 0.03118 0.03565 0.29% FluxRegister::Reflux() 960 0.02606 0.03117 0.03458 0.29% VisMF::Write(FabArray) 6 0.008733 0.0122 0.03177 0.26% MLMG::solve() 360 0.01002 0.02115 0.03112 0.26% Gravity::fill_multipole_BCs() 70 0.02653 0.02818 0.03022 0.25% Castro::initMFs() 35 0.0214 0.02457 0.03022 0.25% MLCellLinOp::reflux() 951 0.02232 0.02507 0.02961 0.24% FillPatchTwoLevels 756 0.02683 0.02767 0.02897 0.24% FabArrayBase::getCPC() 29651 0.02614 0.02756 0.02894 0.24% FabArrayBase::getFB() 157859 0.02579 0.02672 0.02821 0.23% Castro::initialize_do_advance() 140 0.02063 0.02486 0.02747 0.23% MLCellLinOp::updateSolBC() 871 0.01149 0.01691 0.0244 0.20% Castro::enforce_min_density() 1182 0.01877 0.02119 0.02402 0.20% MultiFab::contains_nan() 280 0.01766 0.0208 0.02362 0.20% Castro::construct_new_source() 1300 0.02052 0.02159 0.0226 0.19% MLCellLinOp::updateCorBC() 771 0.01064 0.01556 0.02257 0.19% Amr::coarseTimeStep() 20 0.001969 0.005278 0.02248 0.19% MLMG::interpCorrection_1 771 0.01542 0.01818 0.02172 0.18% BndryData::define() 540 0.01214 0.01566 0.02118 0.18% Castro::FluxRegCrseInit 140 0.01374 0.01638 0.01871 0.15% MLCellLinOp::smooth() 27488 0.01595 0.01659 0.01732 0.14% Gravity::get_new_grav_vector() 263 0.01154 0.01265 0.01568 0.13% StateData::define() 140 0.01062 0.01219 0.01511 0.12% Castro::FluxRegFineAdd() 140 0.006703 0.00879 0.01461 0.12% MLPoisson::FFlux() 7882 0.006909 0.0116 0.01446 0.12% Castro::initialize_advance() 140 0.008861 0.01086 0.01332 0.11% MLCellLinOp::setLevelBC() 450 0.007679 0.009709 0.0126 0.10% Castro::construct_old_source() 700 0.01029 0.01115 0.01256 0.10% FPinfo::FPinfo() 7 0.0009969 0.008399 0.01254 0.10% MLCellLinOp::defineBC() 360 0.007987 0.009177 0.01117 0.09% MLCellLinOp::compGrad() 450 0.008073 0.009254 0.01056 0.09% Castro::construct_old_gravity_source() 140 0.007256 0.009016 0.01002 0.08% Castro::swap_state_time_levels() 140 0.006093 0.007544 0.009521 0.08% Gravity::get_old_grav_vector() 140 0.005784 0.006594 0.009444 0.08% FabArray::ParallelCopy() 21259 0.008533 0.008833 0.009273 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003915 0.006709 0.009021 0.07% Castro::buildMetrics() 35 0.005618 0.006425 0.008658 0.07% MultiFab::max() 90 0.003668 0.005626 0.008151 0.07% BoxList::pci 22 0.0004218 0.004477 0.006941 0.06% FabArray::mult() 1063 0.005247 0.006054 0.006936 0.06% Gravity::applyMetricTerms() 90 0.005636 0.00623 0.006639 0.05% Amr::regrid() 21 0.003657 0.004767 0.006516 0.05% Gravity::solve_for_phi() 280 0.005373 0.005782 0.006446 0.05% StateData::FillBoundary(geom) 745 0.001427 0.003715 0.006291 0.05% Amr::timeStep() 140 0.002896 0.003889 0.006092 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0001255 0.002874 0.005837 0.05% AmrMesh::MakeNewGrids() 23 0.002985 0.005215 0.005726 0.05% Gravity::gravity_sync() 60 0.00435 0.005017 0.005679 0.05% MLLinOp::defineGrids() 360 0.004096 0.004436 0.005364 0.04% MLCellLinOp::prepareForSolve() 360 0.00293 0.003825 0.005232 0.04% Castro::Castro() 35 0.003902 0.00422 0.00473 0.04% FabArray::norminf(mask) 270 0.003161 0.003995 0.004714 0.04% MLCellLinOp::correctionResidual() 9063 0.004082 0.004341 0.004528 0.04% FabArray::setDomainBndry() 1617 0.003572 0.003928 0.004461 0.04% MLMG::mgVcycle() 3385 0.003862 0.004009 0.004222 0.03% MLMG::actualBottomSolve() 1843 0.002335 0.002586 0.003435 0.03% average_down_faces 360 0.002244 0.002644 0.0033 0.03% MultiFab::Subtract() 420 0.001958 0.002419 0.002889 0.02% Gravity::update_max_rhs() 30 0.002432 0.002604 0.002737 0.02% Gravity::GetCrsePhi() 250 0.002007 0.002482 0.002732 0.02% MLMG::MLResNormInf() 440 0.0008111 0.001513 0.002679 0.02% Castro::construct_old_gravity() 140 0.002099 0.002411 0.002648 0.02% Castro::reset_internal_energy(MultiFab) 1189 0.001707 0.002068 0.002601 0.02% MLMG::oneIter() 1843 0.002318 0.002426 0.002581 0.02% MLLinOp::makeSubCommunicator() 70 0.001517 0.001723 0.002242 0.02% MLMG:computeResOfCorrection() 6101 0.002058 0.002147 0.002214 0.02% Gravity::create_comp_minus_level_grad_phi() 60 0.001645 0.001869 0.002087 0.02% Gravity::average_fine_ec_onto_crse_ec() 90 0.001482 0.001691 0.001912 0.02% MLMG::mgVcycle_bottom 3385 0.0018 0.001844 0.001903 0.02% MLMG::mgVcycle_down::0 1843 0.001662 0.001743 0.00185 0.02% MLCellLinOp::solutionResidual() 3154 0.001705 0.001743 0.0018 0.01% Castro::finalize_advance() 140 0.001184 0.001339 0.001686 0.01% Gravity::solve_phi_with_mlmg() 300 0.0009541 0.001226 0.001673 0.01% Castro::apply_tagging_restrictions() 34 0.001196 0.001421 0.001644 0.01% Castro::clean_state() 1182 0.001397 0.001477 0.001542 0.01% Gravity::multilevel_solve_for_new_phi() 20 0.001185 0.001378 0.001518 0.01% StateDataPhysBCFunct::() 1617 0.001285 0.001407 0.001513 0.01% MLMG::mgVcycle_up::1 1843 0.001307 0.00137 0.001482 0.01% ClusterList::chop() 4 0 0.0001827 0.001462 0.01% MLMG::mgVcycle_down::1 1843 0.001342 0.001397 0.001453 0.01% TagBoxArray::collate() 34 0.0005488 0.0009812 0.001355 0.01% AMRErrorTag::operator() 34 0.001006 0.001195 0.001334 0.01% MLMG::mgVcycle_up::0 1843 0.001098 0.001152 0.00125 0.01% Castro::expand_state() 200 0.0009585 0.001071 0.001171 0.01% FabArrayBase::TheFPinfo() 728 0.0008517 0.0009062 0.00107 0.01% MLMG::computeResWithCrseSolFineCor() 771 0.0009092 0.0009651 0.001019 0.01% MLPoisson::define() 360 0.0006967 0.0007612 0.0009663 0.01% MLMG::computeResidual() 1843 0.0007977 0.0008687 0.0009408 0.01% Castro::construct_new_gravity() 140 0.0007805 0.0008213 0.0009002 0.01% main() 1 0.0006938 0.000766 0.0008815 0.01% Castro::finalize_do_advance() 140 0.0004546 0.0005756 0.0008498 0.01% FabArrayBase::FB::FB() 299 0.0001902 0.0004352 0.0007297 0.01% Castro::do_new_sources() 260 0.0005949 0.0006596 0.000719 0.01% Castro::build_fine_mask() 40 0.000577 0.0006209 0.0006648 0.01% MLLinOp::define() 360 0.0004514 0.0004895 0.0005958 0.00% Amr::grid_places() 23 0.0003225 0.0003876 0.0005851 0.00% Castro::derive() 34 0.0004441 0.0005084 0.0005749 0.00% Gravity::actual_multilevel_solve() 20 0.0005175 0.0005428 0.0005729 0.00% ClusterList::intersect() 4 0 6.995e-05 0.0005596 0.00% MLMG::miniCycle() 1542 0.0005216 0.0005352 0.0005577 0.00% MLMG::computeMLResidual() 440 0.0004218 0.0004692 0.0005531 0.00% Amr::InitAmr() 1 0.0002735 0.0003419 0.0005461 0.00% Castro::apply_source_to_state() 520 0.000482 0.0005083 0.0005423 0.00% MLMG::computeResWithCrseCorFineCor() 771 0.0004798 0.0004973 0.0005207 0.00% Castro::advance() 140 0.0003951 0.0004233 0.0004822 0.00% Castro::init(old) 28 0.0003112 0.0003773 0.0004705 0.00% Castro::subcycle_advance_ctu() 140 0.0003874 0.0004235 0.000461 0.00% Castro::enforce_speed_limit() 1182 0.0003661 0.0004055 0.0004366 0.00% MLMG::mgVcycle_down::6 483 0.00036 0.0003772 0.0004089 0.00% MLMG::mgVcycle_down::2 483 0.000372 0.0003864 0.0004003 0.00% MLMG::mgVcycle_down::3 483 0.000319 0.0003483 0.0003829 0.00% MLMG::mgVcycle_down::4 483 0.0002984 0.0003245 0.0003599 0.00% Castro::do_old_sources() 140 0.0003222 0.0003429 0.000353 0.00% MLMG::mgVcycle_down::5 483 0.0002822 0.0003033 0.0003443 0.00% AmrMesh-cluster 4 0 4.067e-05 0.0003254 0.00% MLPoisson::prepareForSolve() 360 0.0002589 0.0002828 0.0003225 0.00% MLMG::getGradSolution() 360 0.0002451 0.0002759 0.0003043 0.00% Amr::FinalizeInit() 1 3.803e-06 3.981e-05 0.0002797 0.00% Gravity::swapTimeLevels() 140 0.0002212 0.0002466 0.0002777 0.00% MLMG::mgVcycle_up::3 483 0.0002112 0.0002331 0.0002666 0.00% MLMG::mgVcycle_up::5 483 0.0002232 0.000244 0.0002665 0.00% MLMG::mgVcycle_up::6 483 0.0002436 0.0002518 0.0002643 0.00% AmrLevel::AmrLevel(dm) 35 0.0002344 0.000246 0.0002624 0.00% MLMG::mgVcycle_up::2 483 0.0002383 0.000245 0.0002552 0.00% makeSFC 350 0.0001987 0.0002226 0.0002364 0.00% MLMG::mgVcycle_up::4 483 0.0002099 0.0002185 0.0002276 0.00% TagBoxArray::mapPRD 34 0.0002029 0.0002095 0.0002168 0.00% OwnerMask() 34 0.0001681 0.0001867 0.0002139 0.00% Castro::check_for_nan() 280 0.0001765 0.0001894 0.0002102 0.00% Castro::post_regrid() 66 0.0001483 0.000172 0.0002095 0.00% Castro::post_timestep() 140 0.0001424 0.0001631 0.0002018 0.00% Castro::avgDown(state_indx) 248 0.0001719 0.0001796 0.0001998 0.00% MultiFab::Multiply() 40 0.0001498 0.0001652 0.0001744 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001492 0.0001592 0.0001711 0.00% DistributionMapping::Distribute() 355 0.0001446 0.0001524 0.0001637 0.00% MLMG::MLRhsNormInf() 360 0.000138 0.0001446 0.0001516 0.00% knapsack() 7 0.00011 0.0001163 0.0001475 0.00% Gravity::solve_for_delta_phi 60 9.187e-05 0.0001022 0.0001315 0.00% FabArray::RecvLayoutMask() 90 8.906e-05 0.0001096 0.0001184 0.00% Castro::enforce_consistent_e() 7 7.302e-05 9.278e-05 0.0001148 0.00% Castro::retry_advance_ctu() 140 4.475e-05 6.012e-05 0.0001112 0.00% Castro::create_source_corrector() 140 6.9e-05 7.76e-05 8.536e-05 0.00% BoxList::complementIn 574 6.77e-05 7.253e-05 7.844e-05 0.00% Castro::errorEst() 34 6.638e-05 6.958e-05 7.725e-05 0.00% Castro::avgDown() 62 6.369e-05 6.929e-05 7.247e-05 0.00% Castro::computeNewDt() 28 4.016e-05 4.309e-05 4.691e-05 0.00% Amr::writeSmallPlotFile() 1 3.318e-05 3.944e-05 4.405e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.807e-05 3.334e-05 4.235e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.14e-05 2.369e-05 3.338e-05 0.00% Amr::bldFineLevels() 1 2.097e-05 2.508e-05 3.326e-05 0.00% Gravity::set_mass_offset() 21 2.07e-05 2.423e-05 2.861e-05 0.00% BoxList::parallelComplementIn() 57 2.193e-05 2.265e-05 2.446e-05 0.00% Amr::defBaseLevel() 1 1.685e-05 1.973e-05 2.243e-05 0.00% Amr::initSubcycle() 1 1.364e-05 1.519e-05 1.67e-05 0.00% Castro::apply_problem_tags() 34 1.34e-05 1.529e-05 1.66e-05 0.00% Castro::post_init() 3 7.961e-06 9.583e-06 1.091e-05 0.00% Amr::InitializeInit() 1 2.016e-06 2.844e-06 7.281e-06 0.00% Castro::computeInitialDt() 2 3.443e-06 3.788e-06 4.256e-06 0.00% Amr::init() 1 1.708e-06 1.894e-06 2.421e-06 0.00% Amr::initialInit() 1 1.194e-06 1.492e-06 2.039e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 12.09 12.09 12.09 100.00% Amr::coarseTimeStep() 20 10.98 10.98 10.98 90.79% Amr::timeStep() 140 10.94 10.96 10.96 90.66% Castro::advance() 140 8.039 8.043 8.046 66.53% Castro::subcycle_advance_ctu() 140 7.823 7.854 7.891 65.25% Castro::do_advance_ctu() 140 7.822 7.854 7.891 65.25% Gravity::actual_solve_with_mlmg() 360 6.012 6.022 6.037 49.92% MLMG::solve() 360 5.835 5.843 5.851 48.38% MLMG::oneIter() 1843 5.431 5.465 5.486 45.36% MLMG::mgVcycle() 3385 5.03 5.086 5.13 42.42% Gravity::solve_phi_with_mlmg() 300 4.514 4.522 4.537 37.51% Gravity::solve_for_phi() 280 3.826 3.834 3.848 31.82% MLMG::mgVcycle_bottom 3385 3.432 3.455 3.469 28.69% Castro::construct_new_gravity() 140 3.046 3.05 3.058 25.28% MLMG::actualBottomSolve() 1843 3.011 3.02 3.047 25.19% MLCGSolver::bicgstab 1420 3.007 3.016 3.042 25.16% Castro::construct_ctu_hydro_source() 140 1.989 2.393 2.671 22.08% Castro::post_timestep() 140 2.103 2.122 2.128 17.60% Castro::reflux() 60 1.973 1.988 2.002 16.55% MLCellLinOp::applyBC() 165252 1.509 1.717 1.956 16.17% MLCellLinOp::smooth() 27488 1.677 1.754 1.813 14.99% FabArray::FillBoundary() 157859 1.223 1.424 1.686 13.94% Gravity::gravity_sync() 60 1.64 1.64 1.64 13.56% MLCGSolver::ParallelAllReduce 243542 1.072 1.324 1.615 13.36% Gravity::solve_for_delta_phi 60 1.558 1.558 1.559 12.89% MLCellLinOp::apply() 108875 1.17 1.34 1.507 12.47% MLPoisson::Fsmooth() 54976 0.9576 1.066 1.162 9.61% Amr::writePlotFile() 2 0.9303 0.9306 0.9308 7.70% Castro::construct_old_gravity() 140 0.9172 0.9226 0.9297 7.69% FabArray::ParallelCopy() 21259 0.6077 0.7501 0.9153 7.57% Amr::regrid() 21 0.8396 0.8469 0.8542 7.06% FillBoundary_finish() 157859 0.5175 0.6648 0.8482 7.01% FillBoundary_nowait() 157859 0.578 0.7041 0.8232 6.81% Gravity::multilevel_solve_for_new_phi() 20 0.7031 0.7054 0.7065 5.84% Gravity::actual_multilevel_solve() 20 0.7016 0.704 0.7051 5.83% FabArray::ParallelCopy_finish() 21259 0.3385 0.494 0.6808 5.63% Castro::post_regrid() 66 0.6732 0.6767 0.6794 5.62% FillPatchIterator::Initialize 889 0.4589 0.5279 0.6034 4.99% MLMG::mgVcycle_down::0 1843 0.5047 0.5286 0.5501 4.55% FillPatchTwoLevels 756 0.3868 0.4544 0.5315 4.40% MLMG::mgVcycle_up::0 1843 0.477 0.4914 0.4998 4.13% MLMG::miniCycle() 1542 0.4062 0.4354 0.4561 3.77% Castro::clean_state() 1182 0.356 0.4112 0.4526 3.74% FillPatchSingleLevel 1617 0.2225 0.2832 0.3719 3.08% Castro::initialize_do_advance() 140 0.292 0.3089 0.3326 2.75% Castro::expand_state() 200 0.2376 0.2633 0.308 2.55% MLCellLinOp::correctionResidual() 9063 0.2601 0.287 0.3059 2.53% MLPoisson::Fapply() 108875 0.2502 0.2838 0.3032 2.51% Castro::do_new_sources() 260 0.2197 0.2547 0.2825 2.34% FabArray::ParallelCopy_nowait() 21259 0.2259 0.2473 0.2815 2.33% Castro::computeTemp() 1189 0.2121 0.2465 0.2702 2.23% MLMG::mgVcycle_down::1 1843 0.2326 0.2407 0.2529 2.09% MLCellLinOp::solutionResidual() 3154 0.2095 0.2252 0.2413 2.00% FabArray::setVal() 27514 0.1381 0.1724 0.2058 1.70% MLMG::computeResWithCrseSolFineCor() 771 0.159 0.1847 0.2054 1.70% amrex::Dot() 193316 0.1618 0.1889 0.2048 1.69% Castro::estTimeStep() 308 0.1093 0.1627 0.2022 1.67% Amr::init() 1 0.2014 0.2016 0.2017 1.67% MLMG::mgVcycle_up::1 1843 0.1789 0.1892 0.1955 1.62% Castro::reset_internal_energy(MultiFab) 1189 0.1481 0.1731 0.1881 1.56% Castro::reset_internal_energy(Fab) 5919 0.1462 0.1711 0.1855 1.53% Amr::initialInit() 1 0.1811 0.1813 0.1815 1.50% FabArray::Saxpy() 145223 0.1355 0.1589 0.1801 1.49% amrex::Copy() 106562 0.134 0.1556 0.1769 1.46% Castro::initialize_advance() 140 0.1151 0.1472 0.1737 1.44% Amr::FinalizeInit() 1 0.1683 0.171 0.1732 1.43% amrex::average_down 8093 0.1187 0.1422 0.1652 1.37% Castro::normalize_species() 1182 0.1245 0.1429 0.1579 1.31% Castro::construct_new_source() 1300 0.12 0.1377 0.1522 1.26% MLMG::computeResidual() 1843 0.1158 0.1339 0.1421 1.18% MLMG:computeResOfCorrection() 6101 0.1279 0.1316 0.136 1.12% MLMG::addInterpCorrection() 6101 0.06001 0.1125 0.1336 1.10% FabArray::norminf() 100641 0.1083 0.1226 0.1317 1.09% MLPoisson::normalize() 98078 0.09838 0.1123 0.121 1.00% Castro::avgDown() 62 0.07232 0.09373 0.1164 0.96% Castro::avgDown(state_indx) 248 0.07225 0.09366 0.1163 0.96% amrex::average_down_w_geom 248 0.07207 0.09348 0.1161 0.96% Castro::do_old_sources() 140 0.08596 0.1019 0.1159 0.96% MLMG::ResNormInf() 2383 0.05409 0.08262 0.1118 0.92% MLMG::mgVcycle_up::2 483 0.02795 0.06887 0.1096 0.91% MLPoisson::define() 360 0.07811 0.09024 0.1085 0.90% Gravity::get_new_grav_vector() 263 0.1029 0.1047 0.1062 0.88% Castro::construct_new_gravity_source() 260 0.07475 0.08738 0.09802 0.81% MLCellLinOp::reflux() 951 0.07327 0.08835 0.09711 0.80% Amr::bldFineLevels() 1 0.08813 0.09237 0.09693 0.80% MLMG::computeResWithCrseCorFineCor() 771 0.08063 0.09179 0.09574 0.79% FabArray::LinComb() 96778 0.05561 0.07002 0.08333 0.69% Castro::post_init() 3 0.06997 0.07471 0.07907 0.65% MLMG::computeMLResidual() 440 0.05645 0.06623 0.07606 0.63% MLCellLinOp::setLevelBC() 450 0.02565 0.04541 0.07137 0.59% MLMG::prepareForSolve() 360 0.06325 0.06668 0.06951 0.57% FabArrayBase::getCPC() 29651 0.05692 0.06372 0.06932 0.57% MLCellLinOp::updateSolBC() 871 0.04582 0.05841 0.06791 0.56% FabArray::Xpay() 59602 0.04887 0.05918 0.06778 0.56% FillPatchInterp(MF) 728 0.06614 0.06698 0.06773 0.56% MLMG::mgVcycle_up::3 483 0.004229 0.02932 0.06624 0.55% FluxRegister::Reflux() 960 0.05341 0.06143 0.06604 0.55% Castro::initData() 7 0.05153 0.05836 0.0652 0.54% Castro::init(old) 28 0.04868 0.05774 0.06368 0.53% MLCellLinOp::defineAuxData() 360 0.04586 0.05315 0.06317 0.52% Gravity::get_old_grav_vector() 140 0.06081 0.06193 0.06311 0.52% MLCellLinOp::updateCorBC() 771 0.04378 0.05195 0.05927 0.49% Gravity::GetCrsePhi() 250 0.02007 0.03644 0.0561 0.46% Castro::Castro() 35 0.03841 0.044 0.05461 0.45% amrex::Add() 7701 0.041 0.04605 0.05057 0.42% MLMG::interpCorrection_1 771 0.02916 0.03673 0.04933 0.41% Castro::finalize_advance() 140 0.03891 0.04126 0.04807 0.40% FabArrayBase::CPC::define() 4099 0.03078 0.03616 0.04114 0.34% Castro::apply_source_to_state() 520 0.02928 0.03548 0.0385 0.32% MLCellLinOp::defineBC() 360 0.02307 0.02915 0.03795 0.31% Amr::grid_places() 23 0.02153 0.03154 0.03541 0.29% AmrMesh::MakeNewGrids() 23 0.02117 0.03115 0.03505 0.29% MLMG::mgVcycle_down::2 483 0.03197 0.03323 0.03485 0.29% Castro::construct_old_source() 700 0.02557 0.0295 0.03231 0.27% VisMF::Write(FabArray) 6 0.008733 0.0122 0.03177 0.26% Gravity::fill_multipole_BCs() 70 0.02772 0.02935 0.03137 0.26% Castro::initMFs() 35 0.0214 0.02457 0.03022 0.25% FabArrayBase::getFB() 157859 0.02614 0.02715 0.02894 0.24% Castro::FluxRegCrseInit 140 0.02619 0.02705 0.0274 0.23% BndryData::define() 540 0.01483 0.01969 0.02645 0.22% Castro::enforce_min_density() 1182 0.01877 0.02119 0.02402 0.20% Castro::check_for_nan() 280 0.01786 0.02099 0.02383 0.20% MLMG::mgVcycle_down::3 483 0.005711 0.01395 0.02362 0.20% MultiFab::contains_nan() 280 0.01766 0.0208 0.02362 0.20% Castro::errorEst() 34 0.009711 0.0182 0.02155 0.18% Castro::computeNewDt() 28 0.01931 0.02059 0.02146 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01728 0.01821 0.0195 0.16% Castro::derive() 34 0.007396 0.0155 0.01855 0.15% MLMG::getGradSolution() 360 0.01365 0.01519 0.01794 0.15% Gravity::update_max_rhs() 30 0.01445 0.01582 0.0177 0.15% MLCellLinOp::compGrad() 450 0.01341 0.01492 0.01764 0.15% AmrLevel::AmrLevel(dm) 35 0.01086 0.01243 0.01536 0.13% StateData::define() 140 0.01062 0.01219 0.01511 0.12% Castro::FluxRegFineAdd() 140 0.006703 0.00879 0.01461 0.12% MLPoisson::FFlux() 7882 0.006909 0.0116 0.01446 0.12% FabArrayBase::TheFPinfo() 728 0.002107 0.009562 0.01377 0.11% Amr::InitializeInit() 1 0.008155 0.0103 0.01305 0.11% Amr::defBaseLevel() 1 0.008153 0.01029 0.01305 0.11% FPinfo::FPinfo() 7 0.001241 0.008655 0.01278 0.11% MLMG::mgVcycle_down::4 483 0.005189 0.006333 0.01165 0.10% average_down_faces 360 0.008029 0.009687 0.01072 0.09% MLMG::MLResNormInf() 440 0.007711 0.009128 0.0107 0.09% Castro::construct_old_gravity_source() 140 0.007256 0.009016 0.01002 0.08% Castro::swap_state_time_levels() 140 0.006093 0.007544 0.009521 0.08% MLMG::mgVcycle_up::4 483 0.004161 0.004887 0.00913 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003915 0.006709 0.009021 0.07% Castro::buildMetrics() 35 0.005717 0.00654 0.008788 0.07% MLMG::mgVcycle_down::5 483 0.005059 0.005624 0.008734 0.07% MLLinOp::define() 360 0.006616 0.007171 0.008213 0.07% MultiFab::max() 90 0.003668 0.005626 0.008151 0.07% StateDataPhysBCFunct::() 1617 0.002712 0.005122 0.007767 0.06% MLLinOp::defineGrids() 360 0.006157 0.006681 0.007617 0.06% MLMG::mgVcycle_down::6 483 0.005109 0.005521 0.007544 0.06% BoxList::parallelComplementIn() 57 0.0004644 0.004517 0.006978 0.06% BoxList::pci 22 0.0004218 0.004477 0.006941 0.06% FabArray::mult() 1063 0.005247 0.006054 0.006936 0.06% MLMG::mgVcycle_up::5 483 0.004319 0.004707 0.006771 0.06% Gravity::applyMetricTerms() 90 0.005636 0.00623 0.006639 0.05% MLMG::mgVcycle_up::6 483 0.004789 0.00508 0.006504 0.05% MLMG::MLRhsNormInf() 360 0.005203 0.005854 0.006305 0.05% StateData::FillBoundary(geom) 745 0.001427 0.003715 0.006291 0.05% DistributionMapping::LeastUsedCPUs() 12 0.0001255 0.002874 0.005837 0.05% DistributionMapping::SFCProcessorMapDoIt() 5 0.0001055 0.002803 0.005767 0.05% Castro::computeInitialDt() 2 0.001058 0.003734 0.005686 0.05% MLPoisson::prepareForSolve() 360 0.003245 0.004108 0.005502 0.05% MLCellLinOp::prepareForSolve() 360 0.00293 0.003825 0.005232 0.04% FabArray::norminf(mask) 270 0.003161 0.003995 0.004714 0.04% FabArray::setDomainBndry() 1617 0.003572 0.003928 0.004461 0.04% Gravity::swapTimeLevels() 140 0.002971 0.003651 0.004161 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.003062 0.003508 0.004 0.03% MultiFab::Subtract() 420 0.001958 0.002419 0.002889 0.02% TagBoxArray::mapPRD 34 0.001244 0.001822 0.002433 0.02% AmrMesh-cluster 4 0 0.0002933 0.002346 0.02% MLLinOp::makeSubCommunicator() 70 0.001517 0.001723 0.002242 0.02% Castro::apply_tagging_restrictions() 34 0.001196 0.001421 0.001644 0.01% ClusterList::chop() 4 0 0.0001827 0.001462 0.01% TagBoxArray::collate() 34 0.0005488 0.0009812 0.001355 0.01% AMRErrorTag::operator() 34 0.001006 0.001195 0.001334 0.01% Castro::finalize_do_advance() 140 0.0004546 0.0005756 0.0008498 0.01% FabArrayBase::FB::FB() 299 0.0001902 0.0004352 0.0007297 0.01% Castro::build_fine_mask() 40 0.000577 0.0006209 0.0006648 0.01% Amr::InitAmr() 1 0.0002886 0.0003571 0.0005628 0.00% ClusterList::intersect() 4 0 6.995e-05 0.0005596 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0004947 0.0005217 0.0005479 0.00% Castro::enforce_speed_limit() 1182 0.0003661 0.0004055 0.0004366 0.00% makeSFC 350 0.0003404 0.0003624 0.0003768 0.00% DistributionMapping::KnapSackDoIt() 7 0.0002438 0.0002568 0.0002697 0.00% OwnerMask() 34 0.0001681 0.0001867 0.0002139 0.00% MultiFab::Multiply() 40 0.0001498 0.0001652 0.0001744 0.00% DistributionMapping::Distribute() 355 0.0001446 0.0001524 0.0001637 0.00% knapsack() 7 0.00011 0.0001163 0.0001475 0.00% FabArray::RecvLayoutMask() 90 8.906e-05 0.0001096 0.0001184 0.00% Castro::enforce_consistent_e() 7 7.302e-05 9.278e-05 0.0001148 0.00% Castro::retry_advance_ctu() 140 4.475e-05 6.012e-05 0.0001112 0.00% Castro::create_source_corrector() 140 6.9e-05 7.76e-05 8.536e-05 0.00% BoxList::complementIn 574 6.77e-05 7.253e-05 7.844e-05 0.00% Amr::writeSmallPlotFile() 1 3.318e-05 3.944e-05 4.405e-05 0.00% Gravity::set_mass_offset() 21 2.07e-05 2.423e-05 2.861e-05 0.00% Amr::initSubcycle() 1 1.364e-05 1.519e-05 1.67e-05 0.00% Castro::apply_problem_tags() 34 1.34e-05 1.529e-05 1.66e-05 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 9 B 11 B 19 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.05-29-g76d6d344e12d) finalized