MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.03-6-g5b7fa9867d02) initialized Starting run at 06:41:14 UTC on 2023-03-09. Successfully read inputs file ... Castro git describe: 23.03-2-g0304294be AMReX git describe: 23.03-6-g5b7fa9867 Microphysics git describe: 23.03-12-g1f07dde0 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001798258 new finest: 1 grid_places() time: 0.008001343 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.009212247 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.008732242 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.015702596 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.490102105 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000530616 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.531655803 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000807232 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.553480344 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000550567 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.563448344 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000820991 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.526978851 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000536605 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.517085627 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000805043 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.52383643 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.00052487 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.516228125 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000775495 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.522375052 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000532956 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.517516372 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000780333 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.524451338 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000549074 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.517887685 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000759997 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.526119842 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000529595 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.5204186 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000764386 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.525908828 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000537326 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.521768336 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000770832 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.528855095 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000531714 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.51931494 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000772013 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.52811601 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000528515 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.521932331 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.017092091 seconds Ending run at 06:41:25 UTC on 2023-03-09. Run time = 10.70685348 Run time without initialization = 10.51814387 Average number of zones advanced per microsecond: 0.838 Average number of zones advanced per microsecond per rank: 0.105 TinyProfiler total time across processes [min...avg...max]: 10.71 ... 10.71 ... 10.71 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9869 2.3592 2.5755 24.05% MLCGSolver::ParallelAllReduce 243542 0.9169 1.07 1.307 12.21% MLPoisson::Fsmooth() 54976 0.911 0.9815 1.049 9.80% Castro::do_advance_ctu() 140 0.3066 0.5296 0.9034 8.44% FillBoundary_nowait() 157859 0.5651 0.6795 0.7688 7.18% FillBoundary_finish() 157859 0.4889 0.5755 0.6871 6.42% FabArray::ParallelCopy_finish() 21259 0.3096 0.4334 0.6409 5.99% MLCellLinOp::applyBC() 165252 0.2354 0.3308 0.4214 3.94% MLPoisson::Fapply() 108875 0.2623 0.2885 0.3092 2.89% FabArray::ParallelCopy_nowait() 21259 0.159 0.1873 0.2112 1.97% FabArray::setVal() 27514 0.1414 0.1739 0.2099 1.96% amrex::Dot() 193316 0.171 0.1919 0.2042 1.91% Castro::estTimeStep() 308 0.1104 0.1505 0.1871 1.75% Castro::reset_internal_energy(Fab) 5919 0.149 0.1718 0.182 1.70% FabArray::Saxpy() 145223 0.1363 0.1588 0.1743 1.63% amrex::Copy() 106562 0.1285 0.1506 0.1681 1.57% Castro::normalize_species() 1182 0.1278 0.1436 0.1538 1.44% MLCGSolver::bicgstab 1420 0.1209 0.1271 0.1354 1.26% FabArray::norminf() 100641 0.1135 0.1233 0.1306 1.22% MLPoisson::normalize() 98078 0.1043 0.1141 0.1239 1.16% Castro::construct_new_gravity_source() 260 0.07423 0.08468 0.09117 0.85% amrex::average_down 8093 0.07107 0.07754 0.08129 0.76% FabArray::LinComb() 96778 0.06074 0.07233 0.08068 0.75% Castro::computeTemp() 1189 0.06466 0.07364 0.0797 0.74% MLMG::addInterpCorrection() 6101 0.06047 0.06436 0.06861 0.64% FillPatchInterp(MF) 728 0.0656 0.06699 0.06844 0.64% FabArray::Xpay() 59602 0.05263 0.06067 0.06503 0.61% MLMG::ResNormInf() 2383 0.02103 0.04249 0.06341 0.59% Castro::initData() 7 0.04343 0.05326 0.06152 0.57% FabArray::FillBoundary() 157859 0.05384 0.0561 0.05922 0.55% FillPatchIterator::Initialize 889 0.04581 0.05039 0.0558 0.52% amrex::Add() 7701 0.03834 0.04597 0.05162 0.48% MLCellLinOp::defineAuxData() 360 0.03653 0.04227 0.04994 0.47% MLMG::prepareForSolve() 360 0.03366 0.03877 0.0447 0.42% FillPatchSingleLevel 1617 0.03197 0.03859 0.04463 0.42% MLCellLinOp::apply() 108875 0.03699 0.03959 0.0429 0.40% amrex::average_down_w_geom 248 0.03072 0.03571 0.0407 0.38% FabArrayBase::CPC::define() 4099 0.03047 0.03613 0.04055 0.38% Gravity::actual_solve_with_mlmg() 360 0.02283 0.02797 0.03622 0.34% Castro::reflux() 60 0.02356 0.03027 0.03492 0.33% FluxRegister::Reflux() 960 0.02411 0.02978 0.03332 0.31% FabArrayBase::getFB() 157859 0.02572 0.02741 0.02993 0.28% MLMG::solve() 360 0.008627 0.01881 0.02898 0.27% FillPatchTwoLevels 756 0.02631 0.02744 0.02867 0.27% Gravity::fill_multipole_BCs() 70 0.02585 0.02727 0.02866 0.27% Castro::initMFs() 35 0.02048 0.02435 0.02839 0.27% Castro::initialize_do_advance() 140 0.02097 0.02577 0.02839 0.27% FabArrayBase::getCPC() 29651 0.02595 0.02715 0.02827 0.26% VisMF::Write(FabArray) 6 0.008837 0.01165 0.02761 0.26% MLCellLinOp::reflux() 951 0.02013 0.02282 0.02529 0.24% Amr::writePlotFile() 2 0.005751 0.02174 0.0246 0.23% MLCellLinOp::updateSolBC() 871 0.01235 0.01756 0.02378 0.22% Castro::enforce_min_density() 1182 0.01864 0.02111 0.02345 0.22% MultiFab::contains_nan() 280 0.01744 0.02063 0.02284 0.21% Castro::construct_new_source() 1300 0.02024 0.02129 0.02256 0.21% MLCellLinOp::updateCorBC() 771 0.01116 0.01584 0.02173 0.20% Amr::coarseTimeStep() 20 0.001931 0.005333 0.02123 0.20% BndryData::define() 540 0.01199 0.01559 0.02082 0.19% MLMG::interpCorrection_1 771 0.0161 0.01844 0.02076 0.19% Castro::FluxRegCrseInit 140 0.01348 0.01631 0.01936 0.18% MLCellLinOp::smooth() 27488 0.01682 0.01754 0.01818 0.17% Gravity::get_new_grav_vector() 263 0.01074 0.01242 0.01437 0.13% Castro::initialize_advance() 140 0.008475 0.01086 0.01365 0.13% StateData::define() 140 0.01019 0.0117 0.01328 0.12% MLPoisson::FFlux() 7882 0.007599 0.01101 0.01278 0.12% Castro::FluxRegFineAdd() 140 0.005163 0.007937 0.01245 0.12% MLCellLinOp::setLevelBC() 450 0.007509 0.009662 0.01241 0.12% Castro::construct_old_source() 700 0.01009 0.01104 0.01211 0.11% MLCellLinOp::defineBC() 360 0.007687 0.009137 0.01123 0.10% Castro::swap_state_time_levels() 140 0.005832 0.007694 0.01114 0.10% MLCellLinOp::compGrad() 450 0.00804 0.009324 0.01082 0.10% FPinfo::FPinfo() 7 0.0009978 0.004853 0.01029 0.10% Castro::construct_old_gravity_source() 140 0.007499 0.00911 0.009982 0.09% FabArray::ParallelCopy() 21259 0.008901 0.009209 0.009554 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003723 0.006716 0.009112 0.09% Gravity::get_old_grav_vector() 140 0.005342 0.006438 0.008956 0.08% MultiFab::max() 90 0.003778 0.005527 0.00829 0.08% Castro::buildMetrics() 35 0.00558 0.006374 0.008279 0.08% BoxList::pci 22 0.0003971 0.004132 0.006746 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0001663 0.003058 0.006524 0.06% Amr::timeStep() 140 0.003004 0.003754 0.006481 0.06% Amr::regrid() 21 0.003453 0.004654 0.006315 0.06% StateData::FillBoundary(geom) 745 0.001495 0.003794 0.006306 0.06% Gravity::solve_for_phi() 280 0.005028 0.005728 0.006194 0.06% Gravity::applyMetricTerms() 90 0.005231 0.00572 0.006123 0.06% AmrMesh::MakeNewGrids() 23 0.002978 0.005309 0.005881 0.05% FabArray::mult() 1063 0.004394 0.005192 0.005849 0.05% Gravity::gravity_sync() 60 0.004087 0.004832 0.005276 0.05% MLCellLinOp::prepareForSolve() 360 0.002895 0.003779 0.005055 0.05% MLLinOp::defineGrids() 360 0.003846 0.004222 0.004909 0.05% MLCellLinOp::correctionResidual() 9063 0.004021 0.004273 0.004697 0.04% FabArray::norminf(mask) 270 0.003381 0.004075 0.004632 0.04% Castro::Castro() 35 0.003808 0.00419 0.004506 0.04% MLMG::mgVcycle() 3385 0.003701 0.003986 0.00435 0.04% FabArray::setDomainBndry() 1617 0.003603 0.003898 0.004264 0.04% MLMG::actualBottomSolve() 1843 0.00226 0.002564 0.003467 0.03% average_down_faces 360 0.002395 0.002751 0.003408 0.03% Gravity::GetCrsePhi() 250 0.002 0.002487 0.003053 0.03% MultiFab::Subtract() 420 0.001919 0.002477 0.00305 0.03% Gravity::update_max_rhs() 30 0.002337 0.002656 0.002885 0.03% Castro::construct_old_gravity() 140 0.00217 0.002455 0.002718 0.03% MLMG::oneIter() 1843 0.002349 0.002479 0.002715 0.03% Castro::reset_internal_energy(MultiFab) 1189 0.001614 0.001984 0.002411 0.02% MLMG::MLResNormInf() 440 0.0006737 0.001286 0.002372 0.02% MLMG:computeResOfCorrection() 6101 0.002064 0.002203 0.00232 0.02% Gravity::create_comp_minus_level_grad_phi() 60 0.001563 0.001937 0.002209 0.02% MLMG::mgVcycle_bottom 3385 0.001709 0.001812 0.00196 0.02% MLLinOp::makeSubCommunicator() 70 0.001301 0.001549 0.001952 0.02% MLCellLinOp::solutionResidual() 3154 0.001676 0.001758 0.001868 0.02% Gravity::average_fine_ec_onto_crse_ec() 90 0.001451 0.001667 0.001854 0.02% MLMG::mgVcycle_down::0 1843 0.001646 0.00171 0.001798 0.02% TagBoxArray::collate() 34 0.0006542 0.001022 0.001747 0.02% Gravity::solve_phi_with_mlmg() 300 0.0008111 0.001173 0.001695 0.02% StateDataPhysBCFunct::() 1617 0.001315 0.001428 0.001631 0.02% Castro::clean_state() 1182 0.001461 0.001535 0.001619 0.02% Castro::apply_tagging_restrictions() 34 0.001141 0.001424 0.001614 0.02% Castro::finalize_advance() 140 0.001111 0.001319 0.001585 0.01% Gravity::multilevel_solve_for_new_phi() 20 0.001112 0.001427 0.00158 0.01% MLMG::mgVcycle_down::1 1843 0.001363 0.00145 0.001514 0.01% MLMG::mgVcycle_up::1 1843 0.001278 0.001345 0.00146 0.01% ClusterList::chop() 4 0 0.0001804 0.001443 0.01% AMRErrorTag::operator() 34 0.0009604 0.001215 0.001371 0.01% Castro::expand_state() 200 0.001008 0.001112 0.001189 0.01% MLMG::mgVcycle_up::0 1843 0.001047 0.00111 0.001164 0.01% FabArrayBase::TheFPinfo() 728 0.0009196 0.0009754 0.001078 0.01% MLMG::computeResWithCrseSolFineCor() 771 0.0009175 0.0009789 0.00103 0.01% MLMG::computeResidual() 1843 0.0008347 0.0008607 0.0009114 0.01% main() 1 0.0006849 0.0007476 0.0008802 0.01% Castro::construct_new_gravity() 140 0.000755 0.0008026 0.0008801 0.01% MLPoisson::define() 360 0.00064 0.0007031 0.0007919 0.01% Castro::finalize_do_advance() 140 0.0004159 0.0005632 0.0007467 0.01% FabArrayBase::FB::FB() 299 0.0001974 0.0004238 0.0007274 0.01% Castro::do_new_sources() 260 0.0006632 0.0006799 0.0007087 0.01% Castro::build_fine_mask() 40 0.0005667 0.0006157 0.0006595 0.01% Gravity::actual_multilevel_solve() 20 0.000443 0.0005255 0.0005889 0.01% Amr::grid_places() 23 0.000298 0.0003609 0.000588 0.01% Castro::derive() 34 0.0004472 0.0004867 0.0005812 0.01% MLMG::miniCycle() 1542 0.0005196 0.0005511 0.0005778 0.01% ClusterList::intersect() 4 0 7.002e-05 0.0005601 0.01% MLMG::computeResWithCrseCorFineCor() 771 0.000497 0.0005253 0.000547 0.01% Amr::InitAmr() 1 0.0002841 0.000383 0.0005465 0.01% Castro::apply_source_to_state() 520 0.0004705 0.0004976 0.0005459 0.01% MLMG::computeMLResidual() 440 0.0004304 0.000463 0.000496 0.00% MLLinOp::define() 360 0.0003945 0.000442 0.0004794 0.00% Castro::advance() 140 0.0003966 0.0004242 0.0004656 0.00% Castro::init(old) 28 0.0003363 0.0003962 0.0004654 0.00% Castro::subcycle_advance_ctu() 140 0.000353 0.0004086 0.0004458 0.00% MLMG::mgVcycle_down::2 483 0.0003806 0.0004063 0.0004301 0.00% MLMG::mgVcycle_down::6 483 0.000362 0.000388 0.0004138 0.00% Castro::enforce_speed_limit() 1182 0.0003756 0.0003888 0.0004089 0.00% MLMG::mgVcycle_down::3 483 0.00032 0.0003552 0.0004027 0.00% Castro::do_old_sources() 140 0.0003496 0.0003666 0.0003867 0.00% MLMG::mgVcycle_down::4 483 0.0003027 0.0003399 0.0003678 0.00% AmrMesh-cluster 4 0 4.389e-05 0.0003511 0.00% MLMG::mgVcycle_down::5 483 0.00029 0.0003071 0.0003297 0.00% MLPoisson::prepareForSolve() 360 0.0002352 0.0002604 0.0003247 0.00% MLMG::getGradSolution() 360 0.000268 0.0002786 0.0002926 0.00% MLMG::mgVcycle_up::6 483 0.0002517 0.0002677 0.0002843 0.00% MLMG::mgVcycle_up::2 483 0.0002362 0.0002543 0.0002754 0.00% AmrLevel::AmrLevel(dm) 35 0.0002212 0.0002423 0.0002708 0.00% Gravity::swapTimeLevels() 140 0.0002309 0.000251 0.0002679 0.00% MLMG::mgVcycle_up::3 483 0.0002037 0.0002311 0.0002577 0.00% MLMG::mgVcycle_up::5 483 0.0002211 0.0002381 0.0002573 0.00% Castro::post_regrid() 66 0.0001428 0.0001728 0.0002361 0.00% TagBoxArray::mapPRD 34 0.0001977 0.0002119 0.0002335 0.00% makeSFC 350 0.0001928 0.0002122 0.0002318 0.00% MLMG::mgVcycle_up::4 483 0.0002054 0.0002198 0.0002303 0.00% Castro::post_timestep() 140 0.0001874 0.0002055 0.0002287 0.00% OwnerMask() 34 0.0001581 0.0001875 0.0002165 0.00% Castro::check_for_nan() 280 0.0001774 0.0001938 0.0002092 0.00% Castro::avgDown(state_indx) 248 0.0001637 0.0001725 0.0001879 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001579 0.0001686 0.0001824 0.00% MultiFab::Multiply() 40 0.0001596 0.0001661 0.0001735 0.00% MLMG::MLRhsNormInf() 360 0.000152 0.0001597 0.0001704 0.00% DistributionMapping::Distribute() 355 0.0001418 0.0001513 0.0001584 0.00% Castro::enforce_consistent_e() 7 7.902e-05 9.64e-05 0.0001243 0.00% Gravity::solve_for_delta_phi 60 8.435e-05 0.000103 0.0001224 0.00% FabArray::RecvLayoutMask() 90 9.436e-05 0.0001091 0.0001213 0.00% knapsack() 7 0.0001041 0.0001079 0.0001116 0.00% Amr::FinalizeInit() 1 4.153e-06 1.749e-05 0.0001082 0.00% Castro::create_source_corrector() 140 6.717e-05 7.66e-05 8.947e-05 0.00% BoxList::complementIn 574 6.713e-05 7.331e-05 8.305e-05 0.00% Castro::avgDown() 62 7.157e-05 7.577e-05 8.286e-05 0.00% Amr::writeSmallPlotFile() 1 3.297e-05 3.883e-05 7.385e-05 0.00% Castro::retry_advance_ctu() 140 4.568e-05 5.961e-05 6.999e-05 0.00% Castro::errorEst() 34 6.325e-05 6.649e-05 6.99e-05 0.00% Castro::computeNewDt() 28 4.116e-05 4.528e-05 5.39e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.745e-05 3.347e-05 5.019e-05 0.00% Amr::bldFineLevels() 1 2.16e-05 2.515e-05 3.303e-05 0.00% BoxList::parallelComplementIn() 57 2.14e-05 2.283e-05 2.789e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.028e-05 2.337e-05 2.693e-05 0.00% Gravity::set_mass_offset() 21 1.939e-05 2.276e-05 2.574e-05 0.00% Amr::defBaseLevel() 1 1.562e-05 1.923e-05 2.505e-05 0.00% Amr::initSubcycle() 1 1.488e-05 1.727e-05 2.156e-05 0.00% Castro::apply_problem_tags() 34 1.392e-05 1.59e-05 1.773e-05 0.00% Castro::post_init() 3 7.957e-06 8.852e-06 9.435e-06 0.00% Amr::InitializeInit() 1 2.176e-06 3.055e-06 5.868e-06 0.00% Castro::computeInitialDt() 2 2.921e-06 3.389e-06 4.291e-06 0.00% Amr::init() 1 1.558e-06 1.857e-06 2.329e-06 0.00% Amr::initialInit() 1 1.144e-06 1.397e-06 1.855e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.71 10.71 10.71 100.00% Amr::coarseTimeStep() 20 10.5 10.5 10.5 98.06% Amr::timeStep() 140 10.46 10.48 10.48 97.92% Castro::advance() 140 7.732 7.736 7.739 72.28% Castro::subcycle_advance_ctu() 140 7.51 7.546 7.584 70.83% Castro::do_advance_ctu() 140 7.51 7.546 7.584 70.83% Gravity::actual_solve_with_mlmg() 360 5.69 5.7 5.713 53.35% MLMG::solve() 360 5.515 5.522 5.53 51.65% MLMG::oneIter() 1843 5.147 5.169 5.179 48.37% MLMG::mgVcycle() 3385 4.787 4.819 4.844 45.25% Gravity::solve_phi_with_mlmg() 300 4.283 4.294 4.309 40.24% Gravity::solve_for_phi() 280 3.628 3.639 3.653 34.11% MLMG::mgVcycle_bottom 3385 3.251 3.265 3.279 30.63% Castro::construct_new_gravity() 140 2.888 2.891 2.899 27.07% MLMG::actualBottomSolve() 1843 2.858 2.867 2.892 27.01% MLCGSolver::bicgstab 1420 2.855 2.863 2.888 26.97% Castro::construct_ctu_hydro_source() 140 1.987 2.359 2.575 24.05% Castro::post_timestep() 140 1.964 1.98 1.987 18.55% Castro::reflux() 60 1.852 1.864 1.875 17.51% MLCellLinOp::applyBC() 165252 1.504 1.641 1.825 17.05% MLCellLinOp::smooth() 27488 1.575 1.624 1.664 15.54% Gravity::gravity_sync() 60 1.536 1.537 1.537 14.35% FabArray::FillBoundary() 157859 1.196 1.339 1.532 14.31% Gravity::solve_for_delta_phi 60 1.461 1.462 1.462 13.66% MLCellLinOp::apply() 108875 1.18 1.321 1.44 13.45% MLCGSolver::ParallelAllReduce 243542 1.018 1.169 1.395 13.03% MLPoisson::Fsmooth() 54976 0.911 0.9815 1.049 9.80% Castro::construct_old_gravity() 140 0.8773 0.8829 0.8902 8.31% FabArray::ParallelCopy() 21259 0.5716 0.6885 0.8615 8.05% Amr::regrid() 21 0.8032 0.8127 0.8212 7.67% FillBoundary_nowait() 157859 0.5938 0.7073 0.7969 7.44% FillBoundary_finish() 157859 0.4889 0.5755 0.6871 6.42% Gravity::multilevel_solve_for_new_phi() 20 0.6704 0.6724 0.6733 6.29% Gravity::actual_multilevel_solve() 20 0.6688 0.671 0.6722 6.28% Castro::post_regrid() 66 0.6449 0.6492 0.6517 6.09% FabArray::ParallelCopy_finish() 21259 0.3096 0.4334 0.6409 5.99% FillPatchIterator::Initialize 889 0.4534 0.5171 0.5946 5.55% FillPatchTwoLevels 756 0.3836 0.4463 0.5277 4.93% MLMG::mgVcycle_down::0 1843 0.4793 0.4925 0.505 4.72% MLMG::mgVcycle_up::0 1843 0.46 0.4675 0.4723 4.41% Castro::clean_state() 1182 0.3629 0.4128 0.4405 4.11% MLMG::miniCycle() 1542 0.3831 0.3992 0.4102 3.83% FillPatchSingleLevel 1617 0.2264 0.2815 0.3672 3.43% Castro::initialize_do_advance() 140 0.2962 0.3127 0.3377 3.15% MLPoisson::Fapply() 108875 0.2623 0.2885 0.3092 2.89% Castro::expand_state() 200 0.2331 0.2624 0.3066 2.86% MLCellLinOp::correctionResidual() 9063 0.2521 0.2715 0.2864 2.68% FabArray::ParallelCopy_nowait() 21259 0.2116 0.2459 0.2725 2.54% Castro::do_new_sources() 260 0.2223 0.2517 0.2699 2.52% Castro::computeTemp() 1189 0.2156 0.2475 0.2627 2.45% MLMG::mgVcycle_down::1 1843 0.218 0.2227 0.2285 2.13% MLCellLinOp::solutionResidual() 3154 0.1991 0.2108 0.2216 2.07% FabArray::setVal() 27514 0.1414 0.1739 0.2099 1.96% amrex::Dot() 193316 0.171 0.1919 0.2042 1.91% MLMG::mgVcycle_up::1 1843 0.1787 0.1846 0.1902 1.78% Amr::init() 1 0.188 0.1882 0.1883 1.76% Castro::estTimeStep() 308 0.1104 0.1505 0.1871 1.75% Castro::reset_internal_energy(MultiFab) 1189 0.151 0.1738 0.1839 1.72% Castro::reset_internal_energy(Fab) 5919 0.149 0.1718 0.182 1.70% Castro::initialize_advance() 140 0.1166 0.1494 0.1807 1.69% MLMG::computeResWithCrseSolFineCor() 771 0.1485 0.1665 0.1791 1.67% FabArray::Saxpy() 145223 0.1363 0.1588 0.1743 1.63% Amr::initialInit() 1 0.172 0.1722 0.1723 1.61% amrex::Copy() 106562 0.1285 0.1506 0.1681 1.57% Amr::FinalizeInit() 1 0.1569 0.1611 0.1647 1.54% MLMG::addInterpCorrection() 6101 0.07547 0.1304 0.154 1.44% Castro::normalize_species() 1182 0.1278 0.1436 0.1538 1.44% amrex::average_down 8093 0.1129 0.1344 0.1474 1.38% Castro::construct_new_source() 1300 0.1189 0.1346 0.1441 1.35% MLMG::computeResidual() 1843 0.1171 0.1279 0.1374 1.28% MLMG:computeResOfCorrection() 6101 0.1246 0.1273 0.1326 1.24% FabArray::norminf() 100641 0.1135 0.1233 0.1306 1.22% MLPoisson::normalize() 98078 0.1043 0.1141 0.1239 1.16% MLMG::mgVcycle_up::2 483 0.02976 0.07215 0.1161 1.08% Castro::do_old_sources() 140 0.08704 0.1032 0.1155 1.08% MLPoisson::define() 360 0.07612 0.08964 0.1072 1.00% Gravity::get_new_grav_vector() 263 0.09468 0.09647 0.09902 0.92% Castro::avgDown() 62 0.0585 0.0734 0.0944 0.88% Castro::avgDown(state_indx) 248 0.05843 0.07332 0.09433 0.88% amrex::average_down_w_geom 248 0.05825 0.07315 0.09416 0.88% Amr::bldFineLevels() 1 0.08652 0.08969 0.09272 0.87% MLMG::ResNormInf() 2383 0.05237 0.0723 0.09175 0.86% Castro::construct_new_gravity_source() 260 0.07423 0.08468 0.09117 0.85% MLMG::computeResWithCrseCorFineCor() 771 0.07795 0.08539 0.091 0.85% MLCellLinOp::reflux() 951 0.06856 0.07973 0.08637 0.81% FabArray::LinComb() 96778 0.06074 0.07233 0.08068 0.75% MLMG::computeMLResidual() 440 0.05334 0.06237 0.0713 0.67% MLCellLinOp::setLevelBC() 450 0.02461 0.04454 0.07043 0.66% Castro::post_init() 3 0.06285 0.06594 0.0692 0.65% MLMG::mgVcycle_up::3 483 0.004148 0.0303 0.06915 0.65% FillPatchInterp(MF) 728 0.0656 0.06699 0.06844 0.64% FabArrayBase::getCPC() 29651 0.05643 0.06328 0.06792 0.63% MLMG::prepareForSolve() 360 0.06159 0.06489 0.06745 0.63% Castro::initData() 7 0.04722 0.05764 0.06667 0.62% FabArray::Xpay() 59602 0.05263 0.06067 0.06503 0.61% Gravity::get_old_grav_vector() 140 0.05994 0.06219 0.06413 0.60% MLCellLinOp::defineAuxData() 360 0.04522 0.05314 0.06235 0.58% FluxRegister::Reflux() 960 0.04878 0.05539 0.06092 0.57% Castro::init(old) 28 0.04683 0.05444 0.05914 0.55% MLCellLinOp::updateSolBC() 871 0.04606 0.05409 0.05894 0.55% Castro::Castro() 35 0.03741 0.04388 0.05228 0.49% amrex::Add() 7701 0.03834 0.04597 0.05162 0.48% Gravity::GetCrsePhi() 250 0.0194 0.03438 0.05136 0.48% MLCellLinOp::updateCorBC() 771 0.0412 0.04654 0.05072 0.47% MLMG::interpCorrection_1 771 0.02964 0.03681 0.04688 0.44% Castro::finalize_advance() 140 0.03636 0.04004 0.04557 0.43% FabArrayBase::CPC::define() 4099 0.03047 0.03613 0.04055 0.38% MLCellLinOp::defineBC() 360 0.02257 0.02906 0.03775 0.35% Castro::apply_source_to_state() 520 0.02965 0.03486 0.03773 0.35% Amr::grid_places() 23 0.02234 0.03018 0.03709 0.35% AmrMesh::MakeNewGrids() 23 0.02196 0.02982 0.0368 0.34% MLMG::mgVcycle_down::2 483 0.03204 0.0333 0.03513 0.33% Amr::writePlotFile() 2 0.03399 0.03407 0.0341 0.32% Castro::construct_old_source() 700 0.02547 0.02954 0.03168 0.30% FabArrayBase::getFB() 157859 0.02596 0.02783 0.03066 0.29% Gravity::fill_multipole_BCs() 70 0.02704 0.02843 0.02981 0.28% Castro::initMFs() 35 0.02048 0.02435 0.02839 0.27% VisMF::Write(FabArray) 6 0.008837 0.01165 0.02761 0.26% Castro::FluxRegCrseInit 140 0.0256 0.02678 0.02718 0.25% BndryData::define() 540 0.0146 0.01963 0.02618 0.24% MLMG::mgVcycle_down::3 483 0.005642 0.01483 0.02591 0.24% Castro::enforce_min_density() 1182 0.01864 0.02111 0.02345 0.22% Castro::check_for_nan() 280 0.01765 0.02082 0.02305 0.22% MultiFab::contains_nan() 280 0.01744 0.02063 0.02284 0.21% Castro::errorEst() 34 0.01057 0.01694 0.02176 0.20% Castro::computeNewDt() 28 0.01908 0.02009 0.02087 0.19% Castro::derive() 34 0.007621 0.01422 0.01901 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01634 0.01721 0.01856 0.17% MLMG::getGradSolution() 360 0.01313 0.01537 0.01809 0.17% MLCellLinOp::compGrad() 450 0.01284 0.01509 0.01782 0.17% Gravity::update_max_rhs() 30 0.01411 0.01524 0.01716 0.16% Amr::InitializeInit() 1 0.00756 0.01104 0.0151 0.14% Amr::defBaseLevel() 1 0.007558 0.01104 0.01509 0.14% AmrLevel::AmrLevel(dm) 35 0.01041 0.01195 0.01352 0.13% StateData::define() 140 0.01019 0.0117 0.01328 0.12% MLPoisson::FFlux() 7882 0.007599 0.01101 0.01278 0.12% Castro::FluxRegFineAdd() 140 0.005163 0.007937 0.01245 0.12% MLMG::mgVcycle_down::4 483 0.005096 0.00632 0.01159 0.11% FabArrayBase::TheFPinfo() 728 0.002115 0.00603 0.01143 0.11% Castro::swap_state_time_levels() 140 0.005832 0.007694 0.01114 0.10% FPinfo::FPinfo() 7 0.001195 0.005054 0.01048 0.10% MLMG::MLResNormInf() 440 0.007863 0.008934 0.01015 0.09% average_down_faces 360 0.00803 0.009309 0.01006 0.09% Castro::construct_old_gravity_source() 140 0.007499 0.00911 0.009982 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003723 0.006716 0.009112 0.09% Castro::computeInitialDt() 2 0.001047 0.005268 0.008857 0.08% MLMG::mgVcycle_up::4 483 0.004032 0.004882 0.008839 0.08% Castro::buildMetrics() 35 0.005684 0.006492 0.008406 0.08% MultiFab::max() 90 0.003778 0.005527 0.00829 0.08% MLMG::mgVcycle_down::5 483 0.004995 0.005601 0.008194 0.08% StateDataPhysBCFunct::() 1617 0.00281 0.005222 0.007825 0.07% MLLinOp::define() 360 0.006245 0.006734 0.007635 0.07% MLMG::mgVcycle_down::6 483 0.005033 0.005495 0.007297 0.07% MLLinOp::defineGrids() 360 0.005836 0.006292 0.007165 0.07% BoxList::parallelComplementIn() 57 0.0004366 0.004167 0.006778 0.06% MLMG::mgVcycle_up::6 483 0.004693 0.005161 0.006755 0.06% BoxList::pci 22 0.0003971 0.004132 0.006746 0.06% MLMG::mgVcycle_up::5 483 0.004202 0.004693 0.006559 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0001663 0.003058 0.006524 0.06% DistributionMapping::SFCProcessorMapDoIt() 5 0.000142 0.003032 0.006499 0.06% StateData::FillBoundary(geom) 745 0.001495 0.003794 0.006306 0.06% MLMG::MLRhsNormInf() 360 0.005459 0.005914 0.006268 0.06% Gravity::applyMetricTerms() 90 0.005231 0.00572 0.006123 0.06% FabArray::mult() 1063 0.004394 0.005192 0.005849 0.05% MLPoisson::prepareForSolve() 360 0.003178 0.004039 0.005311 0.05% MLCellLinOp::prepareForSolve() 360 0.002895 0.003779 0.005055 0.05% FabArray::norminf(mask) 270 0.003381 0.004075 0.004632 0.04% Gravity::swapTimeLevels() 140 0.002997 0.003769 0.00448 0.04% FabArray::setDomainBndry() 1617 0.003603 0.003898 0.004264 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002937 0.003561 0.004105 0.04% TagBoxArray::mapPRD 34 0.001208 0.001956 0.003312 0.03% MultiFab::Subtract() 420 0.001919 0.002477 0.00305 0.03% AmrMesh-cluster 4 0 0.0002943 0.002354 0.02% MLLinOp::makeSubCommunicator() 70 0.001301 0.001549 0.001952 0.02% TagBoxArray::collate() 34 0.0006542 0.001022 0.001747 0.02% Castro::apply_tagging_restrictions() 34 0.001141 0.001424 0.001614 0.02% ClusterList::chop() 4 0 0.0001804 0.001443 0.01% AMRErrorTag::operator() 34 0.0009604 0.001215 0.001371 0.01% Castro::finalize_do_advance() 140 0.0004159 0.0005632 0.0007467 0.01% FabArrayBase::FB::FB() 299 0.0001974 0.0004238 0.0007274 0.01% Castro::build_fine_mask() 40 0.0005667 0.0006157 0.0006595 0.01% Amr::InitAmr() 1 0.0003003 0.0004003 0.0005674 0.01% ClusterList::intersect() 4 0 7.002e-05 0.0005601 0.01% MLLinOp::makeAgglomeratedDMap 70 0.000487 0.000521 0.0005589 0.01% Castro::enforce_speed_limit() 1182 0.0003756 0.0003888 0.0004089 0.00% makeSFC 350 0.0003247 0.0003525 0.0003765 0.00% OwnerMask() 34 0.0001581 0.0001875 0.0002165 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001932 0.0002015 0.0002115 0.00% MultiFab::Multiply() 40 0.0001596 0.0001661 0.0001735 0.00% DistributionMapping::Distribute() 355 0.0001418 0.0001513 0.0001584 0.00% Castro::enforce_consistent_e() 7 7.902e-05 9.64e-05 0.0001243 0.00% FabArray::RecvLayoutMask() 90 9.436e-05 0.0001091 0.0001213 0.00% knapsack() 7 0.0001041 0.0001079 0.0001116 0.00% Castro::create_source_corrector() 140 6.717e-05 7.66e-05 8.947e-05 0.00% BoxList::complementIn 574 6.713e-05 7.331e-05 8.305e-05 0.00% Amr::writeSmallPlotFile() 1 3.297e-05 3.883e-05 7.385e-05 0.00% Castro::retry_advance_ctu() 140 4.568e-05 5.961e-05 6.999e-05 0.00% Gravity::set_mass_offset() 21 1.939e-05 2.276e-05 2.574e-05 0.00% Amr::initSubcycle() 1 1.488e-05 1.727e-05 2.156e-05 0.00% Castro::apply_problem_tags() 34 1.392e-05 1.59e-05 1.773e-05 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 9 B 11 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.03-6-g5b7fa9867d02) finalized