MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.06-1-g08326158c80e) initialized Starting run at 18:40:04 UTC on 2023-06-04. Successfully read inputs file ... Castro git describe: 23.06-10-gcab86d3df AMReX git describe: 23.06-1-g08326158c Microphysics git describe: 23.06-2-g726fe1e2 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001737093 new finest: 1 grid_places() time: 0.008047777 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.010738926 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.011797599 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.020370279 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.542281414 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000599524 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.575234187 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000806805 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.594267628 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000590887 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.541382983 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000777496 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.536987464 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000514746 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.527579534 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000755261 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.535971483 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000536892 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.533389906 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000767023 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.537625862 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000536367 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.519668481 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000749432 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.528843664 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000515687 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.521393711 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.00076281 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.527089074 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.00054755 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.522340197 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.00075153 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.530371554 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000531648 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.55663662 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000800722 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.548734646 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000519273 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.572616754 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000843999 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.567806951 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000515659 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.540661331 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.018144377 seconds Ending run at 18:40:16 UTC on 2023-06-04. Run time = 11.12682783 Run time without initialization = 10.8834241 Average number of zones advanced per microsecond: 0.810 Average number of zones advanced per microsecond per rank: 0.101 TinyProfiler total time across processes [min...avg...max]: 11.13 ... 11.13 ... 11.13 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9814 2.3868 2.6536 23.85% MLCGSolver::ParallelAllReduce 243542 0.932 1.167 1.454 13.06% MLPoisson::Fsmooth() 54976 0.9545 1.063 1.162 10.45% check_for_negative_density() 140 0.3144 0.5885 0.9958 8.95% FillBoundary_finish() 157859 0.4824 0.6396 0.8218 7.39% FillBoundary_nowait() 157859 0.5577 0.6768 0.7909 7.11% FabArray::ParallelCopy_finish() 21259 0.3726 0.5199 0.6889 6.19% MLCellLinOp::applyBC() 165252 0.2353 0.3293 0.4261 3.83% MLPoisson::Fapply() 108875 0.2491 0.2822 0.3004 2.70% FabArray::ParallelCopy_nowait() 21259 0.1697 0.1897 0.2174 1.95% amrex::Dot() 193316 0.1622 0.189 0.2093 1.88% FabArray::setVal() 27514 0.136 0.1727 0.203 1.82% Castro::estTimeStep() 308 0.1183 0.1619 0.2015 1.81% Castro::reset_internal_energy(Fab) 5919 0.1454 0.1702 0.1838 1.65% FabArray::Saxpy() 145223 0.1398 0.1589 0.1777 1.60% amrex::Copy() 106562 0.1322 0.1537 0.1724 1.55% Castro::normalize_species() 1182 0.1233 0.1433 0.1564 1.41% MLCGSolver::bicgstab 1420 0.1197 0.1265 0.1362 1.22% FabArray::norminf() 100641 0.1076 0.122 0.1333 1.20% MLPoisson::normalize() 98078 0.09888 0.1117 0.118 1.06% Castro::construct_new_gravity_source() 260 0.07356 0.0866 0.0952 0.86% amrex::average_down 8093 0.06706 0.07639 0.08378 0.75% Castro::computeTemp() 1189 0.06336 0.07304 0.08165 0.73% FabArray::LinComb() 96778 0.05715 0.06917 0.07983 0.72% MLMG::ResNormInf() 2383 0.02112 0.04997 0.07831 0.70% Castro::initData() 7 0.04364 0.0559 0.0726 0.65% FillPatchInterp(MF) 728 0.06612 0.06685 0.06833 0.61% FabArray::Xpay() 59602 0.04924 0.05842 0.06559 0.59% FillPatchIterator::Initialize 889 0.04655 0.05169 0.0573 0.51% FabArray::FillBoundary() 157859 0.05046 0.05246 0.05498 0.49% MLMG::addInterpCorrection() 6101 0.04473 0.04863 0.05375 0.48% amrex::Add() 7701 0.04163 0.04587 0.05279 0.47% MLCellLinOp::defineAuxData() 360 0.03717 0.04234 0.05036 0.45% MLMG::prepareForSolve() 360 0.03557 0.0388 0.04457 0.40% MLCellLinOp::apply() 108875 0.03757 0.03953 0.04188 0.38% amrex::average_down_w_geom 248 0.03017 0.03632 0.04187 0.38% FillPatchSingleLevel 1617 0.02846 0.03718 0.04067 0.37% FabArrayBase::CPC::define() 4099 0.03056 0.03582 0.04059 0.36% Castro::reflux() 60 0.02653 0.03166 0.03717 0.33% Gravity::actual_solve_with_mlmg() 360 0.02295 0.02744 0.03581 0.32% FluxRegister::Reflux() 960 0.02591 0.03116 0.03482 0.31% Gravity::fill_multipole_BCs() 70 0.02772 0.02953 0.03296 0.30% VisMF::Write(FabArray) 6 0.008812 0.01229 0.03275 0.29% Amr::writePlotFile() 2 0.006362 0.02692 0.03052 0.27% MLCellLinOp::reflux() 951 0.02202 0.02546 0.0305 0.27% MLMG::solve() 360 0.008872 0.01963 0.0297 0.27% Castro::initMFs() 35 0.0206 0.02626 0.0289 0.26% FillPatchTwoLevels 756 0.02663 0.02737 0.02848 0.26% FabArrayBase::getFB() 157859 0.02566 0.02679 0.02809 0.25% FabArrayBase::getCPC() 29651 0.02602 0.02722 0.02796 0.25% Castro::initialize_do_advance() 140 0.02061 0.02519 0.02781 0.25% Amr::coarseTimeStep() 20 0.002438 0.00601 0.02698 0.24% MLCellLinOp::updateSolBC() 871 0.0117 0.01701 0.02453 0.22% Castro::enforce_min_density() 1182 0.01839 0.02101 0.02362 0.21% Castro::construct_new_source() 1300 0.02026 0.02135 0.02309 0.21% MultiFab::contains_nan() 280 0.0171 0.02057 0.02293 0.21% MLCellLinOp::updateCorBC() 771 0.01097 0.01563 0.02251 0.20% MLMG::interpCorrection_1 771 0.01515 0.01817 0.02168 0.19% BndryData::define() 540 0.012 0.01551 0.0209 0.19% Castro::FluxRegCrseInit 140 0.01326 0.01639 0.01923 0.17% MLCellLinOp::smooth() 27488 0.01614 0.01665 0.01746 0.16% StateData::define() 140 0.01035 0.01329 0.01528 0.14% Gravity::get_new_grav_vector() 263 0.01075 0.01239 0.01489 0.13% MLPoisson::FFlux() 7882 0.007768 0.01168 0.0143 0.13% FPinfo::FPinfo() 7 0.002034 0.00722 0.01368 0.12% Castro::initialize_advance() 140 0.00866 0.01072 0.01278 0.11% MLCellLinOp::setLevelBC() 450 0.007518 0.009682 0.01249 0.11% Castro::FluxRegFineAdd() 140 0.00585 0.008069 0.01224 0.11% Castro::construct_old_source() 700 0.01038 0.01103 0.01207 0.11% MLCellLinOp::defineBC() 360 0.007879 0.009199 0.0113 0.10% MLCellLinOp::compGrad() 450 0.008022 0.009424 0.01051 0.09% Castro::construct_old_gravity_source() 140 0.00746 0.008916 0.009869 0.09% FabArray::ParallelCopy() 21259 0.008765 0.009014 0.00946 0.09% MultiFab::max() 90 0.005228 0.00704 0.00934 0.08% Castro::swap_state_time_levels() 140 0.00601 0.007458 0.009299 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003878 0.00667 0.008959 0.08% Gravity::get_old_grav_vector() 140 0.005471 0.006483 0.008856 0.08% Castro::buildMetrics() 35 0.005599 0.006797 0.008824 0.08% DistributionMapping::LeastUsedCPUs() 12 0.0001503 0.003435 0.007566 0.07% FabArray::mult() 1063 0.005214 0.006036 0.006916 0.06% Gravity::applyMetricTerms() 90 0.005626 0.006344 0.006703 0.06% BoxList::pci 22 0.0004031 0.003989 0.00663 0.06% Amr::regrid() 21 0.004096 0.004974 0.006559 0.06% StateData::FillBoundary(geom) 745 0.001465 0.003638 0.006258 0.06% Amr::timeStep() 140 0.003204 0.003828 0.006131 0.06% Gravity::solve_for_phi() 280 0.005436 0.005687 0.006052 0.05% AmrMesh::MakeNewGrids() 23 0.002954 0.005291 0.006024 0.05% Gravity::gravity_sync() 60 0.00457 0.00499 0.005508 0.05% MLCellLinOp::prepareForSolve() 360 0.00287 0.003833 0.005189 0.05% MLLinOp::defineGrids() 360 0.004068 0.004426 0.005044 0.05% FabArray::norminf(mask) 270 0.003117 0.004047 0.004914 0.04% Castro::Castro() 35 0.003869 0.00437 0.004613 0.04% MLCellLinOp::correctionResidual() 9063 0.004092 0.004274 0.004556 0.04% FabArray::setDomainBndry() 1617 0.003519 0.003849 0.004401 0.04% MLMG::mgVcycle() 3385 0.00388 0.004089 0.004341 0.04% average_down_faces 360 0.002261 0.00264 0.003293 0.03% MLMG::actualBottomSolve() 1843 0.002312 0.002564 0.00319 0.03% MLMG::MLResNormInf() 440 0.001078 0.001683 0.003118 0.03% Gravity::update_max_rhs() 30 0.002401 0.0027 0.003057 0.03% MultiFab::Subtract() 420 0.001853 0.002362 0.002872 0.03% Gravity::GetCrsePhi() 250 0.001982 0.0025 0.002855 0.03% Castro::construct_old_gravity() 140 0.002145 0.002437 0.002695 0.02% MLMG::oneIter() 1843 0.00248 0.002535 0.002664 0.02% Castro::reset_internal_energy(MultiFab) 1189 0.001711 0.002045 0.002582 0.02% MLLinOp::makeSubCommunicator() 70 0.001492 0.001707 0.002285 0.02% MLMG:computeResOfCorrection() 6101 0.002035 0.002091 0.002148 0.02% TagBoxArray::collate() 34 0.0006264 0.001116 0.00207 0.02% Gravity::create_comp_minus_level_grad_phi() 60 0.001537 0.001848 0.002046 0.02% Gravity::average_fine_ec_onto_crse_ec() 90 0.001533 0.001698 0.001939 0.02% MLMG::mgVcycle_bottom 3385 0.001775 0.001828 0.001887 0.02% MLCellLinOp::solutionResidual() 3154 0.001639 0.001744 0.001805 0.02% MLMG::mgVcycle_down::0 1843 0.001644 0.001712 0.001781 0.02% Castro::apply_tagging_restrictions() 34 0.001206 0.001461 0.001697 0.02% Gravity::solve_phi_with_mlmg() 300 0.0008912 0.001172 0.001606 0.01% Castro::do_advance_ctu() 140 0.001409 0.00153 0.0016 0.01% Castro::finalize_advance() 140 0.00112 0.001294 0.001567 0.01% Gravity::multilevel_solve_for_new_phi() 20 0.001206 0.00141 0.001548 0.01% main() 1 0.0006927 0.001036 0.001514 0.01% StateDataPhysBCFunct::() 1617 0.001315 0.001397 0.001478 0.01% AMRErrorTag::operator() 34 0.001013 0.001254 0.001477 0.01% Castro::clean_state() 1182 0.001306 0.001385 0.001476 0.01% ClusterList::chop() 4 0 0.000183 0.001464 0.01% MLMG::mgVcycle_down::1 1843 0.001342 0.001385 0.001436 0.01% MLMG::mgVcycle_up::1 1843 0.001306 0.001351 0.001426 0.01% MLMG::mgVcycle_up::0 1843 0.001095 0.001141 0.001174 0.01% Castro::expand_state() 200 0.0009333 0.001058 0.00116 0.01% FabArrayBase::TheFPinfo() 728 0.0008545 0.0009229 0.0009745 0.01% MLMG::computeResWithCrseSolFineCor() 771 0.0008565 0.0008882 0.0009399 0.01% MLMG::computeResidual() 1843 0.0007958 0.0008464 0.0008752 0.01% MLPoisson::define() 360 0.0007059 0.0007626 0.0008684 0.01% Castro::construct_new_gravity() 140 0.0007185 0.0007757 0.0008004 0.01% Castro::finalize_do_advance() 140 0.0004389 0.0005542 0.0007408 0.01% FabArrayBase::FB::FB() 299 0.0001829 0.0004346 0.0007268 0.01% Castro::build_fine_mask() 40 0.0005435 0.0006084 0.0006753 0.01% Castro::do_new_sources() 260 0.0005746 0.0006382 0.0006743 0.01% Castro::derive() 34 0.0004694 0.000532 0.0006068 0.01% Amr::grid_places() 23 0.0003166 0.0003829 0.0005883 0.01% Gravity::actual_multilevel_solve() 20 0.0004784 0.0005384 0.0005733 0.01% MLMG::miniCycle() 1542 0.0005254 0.0005476 0.0005678 0.01% ClusterList::intersect() 4 0 6.983e-05 0.0005587 0.01% Castro::apply_source_to_state() 520 0.0004469 0.0004951 0.0005373 0.00% Amr::InitAmr() 1 0.0002948 0.0003827 0.0005348 0.00% MLMG::computeMLResidual() 440 0.0004399 0.000457 0.0004995 0.00% MLMG::computeResWithCrseCorFineCor() 771 0.0004448 0.0004668 0.0004968 0.00% MLLinOp::define() 360 0.0003952 0.0004231 0.0004816 0.00% Castro::init(old) 28 0.0003261 0.0003786 0.0004462 0.00% Castro::subcycle_advance_ctu() 140 0.0003662 0.0004046 0.0004403 0.00% Castro::enforce_speed_limit() 1182 0.0003583 0.0003832 0.0004122 0.00% Castro::advance() 140 0.0003435 0.0003738 0.0004003 0.00% MLMG::mgVcycle_down::2 483 0.0003585 0.0003785 0.0003972 0.00% MLMG::mgVcycle_down::6 483 0.0003551 0.0003664 0.0003851 0.00% Castro::do_old_sources() 140 0.0003113 0.00034 0.0003734 0.00% MLMG::mgVcycle_down::4 483 0.0002942 0.0003279 0.0003665 0.00% MLMG::mgVcycle_down::3 483 0.0003076 0.0003409 0.0003654 0.00% AmrMesh-cluster 4 0 4.098e-05 0.0003278 0.00% MLMG::mgVcycle_down::5 483 0.0002828 0.0003006 0.0003245 0.00% Gravity::swapTimeLevels() 140 0.0002516 0.0002683 0.00031 0.00% AmrLevel::AmrLevel(dm) 35 0.0002316 0.0002645 0.0003019 0.00% MLPoisson::prepareForSolve() 360 0.0002408 0.0002602 0.0002871 0.00% MLMG::getGradSolution() 360 0.000259 0.0002708 0.0002817 0.00% MLMG::mgVcycle_up::6 483 0.0002379 0.0002495 0.0002783 0.00% MLMG::mgVcycle_up::2 483 0.0002351 0.0002471 0.0002619 0.00% MLMG::mgVcycle_up::3 483 0.0002035 0.0002273 0.000252 0.00% MLMG::mgVcycle_up::5 483 0.0002211 0.0002334 0.0002511 0.00% TagBoxArray::mapPRD 34 0.0001978 0.000214 0.0002376 0.00% makeSFC 350 0.0001863 0.0002171 0.0002369 0.00% MLMG::mgVcycle_up::4 483 0.0002063 0.00022 0.0002334 0.00% OwnerMask() 34 0.0001698 0.0001896 0.0002235 0.00% Castro::check_for_nan() 280 0.0001721 0.0001874 0.0002089 0.00% Castro::post_regrid() 66 0.0001462 0.00017 0.0001999 0.00% Castro::avgDown(state_indx) 248 0.0001621 0.0001806 0.0001947 0.00% Castro::post_timestep() 140 0.0001594 0.0001688 0.000183 0.00% Castro::enforce_consistent_e() 7 7.763e-05 0.0001071 0.0001714 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001486 0.0001588 0.0001686 0.00% MultiFab::Multiply() 40 0.0001532 0.0001606 0.0001659 0.00% DistributionMapping::Distribute() 355 0.0001439 0.0001534 0.0001632 0.00% MLMG::MLRhsNormInf() 360 0.0001429 0.0001501 0.0001576 0.00% Gravity::solve_for_delta_phi 60 9.057e-05 0.0001162 0.0001473 0.00% Amr::FinalizeInit() 1 3.789e-06 2.126e-05 0.0001345 0.00% knapsack() 7 0.0001011 0.0001119 0.0001262 0.00% FabArray::RecvLayoutMask() 90 9.116e-05 0.000108 0.000119 0.00% BoxList::complementIn 574 7.029e-05 7.92e-05 9.238e-05 0.00% Castro::create_source_corrector() 140 7.001e-05 7.639e-05 8.767e-05 0.00% Castro::errorEst() 34 6.136e-05 6.793e-05 7.514e-05 0.00% Castro::avgDown() 62 6.1e-05 6.768e-05 7.488e-05 0.00% Castro::retry_advance_ctu() 140 4.537e-05 5.418e-05 6.861e-05 0.00% Castro::computeNewDt() 28 3.98e-05 4.368e-05 4.757e-05 0.00% Amr::defBaseLevel() 1 1.72e-05 2.599e-05 3.872e-05 0.00% Amr::writeSmallPlotFile() 1 3.175e-05 3.434e-05 3.685e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.937e-05 3.223e-05 3.527e-05 0.00% Amr::bldFineLevels() 1 2.247e-05 2.673e-05 3.396e-05 0.00% Gravity::set_mass_offset() 21 1.858e-05 2.422e-05 2.824e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.194e-05 2.469e-05 2.714e-05 0.00% BoxList::parallelComplementIn() 57 2.187e-05 2.34e-05 2.574e-05 0.00% Castro::apply_problem_tags() 34 1.477e-05 1.573e-05 1.717e-05 0.00% Amr::initSubcycle() 1 9.245e-06 1.203e-05 1.69e-05 0.00% Castro::post_init() 3 8.47e-06 9.289e-06 1.024e-05 0.00% Amr::initialInit() 1 1.247e-06 2.013e-06 6.275e-06 0.00% Amr::InitializeInit() 1 2.3e-06 3.016e-06 5.954e-06 0.00% Castro::computeInitialDt() 2 3.16e-06 3.62e-06 4.598e-06 0.00% Amr::init() 1 1.583e-06 1.882e-06 2.127e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 11.13 11.13 11.13 100.00% Amr::coarseTimeStep() 20 10.86 10.86 10.86 97.63% Amr::timeStep() 140 10.82 10.84 10.85 97.47% Castro::advance() 140 7.916 7.92 7.924 71.21% Castro::subcycle_advance_ctu() 140 7.702 7.732 7.77 69.83% Castro::do_advance_ctu() 140 7.702 7.731 7.77 69.83% Gravity::actual_solve_with_mlmg() 360 5.927 5.936 5.95 53.47% MLMG::solve() 360 5.75 5.759 5.766 51.82% MLMG::oneIter() 1843 5.355 5.389 5.409 48.61% MLMG::mgVcycle() 3385 4.95 5.004 5.048 45.37% Gravity::solve_phi_with_mlmg() 300 4.438 4.446 4.46 40.09% Gravity::solve_for_phi() 280 3.726 3.732 3.745 33.66% MLMG::mgVcycle_bottom 3385 3.368 3.391 3.405 30.60% MLMG::actualBottomSolve() 1843 2.946 2.954 2.98 26.78% Castro::construct_new_gravity() 140 2.965 2.969 2.977 26.76% MLCGSolver::bicgstab 1420 2.942 2.951 2.976 26.74% Castro::construct_ctu_hydro_source() 140 1.981 2.387 2.654 23.85% Castro::post_timestep() 140 2.095 2.116 2.122 19.07% Castro::reflux() 60 1.966 1.981 1.997 17.95% MLCellLinOp::applyBC() 165252 1.465 1.696 1.924 17.29% MLCellLinOp::smooth() 27488 1.663 1.739 1.799 16.17% FabArray::FillBoundary() 157859 1.176 1.396 1.649 14.82% Gravity::gravity_sync() 60 1.633 1.633 1.634 14.68% Gravity::solve_for_delta_phi 60 1.548 1.549 1.55 13.93% MLCGSolver::ParallelAllReduce 243542 1.035 1.264 1.537 13.81% MLCellLinOp::apply() 108875 1.178 1.333 1.489 13.38% MLPoisson::Fsmooth() 54976 0.9545 1.063 1.162 10.45% check_for_negative_density() 140 0.3144 0.5885 0.9958 8.95% FabArray::ParallelCopy() 21259 0.6409 0.7768 0.9326 8.38% Castro::construct_old_gravity() 140 0.8898 0.8953 0.9017 8.10% Amr::regrid() 21 0.8545 0.8617 0.8718 7.83% FillBoundary_finish() 157859 0.4824 0.6396 0.8218 7.39% FillBoundary_nowait() 157859 0.5851 0.704 0.8191 7.36% Gravity::multilevel_solve_for_new_phi() 20 0.7293 0.7317 0.7327 6.58% Gravity::actual_multilevel_solve() 20 0.7278 0.7303 0.7313 6.57% FabArray::ParallelCopy_finish() 21259 0.3726 0.5199 0.6889 6.19% Castro::post_regrid() 66 0.6729 0.6767 0.679 6.10% FillPatchIterator::Initialize 889 0.4903 0.5412 0.6255 5.62% MLMG::mgVcycle_down::0 1843 0.5026 0.524 0.5453 4.90% FillPatchTwoLevels 756 0.4061 0.4595 0.545 4.90% MLMG::mgVcycle_up::0 1843 0.4698 0.4826 0.4911 4.41% MLMG::miniCycle() 1542 0.4082 0.4374 0.459 4.13% Castro::clean_state() 1182 0.353 0.41 0.4485 4.03% FillPatchSingleLevel 1617 0.2475 0.2977 0.3901 3.51% Castro::initialize_do_advance() 140 0.2989 0.3179 0.3446 3.10% Castro::expand_state() 200 0.247 0.2691 0.3143 2.82% MLCellLinOp::correctionResidual() 9063 0.255 0.2845 0.3052 2.74% MLPoisson::Fapply() 108875 0.2491 0.2822 0.3004 2.70% FabArray::ParallelCopy_nowait() 21259 0.2224 0.2479 0.2799 2.52% Castro::do_new_sources() 260 0.2157 0.2521 0.2765 2.48% Castro::computeTemp() 1189 0.2107 0.2453 0.2681 2.41% MLMG::mgVcycle_down::1 1843 0.2306 0.2378 0.2478 2.23% Amr::init() 1 0.2427 0.2428 0.2429 2.18% MLCellLinOp::solutionResidual() 3154 0.205 0.2239 0.2409 2.16% Amr::initialInit() 1 0.222 0.2222 0.2223 2.00% Amr::FinalizeInit() 1 0.2043 0.2111 0.2149 1.93% amrex::Dot() 193316 0.1622 0.189 0.2093 1.88% MLMG::computeResWithCrseSolFineCor() 771 0.1599 0.1862 0.2069 1.86% FabArray::setVal() 27514 0.136 0.1727 0.203 1.82% Castro::estTimeStep() 308 0.1183 0.1619 0.2015 1.81% MLMG::mgVcycle_up::1 1843 0.1758 0.1853 0.1909 1.72% Castro::reset_internal_energy(MultiFab) 1189 0.1473 0.1723 0.1864 1.68% Castro::reset_internal_energy(Fab) 5919 0.1454 0.1702 0.1838 1.65% FabArray::Saxpy() 145223 0.1398 0.1589 0.1777 1.60% Castro::initialize_advance() 140 0.1146 0.1479 0.1728 1.55% amrex::Copy() 106562 0.1322 0.1537 0.1724 1.55% amrex::average_down 8093 0.1201 0.1444 0.169 1.52% Castro::normalize_species() 1182 0.1233 0.1433 0.1564 1.41% Castro::construct_new_source() 1300 0.1176 0.1359 0.1482 1.33% MLMG::computeResidual() 1843 0.1126 0.1323 0.1398 1.26% MLMG:computeResOfCorrection() 6101 0.1247 0.1301 0.1353 1.22% MLMG::addInterpCorrection() 6101 0.05978 0.1131 0.1342 1.21% FabArray::norminf() 100641 0.1076 0.122 0.1333 1.20% Castro::avgDown() 62 0.07284 0.09802 0.1262 1.13% Castro::avgDown(state_indx) 248 0.07277 0.09795 0.1261 1.13% amrex::average_down_w_geom 248 0.07259 0.09777 0.1259 1.13% MLPoisson::normalize() 98078 0.09888 0.1117 0.118 1.06% Castro::do_old_sources() 140 0.08555 0.1014 0.1135 1.02% MLMG::mgVcycle_up::2 483 0.02792 0.06927 0.112 1.01% Castro::post_init() 3 0.09853 0.105 0.1109 1.00% MLPoisson::define() 360 0.07744 0.09002 0.1078 0.97% Gravity::get_new_grav_vector() 263 0.1022 0.104 0.1061 0.95% MLMG::ResNormInf() 2383 0.05225 0.07889 0.105 0.94% Amr::bldFineLevels() 1 0.09221 0.09778 0.1038 0.93% MLMG::computeResWithCrseCorFineCor() 771 0.08137 0.09326 0.09766 0.88% MLCellLinOp::reflux() 951 0.07488 0.0886 0.09755 0.88% Castro::construct_new_gravity_source() 260 0.07356 0.0866 0.0952 0.86% FabArray::LinComb() 96778 0.05715 0.06917 0.07983 0.72% Castro::initData() 7 0.04749 0.06072 0.07941 0.71% MLMG::computeMLResidual() 440 0.05612 0.06519 0.07541 0.68% Castro::init(old) 28 0.06014 0.06688 0.07442 0.67% MLCellLinOp::updateSolBC() 871 0.04779 0.06045 0.07141 0.64% MLCellLinOp::setLevelBC() 450 0.02494 0.04412 0.06872 0.62% FabArrayBase::getCPC() 29651 0.05658 0.06303 0.06847 0.62% FillPatchInterp(MF) 728 0.06612 0.06685 0.06833 0.61% MLMG::prepareForSolve() 360 0.06254 0.06614 0.06829 0.61% MLMG::mgVcycle_up::3 483 0.004099 0.02976 0.06803 0.61% FluxRegister::Reflux() 960 0.05325 0.06184 0.06796 0.61% FabArray::Xpay() 59602 0.04924 0.05842 0.06559 0.59% MLCellLinOp::defineAuxData() 360 0.04595 0.05321 0.06262 0.56% Gravity::get_old_grav_vector() 140 0.05914 0.06037 0.06131 0.55% MLCellLinOp::updateCorBC() 771 0.04438 0.05327 0.05995 0.54% Gravity::GetCrsePhi() 250 0.01778 0.03492 0.05312 0.48% amrex::Add() 7701 0.04163 0.04587 0.05279 0.47% Castro::Castro() 35 0.03729 0.04594 0.05253 0.47% MLMG::interpCorrection_1 771 0.03064 0.03802 0.05014 0.45% Castro::finalize_advance() 140 0.03744 0.04019 0.0448 0.40% Amr::grid_places() 23 0.02152 0.0328 0.0413 0.37% AmrMesh::MakeNewGrids() 23 0.02109 0.03242 0.04099 0.37% Castro::apply_source_to_state() 520 0.02927 0.03683 0.04094 0.37% FabArrayBase::CPC::define() 4099 0.03056 0.03582 0.04059 0.36% Amr::writePlotFile() 2 0.03973 0.03985 0.03989 0.36% MLCellLinOp::defineBC() 360 0.0228 0.02898 0.03779 0.34% MLMG::mgVcycle_down::2 483 0.03275 0.034 0.036 0.32% Gravity::fill_multipole_BCs() 70 0.02884 0.03062 0.034 0.31% VisMF::Write(FabArray) 6 0.008812 0.01229 0.03275 0.29% Castro::construct_old_source() 700 0.02537 0.02914 0.03101 0.28% Castro::initMFs() 35 0.0206 0.02626 0.0289 0.26% FabArrayBase::getFB() 157859 0.02593 0.02723 0.02881 0.26% Castro::FluxRegCrseInit 140 0.0257 0.02684 0.02727 0.25% BndryData::define() 540 0.01469 0.0195 0.02615 0.24% Castro::errorEst() 34 0.009976 0.01932 0.02563 0.23% Castro::enforce_min_density() 1182 0.01839 0.02101 0.02362 0.21% MLMG::mgVcycle_down::3 483 0.005585 0.01401 0.02351 0.21% Castro::check_for_nan() 280 0.01731 0.02075 0.02313 0.21% MultiFab::contains_nan() 280 0.0171 0.02057 0.02293 0.21% Castro::derive() 34 0.006749 0.01652 0.02287 0.21% Castro::computeNewDt() 28 0.02058 0.02151 0.02256 0.20% Gravity::average_fine_ec_onto_crse_ec() 90 0.01707 0.01804 0.01931 0.17% Gravity::update_max_rhs() 30 0.01593 0.0174 0.01855 0.17% MLMG::getGradSolution() 360 0.01444 0.01582 0.01845 0.17% MLCellLinOp::compGrad() 450 0.01416 0.01555 0.01818 0.16% Amr::InitializeInit() 1 0.007432 0.01106 0.01766 0.16% Amr::defBaseLevel() 1 0.00743 0.01105 0.01766 0.16% AmrLevel::AmrLevel(dm) 35 0.01058 0.01356 0.01554 0.14% StateData::define() 140 0.01035 0.01329 0.01528 0.14% FabArrayBase::TheFPinfo() 728 0.003109 0.008357 0.01483 0.13% MLPoisson::FFlux() 7882 0.007768 0.01168 0.0143 0.13% FPinfo::FPinfo() 7 0.002255 0.007434 0.01388 0.12% Castro::FluxRegFineAdd() 140 0.00585 0.008069 0.01224 0.11% MLMG::mgVcycle_down::4 483 0.005061 0.006297 0.01194 0.11% Castro::computeInitialDt() 2 0.00114 0.007911 0.01163 0.10% MLMG::MLResNormInf() 440 0.007923 0.009194 0.011 0.10% average_down_faces 360 0.007934 0.009619 0.01065 0.10% Castro::construct_old_gravity_source() 140 0.00746 0.008916 0.009869 0.09% MultiFab::max() 90 0.005228 0.00704 0.00934 0.08% Castro::swap_state_time_levels() 140 0.00601 0.007458 0.009299 0.08% MLMG::mgVcycle_up::4 483 0.004068 0.004937 0.009282 0.08% Castro::buildMetrics() 35 0.005702 0.006919 0.008972 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003878 0.00667 0.008959 0.08% MLMG::mgVcycle_down::5 483 0.004941 0.005613 0.008526 0.08% MLLinOp::define() 360 0.006633 0.007073 0.007824 0.07% StateDataPhysBCFunct::() 1617 0.00278 0.005035 0.007717 0.07% MLMG::mgVcycle_down::6 483 0.00496 0.005473 0.007571 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0001503 0.003435 0.007566 0.07% DistributionMapping::SFCProcessorMapDoIt() 5 0.0001335 0.003401 0.007539 0.07% MLLinOp::defineGrids() 360 0.006231 0.00665 0.007342 0.07% FabArray::mult() 1063 0.005214 0.006036 0.006916 0.06% MLMG::mgVcycle_up::5 483 0.004207 0.004756 0.006802 0.06% MLMG::mgVcycle_up::6 483 0.004678 0.005139 0.006727 0.06% Gravity::applyMetricTerms() 90 0.005626 0.006344 0.006703 0.06% BoxList::parallelComplementIn() 57 0.0004367 0.00403 0.006673 0.06% BoxList::pci 22 0.0004031 0.003989 0.00663 0.06% MLMG::MLRhsNormInf() 360 0.005218 0.005832 0.006358 0.06% StateData::FillBoundary(geom) 745 0.001465 0.003638 0.006258 0.06% MLPoisson::prepareForSolve() 360 0.003157 0.004093 0.005438 0.05% MLCellLinOp::prepareForSolve() 360 0.00287 0.003833 0.005189 0.05% FabArray::norminf(mask) 270 0.003117 0.004047 0.004914 0.04% FabArray::setDomainBndry() 1617 0.003519 0.003849 0.004401 0.04% Gravity::swapTimeLevels() 140 0.002966 0.003729 0.004241 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002888 0.003397 0.003909 0.04% TagBoxArray::mapPRD 34 0.001325 0.002242 0.003285 0.03% MultiFab::Subtract() 420 0.001853 0.002362 0.002872 0.03% AmrMesh-cluster 4 0 0.0002938 0.00235 0.02% MLLinOp::makeSubCommunicator() 70 0.001492 0.001707 0.002285 0.02% TagBoxArray::collate() 34 0.0006264 0.001116 0.00207 0.02% Castro::apply_tagging_restrictions() 34 0.001206 0.001461 0.001697 0.02% AMRErrorTag::operator() 34 0.001013 0.001254 0.001477 0.01% ClusterList::chop() 4 0 0.000183 0.001464 0.01% Castro::finalize_do_advance() 140 0.0004389 0.0005542 0.0007408 0.01% FabArrayBase::FB::FB() 299 0.0001829 0.0004346 0.0007268 0.01% Castro::build_fine_mask() 40 0.0005435 0.0006084 0.0006753 0.01% ClusterList::intersect() 4 0 6.983e-05 0.0005587 0.01% Amr::InitAmr() 1 0.0003051 0.0003947 0.0005508 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0004792 0.0005173 0.0005384 0.00% Castro::enforce_speed_limit() 1182 0.0003583 0.0003832 0.0004122 0.00% makeSFC 350 0.0003183 0.0003585 0.0003813 0.00% DistributionMapping::KnapSackDoIt() 7 0.0002021 0.0002146 0.0002267 0.00% OwnerMask() 34 0.0001698 0.0001896 0.0002235 0.00% Castro::enforce_consistent_e() 7 7.763e-05 0.0001071 0.0001714 0.00% MultiFab::Multiply() 40 0.0001532 0.0001606 0.0001659 0.00% DistributionMapping::Distribute() 355 0.0001439 0.0001534 0.0001632 0.00% knapsack() 7 0.0001011 0.0001119 0.0001262 0.00% FabArray::RecvLayoutMask() 90 9.116e-05 0.000108 0.000119 0.00% BoxList::complementIn 574 7.029e-05 7.92e-05 9.238e-05 0.00% Castro::create_source_corrector() 140 7.001e-05 7.639e-05 8.767e-05 0.00% Castro::retry_advance_ctu() 140 4.537e-05 5.418e-05 6.861e-05 0.00% Amr::writeSmallPlotFile() 1 3.175e-05 3.434e-05 3.685e-05 0.00% Gravity::set_mass_offset() 21 1.858e-05 2.422e-05 2.824e-05 0.00% Castro::apply_problem_tags() 34 1.477e-05 1.573e-05 1.717e-05 0.00% Amr::initSubcycle() 1 9.245e-06 1.203e-05 1.69e-05 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 10 B 11 B 15 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.06-1-g08326158c80e) finalized