MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.04-31-g6a85487dce1b) initialized Starting run at 05:34:35 UTC on 2023-04-25. Successfully read inputs file ... Castro git describe: 23.04-16-gb19bc8626 AMReX git describe: 23.04-31-g6a85487dc Microphysics git describe: 23.04-5-g55ce5a0f reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001529124 new finest: 1 grid_places() time: 0.006622631 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.007438828 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.012395287 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.016949544 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.504587035 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000542159 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.565578032 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000813996 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.543313509 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.00056435 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.557479031 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.00081763 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.511530363 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000523429 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.503250862 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000786972 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.510477752 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000521419 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.544009922 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000823622 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.521085137 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000545902 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.513807176 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000820214 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.558468876 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000572661 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.526573703 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000788203 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.521393437 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000552614 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.516510616 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000801273 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.523841395 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000556026 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.515596168 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000765465 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.520678504 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000556618 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.513175669 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000785974 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.523447016 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.00055727 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.51616261 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.017121387 seconds Ending run at 05:34:45 UTC on 2023-04-25. Run time = 10.72309719 Run time without initialization = 10.53158729 Average number of zones advanced per microsecond: 0.837 Average number of zones advanced per microsecond per rank: 0.105 TinyProfiler total time across processes [min...avg...max]: 10.72 ... 10.72 ... 10.72 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9611 2.3537 2.5923 24.18% MLCGSolver::ParallelAllReduce 243542 0.9014 1.111 1.38 12.87% MLPoisson::Fsmooth() 54976 0.8421 0.9346 1.023 9.54% Castro::do_advance_ctu() 140 0.3077 0.553 0.9461 8.82% FillBoundary_nowait() 157859 0.5522 0.6661 0.7749 7.23% FillBoundary_finish() 157859 0.4678 0.6024 0.7617 7.10% FabArray::ParallelCopy_finish() 21259 0.3435 0.4786 0.6529 6.09% MLCellLinOp::applyBC() 165252 0.223 0.319 0.4113 3.84% MLPoisson::Fapply() 108875 0.2392 0.2757 0.3005 2.80% FabArray::ParallelCopy_nowait() 21259 0.1679 0.188 0.2111 1.97% FabArray::setVal() 27514 0.1548 0.1762 0.2073 1.93% amrex::Dot() 193316 0.1575 0.1839 0.2011 1.88% Castro::estTimeStep() 308 0.1144 0.1562 0.1886 1.76% Castro::reset_internal_energy(Fab) 5919 0.1398 0.168 0.1807 1.68% FabArray::Saxpy() 145223 0.1347 0.1554 0.1705 1.59% amrex::Copy() 106562 0.1287 0.1478 0.1655 1.54% Castro::normalize_species() 1182 0.1266 0.1416 0.1549 1.44% MLCGSolver::bicgstab 1420 0.1185 0.1262 0.1368 1.28% FabArray::norminf() 100641 0.1064 0.12 0.1287 1.20% MLPoisson::normalize() 98078 0.09373 0.1084 0.1175 1.10% Castro::construct_new_gravity_source() 260 0.07715 0.08609 0.09368 0.87% amrex::average_down 8093 0.06655 0.07435 0.08072 0.75% Castro::computeTemp() 1189 0.05996 0.07183 0.08031 0.75% FabArray::LinComb() 96778 0.05489 0.0687 0.07868 0.73% MLMG::ResNormInf() 2383 0.02213 0.04879 0.07569 0.71% FillPatchInterp(MF) 728 0.06543 0.06619 0.06671 0.62% FabArray::Xpay() 59602 0.05018 0.05908 0.06547 0.61% Castro::initData() 7 0.04424 0.05441 0.06189 0.58% MLMG::addInterpCorrection() 6101 0.04673 0.05128 0.05626 0.52% FillPatchIterator::Initialize 889 0.04877 0.05146 0.05387 0.50% FabArray::FillBoundary() 157859 0.05104 0.05214 0.05347 0.50% MLCellLinOp::defineAuxData() 360 0.03714 0.04227 0.05006 0.47% amrex::Add() 7701 0.04219 0.04634 0.04992 0.47% FillPatchSingleLevel 1617 0.03151 0.03915 0.04478 0.42% MLMG::prepareForSolve() 360 0.03556 0.03892 0.04471 0.42% amrex::average_down_w_geom 248 0.02989 0.03495 0.04017 0.37% FabArrayBase::CPC::define() 4099 0.03048 0.03549 0.03981 0.37% MLCellLinOp::apply() 108875 0.0349 0.03576 0.03725 0.35% Gravity::actual_solve_with_mlmg() 360 0.02263 0.02746 0.03593 0.34% Castro::reflux() 60 0.02661 0.03101 0.03442 0.32% Castro::enforce_min_density() 1182 0.02685 0.03042 0.0337 0.31% FluxRegister::Reflux() 960 0.02334 0.02989 0.03287 0.31% Gravity::fill_multipole_BCs() 70 0.02682 0.0289 0.0325 0.30% MLMG::solve() 360 0.01307 0.02216 0.03096 0.29% Castro::initMFs() 35 0.02231 0.02502 0.02941 0.27% VisMF::Write(FabArray) 6 0.008695 0.01187 0.02923 0.27% FillPatchTwoLevels 756 0.02638 0.02759 0.0289 0.27% FabArrayBase::getCPC() 29651 0.02582 0.02714 0.02853 0.27% Castro::initialize_do_advance() 140 0.02222 0.02612 0.02768 0.26% FabArrayBase::getFB() 157859 0.02547 0.02609 0.02758 0.26% Amr::writePlotFile() 2 0.005362 0.02275 0.02599 0.24% MLCellLinOp::reflux() 951 0.019 0.02229 0.02573 0.24% MLCellLinOp::updateSolBC() 871 0.01158 0.01692 0.02397 0.22% Amr::coarseTimeStep() 20 0.002148 0.005168 0.02283 0.21% MultiFab::contains_nan() 280 0.01736 0.02045 0.02281 0.21% Castro::construct_new_source() 1300 0.02092 0.02132 0.02165 0.20% MLCellLinOp::updateCorBC() 771 0.01056 0.01526 0.02148 0.20% BndryData::define() 540 0.01207 0.01548 0.0209 0.19% MLMG::interpCorrection_1 771 0.0154 0.01777 0.02073 0.19% Castro::FluxRegCrseInit 140 0.01343 0.01648 0.01848 0.17% MLCellLinOp::smooth() 27488 0.01602 0.01676 0.01733 0.16% Gravity::get_new_grav_vector() 263 0.01084 0.01222 0.01435 0.13% FPinfo::FPinfo() 7 0.0009861 0.007915 0.01413 0.13% StateData::define() 140 0.01095 0.01207 0.01387 0.13% Castro::initialize_advance() 140 0.009722 0.01129 0.01353 0.13% MLPoisson::FFlux() 7882 0.006624 0.01053 0.01306 0.12% Castro::FluxRegFineAdd() 140 0.007178 0.008324 0.01235 0.12% Castro::construct_old_source() 700 0.01042 0.0112 0.01223 0.11% MLCellLinOp::setLevelBC() 450 0.007454 0.009523 0.01215 0.11% Castro::swap_state_time_levels() 140 0.006741 0.007843 0.01137 0.11% MLCellLinOp::defineBC() 360 0.007806 0.00908 0.01108 0.10% MLCellLinOp::compGrad() 450 0.008705 0.009512 0.01052 0.10% Castro::construct_old_gravity_source() 140 0.00733 0.009142 0.009884 0.09% Gravity::get_old_grav_vector() 140 0.005509 0.006475 0.009048 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003804 0.006597 0.008946 0.08% FabArray::ParallelCopy() 21259 0.008545 0.00874 0.008926 0.08% Castro::buildMetrics() 35 0.005829 0.006352 0.00831 0.08% MultiFab::max() 90 0.003737 0.005541 0.007821 0.07% DistributionMapping::LeastUsedCPUs() 12 0.000245 0.003652 0.006477 0.06% Gravity::solve_for_phi() 280 0.005233 0.005756 0.00645 0.06% StateData::FillBoundary(geom) 745 0.001524 0.003779 0.006422 0.06% Amr::regrid() 21 0.003743 0.004746 0.006334 0.06% Gravity::applyMetricTerms() 90 0.005078 0.00559 0.006158 0.06% AmrMesh::MakeNewGrids() 23 0.003119 0.005503 0.00612 0.06% FabArray::mult() 1063 0.004196 0.005118 0.006047 0.06% Amr::timeStep() 140 0.002848 0.003663 0.005953 0.06% BoxList::pci 22 0.0004603 0.00308 0.00543 0.05% Gravity::gravity_sync() 60 0.00441 0.004945 0.005365 0.05% MLCellLinOp::prepareForSolve() 360 0.00292 0.003846 0.005337 0.05% MLLinOp::defineGrids() 360 0.004038 0.004314 0.004923 0.05% FabArray::norminf(mask) 270 0.00311 0.00389 0.004553 0.04% Castro::Castro() 35 0.004083 0.004246 0.004443 0.04% MLCellLinOp::correctionResidual() 9063 0.003909 0.004177 0.004415 0.04% FabArray::setDomainBndry() 1617 0.003586 0.003871 0.004402 0.04% MLMG::mgVcycle() 3385 0.00355 0.003758 0.003936 0.04% MLMG::actualBottomSolve() 1843 0.00219 0.002405 0.003317 0.03% average_down_faces 360 0.002361 0.002694 0.00329 0.03% Castro::construct_old_gravity() 140 0.002114 0.002516 0.003013 0.03% Gravity::GetCrsePhi() 250 0.002016 0.002554 0.002909 0.03% MultiFab::Subtract() 420 0.001987 0.002462 0.002877 0.03% Gravity::update_max_rhs() 30 0.00242 0.002613 0.002789 0.03% MLMG::oneIter() 1843 0.002358 0.002417 0.002527 0.02% MLMG::MLResNormInf() 440 0.0007899 0.001444 0.002509 0.02% Castro::reset_internal_energy(MultiFab) 1189 0.00163 0.002015 0.002469 0.02% Gravity::create_comp_minus_level_grad_phi() 60 0.001548 0.001942 0.00232 0.02% MLLinOp::makeSubCommunicator() 70 0.00154 0.001772 0.002226 0.02% MLMG:computeResOfCorrection() 6101 0.002052 0.002098 0.002211 0.02% MLMG::mgVcycle_bottom 3385 0.001837 0.001893 0.001948 0.02% Gravity::average_fine_ec_onto_crse_ec() 90 0.001496 0.001666 0.001857 0.02% MLMG::mgVcycle_down::0 1843 0.001671 0.001716 0.00183 0.02% MLCellLinOp::solutionResidual() 3154 0.001634 0.001697 0.00178 0.02% Castro::clean_state() 1182 0.001389 0.001509 0.001771 0.02% Castro::apply_tagging_restrictions() 34 0.001162 0.00139 0.001621 0.02% Castro::finalize_advance() 140 0.001177 0.001309 0.001563 0.01% Gravity::multilevel_solve_for_new_phi() 20 0.001182 0.001421 0.001562 0.01% Gravity::solve_phi_with_mlmg() 300 0.0009173 0.001188 0.001537 0.01% StateDataPhysBCFunct::() 1617 0.001221 0.001343 0.001485 0.01% MLMG::mgVcycle_down::1 1843 0.001352 0.001411 0.001457 0.01% ClusterList::chop() 4 0 0.0001819 0.001456 0.01% MLMG::mgVcycle_up::1 1843 0.001261 0.001321 0.001409 0.01% TagBoxArray::collate() 34 0.0006632 0.0008742 0.001398 0.01% AMRErrorTag::operator() 34 0.000983 0.001188 0.001396 0.01% FabArrayBase::TheFPinfo() 728 0.0009334 0.001082 0.001319 0.01% Castro::expand_state() 200 0.001048 0.0011 0.001153 0.01% MLMG::mgVcycle_up::0 1843 0.001083 0.001106 0.001139 0.01% MLMG::computeResWithCrseSolFineCor() 771 0.0009079 0.0009426 0.0009957 0.01% Castro::construct_new_gravity() 140 0.0007749 0.0008201 0.0009417 0.01% MLMG::computeResidual() 1843 0.000819 0.0008526 0.0008923 0.01% MLPoisson::define() 360 0.0007315 0.0007856 0.0008877 0.01% main() 1 0.0006901 0.0007436 0.000823 0.01% Castro::finalize_do_advance() 140 0.0004417 0.0005743 0.0007491 0.01% FabArrayBase::FB::FB() 299 0.0001865 0.000422 0.000712 0.01% Castro::do_new_sources() 260 0.0006188 0.0006358 0.0006961 0.01% Castro::build_fine_mask() 40 0.0005553 0.0006091 0.000664 0.01% Amr::grid_places() 23 0.0003171 0.000374 0.0005781 0.01% Gravity::actual_multilevel_solve() 20 0.0004861 0.0005298 0.0005694 0.01% Castro::derive() 34 0.0004633 0.0005094 0.0005483 0.01% ClusterList::intersect() 4 0 6.845e-05 0.0005476 0.01% MLMG::miniCycle() 1542 0.000506 0.0005261 0.0005464 0.01% Castro::apply_source_to_state() 520 0.0004841 0.0005175 0.0005451 0.01% MLMG::computeMLResidual() 440 0.0004389 0.0004743 0.0005295 0.00% Castro::advance() 140 0.0003873 0.000437 0.0005203 0.00% MLMG::computeResWithCrseCorFineCor() 771 0.0004891 0.0005049 0.0005181 0.00% MLLinOp::define() 360 0.0004084 0.0004351 0.0005047 0.00% Castro::subcycle_advance_ctu() 140 0.000349 0.0004112 0.0004853 0.00% Castro::init(old) 28 0.000333 0.0003926 0.0004652 0.00% Castro::enforce_speed_limit() 1182 0.0003761 0.0004016 0.0004424 0.00% Amr::InitAmr() 1 0.0002913 0.0003207 0.0004336 0.00% MLMG::mgVcycle_down::2 483 0.0003772 0.0003886 0.0004088 0.00% MLMG::mgVcycle_down::6 483 0.0003624 0.0003833 0.0004002 0.00% MLMG::mgVcycle_down::4 483 0.0003133 0.0003411 0.0003794 0.00% MLMG::mgVcycle_down::3 483 0.0003278 0.0003468 0.0003718 0.00% Castro::do_old_sources() 140 0.0003248 0.0003483 0.0003706 0.00% MLMG::mgVcycle_down::5 483 0.0002958 0.0003083 0.0003371 0.00% AmrMesh-cluster 4 0 4.111e-05 0.0003289 0.00% MLPoisson::prepareForSolve() 360 0.0002461 0.0002682 0.0003277 0.00% MLMG::getGradSolution() 360 0.0002605 0.0002772 0.0003015 0.00% Gravity::swapTimeLevels() 140 0.0002402 0.0002657 0.0002929 0.00% AmrLevel::AmrLevel(dm) 35 0.0002269 0.0002557 0.0002822 0.00% MLMG::mgVcycle_up::2 483 0.0002365 0.000247 0.0002659 0.00% MLMG::mgVcycle_up::6 483 0.0002339 0.0002459 0.0002621 0.00% MLMG::mgVcycle_up::3 483 0.000205 0.0002234 0.0002545 0.00% MLMG::mgVcycle_up::5 483 0.0002198 0.0002292 0.0002452 0.00% makeSFC 350 0.0002106 0.0002221 0.0002327 0.00% MLMG::mgVcycle_up::4 483 0.0002023 0.0002101 0.000224 0.00% OwnerMask() 34 0.0001713 0.0001921 0.0002212 0.00% TagBoxArray::mapPRD 34 0.0001978 0.0002076 0.0002209 0.00% Castro::avgDown(state_indx) 248 0.0001638 0.0001835 0.0002075 0.00% Castro::check_for_nan() 280 0.0001663 0.0001798 0.0001956 0.00% Castro::post_regrid() 66 0.0001497 0.0001687 0.0001891 0.00% DistributionMapping::Distribute() 355 0.000144 0.0001608 0.0001861 0.00% Castro::post_timestep() 140 0.0001544 0.0001686 0.0001857 0.00% MultiFab::Multiply() 40 0.0001549 0.0001629 0.000174 0.00% MLMG::MLRhsNormInf() 360 0.000142 0.000149 0.0001711 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001488 0.0001581 0.0001694 0.00% Amr::FinalizeInit() 1 4.107e-06 2.221e-05 0.0001471 0.00% Gravity::solve_for_delta_phi 60 9.287e-05 0.0001082 0.0001267 0.00% FabArray::RecvLayoutMask() 90 8.95e-05 0.0001122 0.0001194 0.00% knapsack() 7 0.0001029 0.0001093 0.0001159 0.00% Castro::enforce_consistent_e() 7 7.656e-05 9.316e-05 0.0001107 0.00% Castro::create_source_corrector() 140 7.183e-05 8.204e-05 0.0001007 0.00% Castro::avgDown() 62 7.702e-05 8.436e-05 9.299e-05 0.00% BoxList::complementIn 574 7.007e-05 7.509e-05 8.21e-05 0.00% Castro::errorEst() 34 6.28e-05 6.722e-05 7.597e-05 0.00% Castro::retry_advance_ctu() 140 5.047e-05 5.757e-05 6.551e-05 0.00% Amr::defBaseLevel() 1 3.2e-05 4.025e-05 5.233e-05 0.00% Castro::computeNewDt() 28 4.037e-05 4.244e-05 4.578e-05 0.00% Amr::bldFineLevels() 1 2.269e-05 3.428e-05 4.456e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 3.045e-05 3.394e-05 3.708e-05 0.00% Amr::writeSmallPlotFile() 1 3.222e-05 3.339e-05 3.552e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.375e-05 2.5e-05 2.75e-05 0.00% BoxList::parallelComplementIn() 57 2.135e-05 2.296e-05 2.742e-05 0.00% Gravity::set_mass_offset() 21 1.897e-05 2.238e-05 2.483e-05 0.00% Castro::apply_problem_tags() 34 1.387e-05 1.502e-05 1.56e-05 0.00% Castro::post_init() 3 7.386e-06 9.005e-06 1.294e-05 0.00% Amr::initSubcycle() 1 9.045e-06 1.009e-05 1.074e-05 0.00% Amr::InitializeInit() 1 2.034e-06 2.791e-06 5.374e-06 0.00% Castro::computeInitialDt() 2 2.988e-06 3.496e-06 3.807e-06 0.00% Amr::init() 1 1.454e-06 1.748e-06 2.238e-06 0.00% Amr::initialInit() 1 1.072e-06 1.256e-06 1.598e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.72 10.72 10.72 100.00% Amr::coarseTimeStep() 20 10.51 10.51 10.51 98.04% Amr::timeStep() 140 10.48 10.49 10.5 97.89% Castro::advance() 140 7.724 7.728 7.731 72.09% Castro::subcycle_advance_ctu() 140 7.5 7.534 7.558 70.48% Castro::do_advance_ctu() 140 7.5 7.533 7.558 70.48% Gravity::actual_solve_with_mlmg() 360 5.628 5.639 5.653 52.72% MLMG::solve() 360 5.454 5.461 5.468 51.00% MLMG::oneIter() 1843 5.068 5.095 5.111 47.66% MLMG::mgVcycle() 3385 4.69 4.736 4.772 44.50% Gravity::solve_phi_with_mlmg() 300 4.234 4.24 4.252 39.66% Gravity::solve_for_phi() 280 3.587 3.594 3.607 33.63% MLMG::mgVcycle_bottom 3385 3.218 3.237 3.251 30.32% MLMG::actualBottomSolve() 1843 2.836 2.844 2.869 26.76% MLCGSolver::bicgstab 1420 2.833 2.841 2.865 26.72% Castro::construct_new_gravity() 140 2.842 2.846 2.856 26.63% Castro::construct_ctu_hydro_source() 140 1.961 2.354 2.592 24.18% Castro::post_timestep() 140 1.992 2.009 2.016 18.80% Castro::reflux() 60 1.869 1.881 1.893 17.65% MLCellLinOp::applyBC() 165252 1.43 1.635 1.841 17.17% MLCellLinOp::smooth() 27488 1.521 1.583 1.636 15.26% FabArray::FillBoundary() 157859 1.15 1.347 1.57 14.64% Gravity::gravity_sync() 60 1.537 1.537 1.537 14.34% MLCGSolver::ParallelAllReduce 243542 1.001 1.205 1.46 13.62% Gravity::solve_for_delta_phi 60 1.458 1.459 1.46 13.61% MLCellLinOp::apply() 108875 1.144 1.291 1.434 13.37% MLPoisson::Fsmooth() 54976 0.8421 0.9346 1.023 9.54% Castro::construct_old_gravity() 140 0.8798 0.885 0.89 8.30% FabArray::ParallelCopy() 21259 0.6088 0.7331 0.8852 8.26% Amr::regrid() 21 0.8015 0.8086 0.8172 7.62% FillBoundary_nowait() 157859 0.5785 0.6926 0.8013 7.47% FillBoundary_finish() 157859 0.4678 0.6024 0.7617 7.10% Gravity::multilevel_solve_for_new_phi() 20 0.6621 0.6637 0.6643 6.20% Gravity::actual_multilevel_solve() 20 0.6606 0.6622 0.6629 6.18% FabArray::ParallelCopy_finish() 21259 0.3435 0.4786 0.6529 6.09% Castro::post_regrid() 66 0.6369 0.6402 0.6431 6.00% FillPatchIterator::Initialize 889 0.4633 0.5288 0.5832 5.44% FillPatchTwoLevels 756 0.3896 0.453 0.5109 4.76% MLMG::mgVcycle_down::0 1843 0.4608 0.4818 0.5 4.66% Castro::clean_state() 1182 0.3563 0.4146 0.4525 4.22% MLMG::mgVcycle_up::0 1843 0.4308 0.4419 0.4497 4.19% MLMG::miniCycle() 1542 0.3691 0.3932 0.4116 3.84% FillPatchSingleLevel 1617 0.2334 0.2855 0.3484 3.25% Castro::initialize_do_advance() 140 0.2991 0.3163 0.3289 3.07% Castro::expand_state() 200 0.242 0.269 0.3039 2.83% MLPoisson::Fapply() 108875 0.2392 0.2757 0.3005 2.80% MLCellLinOp::correctionResidual() 9063 0.252 0.2746 0.2907 2.71% Castro::do_new_sources() 260 0.2286 0.2534 0.2713 2.53% FabArray::ParallelCopy_nowait() 21259 0.2216 0.2459 0.2712 2.53% Castro::computeTemp() 1189 0.2018 0.2419 0.2634 2.46% MLCellLinOp::solutionResidual() 3154 0.2033 0.2182 0.2335 2.18% MLMG::mgVcycle_down::1 1843 0.2168 0.2227 0.2333 2.18% FabArray::setVal() 27514 0.1548 0.1762 0.2073 1.93% amrex::Dot() 193316 0.1575 0.1839 0.2011 1.88% Amr::init() 1 0.1909 0.191 0.1911 1.78% Castro::estTimeStep() 308 0.1144 0.1562 0.1886 1.76% MLMG::computeResWithCrseSolFineCor() 771 0.148 0.1707 0.1885 1.76% Castro::reset_internal_energy(MultiFab) 1189 0.1418 0.17 0.1831 1.71% Castro::initialize_advance() 140 0.1313 0.1519 0.181 1.69% Castro::reset_internal_energy(Fab) 5919 0.1398 0.168 0.1807 1.68% MLMG::mgVcycle_up::1 1843 0.1661 0.1739 0.179 1.67% Amr::initialInit() 1 0.1738 0.1738 0.1738 1.62% FabArray::Saxpy() 145223 0.1347 0.1554 0.1705 1.59% Amr::FinalizeInit() 1 0.161 0.1635 0.1664 1.55% amrex::Copy() 106562 0.1287 0.1478 0.1655 1.54% amrex::average_down 8093 0.1146 0.1363 0.1555 1.45% Castro::normalize_species() 1182 0.1266 0.1416 0.1549 1.44% Castro::construct_new_source() 1300 0.1237 0.136 0.1462 1.36% MLMG::computeResidual() 1843 0.1147 0.1304 0.1382 1.29% MLMG::addInterpCorrection() 6101 0.06336 0.1143 0.1362 1.27% FabArray::norminf() 100641 0.1064 0.12 0.1287 1.20% MLMG:computeResOfCorrection() 6101 0.1244 0.1266 0.1286 1.20% MLPoisson::normalize() 98078 0.09373 0.1084 0.1175 1.10% Castro::do_old_sources() 140 0.09104 0.1038 0.1172 1.09% MLMG::mgVcycle_up::2 483 0.0286 0.06896 0.1091 1.02% MLPoisson::define() 360 0.07742 0.08977 0.1073 1.00% Castro::avgDown() 62 0.06825 0.08763 0.1069 1.00% Castro::avgDown(state_indx) 248 0.06815 0.08754 0.1068 1.00% amrex::average_down_w_geom 248 0.06799 0.08736 0.1067 0.99% Gravity::get_new_grav_vector() 263 0.1002 0.1014 0.1026 0.96% MLMG::ResNormInf() 2383 0.05314 0.07754 0.1024 0.95% Amr::bldFineLevels() 1 0.08714 0.09121 0.09564 0.89% Castro::construct_new_gravity_source() 260 0.07715 0.08609 0.09368 0.87% MLMG::computeResWithCrseCorFineCor() 771 0.0776 0.08823 0.09215 0.86% MLCellLinOp::reflux() 951 0.06647 0.07946 0.088 0.82% FabArray::LinComb() 96778 0.05489 0.0687 0.07868 0.73% MLMG::computeMLResidual() 440 0.05492 0.06386 0.07327 0.68% Castro::post_init() 3 0.06398 0.06854 0.07275 0.68% MLCellLinOp::setLevelBC() 450 0.02421 0.0452 0.07117 0.66% MLMG::prepareForSolve() 360 0.06153 0.06535 0.06793 0.63% FabArrayBase::getCPC() 29651 0.0563 0.06263 0.06725 0.63% Castro::initData() 7 0.04816 0.05886 0.06677 0.62% FillPatchInterp(MF) 728 0.06543 0.06619 0.06671 0.62% FabArray::Xpay() 59602 0.05018 0.05908 0.06547 0.61% MLMG::mgVcycle_up::3 483 0.004068 0.02901 0.06531 0.61% FluxRegister::Reflux() 960 0.04915 0.05895 0.06517 0.61% Gravity::get_old_grav_vector() 140 0.06041 0.06239 0.06437 0.60% MLCellLinOp::updateSolBC() 871 0.0464 0.05755 0.06383 0.60% MLCellLinOp::defineAuxData() 360 0.04599 0.05318 0.06268 0.58% Castro::init(old) 28 0.04949 0.05545 0.05772 0.54% MLCellLinOp::updateCorBC() 771 0.04142 0.05008 0.05651 0.53% Castro::Castro() 35 0.04061 0.04461 0.05307 0.49% Gravity::GetCrsePhi() 250 0.0189 0.03674 0.05094 0.48% amrex::Add() 7701 0.04219 0.04634 0.04992 0.47% MLMG::interpCorrection_1 771 0.02896 0.03631 0.04831 0.45% Castro::finalize_advance() 140 0.04 0.04144 0.04624 0.43% FabArrayBase::CPC::define() 4099 0.03048 0.03549 0.03981 0.37% MLCellLinOp::defineBC() 360 0.02272 0.02875 0.03728 0.35% Castro::apply_source_to_state() 520 0.03472 0.03569 0.03711 0.35% Amr::writePlotFile() 2 0.03517 0.03528 0.03533 0.33% Amr::grid_places() 23 0.01926 0.02875 0.03529 0.33% AmrMesh::MakeNewGrids() 23 0.01894 0.02838 0.03494 0.33% Castro::enforce_min_density() 1182 0.02685 0.03042 0.0337 0.31% Gravity::fill_multipole_BCs() 70 0.02788 0.02997 0.03355 0.31% MLMG::mgVcycle_down::2 483 0.03072 0.03189 0.03317 0.31% Castro::construct_old_source() 700 0.02657 0.02967 0.03175 0.30% Castro::initMFs() 35 0.02231 0.02502 0.02941 0.27% VisMF::Write(FabArray) 6 0.008695 0.01187 0.02923 0.27% FabArrayBase::getFB() 157859 0.02571 0.02651 0.02829 0.26% Castro::FluxRegCrseInit 140 0.02669 0.02776 0.02812 0.26% BndryData::define() 540 0.01469 0.0194 0.02588 0.24% MLMG::mgVcycle_down::3 483 0.005567 0.01386 0.02345 0.22% Castro::check_for_nan() 280 0.01755 0.02063 0.02299 0.21% MultiFab::contains_nan() 280 0.01736 0.02045 0.02281 0.21% Castro::errorEst() 34 0.008475 0.0166 0.02212 0.21% Castro::computeNewDt() 28 0.019 0.02018 0.02109 0.20% Castro::derive() 34 0.006226 0.01394 0.01927 0.18% Gravity::average_fine_ec_onto_crse_ec() 90 0.01673 0.01751 0.01865 0.17% MLMG::getGradSolution() 360 0.0136 0.01549 0.01793 0.17% MLCellLinOp::compGrad() 450 0.01332 0.01521 0.01763 0.16% Gravity::update_max_rhs() 30 0.014 0.01499 0.01659 0.15% FabArrayBase::TheFPinfo() 728 0.002122 0.0092 0.01547 0.14% FPinfo::FPinfo() 7 0.001189 0.008117 0.01433 0.13% AmrLevel::AmrLevel(dm) 35 0.01118 0.01233 0.01415 0.13% StateData::define() 140 0.01095 0.01207 0.01387 0.13% MLPoisson::FFlux() 7882 0.006624 0.01053 0.01306 0.12% Amr::InitializeInit() 1 0.007395 0.01032 0.01279 0.12% Amr::defBaseLevel() 1 0.007389 0.01032 0.01279 0.12% Castro::FluxRegFineAdd() 140 0.007178 0.008324 0.01235 0.12% Castro::swap_state_time_levels() 140 0.006741 0.007843 0.01137 0.11% MLMG::mgVcycle_down::4 483 0.005031 0.006035 0.01115 0.10% MLMG::MLResNormInf() 440 0.007682 0.008878 0.01057 0.10% average_down_faces 360 0.008008 0.009345 0.01013 0.09% Castro::construct_old_gravity_source() 140 0.00733 0.009142 0.009884 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003804 0.006597 0.008946 0.08% MLMG::mgVcycle_up::4 483 0.004003 0.004662 0.008865 0.08% Castro::buildMetrics() 35 0.00594 0.006469 0.008443 0.08% MLMG::mgVcycle_down::5 483 0.004879 0.005351 0.007934 0.07% StateDataPhysBCFunct::() 1617 0.0028 0.005122 0.007907 0.07% MLLinOp::define() 360 0.006619 0.007051 0.007831 0.07% MultiFab::max() 90 0.003737 0.005541 0.007821 0.07% MLLinOp::defineGrids() 360 0.006201 0.006616 0.007326 0.07% MLMG::mgVcycle_down::6 483 0.004914 0.005241 0.006994 0.07% DistributionMapping::LeastUsedCPUs() 12 0.000245 0.003652 0.006477 0.06% DistributionMapping::SFCProcessorMapDoIt() 5 0.0002171 0.003629 0.006458 0.06% MLMG::mgVcycle_up::5 483 0.004145 0.004472 0.006447 0.06% MLMG::mgVcycle_up::6 483 0.004598 0.004896 0.006434 0.06% StateData::FillBoundary(geom) 745 0.001524 0.003779 0.006422 0.06% Castro::computeInitialDt() 2 0.001011 0.003459 0.006265 0.06% MLMG::MLRhsNormInf() 360 0.005129 0.005744 0.006235 0.06% Gravity::applyMetricTerms() 90 0.005078 0.00559 0.006158 0.06% FabArray::mult() 1063 0.004196 0.005118 0.006047 0.06% MLPoisson::prepareForSolve() 360 0.003248 0.004114 0.005589 0.05% BoxList::parallelComplementIn() 57 0.0005001 0.003119 0.005466 0.05% BoxList::pci 22 0.0004603 0.00308 0.00543 0.05% MLCellLinOp::prepareForSolve() 360 0.00292 0.003846 0.005337 0.05% FabArray::norminf(mask) 270 0.00311 0.00389 0.004553 0.04% Gravity::swapTimeLevels() 140 0.003329 0.003879 0.004544 0.04% FabArray::setDomainBndry() 1617 0.003586 0.003871 0.004402 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002931 0.003612 0.004148 0.04% MultiFab::Subtract() 420 0.001987 0.002462 0.002877 0.03% TagBoxArray::mapPRD 34 0.001181 0.001863 0.002678 0.02% AmrMesh-cluster 4 0 0.0002915 0.002332 0.02% MLLinOp::makeSubCommunicator() 70 0.00154 0.001772 0.002226 0.02% Castro::apply_tagging_restrictions() 34 0.001162 0.00139 0.001621 0.02% ClusterList::chop() 4 0 0.0001819 0.001456 0.01% TagBoxArray::collate() 34 0.0006632 0.0008742 0.001398 0.01% AMRErrorTag::operator() 34 0.000983 0.001188 0.001396 0.01% Castro::finalize_do_advance() 140 0.0004417 0.0005743 0.0007491 0.01% FabArrayBase::FB::FB() 299 0.0001865 0.000422 0.000712 0.01% Castro::build_fine_mask() 40 0.0005553 0.0006091 0.000664 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005067 0.0005299 0.0005593 0.01% ClusterList::intersect() 4 0 6.845e-05 0.0005476 0.01% Amr::InitAmr() 1 0.0003012 0.0003308 0.000443 0.00% Castro::enforce_speed_limit() 1182 0.0003761 0.0004016 0.0004424 0.00% makeSFC 350 0.0003451 0.0003719 0.0004069 0.00% OwnerMask() 34 0.0001713 0.0001921 0.0002212 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001931 0.0002029 0.0002089 0.00% DistributionMapping::Distribute() 355 0.000144 0.0001608 0.0001861 0.00% MultiFab::Multiply() 40 0.0001549 0.0001629 0.000174 0.00% FabArray::RecvLayoutMask() 90 8.95e-05 0.0001122 0.0001194 0.00% knapsack() 7 0.0001029 0.0001093 0.0001159 0.00% Castro::enforce_consistent_e() 7 7.656e-05 9.316e-05 0.0001107 0.00% Castro::create_source_corrector() 140 7.183e-05 8.204e-05 0.0001007 0.00% BoxList::complementIn 574 7.007e-05 7.509e-05 8.21e-05 0.00% Castro::retry_advance_ctu() 140 5.047e-05 5.757e-05 6.551e-05 0.00% Amr::writeSmallPlotFile() 1 3.222e-05 3.339e-05 3.552e-05 0.00% Gravity::set_mass_offset() 21 1.897e-05 2.238e-05 2.483e-05 0.00% Castro::apply_problem_tags() 34 1.387e-05 1.502e-05 1.56e-05 0.00% Amr::initSubcycle() 1 9.045e-06 1.009e-05 1.074e-05 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 10 B 11 B 13 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.04-31-g6a85487dce1b) finalized