MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.01-17-gd5ddf3b22e94) initialized Starting run at 06:45:53 UTC on 2023-01-13. Successfully read inputs file ... Castro git describe: 23.01-14-g78178b78e AMReX git describe: 23.01-17-gd5ddf3b22 Microphysics git describe: 23.01-3-g1e475055 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001664252 new finest: 1 grid_places() time: 0.010351643 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.007877066 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.013119509 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.045810993 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.491047633 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000535448 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.551716287 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000797674 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.53295789 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000541327 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.540762195 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000801997 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.511491937 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000539034 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.506735083 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000781202 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.511380834 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000550299 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.506433344 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000776442 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.509944106 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000505632 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.505974186 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000765827 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.512337836 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000510527 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.508716677 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000771766 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.514110971 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.00052873 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.510092957 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000750666 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.516833338 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000509495 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.50874777 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000772253 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.517547818 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.00052457 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.505860181 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000774417 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.512926205 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000518728 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.510395176 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.017762709 seconds Ending run at 06:46:03 UTC on 2023-01-13. Run time = 10.53262507 Run time without initialization = 10.30709416 Average number of zones advanced per microsecond: 0.855 Average number of zones advanced per microsecond per rank: 0.107 TinyProfiler total time across processes [min...avg...max]: 10.53 ... 10.53 ... 10.53 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9208 2.2876 2.5166 23.89% MLCGSolver::ParallelAllReduce 243542 0.9365 1.099 1.373 13.04% MLPoisson::Fsmooth() 54976 0.7952 0.8893 0.9836 9.34% Castro::do_advance_ctu() 140 0.3109 0.5456 0.914 8.68% FillBoundary_nowait() 157859 0.5449 0.672 0.744 7.06% FillBoundary_finish() 157859 0.413 0.5793 0.7215 6.85% FabArray::ParallelCopy_finish() 21259 0.3275 0.4371 0.633 6.01% MLCellLinOp::applyBC() 165252 0.2154 0.3138 0.4063 3.86% MLPoisson::Fapply() 108875 0.2416 0.2783 0.3018 2.87% FabArray::ParallelCopy_nowait() 21259 0.1692 0.1928 0.2102 2.00% amrex::Dot() 193316 0.1569 0.1839 0.2023 1.92% FabArray::setVal() 27514 0.1513 0.1746 0.2013 1.91% Castro::estTimeStep() 308 0.1141 0.1553 0.1894 1.80% Castro::reset_internal_energy(Fab) 5919 0.1418 0.1687 0.182 1.73% FabArray::Saxpy() 145223 0.1287 0.1516 0.1665 1.58% amrex::Copy() 106562 0.1224 0.1417 0.1545 1.47% Castro::normalize_species() 1182 0.1264 0.141 0.1536 1.46% MLCGSolver::bicgstab 1420 0.1139 0.1229 0.1301 1.24% FabArray::norminf() 100641 0.1043 0.119 0.129 1.22% MLPoisson::normalize() 98078 0.09445 0.1091 0.1179 1.12% Castro::construct_new_gravity_source() 260 0.07564 0.08423 0.0924 0.88% Castro::computeTemp() 1189 0.06128 0.07227 0.08081 0.77% amrex::average_down 8093 0.06324 0.07166 0.07801 0.74% FabArray::LinComb() 96778 0.05314 0.06634 0.07562 0.72% MLMG::ResNormInf() 2383 0.02133 0.04771 0.07379 0.70% FillPatchInterp(MF) 728 0.06555 0.06626 0.06683 0.63% FabArray::Xpay() 59602 0.04795 0.05745 0.06369 0.60% Castro::initData() 7 0.04284 0.05486 0.06269 0.60% MLMG::addInterpCorrection() 6101 0.04723 0.05242 0.05797 0.55% Amr::writePlotFile() 2 0.03422 0.05223 0.05538 0.53% FillPatchIterator::Initialize 889 0.04614 0.05008 0.05453 0.52% FabArray::FillBoundary() 157859 0.04901 0.05098 0.05235 0.50% MLCellLinOp::defineAuxData() 360 0.03624 0.04161 0.04893 0.46% amrex::Add() 7701 0.03639 0.04311 0.04861 0.46% MLMG::prepareForSolve() 360 0.03522 0.03885 0.04371 0.41% FillPatchSingleLevel 1617 0.02762 0.03758 0.0423 0.40% amrex::average_down_w_geom 248 0.02942 0.03446 0.03977 0.38% FabArrayBase::CPC::define() 4099 0.02928 0.03455 0.03884 0.37% MLCellLinOp::apply() 108875 0.03592 0.03658 0.03761 0.36% Gravity::actual_solve_with_mlmg() 360 0.02173 0.02711 0.03454 0.33% Castro::reflux() 60 0.02401 0.02967 0.03413 0.32% Castro::enforce_min_density() 1182 0.02667 0.03034 0.03347 0.32% FluxRegister::Reflux() 960 0.02346 0.02937 0.03325 0.32% Castro::initMFs() 35 0.02105 0.02538 0.03167 0.30% Gravity::fill_multipole_BCs() 70 0.02772 0.03003 0.03143 0.30% VisMF::Write(FabArray) 6 0.008719 0.01178 0.02967 0.28% MLMG::solve() 360 0.009245 0.0192 0.02886 0.27% FabArrayBase::getFB() 157859 0.02603 0.02722 0.02885 0.27% Castro::initialize_do_advance() 140 0.02243 0.02591 0.02874 0.27% FillPatchTwoLevels 756 0.02569 0.02722 0.028 0.27% FabArrayBase::getCPC() 29651 0.02566 0.02716 0.028 0.27% MLCellLinOp::reflux() 951 0.01954 0.02286 0.02701 0.26% Amr::coarseTimeStep() 20 0.00208 0.005212 0.02279 0.22% MultiFab::contains_nan() 280 0.01738 0.02071 0.02257 0.21% Castro::construct_new_source() 1300 0.02075 0.02133 0.02227 0.21% MLCellLinOp::updateSolBC() 871 0.01081 0.01575 0.02223 0.21% Castro::FluxRegCrseInit 140 0.01266 0.01718 0.02115 0.20% MLMG::interpCorrection_1 771 0.01483 0.01766 0.02066 0.20% BndryData::define() 540 0.0119 0.01545 0.0206 0.20% MLCellLinOp::updateCorBC() 771 0.009957 0.01438 0.02033 0.19% MLCellLinOp::smooth() 27488 0.01614 0.01704 0.01811 0.17% FPinfo::FPinfo() 7 0.001304 0.009464 0.01504 0.14% Gravity::get_new_grav_vector() 263 0.01077 0.01234 0.01455 0.14% StateData::define() 140 0.01019 0.01202 0.01439 0.14% MLPoisson::FFlux() 7882 0.007359 0.01136 0.01382 0.13% Castro::initialize_advance() 140 0.00939 0.01103 0.01288 0.12% Castro::FluxRegFineAdd() 140 0.005581 0.007926 0.01208 0.11% Castro::construct_old_source() 700 0.009814 0.01088 0.01179 0.11% MLCellLinOp::setLevelBC() 450 0.007196 0.009149 0.01172 0.11% MLCellLinOp::defineBC() 360 0.007524 0.008961 0.01078 0.10% Castro::construct_old_gravity_source() 140 0.007096 0.008987 0.01037 0.10% MLCellLinOp::compGrad() 450 0.008817 0.009381 0.01035 0.10% FabArray::ParallelCopy() 21259 0.008506 0.008903 0.009558 0.09% Castro::swap_state_time_levels() 140 0.006236 0.007499 0.009275 0.09% Gravity::get_old_grav_vector() 140 0.005278 0.006476 0.008978 0.09% Castro::buildMetrics() 35 0.005397 0.00646 0.008978 0.09% BoxList::pci 22 0.0004182 0.005317 0.008811 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003716 0.006494 0.008238 0.08% MultiFab::max() 90 0.003507 0.004971 0.00756 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0002745 0.003115 0.006583 0.06% Amr::timeStep() 140 0.002668 0.003778 0.00635 0.06% AmrMesh::MakeNewGrids() 23 0.003075 0.005489 0.006217 0.06% Amr::regrid() 21 0.003607 0.004645 0.006168 0.06% StateData::FillBoundary(geom) 745 0.001467 0.003716 0.006153 0.06% Gravity::solve_for_phi() 280 0.00539 0.005688 0.005981 0.06% Gravity::applyMetricTerms() 90 0.005053 0.005604 0.005911 0.06% FabArray::mult() 1063 0.004047 0.00464 0.005197 0.05% Gravity::gravity_sync() 60 0.004255 0.004808 0.005148 0.05% MLLinOp::defineGrids() 360 0.003959 0.004309 0.004975 0.05% MLCellLinOp::prepareForSolve() 360 0.002915 0.003642 0.004802 0.05% FabArray::norminf(mask) 270 0.003126 0.003934 0.004616 0.04% MLCellLinOp::correctionResidual() 9063 0.003983 0.004208 0.004468 0.04% Castro::Castro() 35 0.003694 0.004136 0.004444 0.04% FabArray::setDomainBndry() 1617 0.00352 0.003841 0.004201 0.04% MLMG::mgVcycle() 3385 0.003618 0.003806 0.004086 0.04% average_down_faces 360 0.002272 0.002659 0.003275 0.03% MLMG::actualBottomSolve() 1843 0.002414 0.002617 0.003063 0.03% MLLinOp::makeSubCommunicator() 70 0.001539 0.002195 0.003059 0.03% Gravity::GetCrsePhi() 250 0.001942 0.002537 0.002905 0.03% MultiFab::Subtract() 420 0.001785 0.002344 0.002823 0.03% Gravity::update_max_rhs() 30 0.002504 0.002624 0.002757 0.03% Castro::construct_old_gravity() 140 0.002169 0.002535 0.002756 0.03% MLMG::oneIter() 1843 0.002367 0.002495 0.002668 0.03% MLMG::MLResNormInf() 440 0.0007136 0.001408 0.002521 0.02% Castro::reset_internal_energy(MultiFab) 1189 0.001632 0.002063 0.002494 0.02% MLMG:computeResOfCorrection() 6101 0.00194 0.002078 0.002219 0.02% Gravity::create_comp_minus_level_grad_phi() 60 0.001515 0.001861 0.002173 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001114 0.001465 0.001906 0.02% Gravity::average_fine_ec_onto_crse_ec() 90 0.001436 0.001658 0.001848 0.02% MLMG::mgVcycle_bottom 3385 0.001656 0.001731 0.001826 0.02% MLMG::mgVcycle_down::0 1843 0.001697 0.00174 0.001826 0.02% MLCellLinOp::solutionResidual() 3154 0.001603 0.001681 0.001814 0.02% StateDataPhysBCFunct::() 1617 0.001279 0.001459 0.001731 0.02% Castro::clean_state() 1182 0.001425 0.001497 0.001719 0.02% Castro::apply_tagging_restrictions() 34 0.001142 0.001441 0.001714 0.02% ClusterList::chop() 4 0 0.0001946 0.001556 0.01% Castro::finalize_advance() 140 0.001217 0.001312 0.001523 0.01% MLMG::mgVcycle_down::1 1843 0.001382 0.001415 0.001473 0.01% AMRErrorTag::operator() 34 0.001018 0.00126 0.001424 0.01% Gravity::solve_phi_with_mlmg() 300 0.000994 0.001192 0.001407 0.01% MLMG::mgVcycle_up::1 1843 0.001238 0.001295 0.001391 0.01% TagBoxArray::collate() 34 0.0007765 0.0009955 0.001339 0.01% Castro::expand_state() 200 0.0009692 0.001077 0.001196 0.01% MLMG::mgVcycle_up::0 1843 0.001094 0.001122 0.001193 0.01% FabArrayBase::TheFPinfo() 728 0.0009258 0.001018 0.001114 0.01% Castro::build_fine_mask() 100 0.0008316 0.0009504 0.001084 0.01% MLMG::computeResWithCrseSolFineCor() 771 0.0008714 0.0009412 0.001056 0.01% MLMG::computeResidual() 1843 0.0008248 0.0008677 0.0009389 0.01% Castro::construct_new_gravity() 140 0.0007468 0.0008007 0.0008767 0.01% main() 1 0.0007042 0.0007624 0.0008658 0.01% MLPoisson::define() 360 0.0006923 0.0007641 0.0008493 0.01% Castro::do_new_sources() 260 0.000642 0.0006878 0.0007391 0.01% Castro::finalize_do_advance() 140 0.0004243 0.0005595 0.0007069 0.01% Amr::InitAmr() 1 0.0002773 0.000417 0.0006498 0.01% FabArrayBase::FB::FB() 299 0.000183 0.0004119 0.0006188 0.01% ClusterList::intersect() 4 0 7.45e-05 0.000596 0.01% Castro::derive() 34 0.0004299 0.0005238 0.0005903 0.01% Amr::grid_places() 23 0.0003217 0.0003763 0.0005705 0.01% MLMG::miniCycle() 1542 0.0004959 0.0005249 0.0005598 0.01% Castro::apply_source_to_state() 520 0.0004877 0.0005166 0.0005557 0.01% MLMG::computeResWithCrseCorFineCor() 771 0.0004879 0.0005104 0.000552 0.01% Gravity::actual_multilevel_solve() 20 0.0004504 0.0005031 0.000533 0.01% MLMG::computeMLResidual() 440 0.0004015 0.0004585 0.0005292 0.01% Castro::subcycle_advance_ctu() 140 0.0003688 0.0004332 0.0005087 0.00% MLLinOp::define() 360 0.0004259 0.0004454 0.0004778 0.00% Castro::init(old) 28 0.0003281 0.0003964 0.0004599 0.00% Castro::advance() 140 0.0003376 0.0003891 0.0004485 0.00% Castro::enforce_speed_limit() 1182 0.0003959 0.0004085 0.000424 0.00% MLMG::mgVcycle_down::2 483 0.0003617 0.0003884 0.0004153 0.00% MLMG::mgVcycle_down::6 483 0.0003687 0.0003799 0.0003986 0.00% MLMG::mgVcycle_down::4 483 0.000311 0.0003372 0.000373 0.00% MLMG::mgVcycle_down::3 483 0.00032 0.0003443 0.000366 0.00% Castro::do_old_sources() 140 0.0003313 0.0003481 0.0003637 0.00% AmrMesh-cluster 4 0 4.232e-05 0.0003385 0.00% MLMG::mgVcycle_down::5 483 0.0002894 0.0003053 0.0003353 0.00% MLPoisson::prepareForSolve() 360 0.0002476 0.0002763 0.0003113 0.00% MLMG::mgVcycle_up::6 483 0.0002549 0.0002726 0.0002974 0.00% Gravity::swapTimeLevels() 140 0.0002497 0.0002669 0.000289 0.00% MLMG::getGradSolution() 360 0.0002495 0.0002673 0.0002818 0.00% MLMG::mgVcycle_up::2 483 0.0002297 0.0002502 0.0002776 0.00% MLMG::mgVcycle_up::5 483 0.000222 0.0002341 0.0002634 0.00% MLMG::mgVcycle_up::3 483 0.000209 0.0002271 0.0002614 0.00% Castro::post_timestep() 140 0.0001855 0.0002126 0.0002578 0.00% MLMG::mgVcycle_up::4 483 0.0002027 0.0002154 0.0002502 0.00% MultiFab::Multiply() 40 0.0002251 0.0002356 0.0002484 0.00% makeSFC 350 0.0002096 0.0002304 0.0002469 0.00% AmrLevel::AmrLevel(dm) 35 0.0001937 0.0002154 0.0002429 0.00% OwnerMask() 34 0.000164 0.00019 0.000228 0.00% DistributionMapping::Distribute() 355 0.0001528 0.0001729 0.0002273 0.00% TagBoxArray::mapPRD 34 0.0001878 0.0002032 0.0002171 0.00% Castro::check_for_nan() 280 0.0001656 0.0001896 0.0002104 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001652 0.0001759 0.0002001 0.00% Castro::avgDown(state_indx) 248 0.0001578 0.0001693 0.0001931 0.00% Castro::post_regrid() 66 0.0001435 0.0001658 0.0001811 0.00% Gravity::solve_for_delta_phi 60 9.021e-05 0.0001133 0.0001769 0.00% MLMG::MLRhsNormInf() 360 0.000146 0.000152 0.0001615 0.00% Castro::enforce_consistent_e() 7 7.063e-05 0.0001013 0.0001365 0.00% Amr::FinalizeInit() 1 3.476e-06 2.093e-05 0.0001353 0.00% FabArray::RecvLayoutMask() 90 8.37e-05 0.0001038 0.0001217 0.00% knapsack() 7 0.0001027 0.0001112 0.0001174 0.00% Castro::create_source_corrector() 140 6.838e-05 7.793e-05 9.101e-05 0.00% BoxList::complementIn 574 6.593e-05 7.104e-05 7.601e-05 0.00% Castro::errorEst() 34 6.427e-05 6.957e-05 7.534e-05 0.00% Castro::avgDown() 62 6.394e-05 6.881e-05 7.356e-05 0.00% Castro::retry_advance_ctu() 140 5.005e-05 5.646e-05 7.139e-05 0.00% Amr::writeSmallPlotFile() 1 3.075e-05 3.77e-05 6.143e-05 0.00% Castro::computeNewDt() 28 4.113e-05 4.364e-05 4.686e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.901e-05 3.505e-05 4.362e-05 0.00% Amr::defBaseLevel() 1 2.796e-05 3.704e-05 4.219e-05 0.00% Amr::bldFineLevels() 1 2.292e-05 2.999e-05 4.073e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.345e-05 2.552e-05 2.868e-05 0.00% Gravity::set_mass_offset() 21 2.072e-05 2.333e-05 2.579e-05 0.00% BoxList::parallelComplementIn() 57 2.214e-05 2.383e-05 2.511e-05 0.00% Amr::initSubcycle() 1 8.722e-06 1.276e-05 1.724e-05 0.00% Castro::apply_problem_tags() 34 1.483e-05 1.575e-05 1.668e-05 0.00% Castro::post_init() 3 8.114e-06 9.431e-06 1.125e-05 0.00% Amr::InitializeInit() 1 2.016e-06 3.11e-06 6.324e-06 0.00% Amr::initialInit() 1 1.16e-06 1.888e-06 5.541e-06 0.00% Castro::computeInitialDt() 2 3.48e-06 3.978e-06 4.404e-06 0.00% Amr::init() 1 1.811e-06 2.253e-06 3.396e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.53 10.53 10.53 100.00% Amr::coarseTimeStep() 20 10.29 10.29 10.29 97.68% Amr::timeStep() 140 10.25 10.27 10.27 97.53% Castro::advance() 140 7.576 7.579 7.584 72.00% Castro::subcycle_advance_ctu() 140 7.359 7.385 7.416 70.41% Castro::do_advance_ctu() 140 7.358 7.385 7.416 70.41% Gravity::actual_solve_with_mlmg() 360 5.529 5.538 5.551 52.70% MLMG::solve() 360 5.357 5.364 5.372 51.00% MLMG::oneIter() 1843 4.982 5.009 5.025 47.71% MLMG::mgVcycle() 3385 4.607 4.652 4.688 44.51% Gravity::solve_phi_with_mlmg() 300 4.164 4.172 4.187 39.75% Gravity::solve_for_phi() 280 3.525 3.533 3.548 33.68% MLMG::mgVcycle_bottom 3385 3.184 3.204 3.227 30.64% MLMG::actualBottomSolve() 1843 2.822 2.829 2.848 27.04% MLCGSolver::bicgstab 1420 2.818 2.826 2.844 27.00% Castro::construct_new_gravity() 140 2.788 2.792 2.801 26.60% Castro::construct_ctu_hydro_source() 140 1.921 2.288 2.517 23.89% Castro::post_timestep() 140 1.923 1.941 1.948 18.49% Castro::reflux() 60 1.809 1.822 1.838 17.45% MLCellLinOp::applyBC() 165252 1.402 1.614 1.809 17.18% MLCellLinOp::smooth() 27488 1.456 1.515 1.568 14.89% FabArray::FillBoundary() 157859 1.129 1.33 1.545 14.67% Gravity::gravity_sync() 60 1.5 1.5 1.5 14.24% MLCGSolver::ParallelAllReduce 243542 1.036 1.193 1.453 13.79% Gravity::solve_for_delta_phi 60 1.425 1.426 1.426 13.54% MLCellLinOp::apply() 108875 1.143 1.296 1.42 13.48% MLPoisson::Fsmooth() 54976 0.7952 0.8893 0.9836 9.34% Castro::construct_old_gravity() 140 0.8692 0.874 0.8807 8.36% FabArray::ParallelCopy() 21259 0.5873 0.696 0.8663 8.22% Amr::regrid() 21 0.7972 0.8013 0.8084 7.68% FillBoundary_nowait() 157859 0.5724 0.6996 0.7713 7.32% FillBoundary_finish() 157859 0.413 0.5793 0.7215 6.85% Gravity::multilevel_solve_for_new_phi() 20 0.6543 0.656 0.6569 6.24% Gravity::actual_multilevel_solve() 20 0.6527 0.6545 0.6558 6.23% Castro::post_regrid() 66 0.6321 0.6354 0.6381 6.06% FabArray::ParallelCopy_finish() 21259 0.3275 0.4371 0.633 6.01% FillPatchIterator::Initialize 889 0.4534 0.5117 0.5783 5.49% FillPatchTwoLevels 756 0.3834 0.4401 0.5109 4.85% MLMG::mgVcycle_down::0 1843 0.4425 0.4621 0.4802 4.56% Castro::clean_state() 1182 0.359 0.415 0.4525 4.30% MLMG::mgVcycle_up::0 1843 0.4135 0.4242 0.432 4.10% MLMG::miniCycle() 1542 0.3511 0.375 0.3925 3.73% FillPatchSingleLevel 1617 0.2291 0.2736 0.347 3.29% Castro::initialize_do_advance() 140 0.3016 0.3123 0.3299 3.13% MLPoisson::Fapply() 108875 0.2416 0.2783 0.3018 2.87% Castro::expand_state() 200 0.2394 0.2593 0.2967 2.82% MLCellLinOp::correctionResidual() 9063 0.2483 0.2718 0.2856 2.71% Castro::do_new_sources() 260 0.2254 0.2516 0.2729 2.59% FabArray::ParallelCopy_nowait() 21259 0.2222 0.25 0.2698 2.56% Castro::computeTemp() 1189 0.205 0.2431 0.2652 2.52% MLCellLinOp::solutionResidual() 3154 0.1964 0.2106 0.2251 2.14% Amr::init() 1 0.2247 0.2249 0.2251 2.14% MLMG::mgVcycle_down::1 1843 0.2085 0.2144 0.224 2.13% amrex::Dot() 193316 0.1569 0.1839 0.2023 1.92% FabArray::setVal() 27514 0.1513 0.1746 0.2013 1.91% MLMG::computeResWithCrseSolFineCor() 771 0.1488 0.172 0.1897 1.80% Castro::estTimeStep() 308 0.1141 0.1553 0.1894 1.80% Castro::reset_internal_energy(MultiFab) 1189 0.1437 0.1708 0.1844 1.75% Castro::reset_internal_energy(Fab) 5919 0.1418 0.1687 0.182 1.73% Amr::initialInit() 1 0.1787 0.1789 0.179 1.70% Castro::initialize_advance() 140 0.1253 0.151 0.1732 1.64% MLMG::mgVcycle_up::1 1843 0.16 0.1669 0.1713 1.63% Amr::FinalizeInit() 1 0.1612 0.167 0.1713 1.63% amrex::average_down 8093 0.1115 0.1358 0.167 1.59% FabArray::Saxpy() 145223 0.1287 0.1516 0.1665 1.58% amrex::Copy() 106562 0.1224 0.1417 0.1545 1.47% Castro::normalize_species() 1182 0.1264 0.141 0.1536 1.46% Castro::construct_new_source() 1300 0.1218 0.1347 0.146 1.39% MLMG::addInterpCorrection() 6101 0.08022 0.113 0.1399 1.33% MLMG::computeResidual() 1843 0.1111 0.1249 0.1328 1.26% FabArray::norminf() 100641 0.1043 0.119 0.129 1.22% MLMG:computeResOfCorrection() 6101 0.1209 0.1234 0.1252 1.19% MLPoisson::normalize() 98078 0.09445 0.1091 0.1179 1.12% Castro::do_old_sources() 140 0.08854 0.1031 0.1147 1.09% MLMG::mgVcycle_up::2 483 0.02839 0.06256 0.1113 1.06% MLPoisson::define() 360 0.07608 0.0891 0.105 1.00% MLMG::ResNormInf() 2383 0.05255 0.07655 0.1003 0.95% Amr::bldFineLevels() 1 0.09425 0.09721 0.1001 0.95% Castro::avgDown() 62 0.05655 0.07564 0.09805 0.93% Castro::avgDown(state_indx) 248 0.05648 0.07557 0.09799 0.93% amrex::average_down_w_geom 248 0.05631 0.07541 0.09783 0.93% Gravity::get_new_grav_vector() 263 0.09365 0.0954 0.09747 0.93% Castro::construct_new_gravity_source() 260 0.07564 0.08423 0.0924 0.88% MLCellLinOp::reflux() 951 0.06925 0.08305 0.09195 0.87% MLMG::computeResWithCrseCorFineCor() 771 0.07914 0.08829 0.0911 0.86% FabArray::LinComb() 96778 0.05314 0.06634 0.07562 0.72% MLMG::computeMLResidual() 440 0.05623 0.06326 0.07161 0.68% Castro::initData() 7 0.04653 0.05952 0.0679 0.64% MLMG::mgVcycle_up::3 483 0.004083 0.02977 0.06751 0.64% MLCellLinOp::setLevelBC() 450 0.024 0.04225 0.06703 0.64% FillPatchInterp(MF) 728 0.06555 0.06626 0.06683 0.63% FabArrayBase::getCPC() 29651 0.05493 0.06171 0.06637 0.63% MLMG::prepareForSolve() 360 0.06103 0.06431 0.06601 0.63% Castro::post_init() 3 0.05975 0.06277 0.06584 0.63% Amr::writePlotFile() 2 0.06459 0.06469 0.06473 0.61% FabArray::Xpay() 59602 0.04795 0.05745 0.06369 0.60% MLCellLinOp::updateSolBC() 871 0.04313 0.05445 0.06319 0.60% Gravity::get_old_grav_vector() 140 0.05948 0.06085 0.06207 0.59% MLCellLinOp::defineAuxData() 360 0.04469 0.0522 0.06057 0.58% FluxRegister::Reflux() 960 0.04907 0.05499 0.0598 0.57% Castro::init(old) 28 0.04621 0.05334 0.05736 0.54% Castro::Castro() 35 0.03789 0.04484 0.05654 0.54% MLCellLinOp::updateCorBC() 771 0.04267 0.05025 0.05625 0.53% Gravity::GetCrsePhi() 250 0.01919 0.03495 0.05153 0.49% amrex::Add() 7701 0.03639 0.04311 0.04861 0.46% MLMG::interpCorrection_1 771 0.02948 0.03608 0.04814 0.46% Castro::finalize_advance() 140 0.03963 0.0427 0.04764 0.45% Amr::grid_places() 23 0.02176 0.03476 0.04447 0.42% AmrMesh::MakeNewGrids() 23 0.02142 0.03439 0.04415 0.42% FabArrayBase::CPC::define() 4099 0.02928 0.03455 0.03884 0.37% Castro::apply_source_to_state() 520 0.03076 0.03476 0.03768 0.36% MLCellLinOp::defineBC() 360 0.02231 0.02862 0.0367 0.35% MLMG::mgVcycle_down::6 483 0.00492 0.009062 0.03471 0.33% Castro::enforce_min_density() 1182 0.02667 0.03034 0.03347 0.32% MLMG::mgVcycle_down::2 483 0.03048 0.0317 0.0329 0.31% MLMG::mgVcycle_up::6 483 0.004644 0.008415 0.03238 0.31% Gravity::fill_multipole_BCs() 70 0.02856 0.03088 0.03227 0.31% Castro::construct_old_source() 700 0.02481 0.02932 0.03221 0.31% Castro::initMFs() 35 0.02105 0.02538 0.03167 0.30% Castro::FluxRegCrseInit 140 0.02833 0.02936 0.02972 0.28% VisMF::Write(FabArray) 6 0.008719 0.01178 0.02967 0.28% FabArrayBase::getFB() 157859 0.02628 0.02763 0.02908 0.28% Castro::errorEst() 34 0.009286 0.02005 0.0263 0.25% BndryData::define() 540 0.01455 0.01938 0.02559 0.24% MLMG::mgVcycle_down::3 483 0.005594 0.01379 0.02375 0.23% Castro::derive() 34 0.006764 0.01726 0.02367 0.22% Castro::check_for_nan() 280 0.01757 0.0209 0.02278 0.22% MultiFab::contains_nan() 280 0.01738 0.02071 0.02257 0.21% Castro::computeNewDt() 28 0.01884 0.01985 0.02067 0.20% Gravity::average_fine_ec_onto_crse_ec() 90 0.01652 0.01742 0.01871 0.18% Amr::InitializeInit() 1 0.007724 0.01186 0.01748 0.17% Amr::defBaseLevel() 1 0.007722 0.01186 0.01747 0.17% MLMG::getGradSolution() 360 0.0138 0.01536 0.01731 0.16% MLCellLinOp::compGrad() 450 0.01355 0.01509 0.01704 0.16% Gravity::update_max_rhs() 30 0.01335 0.01445 0.01632 0.15% FabArrayBase::TheFPinfo() 728 0.002494 0.01069 0.0163 0.15% FPinfo::FPinfo() 7 0.001517 0.009676 0.01525 0.14% AmrLevel::AmrLevel(dm) 35 0.0104 0.01224 0.01461 0.14% StateData::define() 140 0.01019 0.01202 0.01439 0.14% MLPoisson::FFlux() 7882 0.007359 0.01136 0.01382 0.13% Castro::FluxRegFineAdd() 140 0.005581 0.007926 0.01208 0.11% Castro::computeInitialDt() 2 0.00106 0.006808 0.01111 0.11% MLMG::mgVcycle_down::4 483 0.005013 0.006076 0.01099 0.10% MLMG::MLResNormInf() 440 0.007916 0.008887 0.01048 0.10% Castro::construct_old_gravity_source() 140 0.007096 0.008987 0.01037 0.10% average_down_faces 360 0.007931 0.009362 0.01018 0.10% Castro::swap_state_time_levels() 140 0.006236 0.007499 0.009275 0.09% Castro::buildMetrics() 35 0.005491 0.006575 0.009117 0.09% BoxList::parallelComplementIn() 57 0.0004517 0.005353 0.008848 0.08% BoxList::pci 22 0.0004182 0.005317 0.008811 0.08% MLMG::mgVcycle_up::4 483 0.004005 0.004691 0.00873 0.08% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003716 0.006494 0.008238 0.08% MLLinOp::define() 360 0.006601 0.007515 0.008227 0.08% MLMG::mgVcycle_down::5 483 0.004933 0.005374 0.007834 0.07% MLLinOp::defineGrids() 360 0.006158 0.00707 0.007749 0.07% StateDataPhysBCFunct::() 1617 0.002745 0.005175 0.007643 0.07% MultiFab::max() 90 0.003507 0.004971 0.00756 0.07% DistributionMapping::LeastUsedCPUs() 12 0.0002745 0.003115 0.006583 0.06% DistributionMapping::SFCProcessorMapDoIt() 5 0.0002585 0.003087 0.006551 0.06% MLMG::mgVcycle_up::5 483 0.004149 0.004564 0.006523 0.06% MLMG::MLRhsNormInf() 360 0.005304 0.005821 0.006268 0.06% StateData::FillBoundary(geom) 745 0.001467 0.003716 0.006153 0.06% Gravity::applyMetricTerms() 90 0.005053 0.005604 0.005911 0.06% FabArray::mult() 1063 0.004047 0.00464 0.005197 0.05% MLPoisson::prepareForSolve() 360 0.003227 0.003918 0.00509 0.05% MLCellLinOp::prepareForSolve() 360 0.002915 0.003642 0.004802 0.05% FabArray::norminf(mask) 270 0.003126 0.003934 0.004616 0.04% FabArray::setDomainBndry() 1617 0.00352 0.003841 0.004201 0.04% Gravity::swapTimeLevels() 140 0.003544 0.00381 0.004141 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002833 0.003371 0.003988 0.04% MLLinOp::makeSubCommunicator() 70 0.001539 0.002195 0.003059 0.03% MultiFab::Subtract() 420 0.001785 0.002344 0.002823 0.03% TagBoxArray::mapPRD 34 0.001247 0.002066 0.002716 0.03% AmrMesh-cluster 4 0 0.0003114 0.002491 0.02% Castro::apply_tagging_restrictions() 34 0.001142 0.001441 0.001714 0.02% ClusterList::chop() 4 0 0.0001946 0.001556 0.01% AMRErrorTag::operator() 34 0.001018 0.00126 0.001424 0.01% TagBoxArray::collate() 34 0.0007765 0.0009955 0.001339 0.01% Castro::build_fine_mask() 100 0.0008316 0.0009504 0.001084 0.01% Castro::finalize_do_advance() 140 0.0004243 0.0005595 0.0007069 0.01% Amr::InitAmr() 1 0.0002875 0.0004298 0.0006661 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005239 0.0005665 0.0006581 0.01% FabArrayBase::FB::FB() 299 0.000183 0.0004119 0.0006188 0.01% ClusterList::intersect() 4 0 7.45e-05 0.000596 0.01% makeSFC 350 0.000349 0.0003905 0.000458 0.00% Castro::enforce_speed_limit() 1182 0.0003959 0.0004085 0.000424 0.00% MultiFab::Multiply() 40 0.0002251 0.0002356 0.0002484 0.00% OwnerMask() 34 0.000164 0.00019 0.000228 0.00% DistributionMapping::Distribute() 355 0.0001528 0.0001729 0.0002273 0.00% DistributionMapping::KnapSackDoIt() 7 0.0002074 0.0002123 0.0002173 0.00% Castro::enforce_consistent_e() 7 7.063e-05 0.0001013 0.0001365 0.00% FabArray::RecvLayoutMask() 90 8.37e-05 0.0001038 0.0001217 0.00% knapsack() 7 0.0001027 0.0001112 0.0001174 0.00% Castro::create_source_corrector() 140 6.838e-05 7.793e-05 9.101e-05 0.00% BoxList::complementIn 574 6.593e-05 7.104e-05 7.601e-05 0.00% Castro::retry_advance_ctu() 140 5.005e-05 5.646e-05 7.139e-05 0.00% Amr::writeSmallPlotFile() 1 3.075e-05 3.77e-05 6.143e-05 0.00% Gravity::set_mass_offset() 21 2.072e-05 2.333e-05 2.579e-05 0.00% Amr::initSubcycle() 1 8.722e-06 1.276e-05 1.724e-05 0.00% Castro::apply_problem_tags() 34 1.483e-05 1.575e-05 1.668e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (23.01-17-gd5ddf3b22e94) finalized