MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.06-22-g6303e0abfae9) initialized Starting run at 14:01:18 UTC on 2023-06-15. Successfully read inputs file ... Castro git describe: 23.06-25-gc2fdb2009 AMReX git describe: 23.06-22-g6303e0abf Microphysics git describe: 23.06-14-ga0d8db09 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001508966 new finest: 1 grid_places() time: 0.00644801 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.007798701 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.008811806 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.01796965 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.524429088 [STEP 1] FAB kilobyte spread across MPI nodes: [18039 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000548323 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.536195255 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000795627 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.550721098 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000555543 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.564796943 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000795536 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.525573689 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000514064 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.513582588 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000762549 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.522186909 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.00052368 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.515037346 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000771813 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.521035215 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000522792 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.516619323 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000784064 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.524705075 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000528058 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.517317264 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000758595 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.524569558 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000533936 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.520553651 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000762774 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.527532859 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000526091 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.519998943 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000767848 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.525701073 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000525325 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.519489614 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000772993 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.52666426 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000515059 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.520815127 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.017753964 seconds Ending run at 14:01:29 UTC on 2023-06-15. Run time = 10.72856723 Run time without initialization = 10.53880755 Average number of zones advanced per microsecond: 0.836 Average number of zones advanced per microsecond per rank: 0.105 TinyProfiler total time across processes [min...avg...max]: 10.73 ... 10.73 ... 10.73 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.9503 2.3356 2.5763 24.01% MLCGSolver::ParallelAllReduce 243542 0.8869 1.077 1.356 12.63% MLPoisson::Fsmooth() 54976 0.9402 1.043 1.148 10.70% check_for_negative_density() 140 0.2999 0.5473 0.9353 8.72% FillBoundary_finish() 157859 0.4407 0.6039 0.7652 7.13% FillBoundary_nowait() 157859 0.5324 0.6701 0.7365 6.87% FabArray::ParallelCopy_finish() 21259 0.3006 0.4506 0.689 6.42% MLCellLinOp::applyBC() 165252 0.222 0.324 0.4189 3.90% MLPoisson::Fapply() 108875 0.2455 0.2796 0.3049 2.84% FabArray::setVal() 27514 0.1398 0.1746 0.2124 1.98% FabArray::ParallelCopy_nowait() 21259 0.1562 0.1862 0.2107 1.96% amrex::Dot() 193316 0.158 0.1838 0.2023 1.89% Castro::estTimeStep() 308 0.1101 0.1539 0.1915 1.79% Castro::reset_internal_energy(Fab) 5919 0.1437 0.1691 0.1826 1.70% FabArray::Saxpy() 145223 0.1258 0.1521 0.1727 1.61% amrex::Copy() 106562 0.1243 0.1491 0.1696 1.58% Castro::normalize_species() 1182 0.1225 0.1412 0.1541 1.44% MLCGSolver::bicgstab 1420 0.118 0.128 0.1327 1.24% FabArray::norminf() 100641 0.1054 0.1194 0.1297 1.21% MLPoisson::normalize() 98078 0.09964 0.1121 0.1222 1.14% Castro::construct_new_gravity_source() 260 0.07394 0.08406 0.09174 0.86% amrex::average_down 8093 0.07143 0.08001 0.08636 0.80% Castro::computeTemp() 1189 0.06324 0.07294 0.08088 0.75% MLMG::ResNormInf() 2383 0.02103 0.04844 0.07714 0.72% FabArray::LinComb() 96778 0.05372 0.06634 0.07605 0.71% FillPatchInterp(MF) 728 0.06519 0.06601 0.0667 0.62% Castro::initData() 7 0.043 0.05276 0.06418 0.60% FabArray::Xpay() 59602 0.0478 0.05697 0.06262 0.58% FabArray::FillBoundary() 157859 0.05116 0.053 0.05658 0.53% FillPatchIterator::Initialize 889 0.0444 0.04989 0.05616 0.52% MLMG::addInterpCorrection() 6101 0.04363 0.04778 0.05271 0.49% MLCellLinOp::defineAuxData() 360 0.03616 0.04205 0.05008 0.47% amrex::Add() 7701 0.03646 0.04512 0.04909 0.46% MLMG::prepareForSolve() 360 0.03321 0.03837 0.04469 0.42% FillPatchSingleLevel 1617 0.03156 0.03812 0.04357 0.41% FabArrayBase::CPC::define() 4099 0.02968 0.03552 0.04038 0.38% amrex::average_down_w_geom 248 0.02898 0.03464 0.04 0.37% MLCellLinOp::apply() 108875 0.03538 0.0364 0.03835 0.36% Gravity::actual_solve_with_mlmg() 360 0.02272 0.02758 0.03553 0.33% Castro::reflux() 60 0.02335 0.03021 0.03421 0.32% FluxRegister::Reflux() 960 0.0239 0.0295 0.03302 0.31% VisMF::Write(FabArray) 6 0.00853 0.01181 0.03031 0.28% Castro::initialize_do_advance() 140 0.02162 0.02625 0.02927 0.27% MLMG::solve() 360 0.008888 0.01943 0.0291 0.27% Gravity::fill_multipole_BCs() 70 0.02581 0.02701 0.02838 0.26% Castro::initMFs() 35 0.02081 0.02432 0.02837 0.26% FillPatchTwoLevels 756 0.02651 0.02727 0.02802 0.26% Amr::writePlotFile() 2 0.005875 0.0245 0.02792 0.26% FabArrayBase::getCPC() 29651 0.02489 0.0268 0.02775 0.26% FabArrayBase::getFB() 157859 0.02504 0.02605 0.02721 0.25% MLCellLinOp::reflux() 951 0.01955 0.02276 0.02714 0.25% MLCellLinOp::updateSolBC() 871 0.01126 0.01671 0.024 0.22% Castro::enforce_min_density() 1182 0.01845 0.021 0.02365 0.22% MultiFab::contains_nan() 280 0.0168 0.02018 0.02265 0.21% Castro::construct_new_source() 1300 0.01935 0.021 0.02214 0.21% MLCellLinOp::updateCorBC() 771 0.01036 0.01522 0.02168 0.20% Amr::coarseTimeStep() 20 0.002276 0.005075 0.02116 0.20% BndryData::define() 540 0.01187 0.01556 0.02093 0.20% MLMG::interpCorrection_1 771 0.01487 0.01752 0.02054 0.19% Castro::FluxRegCrseInit 140 0.01352 0.01638 0.01885 0.18% MLCellLinOp::smooth() 27488 0.01598 0.01678 0.01742 0.16% Gravity::get_new_grav_vector() 263 0.01022 0.01185 0.01425 0.13% MLPoisson::FFlux() 7882 0.007166 0.0113 0.01402 0.13% Castro::initialize_advance() 140 0.008614 0.01105 0.01392 0.13% StateData::define() 140 0.01005 0.01149 0.01349 0.13% Castro::FluxRegFineAdd() 140 0.005132 0.007945 0.01238 0.12% MLCellLinOp::setLevelBC() 450 0.007623 0.009538 0.01223 0.11% Castro::construct_old_source() 700 0.01003 0.01098 0.01214 0.11% Castro::swap_state_time_levels() 140 0.005934 0.007739 0.01125 0.10% MLCellLinOp::defineBC() 360 0.007809 0.009065 0.01123 0.10% FPinfo::FPinfo() 7 0.001612 0.005425 0.01118 0.10% MLCellLinOp::compGrad() 450 0.007931 0.00935 0.01071 0.10% Castro::construct_old_gravity_source() 140 0.007249 0.009161 0.009997 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003767 0.006692 0.009105 0.08% FabArray::ParallelCopy() 21259 0.008407 0.008831 0.009088 0.08% Gravity::get_old_grav_vector() 140 0.005244 0.006325 0.008966 0.08% MultiFab::max() 90 0.00342 0.005392 0.00846 0.08% Castro::buildMetrics() 35 0.005511 0.00633 0.00834 0.08% StateData::FillBoundary(geom) 745 0.001503 0.003779 0.006596 0.06% Amr::timeStep() 140 0.002826 0.00378 0.006455 0.06% Amr::regrid() 21 0.003387 0.004656 0.00644 0.06% Gravity::applyMetricTerms() 90 0.005144 0.005746 0.006167 0.06% Gravity::solve_for_phi() 280 0.004813 0.005684 0.006106 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0002621 0.00236 0.00584 0.05% AmrMesh::MakeNewGrids() 23 0.002988 0.005193 0.005812 0.05% Gravity::gravity_sync() 60 0.004068 0.00489 0.005457 0.05% MLLinOp::defineGrids() 360 0.003931 0.004319 0.005379 0.05% BoxList::pci 22 0.0004241 0.003085 0.005256 0.05% FabArray::mult() 1063 0.003755 0.004459 0.005135 0.05% MLCellLinOp::prepareForSolve() 360 0.003117 0.003807 0.005106 0.05% FabArray::norminf(mask) 270 0.003064 0.003893 0.00456 0.04% MLCellLinOp::correctionResidual() 9063 0.003944 0.00421 0.004473 0.04% Castro::Castro() 35 0.003764 0.004093 0.004281 0.04% MLMG::mgVcycle() 3385 0.003583 0.00384 0.004225 0.04% FabArray::setDomainBndry() 1617 0.003451 0.003796 0.004083 0.04% average_down_faces 360 0.002262 0.002668 0.003326 0.03% MLMG::actualBottomSolve() 1843 0.002251 0.002475 0.003027 0.03% Gravity::update_max_rhs() 30 0.002261 0.002606 0.002844 0.03% Gravity::GetCrsePhi() 250 0.001964 0.002429 0.002808 0.03% MultiFab::Subtract() 420 0.001865 0.002295 0.002771 0.03% MLMG::oneIter() 1843 0.002306 0.002424 0.002659 0.02% Castro::construct_old_gravity() 140 0.002237 0.002481 0.002634 0.02% MLMG::MLResNormInf() 440 0.0006503 0.001433 0.002603 0.02% Castro::reset_internal_energy(MultiFab) 1189 0.001641 0.002068 0.002527 0.02% Gravity::create_comp_minus_level_grad_phi() 60 0.001509 0.0019 0.002168 0.02% MLLinOp::makeSubCommunicator() 70 0.001441 0.001618 0.002136 0.02% MLMG:computeResOfCorrection() 6101 0.001823 0.001919 0.002066 0.02% MLMG::mgVcycle_bottom 3385 0.001736 0.001797 0.001938 0.02% Gravity::average_fine_ec_onto_crse_ec() 90 0.001473 0.001686 0.001881 0.02% MLMG::mgVcycle_down::0 1843 0.001696 0.001739 0.001814 0.02% MLCellLinOp::solutionResidual() 3154 0.001636 0.001711 0.001797 0.02% Castro::finalize_advance() 140 0.00111 0.001321 0.001705 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001087 0.001428 0.00164 0.02% Castro::apply_tagging_restrictions() 34 0.001118 0.00139 0.001573 0.01% Gravity::solve_phi_with_mlmg() 300 0.0008867 0.001181 0.001525 0.01% Castro::clean_state() 1182 0.001394 0.001456 0.001507 0.01% StateDataPhysBCFunct::() 1617 0.001305 0.001392 0.001472 0.01% MLMG::mgVcycle_down::1 1843 0.001354 0.001396 0.001444 0.01% ClusterList::chop() 4 0 0.0001754 0.001403 0.01% MLMG::mgVcycle_up::1 1843 0.001291 0.001338 0.001372 0.01% AMRErrorTag::operator() 34 0.0009596 0.001182 0.001341 0.01% FabArrayBase::TheFPinfo() 728 0.0009933 0.001075 0.00121 0.01% TagBoxArray::collate() 34 0.0006444 0.000855 0.001201 0.01% Castro::expand_state() 200 0.0009283 0.001084 0.001162 0.01% MLMG::mgVcycle_up::0 1843 0.001063 0.001107 0.001157 0.01% Castro::do_old_sources() 140 0.0007646 0.0008577 0.0009824 0.01% MLMG::computeResWithCrseSolFineCor() 771 0.0008689 0.0009135 0.0009644 0.01% MLPoisson::define() 360 0.0006806 0.0007622 0.0009576 0.01% MLMG::computeResidual() 1843 0.0007613 0.000808 0.0008717 0.01% main() 1 0.0006899 0.0007636 0.0008544 0.01% Castro::construct_new_gravity() 140 0.0007303 0.0007762 0.0008497 0.01% Castro::finalize_do_advance() 140 0.0004716 0.000623 0.0008087 0.01% FabArrayBase::FB::FB() 299 0.0001909 0.0004199 0.0007122 0.01% Castro::do_new_sources() 260 0.0005965 0.0006416 0.0006658 0.01% Castro::build_fine_mask() 40 0.0005661 0.0006127 0.0006381 0.01% Castro::do_advance_ctu() 140 0.0005789 0.0006023 0.0006264 0.01% Gravity::actual_multilevel_solve() 20 0.0004317 0.0005137 0.0005898 0.01% MLMG::miniCycle() 1542 0.0004955 0.0005274 0.0005773 0.01% Castro::apply_source_to_state() 520 0.0004413 0.0005087 0.0005697 0.01% MLMG::computeMLResidual() 440 0.0004594 0.0004919 0.0005566 0.01% MLMG::computeResWithCrseCorFineCor() 771 0.0004842 0.0005106 0.0005326 0.00% ClusterList::intersect() 4 0 6.628e-05 0.0005303 0.00% Castro::derive() 34 0.0004313 0.0004916 0.0005275 0.00% Amr::grid_places() 23 0.0003046 0.0003515 0.0005199 0.00% MLLinOp::define() 360 0.0003777 0.0004209 0.0004863 0.00% Castro::subcycle_advance_ctu() 140 0.000366 0.0004232 0.0004832 0.00% Castro::init(old) 28 0.0003159 0.0003809 0.0004594 0.00% Castro::advance() 140 0.0003498 0.0003863 0.0004304 0.00% Amr::InitAmr() 1 0.0002753 0.0003161 0.0004266 0.00% Castro::enforce_speed_limit() 1182 0.0003526 0.0003782 0.0004152 0.00% MLMG::mgVcycle_down::2 483 0.0003706 0.0003852 0.0003991 0.00% MLMG::mgVcycle_down::3 483 0.0003141 0.0003421 0.0003931 0.00% MLMG::mgVcycle_down::6 483 0.0003501 0.0003642 0.0003866 0.00% MLMG::mgVcycle_down::4 483 0.0003119 0.0003353 0.0003679 0.00% MLMG::mgVcycle_down::5 483 0.0002858 0.0003049 0.0003242 0.00% AmrMesh-cluster 4 0 4.016e-05 0.0003213 0.00% MLPoisson::prepareForSolve() 360 0.0002404 0.0002713 0.0003097 0.00% Gravity::swapTimeLevels() 140 0.0002324 0.000258 0.0002987 0.00% MLMG::getGradSolution() 360 0.0002574 0.0002771 0.0002964 0.00% MLMG::mgVcycle_up::6 483 0.0002407 0.0002539 0.000295 0.00% MLMG::mgVcycle_up::2 483 0.0002398 0.0002517 0.0002841 0.00% AmrLevel::AmrLevel(dm) 35 0.0002373 0.0002519 0.0002739 0.00% MLMG::mgVcycle_up::5 483 0.0002208 0.0002324 0.0002585 0.00% MLMG::mgVcycle_up::3 483 0.0002064 0.0002287 0.0002579 0.00% makeSFC 350 0.0001977 0.0002208 0.00024 0.00% MLMG::mgVcycle_up::4 483 0.0002059 0.0002143 0.0002333 0.00% TagBoxArray::mapPRD 34 0.0001935 0.000208 0.0002317 0.00% Castro::check_for_nan() 280 0.0001772 0.0001936 0.000228 0.00% MultiFab::Multiply() 40 0.0002069 0.0002123 0.0002174 0.00% OwnerMask() 34 0.0001606 0.0001841 0.0002141 0.00% Castro::post_timestep() 140 0.0001658 0.0001751 0.0002027 0.00% Castro::avgDown(state_indx) 248 0.0001622 0.0001746 0.000185 0.00% Castro::post_regrid() 66 0.0001483 0.0001654 0.0001844 0.00% DistributionMapping::Distribute() 355 0.0001416 0.0001523 0.0001772 0.00% MLLinOp::makeAgglomeratedDMap 70 0.000143 0.0001521 0.000166 0.00% MLMG::MLRhsNormInf() 360 0.0001454 0.0001509 0.0001584 0.00% Amr::FinalizeInit() 1 3.708e-06 2.161e-05 0.0001405 0.00% Gravity::solve_for_delta_phi 60 8.504e-05 0.0001002 0.000127 0.00% knapsack() 7 0.0001015 0.0001098 0.0001224 0.00% FabArray::RecvLayoutMask() 90 9.069e-05 0.0001054 0.0001156 0.00% Castro::enforce_consistent_e() 7 7.184e-05 9.217e-05 0.000108 0.00% BoxList::complementIn 574 6.941e-05 7.626e-05 8.806e-05 0.00% Castro::create_source_corrector() 140 6.797e-05 7.593e-05 8.416e-05 0.00% Castro::retry_advance_ctu() 140 5.036e-05 6.178e-05 8.057e-05 0.00% Castro::avgDown() 62 6.595e-05 6.854e-05 7.129e-05 0.00% Castro::errorEst() 34 5.933e-05 6.291e-05 6.478e-05 0.00% Castro::computeNewDt() 28 4.012e-05 4.234e-05 4.389e-05 0.00% Amr::writeSmallPlotFile() 1 3.244e-05 3.429e-05 3.697e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.886e-05 3.295e-05 3.565e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.197e-05 2.453e-05 2.751e-05 0.00% Amr::defBaseLevel() 1 1.772e-05 2.201e-05 2.647e-05 0.00% Amr::bldFineLevels() 1 2.032e-05 2.405e-05 2.598e-05 0.00% Gravity::set_mass_offset() 21 1.937e-05 2.124e-05 2.587e-05 0.00% BoxList::parallelComplementIn() 57 2.173e-05 2.263e-05 2.349e-05 0.00% Castro::apply_problem_tags() 34 1.439e-05 1.552e-05 1.675e-05 0.00% Amr::initSubcycle() 1 8.946e-06 1.148e-05 1.534e-05 0.00% Castro::post_init() 3 8.465e-06 9.043e-06 9.784e-06 0.00% Amr::InitializeInit() 1 2.05e-06 2.715e-06 4.896e-06 0.00% Castro::computeInitialDt() 2 2.554e-06 3.256e-06 3.501e-06 0.00% Amr::init() 1 1.745e-06 2.13e-06 2.761e-06 0.00% Amr::initialInit() 1 1.149e-06 1.417e-06 1.835e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.73 10.73 10.73 100.00% Amr::coarseTimeStep() 20 10.52 10.52 10.52 98.05% Amr::timeStep() 140 10.48 10.5 10.5 97.90% Castro::advance() 140 7.726 7.73 7.734 72.09% Castro::subcycle_advance_ctu() 140 7.501 7.539 7.58 70.65% Castro::do_advance_ctu() 140 7.501 7.539 7.579 70.64% Gravity::actual_solve_with_mlmg() 360 5.715 5.726 5.738 53.49% MLMG::solve() 360 5.542 5.55 5.558 51.80% MLMG::oneIter() 1843 5.157 5.189 5.209 48.55% MLMG::mgVcycle() 3385 4.778 4.829 4.87 45.39% Gravity::solve_phi_with_mlmg() 300 4.294 4.302 4.317 40.24% Gravity::solve_for_phi() 280 3.628 3.637 3.651 34.03% MLMG::mgVcycle_bottom 3385 3.227 3.249 3.262 30.40% Castro::construct_ctu_hydro_source() 140 2.933 2.938 2.943 27.43% Castro::construct_new_gravity() 140 2.882 2.885 2.893 26.96% MLMG::actualBottomSolve() 1843 2.821 2.829 2.854 26.60% MLCGSolver::bicgstab 1420 2.817 2.825 2.85 26.56% Castro::post_timestep() 140 1.982 1.998 2.004 18.68% Castro::reflux() 60 1.864 1.879 1.894 17.65% MLCellLinOp::applyBC() 165252 1.429 1.648 1.841 17.16% MLCellLinOp::smooth() 27488 1.622 1.69 1.746 16.27% FabArray::FillBoundary() 157859 1.149 1.353 1.568 14.62% Gravity::gravity_sync() 60 1.553 1.554 1.554 14.49% Gravity::solve_for_delta_phi 60 1.479 1.48 1.48 13.80% MLCGSolver::ParallelAllReduce 243542 0.9871 1.171 1.436 13.38% MLCellLinOp::apply() 108875 1.159 1.31 1.424 13.27% MLPoisson::Fsmooth() 54976 0.9402 1.043 1.148 10.70% check_for_negative_density() 140 0.2999 0.5473 0.9353 8.72% FabArray::ParallelCopy() 21259 0.5654 0.7034 0.9041 8.43% Castro::construct_old_gravity() 140 0.8797 0.8859 0.8936 8.33% Amr::regrid() 21 0.8105 0.8184 0.8269 7.71% FillBoundary_finish() 157859 0.4407 0.6039 0.7652 7.13% FillBoundary_nowait() 157859 0.5585 0.6966 0.7627 7.11% FabArray::ParallelCopy_finish() 21259 0.3006 0.4506 0.689 6.42% Gravity::multilevel_solve_for_new_phi() 20 0.6801 0.6821 0.6834 6.37% Gravity::actual_multilevel_solve() 20 0.6785 0.6807 0.6823 6.36% Castro::post_regrid() 66 0.653 0.6572 0.6596 6.15% FillPatchIterator::Initialize 889 0.4462 0.5159 0.5967 5.56% MLMG::mgVcycle_down::0 1843 0.496 0.5184 0.5383 5.02% FillPatchTwoLevels 756 0.3769 0.4456 0.5304 4.94% MLMG::mgVcycle_up::0 1843 0.4586 0.4718 0.4808 4.48% Castro::clean_state() 1182 0.3507 0.4069 0.4444 4.14% MLMG::miniCycle() 1542 0.3934 0.4202 0.4405 4.11% Castro::initialize_do_advance() 140 0.3467 0.3784 0.4142 3.86% FillPatchSingleLevel 1617 0.2169 0.2808 0.372 3.47% Castro::expand_state() 200 0.2323 0.2645 0.3112 2.90% MLPoisson::Fapply() 108875 0.2455 0.2796 0.3049 2.84% MLCellLinOp::correctionResidual() 9063 0.2524 0.2759 0.2935 2.74% FabArray::ParallelCopy_nowait() 21259 0.2068 0.244 0.2725 2.54% Castro::do_new_sources() 260 0.2161 0.2473 0.2709 2.53% Castro::computeTemp() 1189 0.2089 0.2441 0.266 2.48% MLMG::mgVcycle_down::1 1843 0.2258 0.2326 0.2446 2.28% MLCellLinOp::solutionResidual() 3154 0.2019 0.2164 0.2313 2.16% Castro::do_old_sources() 140 0.208 0.2104 0.2143 2.00% FabArray::setVal() 27514 0.1398 0.1746 0.2124 1.98% amrex::Dot() 193316 0.158 0.1838 0.2023 1.89% MLMG::computeResWithCrseSolFineCor() 771 0.1499 0.1742 0.1928 1.80% Castro::estTimeStep() 308 0.1101 0.1539 0.1915 1.79% Amr::init() 1 0.1892 0.1893 0.1893 1.76% Castro::reset_internal_energy(MultiFab) 1189 0.1456 0.1712 0.1851 1.73% MLMG::mgVcycle_up::1 1843 0.1718 0.18 0.1848 1.72% Castro::initialize_advance() 140 0.1156 0.1502 0.1832 1.71% Castro::reset_internal_energy(Fab) 5919 0.1437 0.1691 0.1826 1.70% FabArray::Saxpy() 145223 0.1258 0.1521 0.1727 1.61% Amr::initialInit() 1 0.171 0.171 0.1711 1.59% amrex::Copy() 106562 0.1243 0.1491 0.1696 1.58% Amr::FinalizeInit() 1 0.1561 0.1608 0.1638 1.53% amrex::average_down 8093 0.1205 0.1412 0.1626 1.52% Castro::normalize_species() 1182 0.1225 0.1412 0.1541 1.44% Castro::construct_new_source() 1300 0.118 0.1331 0.1449 1.35% MLMG::computeResidual() 1843 0.112 0.1286 0.1351 1.26% MLMG::addInterpCorrection() 6101 0.05784 0.1101 0.1315 1.23% MLMG:computeResOfCorrection() 6101 0.1245 0.1269 0.1298 1.21% FabArray::norminf() 100641 0.1054 0.1194 0.1297 1.21% MLPoisson::normalize() 98078 0.09964 0.1121 0.1222 1.14% MLMG::mgVcycle_up::2 483 0.02752 0.06784 0.108 1.01% MLPoisson::define() 360 0.0762 0.08937 0.1075 1.00% Castro::avgDown() 62 0.06203 0.07956 0.1044 0.97% Castro::avgDown(state_indx) 248 0.06196 0.0795 0.1043 0.97% amrex::average_down_w_geom 248 0.06179 0.07932 0.1042 0.97% MLMG::ResNormInf() 2383 0.05189 0.07707 0.1039 0.97% Castro::finalize_do_advance() 140 0.05402 0.07643 0.099 0.92% Gravity::get_new_grav_vector() 263 0.09353 0.09521 0.09728 0.91% Castro::construct_new_gravity_source() 260 0.07394 0.08406 0.09174 0.86% MLCellLinOp::reflux() 951 0.06863 0.08197 0.09131 0.85% MLMG::computeResWithCrseCorFineCor() 771 0.07815 0.08767 0.09101 0.85% Amr::bldFineLevels() 1 0.08103 0.08515 0.0894 0.83% FabArray::LinComb() 96778 0.05372 0.06634 0.07605 0.71% Castro::post_init() 3 0.06496 0.0697 0.07401 0.69% MLMG::computeMLResidual() 440 0.05325 0.0631 0.07155 0.67% Castro::initData() 7 0.04664 0.05704 0.06916 0.64% MLCellLinOp::setLevelBC() 450 0.02411 0.04351 0.06839 0.64% MLMG::prepareForSolve() 360 0.06236 0.06521 0.06817 0.64% FabArrayBase::getCPC() 29651 0.05457 0.06232 0.06807 0.63% FillPatchInterp(MF) 728 0.06519 0.06601 0.0667 0.62% MLMG::mgVcycle_up::3 483 0.00411 0.02846 0.06414 0.60% Gravity::get_old_grav_vector() 140 0.05998 0.06195 0.06408 0.60% MLCellLinOp::updateSolBC() 871 0.04344 0.05537 0.06377 0.59% MLCellLinOp::defineAuxData() 360 0.04474 0.05287 0.06268 0.58% FabArray::Xpay() 59602 0.0478 0.05697 0.06262 0.58% FluxRegister::Reflux() 960 0.0489 0.05558 0.06082 0.57% Castro::init(old) 28 0.04693 0.05458 0.05971 0.56% MLCellLinOp::updateCorBC() 771 0.04176 0.04937 0.05554 0.52% Gravity::GetCrsePhi() 250 0.01711 0.03482 0.0524 0.49% Castro::Castro() 35 0.0378 0.04378 0.05222 0.49% amrex::Add() 7701 0.03646 0.04512 0.04909 0.46% MLMG::interpCorrection_1 771 0.02931 0.03574 0.04779 0.45% Castro::finalize_advance() 140 0.03649 0.04028 0.04584 0.43% FabArrayBase::CPC::define() 4099 0.02968 0.03552 0.04038 0.38% MLCellLinOp::defineBC() 360 0.02245 0.02887 0.03767 0.35% Castro::apply_source_to_state() 520 0.02892 0.03425 0.03737 0.35% Amr::writePlotFile() 2 0.03682 0.03693 0.03698 0.34% MLMG::mgVcycle_down::2 483 0.03129 0.03249 0.03415 0.32% Amr::grid_places() 23 0.01975 0.0261 0.03215 0.30% Castro::construct_old_source() 700 0.02488 0.02934 0.03197 0.30% AmrMesh::MakeNewGrids() 23 0.01942 0.02575 0.03185 0.30% VisMF::Write(FabArray) 6 0.00853 0.01181 0.03031 0.28% Gravity::fill_multipole_BCs() 70 0.02703 0.02821 0.02957 0.28% Castro::initMFs() 35 0.02081 0.02432 0.02837 0.26% FabArrayBase::getFB() 157859 0.02529 0.02647 0.02744 0.26% Castro::FluxRegCrseInit 140 0.02582 0.02695 0.02742 0.26% BndryData::define() 540 0.01442 0.01953 0.0261 0.24% Castro::enforce_min_density() 1182 0.01845 0.021 0.02365 0.22% MLMG::mgVcycle_down::3 483 0.005474 0.01368 0.02361 0.22% Castro::check_for_nan() 280 0.01703 0.02037 0.02285 0.21% MultiFab::contains_nan() 280 0.0168 0.02018 0.02265 0.21% Castro::computeNewDt() 28 0.019 0.0201 0.02117 0.20% Gravity::average_fine_ec_onto_crse_ec() 90 0.01662 0.01747 0.01862 0.17% Castro::errorEst() 34 0.009447 0.01426 0.01848 0.17% MLMG::getGradSolution() 360 0.01286 0.01523 0.0178 0.17% MLCellLinOp::compGrad() 450 0.0126 0.01496 0.01751 0.16% Gravity::update_max_rhs() 30 0.01374 0.015 0.0171 0.16% Castro::derive() 34 0.006723 0.01161 0.01572 0.15% Amr::InitializeInit() 1 0.00724 0.01024 0.01482 0.14% Amr::defBaseLevel() 1 0.007235 0.01024 0.01482 0.14% MLPoisson::FFlux() 7882 0.007166 0.0113 0.01402 0.13% AmrLevel::AmrLevel(dm) 35 0.01029 0.01174 0.01375 0.13% StateData::define() 140 0.01005 0.01149 0.01349 0.13% FabArrayBase::TheFPinfo() 728 0.002821 0.006705 0.01252 0.12% Castro::FluxRegFineAdd() 140 0.005132 0.007945 0.01238 0.12% MLMG::mgVcycle_down::4 483 0.004986 0.006112 0.01148 0.11% FPinfo::FPinfo() 7 0.00181 0.005631 0.01138 0.11% Castro::swap_state_time_levels() 140 0.005934 0.007739 0.01125 0.10% MLMG::MLResNormInf() 440 0.007757 0.008884 0.0104 0.10% average_down_faces 360 0.007802 0.009302 0.01006 0.09% Castro::construct_old_gravity_source() 140 0.007249 0.009161 0.009997 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8420 0.003767 0.006692 0.009105 0.08% MLMG::mgVcycle_up::4 483 0.004069 0.004734 0.00889 0.08% Castro::computeInitialDt() 2 0.001045 0.005685 0.008601 0.08% Castro::buildMetrics() 35 0.005605 0.006445 0.008471 0.08% MultiFab::max() 90 0.00342 0.005392 0.00846 0.08% MLMG::mgVcycle_down::5 483 0.00486 0.005408 0.008152 0.08% StateDataPhysBCFunct::() 1617 0.002808 0.005171 0.008067 0.08% MLLinOp::define() 360 0.006304 0.006873 0.008057 0.08% MLLinOp::defineGrids() 360 0.005915 0.006452 0.00757 0.07% MLMG::mgVcycle_down::6 483 0.004899 0.005293 0.007227 0.07% StateData::FillBoundary(geom) 745 0.001503 0.003779 0.006596 0.06% MLMG::mgVcycle_up::5 483 0.00415 0.004581 0.006564 0.06% MLMG::mgVcycle_up::6 483 0.004665 0.004997 0.00656 0.06% MLMG::MLRhsNormInf() 360 0.005237 0.005756 0.006209 0.06% Gravity::applyMetricTerms() 90 0.005144 0.005746 0.006167 0.06% DistributionMapping::LeastUsedCPUs() 12 0.0002621 0.00236 0.00584 0.05% DistributionMapping::SFCProcessorMapDoIt() 5 0.0002396 0.002332 0.005822 0.05% MLPoisson::prepareForSolve() 360 0.003426 0.004078 0.005364 0.05% BoxList::parallelComplementIn() 57 0.0004582 0.003123 0.005297 0.05% BoxList::pci 22 0.0004241 0.003085 0.005256 0.05% FabArray::mult() 1063 0.003755 0.004459 0.005135 0.05% MLCellLinOp::prepareForSolve() 360 0.003117 0.003807 0.005106 0.05% Gravity::swapTimeLevels() 140 0.003046 0.003796 0.004763 0.04% FabArray::norminf(mask) 270 0.003064 0.003893 0.00456 0.04% FabArray::setDomainBndry() 1617 0.003451 0.003796 0.004083 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002775 0.003462 0.003903 0.04% MultiFab::Subtract() 420 0.001865 0.002295 0.002771 0.03% TagBoxArray::mapPRD 34 0.001231 0.001913 0.002739 0.03% AmrMesh-cluster 4 0 0.0002819 0.002255 0.02% MLLinOp::makeSubCommunicator() 70 0.001441 0.001618 0.002136 0.02% Castro::apply_tagging_restrictions() 34 0.001118 0.00139 0.001573 0.01% ClusterList::chop() 4 0 0.0001754 0.001403 0.01% AMRErrorTag::operator() 34 0.0009596 0.001182 0.001341 0.01% TagBoxArray::collate() 34 0.0006444 0.000855 0.001201 0.01% FabArrayBase::FB::FB() 299 0.0001909 0.0004199 0.0007122 0.01% Castro::build_fine_mask() 40 0.0005661 0.0006127 0.0006381 0.01% MLLinOp::makeAgglomeratedDMap 70 0.000481 0.0005145 0.0005581 0.01% ClusterList::intersect() 4 0 6.628e-05 0.0005303 0.00% Amr::InitAmr() 1 0.000285 0.0003276 0.0004393 0.00% Castro::enforce_speed_limit() 1182 0.0003526 0.0003782 0.0004152 0.00% makeSFC 350 0.0003369 0.0003624 0.0004006 0.00% MultiFab::Multiply() 40 0.0002069 0.0002123 0.0002174 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001961 0.0002055 0.0002142 0.00% OwnerMask() 34 0.0001606 0.0001841 0.0002141 0.00% DistributionMapping::Distribute() 355 0.0001416 0.0001523 0.0001772 0.00% knapsack() 7 0.0001015 0.0001098 0.0001224 0.00% FabArray::RecvLayoutMask() 90 9.069e-05 0.0001054 0.0001156 0.00% Castro::enforce_consistent_e() 7 7.184e-05 9.217e-05 0.000108 0.00% BoxList::complementIn 574 6.941e-05 7.626e-05 8.806e-05 0.00% Castro::create_source_corrector() 140 6.797e-05 7.593e-05 8.416e-05 0.00% Castro::retry_advance_ctu() 140 5.036e-05 6.178e-05 8.057e-05 0.00% Amr::writeSmallPlotFile() 1 3.244e-05 3.429e-05 3.697e-05 0.00% Gravity::set_mass_offset() 21 1.937e-05 2.124e-05 2.587e-05 0.00% Castro::apply_problem_tags() 34 1.439e-05 1.552e-05 1.675e-05 0.00% Amr::initSubcycle() 1 8.946e-06 1.148e-05 1.534e-05 0.00% -------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 10 B 11 B 17 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.06-22-g6303e0abfae9) finalized