MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.04-28-g56661522b4cd) initialized Starting run at 16:02:51 UTC on 2022-04-24. Successfully read inputs file ... Castro git describe: 22.04-22-ge0c20f915 AMReX git describe: 22.04-28-g56661522b Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001482599 new finest: 1 grid_places() time: 0.007163955 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.010697411 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.01246764 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.014446686 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.48421623 [STEP 1] FAB kilobyte spread across MPI nodes: [18083 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000563181 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.566356155 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000802806 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.51666126 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000549068 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.519253591 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000862923 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.489296848 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000525571 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.482180862 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000794266 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.486881762 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.000528118 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.485418801 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.000784656 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.488334294 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000529504 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.484087985 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000796187 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.490589244 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000536026 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.48447112 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000800567 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.49992198 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000541344 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.50595921 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000776114 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.511894226 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.00053027 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.497962574 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000789715 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.493046932 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000541464 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.492445807 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000787566 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.510781054 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000534348 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.506745359 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.014169634 seconds Ending run at 16:03:01 UTC on 2022-04-24. Run time = 10.2344951 Run time without initialization = 10.01161666 Average number of zones advanced per microsecond: 0.880 Average number of zones advanced per microsecond per rank: 0.110 TinyProfiler total time across processes [min...avg...max]: 10.23 ... 10.23 ... 10.23 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.7576 2.1080 2.3662 23.12% MLCGSolver::ParallelAllReduce 243542 0.7898 1.022 1.327 12.96% MLPoisson::Fsmooth() 54976 0.7888 0.8879 0.9688 9.47% Castro::do_advance_ctu() 140 0.2948 0.5575 0.9063 8.86% FillBoundary_finish() 157859 0.4751 0.6113 0.7959 7.78% FillBoundary_nowait() 157859 0.4847 0.6604 0.7669 7.49% FabArray::ParallelCopy_finish() 21119 0.305 0.4715 0.7324 7.16% MLCellLinOp::applyBC() 165252 0.1977 0.2844 0.3711 3.63% MLPoisson::Fapply() 108875 0.2535 0.289 0.3064 2.99% MLCGSolver::bicgstab 1420 0.1982 0.232 0.2504 2.45% MultiFab::LinComb() 288336 0.1605 0.2031 0.2413 2.36% FabArray::setVal() 27604 0.1415 0.1747 0.2124 2.08% FabArray::ParallelCopy_nowait() 21119 0.1505 0.1821 0.2044 2.00% MultiFab::Dot() 193316 0.1556 0.1846 0.2001 1.95% Castro::reset_internal_energy() 1189 0.141 0.1678 0.1822 1.78% Castro::normalize_species() 1182 0.1302 0.1483 0.1628 1.59% Castro::estTimeStep() 228 0.08657 0.09684 0.1207 1.18% MLPoisson::normalize() 98078 0.09749 0.1124 0.1196 1.17% MLMG::ResNormInf() 2383 0.05416 0.07745 0.1017 0.99% Castro::construct_new_gravity_source() 260 0.0651 0.07524 0.08312 0.81% amrex::average_down 8093 0.06661 0.07608 0.08212 0.80% Castro::initData() 7 0.0448 0.05711 0.07802 0.76% Castro::computeTemp() 1189 0.05797 0.06828 0.07644 0.75% CellConservativeLinear::interp() 8794 0.06485 0.06658 0.06834 0.67% MultiFab::Saxpy() 1180 0.05273 0.06194 0.06811 0.67% CGSolver::sxay() 288086 0.06164 0.0642 0.06597 0.64% MLMG::addInterpCorrection() 6101 0.04731 0.05338 0.05818 0.57% FabArray::FillBoundary() 157859 0.05156 0.05353 0.05801 0.57% MLCellLinOp::defineAuxData() 360 0.03599 0.04227 0.05106 0.50% FillPatchIterator::Initialize 829 0.04239 0.04555 0.04991 0.49% amrex::average_down_w_geom 248 0.03047 0.03639 0.04249 0.42% MLMG::prepareForSolve() 360 0.0303 0.03539 0.04227 0.41% Castro::reflux() 60 0.02937 0.03776 0.04145 0.41% MLCellLinOp::apply() 108875 0.0385 0.03949 0.04054 0.40% FabArrayBase::CPC::define() 4019 0.02783 0.03358 0.03875 0.38% Amr::regrid() 21 0.0261 0.03122 0.03824 0.37% FillPatchSingleLevel 1517 0.02498 0.03174 0.03777 0.37% Gravity::actual_solve_with_mlmg() 360 0.02257 0.02765 0.03565 0.35% FluxRegister::Reflux() 960 0.02578 0.03117 0.03508 0.34% MultiFab::Xpay() 12217 0.02769 0.03186 0.03471 0.34% FabArrayBase::getFB() 157859 0.02879 0.03083 0.03234 0.32% Gravity::fill_multipole_BCs() 70 0.02778 0.02951 0.03116 0.30% MLCellLinOp::reflux() 951 0.02405 0.02692 0.03102 0.30% MLMG::interpCorrection_1 771 0.02157 0.02605 0.03024 0.30% FabArrayBase::getCPC() 29601 0.02635 0.02799 0.02924 0.29% MLMG::solve() 360 0.009029 0.01996 0.02919 0.29% Castro::initialize_do_advance() 140 0.0222 0.02601 0.0287 0.28% FillPatchTwoLevels 716 0.02487 0.02653 0.02732 0.27% Gravity::get_new_grav_vector() 263 0.01633 0.01985 0.02419 0.24% Castro::enforce_min_density() 1182 0.01853 0.02127 0.02401 0.23% VisMF::Write(FabArray) 6 0.007661 0.01005 0.02371 0.23% MLCellLinOp::updateSolBC() 871 0.01123 0.01656 0.02353 0.23% MLMG::oneIter() 1843 0.01819 0.02087 0.02269 0.22% Castro::construct_new_source() 1300 0.02009 0.02129 0.02257 0.22% Castro::expand_state() 140 0.019 0.02081 0.02255 0.22% MultiFab::contains_nan() 280 0.01616 0.01973 0.02254 0.22% BndryData::define() 540 0.01207 0.01594 0.0219 0.21% MLCellLinOp::updateCorBC() 771 0.01046 0.01536 0.02183 0.21% Amr::writePlotFile() 2 0.005597 0.01933 0.02175 0.21% Castro::finalize_advance() 140 0.01518 0.01865 0.02143 0.21% MLCellLinOp::smooth() 27488 0.01645 0.01708 0.018 0.18% Gravity::get_old_grav_vector() 140 0.00873 0.01117 0.01536 0.15% Castro::initialize_advance() 140 0.008543 0.01084 0.01402 0.14% FPinfo::FPinfo() 7 0.001406 0.007312 0.01381 0.13% MLPoisson::FFlux() 7882 0.00708 0.01054 0.01306 0.13% MLCellLinOp::setLevelBC() 450 0.007897 0.009977 0.01303 0.13% StateData::define() 140 0.009267 0.01068 0.01231 0.12% Castro::construct_old_source() 700 0.009676 0.0109 0.012 0.12% MLCellLinOp::defineBC() 360 0.00809 0.009607 0.0119 0.12% Castro::swap_state_time_levels() 140 0.005992 0.008153 0.0116 0.11% MLCellLinOp::compGrad() 450 0.008768 0.01005 0.01148 0.11% Castro::FluxRegFineAdd() 140 0.005302 0.007786 0.01141 0.11% Gravity::gravity_sync() 60 0.007591 0.009324 0.0103 0.10% Castro::construct_old_gravity_source() 140 0.007408 0.009064 0.00986 0.10% FabArray::ParallelCopy() 21119 0.008715 0.009066 0.009486 0.09% DistributionMapping::LeastUsedCPUs() 12 0.0001394 0.005439 0.009312 0.09% MultiFab::max() 90 0.004286 0.006253 0.009095 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003877 0.006879 0.008677 0.08% Gravity::solve_for_phi() 280 0.006045 0.006786 0.007409 0.07% FabArray::mult() 1063 0.005316 0.006158 0.007092 0.07% Amr::timeStep() 140 0.003281 0.00401 0.007013 0.07% Castro::init(old) 28 0.005532 0.006023 0.006685 0.07% AmrMesh::MakeNewGrids() 23 0.00306 0.005374 0.0062 0.06% MLLinOp::defineGrids() 360 0.004626 0.00501 0.006126 0.06% BoxList::pci 22 0.0004592 0.003306 0.00598 0.06% Gravity::applyMetricTerms() 90 0.004674 0.005198 0.005591 0.05% StateData::FillBoundary(geom) 685 0.001098 0.003115 0.005361 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003778 0.004397 0.005275 0.05% MLMG::MLRhsNormInf() 360 0.00387 0.004498 0.004999 0.05% MLCellLinOp::prepareForSolve() 360 0.002956 0.003708 0.004981 0.05% MultiFab::norm0(mask) 270 0.003113 0.003916 0.004686 0.05% Amr::bldFineLevels() 1 0.00311 0.003623 0.004662 0.05% Castro::construct_old_gravity() 140 0.003438 0.004095 0.004558 0.04% Castro::construct_new_gravity() 140 0.003551 0.003987 0.004389 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.003259 0.003739 0.004297 0.04% MLCellLinOp::correctionResidual() 9063 0.003802 0.004109 0.004296 0.04% MLMG::mgVcycle() 3385 0.003856 0.004071 0.004223 0.04% MLMG::computeResWithCrseCorFineCor() 771 0.002813 0.003327 0.004005 0.04% FabArray::setDomainBndry() 1517 0.0033 0.003622 0.003916 0.04% Gravity::update_max_rhs() 30 0.002691 0.00318 0.003545 0.03% MLMG::actualBottomSolve() 1843 0.002502 0.00275 0.003432 0.03% FillPatchInterp(Fab) 688 0.002995 0.003183 0.003348 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002172 0.002649 0.003034 0.03% MultiFab::Subtract() 420 0.00194 0.002424 0.002973 0.03% Amr::defBaseLevel() 1 0.00196 0.00227 0.002934 0.03% Gravity::GetCrsePhi() 250 0.001998 0.00242 0.002801 0.03% Amr::coarseTimeStep() 20 0.0007675 0.001515 0.00267 0.03% MultiFab::Copy() 450 0.001807 0.002168 0.002586 0.03% MLMG::MLResNormInf() 440 0.0006819 0.001431 0.002548 0.02% MLLinOp::makeSubCommunicator() 70 0.00139 0.001756 0.002493 0.02% MLMG:computeResOfCorrection() 6101 0.002122 0.002227 0.002307 0.02% Castro::apply_tagging_restrictions() 34 0.001338 0.00168 0.002114 0.02% MLMG::mgVcycle_down::0 1843 0.001869 0.001917 0.00199 0.02% MLCellLinOp::solutionResidual() 3154 0.001788 0.00185 0.00196 0.02% MLMG::mgVcycle_bottom 3385 0.001764 0.001826 0.001858 0.02% Gravity::solve_phi_with_mlmg() 300 0.0009342 0.001183 0.001766 0.02% TagBoxArray::collate() 34 0.0005808 0.001109 0.0016 0.02% MLMG::mgVcycle_down::1 1843 0.001489 0.001528 0.001588 0.02% AMRErrorTag::operator() 34 0.0009377 0.001233 0.001578 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001144 0.001443 0.001576 0.02% StateDataPhysBCFunct::() 1517 0.001249 0.001423 0.001569 0.02% Castro::clean_state() 1182 0.001465 0.001504 0.001547 0.02% MLMG::mgVcycle_up::1 1843 0.001246 0.001344 0.00149 0.01% ClusterList::chop() 4 0 0.0001735 0.001388 0.01% MLMG::mgVcycle_up::0 1843 0.001076 0.001132 0.001259 0.01% main() 1 0.0007155 0.0008243 0.00125 0.01% MLPoisson::define() 360 0.0008022 0.0008932 0.001162 0.01% MLMG::buildFineMask() 360 0.0009402 0.000995 0.00107 0.01% Castro::build_fine_mask() 100 0.0008105 0.0009121 0.001045 0.01% FabArrayBase::TheFPinfo() 688 0.0007849 0.000865 0.0009592 0.01% Gravity::actual_multilevel_solve() 20 0.0007433 0.0008488 0.0009084 0.01% Castro::finalize_do_advance() 140 0.0004499 0.0006357 0.0008414 0.01% MLMG::computeResidual() 1843 0.0007344 0.0008003 0.0008335 0.01% Castro::derive() 34 0.000477 0.0005595 0.0006997 0.01% MLMG::miniCycle() 1542 0.0005968 0.0006248 0.0006755 0.01% FabArrayBase::FB::FB() 299 0.000198 0.0004451 0.0006685 0.01% Castro::do_new_sources() 260 0.0006121 0.0006372 0.0006574 0.01% Amr::grid_places() 23 0.0003196 0.0003703 0.0005922 0.01% ClusterList::intersect() 4 0 6.488e-05 0.000519 0.01% MLLinOp::define() 360 0.000398 0.0004291 0.0004748 0.00% Amr::InitAmr() 1 0.0002722 0.0003423 0.0004748 0.00% Castro::apply_source_to_state() 520 0.0003903 0.0004287 0.0004595 0.00% Castro::subcycle_advance_ctu() 140 0.0003576 0.0003973 0.0004581 0.00% Castro::advance() 140 0.0003818 0.0004039 0.0004445 0.00% MLMG::mgVcycle_down::4 483 0.0003682 0.0003972 0.0004303 0.00% MLPoisson::prepareForSolve() 360 0.0002743 0.0003206 0.0004059 0.00% Castro::enforce_speed_limit() 1182 0.0003282 0.0003628 0.0004031 0.00% MLMG::mgVcycle_down::2 483 0.0003714 0.0003866 0.0003992 0.00% MLMG::mgVcycle_down::3 483 0.0003349 0.0003637 0.0003924 0.00% MLMG::mgVcycle_down::6 483 0.0003404 0.0003529 0.0003728 0.00% MLMG::mgVcycle_down::5 483 0.0003214 0.0003356 0.000367 0.00% MLMG::computeMLResidual() 440 0.0002915 0.0003146 0.000363 0.00% Castro::do_old_sources() 140 0.0003119 0.000328 0.0003413 0.00% AmrMesh-cluster 4 0 3.95e-05 0.000316 0.00% MLMG::mgVcycle_up::6 483 0.0002922 0.0002998 0.0003092 0.00% MLMG::mgVcycle_up::2 483 0.0002521 0.0002688 0.0002998 0.00% Gravity::swapTimeLevels() 140 0.0002499 0.0002697 0.000297 0.00% MultiFab::Multiply() 40 0.0002389 0.0002545 0.0002669 0.00% makeSFC 350 0.0002069 0.0002321 0.0002663 0.00% MLMG::mgVcycle_up::3 483 0.0002157 0.000238 0.0002613 0.00% MLMG::mgVcycle_up::5 483 0.0002394 0.0002474 0.0002576 0.00% MLMG::mgVcycle_up::4 483 0.000222 0.0002347 0.0002489 0.00% MLMG::getGradSolution() 360 0.0002132 0.000224 0.0002313 0.00% AmrLevel::AmrLevel(dm) 35 0.000185 0.0002016 0.00023 0.00% OwnerMask() 34 0.0001676 0.0001907 0.0002277 0.00% TagBoxArray::mapPRD 34 0.0001842 0.0002014 0.0002268 0.00% Castro::check_for_nan() 280 0.0001753 0.0001918 0.0002129 0.00% Castro::avgDown(state_indx) 248 0.0001549 0.0001722 0.0001878 0.00% DistributionMapping::Distribute() 355 0.0001572 0.0001689 0.0001841 0.00% Castro::enforce_consistent_e() 7 7.272e-05 0.0001069 0.0001807 0.00% Castro::post_regrid() 66 0.000142 0.0001614 0.0001801 0.00% Castro::post_timestep() 140 0.0001465 0.0001628 0.0001759 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001412 0.0001569 0.0001728 0.00% FabArray::RecvLayoutMask() 90 9.508e-05 0.0001181 0.0001268 0.00% knapsack() 7 0.0001013 0.0001062 0.000111 0.00% Amr::FinalizeInit() 1 3.77e-06 1.735e-05 0.0001069 0.00% Castro::retry_advance_ctu() 140 7.315e-05 8.854e-05 0.0001036 0.00% Gravity::solve_for_delta_phi 60 8.891e-05 9.61e-05 0.0001033 0.00% Castro::create_source_corrector() 140 7.632e-05 8.854e-05 9.581e-05 0.00% BoxList::complementIn 574 6.803e-05 7.333e-05 8.2e-05 0.00% Castro::avgDown() 62 6.614e-05 7.198e-05 7.92e-05 0.00% Castro::errorEst() 34 6.209e-05 6.991e-05 7.708e-05 0.00% Amr::writeSmallPlotFile() 1 3.32e-05 4.717e-05 7.27e-05 0.00% Castro::computeNewDt() 28 3.954e-05 4.574e-05 5.895e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 3.059e-05 3.34e-05 3.563e-05 0.00% BoxList::parallelComplementIn() 57 2.566e-05 2.925e-05 3.335e-05 0.00% Amr::initSubcycle() 1 8.986e-06 1.316e-05 2.697e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.198e-05 2.361e-05 2.649e-05 0.00% Gravity::set_mass_offset() 21 2.157e-05 2.328e-05 2.588e-05 0.00% Castro::apply_problem_tags() 34 1.48e-05 1.709e-05 1.878e-05 0.00% Castro::post_init() 3 8.405e-06 9.661e-06 1.133e-05 0.00% Amr::InitializeInit() 1 2.269e-06 3.74e-06 1.102e-05 0.00% Amr::init() 1 1.728e-06 2.897e-06 8.913e-06 0.00% Castro::computeInitialDt() 2 3.204e-06 3.614e-06 4.117e-06 0.00% Amr::initialInit() 1 1.101e-06 1.379e-06 1.821e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.23 10.23 10.23 100.00% Amr::coarseTimeStep() 20 9.996 9.996 9.996 97.67% Amr::timeStep() 140 9.966 9.98 9.983 97.54% Castro::advance() 140 7.349 7.353 7.357 71.88% Castro::subcycle_advance_ctu() 140 7.128 7.165 7.204 70.39% Castro::do_advance_ctu() 140 7.127 7.164 7.203 70.38% Gravity::actual_solve_with_mlmg() 360 5.528 5.547 5.585 54.57% MLMG::solve() 360 5.348 5.357 5.365 52.42% MLMG::oneIter() 1843 4.963 4.991 5.007 48.93% MLMG::mgVcycle() 3385 4.571 4.617 4.651 45.45% Gravity::solve_phi_with_mlmg() 300 4.188 4.22 4.247 41.50% Gravity::solve_for_phi() 280 3.529 3.56 3.586 35.04% MLMG::mgVcycle_bottom 3385 3.138 3.159 3.182 31.09% Castro::construct_new_gravity() 140 2.815 2.82 2.828 27.64% MLMG::actualBottomSolve() 1843 2.77 2.778 2.798 27.34% MLCGSolver::bicgstab 1420 2.766 2.774 2.793 27.29% Castro::construct_ctu_hydro_source() 140 1.758 2.108 2.366 23.12% Castro::post_timestep() 140 1.868 1.882 1.888 18.44% MLCellLinOp::applyBC() 165252 1.433 1.59 1.797 17.56% Castro::reflux() 60 1.745 1.76 1.771 17.30% FabArray::FillBoundary() 157859 1.181 1.357 1.598 15.62% MLCellLinOp::smooth() 27488 1.464 1.523 1.572 15.36% Gravity::gravity_sync() 60 1.483 1.483 1.484 14.50% MLCellLinOp::apply() 108875 1.107 1.276 1.415 13.83% Gravity::solve_for_delta_phi 60 1.406 1.407 1.408 13.75% MLCGSolver::ParallelAllReduce 243542 0.8915 1.116 1.406 13.74% MLPoisson::Fsmooth() 54976 0.7888 0.8879 0.9688 9.47% FabArray::ParallelCopy() 21119 0.5683 0.7158 0.9381 9.17% Castro::construct_old_gravity() 140 0.8482 0.8785 0.8973 8.77% Amr::regrid() 21 0.7951 0.8028 0.8112 7.93% FillBoundary_nowait() 157859 0.5139 0.6917 0.7985 7.80% FillBoundary_finish() 157859 0.4751 0.6113 0.7959 7.78% FabArray::ParallelCopy_finish() 21119 0.305 0.4715 0.7324 7.16% Gravity::multilevel_solve_for_new_phi() 20 0.6756 0.6775 0.6783 6.63% Gravity::actual_multilevel_solve() 20 0.674 0.6761 0.6772 6.62% Castro::post_regrid() 66 0.6278 0.6321 0.6361 6.22% FillPatchIterator::Initialize 829 0.4325 0.4904 0.5626 5.50% FillPatchTwoLevels 716 0.3725 0.4296 0.5044 4.93% MLMG::mgVcycle_down::0 1843 0.4472 0.4672 0.4846 4.74% Castro::clean_state() 1182 0.3486 0.4063 0.4462 4.36% MLMG::mgVcycle_up::0 1843 0.418 0.4281 0.4336 4.24% MLMG::miniCycle() 1542 0.3564 0.3817 0.3989 3.90% Castro::initialize_do_advance() 140 0.2936 0.3137 0.339 3.31% FillPatchSingleLevel 1517 0.2012 0.2576 0.3373 3.30% MLPoisson::Fapply() 108875 0.2535 0.289 0.3064 2.99% CGSolver::sxay() 288086 0.2193 0.2639 0.3044 2.97% MLCellLinOp::correctionResidual() 9063 0.2578 0.2803 0.2951 2.88% Castro::do_new_sources() 260 0.2099 0.2411 0.2672 2.61% Castro::expand_state() 140 0.2006 0.2234 0.2622 2.56% Castro::computeTemp() 1189 0.199 0.2361 0.2586 2.53% FabArray::ParallelCopy_nowait() 21119 0.197 0.2352 0.2583 2.52% MultiFab::LinComb() 288336 0.1605 0.2031 0.2413 2.36% MLCellLinOp::solutionResidual() 3154 0.2047 0.2183 0.234 2.29% MLMG::mgVcycle_down::1 1843 0.2092 0.2144 0.2247 2.20% Amr::init() 1 0.2222 0.2224 0.2224 2.17% FabArray::setVal() 27604 0.1415 0.1747 0.2124 2.08% Amr::initialInit() 1 0.2075 0.2077 0.2078 2.03% Amr::FinalizeInit() 1 0.1929 0.1975 0.2012 1.97% MultiFab::Dot() 193316 0.1556 0.1846 0.2001 1.95% MLMG::computeResWithCrseSolFineCor() 771 0.1531 0.1754 0.193 1.89% Castro::reset_internal_energy() 1189 0.141 0.1678 0.1822 1.78% Castro::initialize_advance() 140 0.1153 0.1499 0.182 1.78% amrex::average_down 8093 0.1178 0.143 0.1752 1.71% MLMG::mgVcycle_up::1 1843 0.1608 0.168 0.1719 1.68% Castro::normalize_species() 1182 0.1302 0.1483 0.1628 1.59% Castro::construct_new_source() 1300 0.1114 0.1265 0.1387 1.36% MLMG::computeResidual() 1843 0.1151 0.13 0.1376 1.34% MLMG::addInterpCorrection() 6101 0.07875 0.1119 0.1368 1.34% MLMG:computeResOfCorrection() 6101 0.1223 0.1248 0.1277 1.25% Castro::estTimeStep() 228 0.08657 0.09684 0.1207 1.18% MLPoisson::normalize() 98078 0.09749 0.1124 0.1196 1.17% Castro::do_old_sources() 140 0.08608 0.1022 0.1166 1.14% Castro::avgDown() 62 0.0716 0.08821 0.1134 1.11% Castro::avgDown(state_indx) 248 0.07153 0.08814 0.1134 1.11% amrex::average_down_w_geom 248 0.07136 0.08797 0.1132 1.11% MLPoisson::define() 360 0.07812 0.09214 0.1111 1.09% MLMG::mgVcycle_up::2 483 0.0281 0.06074 0.1077 1.05% MLCellLinOp::setLevelBC() 450 0.02546 0.0543 0.1055 1.03% Gravity::get_new_grav_vector() 263 0.09931 0.1015 0.1048 1.02% Amr::bldFineLevels() 1 0.08959 0.09521 0.1047 1.02% MLMG::ResNormInf() 2383 0.05661 0.08008 0.1038 1.01% Castro::post_init() 3 0.0863 0.09629 0.1022 1.00% MLMG::computeResWithCrseCorFineCor() 771 0.08572 0.09476 0.09847 0.96% MLCellLinOp::reflux() 951 0.07033 0.08339 0.09325 0.91% Gravity::GetCrsePhi() 250 0.02435 0.05709 0.0924 0.90% Castro::initData() 7 0.04837 0.06179 0.08507 0.83% Castro::construct_new_gravity_source() 260 0.0651 0.07524 0.08312 0.81% MLMG::computeMLResidual() 440 0.05403 0.06415 0.07371 0.72% FillPatchInterp(Fab) 688 0.06784 0.06977 0.07169 0.70% CellConservativeLinear::interp() 8794 0.06485 0.06658 0.06834 0.67% MultiFab::Saxpy() 1180 0.05273 0.06194 0.06811 0.67% FabArrayBase::getCPC() 29601 0.05418 0.06158 0.06799 0.66% MLMG::prepareForSolve() 360 0.05947 0.06419 0.06717 0.66% MLCellLinOp::updateSolBC() 871 0.0443 0.05651 0.06471 0.63% Gravity::get_old_grav_vector() 140 0.06114 0.06247 0.06415 0.63% MLMG::mgVcycle_up::3 483 0.004154 0.02809 0.06409 0.63% MLCellLinOp::defineAuxData() 360 0.04487 0.05354 0.0636 0.62% MLCellLinOp::updateCorBC() 771 0.04736 0.05468 0.06012 0.59% FluxRegister::Reflux() 960 0.05156 0.05579 0.05991 0.59% Castro::init(old) 28 0.04761 0.05538 0.05976 0.58% MLMG::interpCorrection_1 771 0.03743 0.04461 0.05666 0.55% Castro::finalize_advance() 140 0.03516 0.03819 0.04276 0.42% MLCellLinOp::defineBC() 360 0.02315 0.02996 0.03932 0.38% FabArrayBase::CPC::define() 4019 0.02783 0.03358 0.03875 0.38% Amr::grid_places() 23 0.01935 0.03102 0.03872 0.38% AmrMesh::MakeNewGrids() 23 0.01903 0.03065 0.0384 0.38% Castro::apply_source_to_state() 520 0.02822 0.03341 0.03647 0.36% MLMG::mgVcycle_down::6 483 0.005372 0.009558 0.03479 0.34% MultiFab::Xpay() 12217 0.02769 0.03186 0.03471 0.34% MLMG::mgVcycle_down::2 483 0.0313 0.03252 0.03384 0.33% FabArrayBase::getFB() 157859 0.02904 0.03127 0.03273 0.32% Castro::computeNewDt() 28 0.01553 0.01916 0.03253 0.32% MLMG::mgVcycle_up::6 483 0.004584 0.008323 0.03245 0.32% Castro::construct_old_source() 700 0.02552 0.02969 0.03226 0.32% Gravity::fill_multipole_BCs() 70 0.02834 0.03005 0.03172 0.31% Amr::writePlotFile() 2 0.02931 0.02938 0.02941 0.29% BndryData::define() 540 0.01483 0.02006 0.02708 0.26% Castro::errorEst() 34 0.009302 0.01816 0.02484 0.24% Castro::enforce_min_density() 1182 0.01853 0.02127 0.02401 0.23% MLMG::mgVcycle_down::3 483 0.006207 0.01424 0.02397 0.23% VisMF::Write(FabArray) 6 0.007661 0.01005 0.02371 0.23% Castro::check_for_nan() 280 0.01637 0.01992 0.02274 0.22% MultiFab::contains_nan() 280 0.01616 0.01973 0.02254 0.22% Castro::derive() 34 0.005907 0.01516 0.02174 0.21% Gravity::average_fine_ec_onto_crse_ec() 90 0.01735 0.01815 0.0194 0.19% MLMG::getGradSolution() 360 0.01366 0.01577 0.01846 0.18% MLCellLinOp::compGrad() 450 0.01345 0.01555 0.01823 0.18% Gravity::update_max_rhs() 30 0.01435 0.0157 0.01741 0.17% FabArrayBase::TheFPinfo() 688 0.002411 0.008376 0.01486 0.15% Amr::InitializeInit() 1 0.006461 0.01014 0.01469 0.14% Amr::defBaseLevel() 1 0.00645 0.01013 0.01469 0.14% FPinfo::FPinfo() 7 0.001599 0.007511 0.01401 0.14% MLPoisson::FFlux() 7882 0.00708 0.01054 0.01306 0.13% AmrLevel::AmrLevel(dm) 35 0.009466 0.01088 0.0125 0.12% StateData::define() 140 0.009267 0.01068 0.01231 0.12% Castro::swap_state_time_levels() 140 0.005992 0.008153 0.0116 0.11% Castro::FluxRegFineAdd() 140 0.005302 0.007786 0.01141 0.11% MLMG::mgVcycle_down::4 483 0.005602 0.006651 0.01126 0.11% MLMG::MLResNormInf() 440 0.007562 0.008914 0.01033 0.10% Castro::construct_old_gravity_source() 140 0.007408 0.009064 0.00986 0.10% DistributionMapping::LeastUsedCPUs() 12 0.0001394 0.005439 0.009312 0.09% DistributionMapping::SFCProcessorMapDoIt() 5 0.000131 0.005414 0.009279 0.09% Castro::computeInitialDt() 2 0.0008102 0.005518 0.00917 0.09% MultiFab::max() 90 0.004286 0.006253 0.009095 0.09% MLLinOp::define() 360 0.00706 0.007742 0.00894 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003877 0.006879 0.008677 0.08% MLMG::mgVcycle_up::4 483 0.004134 0.004851 0.008648 0.08% MLLinOp::defineGrids() 360 0.006642 0.007313 0.008465 0.08% MLMG::mgVcycle_down::5 483 0.00543 0.005972 0.008204 0.08% FabArray::mult() 1063 0.005316 0.006158 0.007092 0.07% StateDataPhysBCFunct::() 1517 0.002347 0.004538 0.00693 0.07% MLMG::mgVcycle_up::5 483 0.004259 0.004703 0.006426 0.06% MLMG::MLRhsNormInf() 360 0.005247 0.005777 0.006173 0.06% BoxList::parallelComplementIn() 57 0.0004999 0.003349 0.006027 0.06% BoxList::pci 22 0.0004592 0.003306 0.00598 0.06% Gravity::applyMetricTerms() 90 0.004674 0.005198 0.005591 0.05% StateData::FillBoundary(geom) 685 0.001098 0.003115 0.005361 0.05% MLPoisson::prepareForSolve() 360 0.003361 0.004029 0.005299 0.05% MLCellLinOp::prepareForSolve() 360 0.002956 0.003708 0.004981 0.05% MultiFab::norm0(mask) 270 0.003113 0.003916 0.004686 0.05% Gravity::swapTimeLevels() 140 0.003093 0.00376 0.004345 0.04% FabArray::setDomainBndry() 1517 0.0033 0.003622 0.003916 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002774 0.003344 0.003864 0.04% TagBoxArray::mapPRD 34 0.001335 0.002261 0.003584 0.04% MultiFab::Subtract() 420 0.00194 0.002424 0.002973 0.03% MultiFab::Copy() 450 0.001807 0.002168 0.002586 0.03% MLLinOp::makeSubCommunicator() 70 0.00139 0.001756 0.002493 0.02% AmrMesh-cluster 4 0 0.0002778 0.002223 0.02% Castro::apply_tagging_restrictions() 34 0.001338 0.00168 0.002114 0.02% TagBoxArray::collate() 34 0.0005808 0.001109 0.0016 0.02% AMRErrorTag::operator() 34 0.0009377 0.001233 0.001578 0.02% MLMG::buildFineMask() 360 0.001184 0.001301 0.001441 0.01% ClusterList::chop() 4 0 0.0001735 0.001388 0.01% Castro::build_fine_mask() 100 0.0008105 0.0009121 0.001045 0.01% Castro::finalize_do_advance() 140 0.0004499 0.0006357 0.0008414 0.01% FabArrayBase::FB::FB() 299 0.000198 0.0004451 0.0006685 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005054 0.0005467 0.000602 0.01% ClusterList::intersect() 4 0 6.488e-05 0.000519 0.01% Amr::InitAmr() 1 0.0002816 0.0003555 0.0004903 0.00% makeSFC 350 0.0003597 0.0003898 0.0004313 0.00% Castro::enforce_speed_limit() 1182 0.0003282 0.0003628 0.0004031 0.00% MultiFab::Multiply() 40 0.0002389 0.0002545 0.0002669 0.00% OwnerMask() 34 0.0001676 0.0001907 0.0002277 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001923 0.0001988 0.0002072 0.00% DistributionMapping::Distribute() 355 0.0001572 0.0001689 0.0001841 0.00% Castro::enforce_consistent_e() 7 7.272e-05 0.0001069 0.0001807 0.00% FabArray::RecvLayoutMask() 90 9.508e-05 0.0001181 0.0001268 0.00% knapsack() 7 0.0001013 0.0001062 0.000111 0.00% Castro::retry_advance_ctu() 140 7.315e-05 8.854e-05 0.0001036 0.00% Castro::create_source_corrector() 140 7.632e-05 8.854e-05 9.581e-05 0.00% BoxList::complementIn 574 6.803e-05 7.333e-05 8.2e-05 0.00% Amr::writeSmallPlotFile() 1 3.32e-05 4.717e-05 7.27e-05 0.00% Amr::initSubcycle() 1 8.986e-06 1.316e-05 2.697e-05 0.00% Gravity::set_mass_offset() 21 2.157e-05 2.328e-05 2.588e-05 0.00% Castro::apply_problem_tags() 34 1.48e-05 1.709e-05 1.878e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.04-28-g56661522b4cd) finalized