MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (22.01-26-g65f906216a5e) initialized Starting run at 06:31:03 UTC on 2022-01-17. Successfully read inputs file ... Castro git describe: 21.12-27-g958e0cc7a AMReX git describe: 22.01-26-g65f906216 Microphysics git describe: 22.01-20-g1a290c72 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... grid_places() time: 0.001404799 new finest: 1 grid_places() time: 0.006675709 new finest: 2 Now regridding at level lbase = 0 grid_places() time: 0.010775316 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 Now regridding at level lbase = 0 grid_places() time: 0.016210987 new finest: 2 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 INITIAL GRIDS Level 0 16 grids 65536 cells 100 % of domain smallest grid: 64 x 64 biggest grid: 64 x 64 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 PLOTFILE: file = dustcollapse-2d-poissonn_plt00000 Write plotfile time = 0.014153435 seconds [Level 0 step 1] ADVANCE with dt = 1.135435554e-05 [Level 0 step 1] Advanced 65536 cells [Level 1 step 1] ADVANCE with dt = 5.677177769e-06 [Level 1 step 1] Advanced 36800 cells [Level 2 step 1] ADVANCE with dt = 2.838588884e-06 [Level 2 step 1] Advanced 75392 cells [Level 2 step 2] ADVANCE with dt = 2.838588884e-06 [Level 2 step 2] Advanced 75392 cells [Level 1 step 2] ADVANCE with dt = 5.677177769e-06 [Level 1 step 2] Advanced 36800 cells [Level 2 step 3] ADVANCE with dt = 2.838588884e-06 [Level 2 step 3] Advanced 75392 cells [Level 2 step 4] ADVANCE with dt = 2.838588884e-06 [Level 2 step 4] Advanced 75392 cells [STEP 1] Coarse TimeStep time: 0.487202322 [STEP 1] FAB kilobyte spread across MPI nodes: [18083 ... 21452] STEP = 1 TIME = 1.135435554e-05 DT = 1.135435554e-05 Now regridding at level lbase = 1 grid_places() time: 0.000493848 new finest: 2 TIME = 1.135435554e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 2] ADVANCE with dt = 1.192207331e-05 [Level 0 step 2] Advanced 65536 cells [Level 1 step 3] ADVANCE with dt = 5.961036657e-06 [Level 1 step 3] Advanced 36800 cells [Level 2 step 5] ADVANCE with dt = 2.980518328e-06 [Level 2 step 5] Advanced 75392 cells [Level 2 step 6] ADVANCE with dt = 2.980518328e-06 [Level 2 step 6] Advanced 75392 cells [Level 1 step 4] ADVANCE with dt = 5.961036657e-06 [Level 1 step 4] Advanced 36800 cells [Level 2 step 7] ADVANCE with dt = 2.980518328e-06 [Level 2 step 7] Advanced 75392 cells [Level 2 step 8] ADVANCE with dt = 2.980518328e-06 [Level 2 step 8] Advanced 75392 cells [STEP 2] Coarse TimeStep time: 0.511457352 [STEP 2] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 2 TIME = 2.327642885e-05 DT = 1.192207331e-05 Now regridding at level lbase = 0 grid_places() time: 0.000728759 new finest: 2 STEP = 2 TIME = 2.327642885e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 3] ADVANCE with dt = 1.251817698e-05 [Level 0 step 3] Advanced 65536 cells [Level 1 step 5] ADVANCE with dt = 6.25908849e-06 [Level 1 step 5] Advanced 36800 cells [Level 2 step 9] ADVANCE with dt = 3.129544245e-06 [Level 2 step 9] Advanced 75392 cells [Level 2 step 10] ADVANCE with dt = 3.129544245e-06 [Level 2 step 10] Advanced 75392 cells [Level 1 step 6] ADVANCE with dt = 6.25908849e-06 [Level 1 step 6] Advanced 36800 cells [Level 2 step 11] ADVANCE with dt = 3.129544245e-06 [Level 2 step 11] Advanced 75392 cells [Level 2 step 12] ADVANCE with dt = 3.129544245e-06 [Level 2 step 12] Advanced 75392 cells [STEP 3] Coarse TimeStep time: 0.523187412 [STEP 3] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 3 TIME = 3.579460583e-05 DT = 1.251817698e-05 Now regridding at level lbase = 1 grid_places() time: 0.000521235 new finest: 2 TIME = 3.579460583e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 4] ADVANCE with dt = 1.314408583e-05 [Level 0 step 4] Advanced 65536 cells [Level 1 step 7] ADVANCE with dt = 6.572042914e-06 [Level 1 step 7] Advanced 36800 cells [Level 2 step 13] ADVANCE with dt = 3.286021457e-06 [Level 2 step 13] Advanced 75392 cells [Level 2 step 14] ADVANCE with dt = 3.286021457e-06 [Level 2 step 14] Advanced 75392 cells [Level 1 step 8] ADVANCE with dt = 6.572042914e-06 [Level 1 step 8] Advanced 36800 cells [Level 2 step 15] ADVANCE with dt = 3.286021457e-06 [Level 2 step 15] Advanced 75392 cells [Level 2 step 16] ADVANCE with dt = 3.286021457e-06 [Level 2 step 16] Advanced 75392 cells [STEP 4] Coarse TimeStep time: 0.527792598 [STEP 4] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 4 TIME = 4.893869166e-05 DT = 1.314408583e-05 Now regridding at level lbase = 0 grid_places() time: 0.000709824 new finest: 2 STEP = 4 TIME = 4.893869166e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 5] ADVANCE with dt = 1.380129012e-05 [Level 0 step 5] Advanced 65536 cells [Level 1 step 9] ADVANCE with dt = 6.90064506e-06 [Level 1 step 9] Advanced 36800 cells [Level 2 step 17] ADVANCE with dt = 3.45032253e-06 [Level 2 step 17] Advanced 75392 cells [Level 2 step 18] ADVANCE with dt = 3.45032253e-06 [Level 2 step 18] Advanced 75392 cells [Level 1 step 10] ADVANCE with dt = 6.90064506e-06 [Level 1 step 10] Advanced 36800 cells [Level 2 step 19] ADVANCE with dt = 3.45032253e-06 [Level 2 step 19] Advanced 75392 cells [Level 2 step 20] ADVANCE with dt = 3.45032253e-06 [Level 2 step 20] Advanced 75392 cells [STEP 5] Coarse TimeStep time: 0.491100035 [STEP 5] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 5 TIME = 6.273998178e-05 DT = 1.380129012e-05 Now regridding at level lbase = 1 grid_places() time: 0.000481928 new finest: 2 TIME = 6.273998178e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 6] ADVANCE with dt = 1.449135463e-05 [Level 0 step 6] Advanced 65536 cells [Level 1 step 11] ADVANCE with dt = 7.245677313e-06 [Level 1 step 11] Advanced 36800 cells [Level 2 step 21] ADVANCE with dt = 3.622838657e-06 [Level 2 step 21] Advanced 75392 cells [Level 2 step 22] ADVANCE with dt = 3.622838657e-06 [Level 2 step 22] Advanced 75392 cells [Level 1 step 12] ADVANCE with dt = 7.245677313e-06 [Level 1 step 12] Advanced 36800 cells [Level 2 step 23] ADVANCE with dt = 3.622838657e-06 [Level 2 step 23] Advanced 75392 cells [Level 2 step 24] ADVANCE with dt = 3.622838657e-06 [Level 2 step 24] Advanced 75392 cells [STEP 6] Coarse TimeStep time: 0.481420273 [STEP 6] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 6 TIME = 7.723133641e-05 DT = 1.449135463e-05 Now regridding at level lbase = 0 grid_places() time: 0.000697085 new finest: 2 STEP = 6 TIME = 7.723133641e-05 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 7] ADVANCE with dt = 1.521592236e-05 [Level 0 step 7] Advanced 65536 cells [Level 1 step 13] ADVANCE with dt = 7.607961179e-06 [Level 1 step 13] Advanced 36800 cells [Level 2 step 25] ADVANCE with dt = 3.803980589e-06 [Level 2 step 25] Advanced 75392 cells [Level 2 step 26] ADVANCE with dt = 3.803980589e-06 [Level 2 step 26] Advanced 75392 cells [Level 1 step 14] ADVANCE with dt = 7.607961179e-06 [Level 1 step 14] Advanced 36800 cells [Level 2 step 27] ADVANCE with dt = 3.803980589e-06 [Level 2 step 27] Advanced 75392 cells [Level 2 step 28] ADVANCE with dt = 3.803980589e-06 [Level 2 step 28] Advanced 75392 cells [STEP 7] Coarse TimeStep time: 0.491917431 [STEP 7] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 7 TIME = 9.244725876e-05 DT = 1.521592236e-05 Now regridding at level lbase = 1 grid_places() time: 0.00051201 new finest: 2 TIME = 9.244725876e-05 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 8] ADVANCE with dt = 1.597671848e-05 [Level 0 step 8] Advanced 65536 cells [Level 1 step 15] ADVANCE with dt = 7.988359238e-06 [Level 1 step 15] Advanced 36800 cells [Level 2 step 29] ADVANCE with dt = 3.994179619e-06 [Level 2 step 29] Advanced 75392 cells [Level 2 step 30] ADVANCE with dt = 3.994179619e-06 [Level 2 step 30] Advanced 75392 cells [Level 1 step 16] ADVANCE with dt = 7.988359238e-06 [Level 1 step 16] Advanced 36800 cells [Level 2 step 31] ADVANCE with dt = 3.994179619e-06 [Level 2 step 31] Advanced 75392 cells [Level 2 step 32] ADVANCE with dt = 3.994179619e-06 [Level 2 step 32] Advanced 75392 cells [STEP 8] Coarse TimeStep time: 0.492739262 [STEP 8] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 8 TIME = 0.0001084239772 DT = 1.597671848e-05 Now regridding at level lbase = 0 grid_places() time: 0.0007064 new finest: 2 STEP = 8 TIME = 0.0001084239772 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 9] ADVANCE with dt = 1.67755544e-05 [Level 0 step 9] Advanced 65536 cells [Level 1 step 17] ADVANCE with dt = 8.387777199e-06 [Level 1 step 17] Advanced 36800 cells [Level 2 step 33] ADVANCE with dt = 4.1938886e-06 [Level 2 step 33] Advanced 75392 cells [Level 2 step 34] ADVANCE with dt = 4.1938886e-06 [Level 2 step 34] Advanced 75392 cells [Level 1 step 18] ADVANCE with dt = 8.387777199e-06 [Level 1 step 18] Advanced 36800 cells [Level 2 step 35] ADVANCE with dt = 4.1938886e-06 [Level 2 step 35] Advanced 75392 cells [Level 2 step 36] ADVANCE with dt = 4.1938886e-06 [Level 2 step 36] Advanced 75392 cells [STEP 9] Coarse TimeStep time: 0.495073083 [STEP 9] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 9 TIME = 0.0001251995316 DT = 1.67755544e-05 Now regridding at level lbase = 1 grid_places() time: 0.000490069 new finest: 2 TIME = 0.0001251995316 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 10] ADVANCE with dt = 1.761433212e-05 [Level 0 step 10] Advanced 65536 cells [Level 1 step 19] ADVANCE with dt = 8.807166059e-06 [Level 1 step 19] Advanced 36800 cells [Level 2 step 37] ADVANCE with dt = 4.40358303e-06 [Level 2 step 37] Advanced 75392 cells [Level 2 step 38] ADVANCE with dt = 4.40358303e-06 [Level 2 step 38] Advanced 75392 cells [Level 1 step 20] ADVANCE with dt = 8.807166059e-06 [Level 1 step 20] Advanced 36800 cells [Level 2 step 39] ADVANCE with dt = 4.40358303e-06 [Level 2 step 39] Advanced 75392 cells [Level 2 step 40] ADVANCE with dt = 4.40358303e-06 [Level 2 step 40] Advanced 75392 cells [STEP 10] Coarse TimeStep time: 0.487327781 [STEP 10] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 10 TIME = 0.0001428138638 DT = 1.761433212e-05 Now regridding at level lbase = 0 grid_places() time: 0.000686007 new finest: 2 STEP = 10 TIME = 0.0001428138638 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 11] ADVANCE with dt = 1.849504872e-05 [Level 0 step 11] Advanced 65536 cells [Level 1 step 21] ADVANCE with dt = 9.247524362e-06 [Level 1 step 21] Advanced 36800 cells [Level 2 step 41] ADVANCE with dt = 4.623762181e-06 [Level 2 step 41] Advanced 75392 cells [Level 2 step 42] ADVANCE with dt = 4.623762181e-06 [Level 2 step 42] Advanced 75392 cells [Level 1 step 22] ADVANCE with dt = 9.247524362e-06 [Level 1 step 22] Advanced 36800 cells [Level 2 step 43] ADVANCE with dt = 4.623762181e-06 [Level 2 step 43] Advanced 75392 cells [Level 2 step 44] ADVANCE with dt = 4.623762181e-06 [Level 2 step 44] Advanced 75392 cells [STEP 11] Coarse TimeStep time: 0.493889661 [STEP 11] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 11 TIME = 0.0001613089125 DT = 1.849504872e-05 Now regridding at level lbase = 1 grid_places() time: 0.000485058 new finest: 2 TIME = 0.0001613089125 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 12] ADVANCE with dt = 1.941980116e-05 [Level 0 step 12] Advanced 65536 cells [Level 1 step 23] ADVANCE with dt = 9.709900581e-06 [Level 1 step 23] Advanced 36800 cells [Level 2 step 45] ADVANCE with dt = 4.85495029e-06 [Level 2 step 45] Advanced 75392 cells [Level 2 step 46] ADVANCE with dt = 4.85495029e-06 [Level 2 step 46] Advanced 75392 cells [Level 1 step 24] ADVANCE with dt = 9.709900581e-06 [Level 1 step 24] Advanced 36800 cells [Level 2 step 47] ADVANCE with dt = 4.85495029e-06 [Level 2 step 47] Advanced 75392 cells [Level 2 step 48] ADVANCE with dt = 4.85495029e-06 [Level 2 step 48] Advanced 75392 cells [STEP 12] Coarse TimeStep time: 0.490000887 [STEP 12] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 12 TIME = 0.0001807287136 DT = 1.941980116e-05 Now regridding at level lbase = 0 grid_places() time: 0.000700472 new finest: 2 STEP = 12 TIME = 0.0001807287136 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 13] ADVANCE with dt = 2.039079122e-05 [Level 0 step 13] Advanced 65536 cells [Level 1 step 25] ADVANCE with dt = 1.019539561e-05 [Level 1 step 25] Advanced 36800 cells [Level 2 step 49] ADVANCE with dt = 5.097697805e-06 [Level 2 step 49] Advanced 75392 cells [Level 2 step 50] ADVANCE with dt = 5.097697805e-06 [Level 2 step 50] Advanced 75392 cells [Level 1 step 26] ADVANCE with dt = 1.019539561e-05 [Level 1 step 26] Advanced 36800 cells [Level 2 step 51] ADVANCE with dt = 5.097697805e-06 [Level 2 step 51] Advanced 75392 cells [Level 2 step 52] ADVANCE with dt = 5.097697805e-06 [Level 2 step 52] Advanced 75392 cells [STEP 13] Coarse TimeStep time: 0.494622593 [STEP 13] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 13 TIME = 0.0002011195049 DT = 2.039079122e-05 Now regridding at level lbase = 1 grid_places() time: 0.000486594 new finest: 2 TIME = 0.0002011195049 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 14] ADVANCE with dt = 2.141033078e-05 [Level 0 step 14] Advanced 65536 cells [Level 1 step 27] ADVANCE with dt = 1.070516539e-05 [Level 1 step 27] Advanced 36800 cells [Level 2 step 53] ADVANCE with dt = 5.352582695e-06 [Level 2 step 53] Advanced 75392 cells [Level 2 step 54] ADVANCE with dt = 5.352582695e-06 [Level 2 step 54] Advanced 75392 cells [Level 1 step 28] ADVANCE with dt = 1.070516539e-05 [Level 1 step 28] Advanced 36800 cells [Level 2 step 55] ADVANCE with dt = 5.352582695e-06 [Level 2 step 55] Advanced 75392 cells [Level 2 step 56] ADVANCE with dt = 5.352582695e-06 [Level 2 step 56] Advanced 75392 cells [STEP 14] Coarse TimeStep time: 0.488025358 [STEP 14] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 14 TIME = 0.0002225298356 DT = 2.141033078e-05 Now regridding at level lbase = 0 grid_places() time: 0.000683734 new finest: 2 STEP = 14 TIME = 0.0002225298356 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 15] ADVANCE with dt = 2.248084732e-05 [Level 0 step 15] Advanced 65536 cells [Level 1 step 29] ADVANCE with dt = 1.124042366e-05 [Level 1 step 29] Advanced 36800 cells [Level 2 step 57] ADVANCE with dt = 5.62021183e-06 [Level 2 step 57] Advanced 75392 cells [Level 2 step 58] ADVANCE with dt = 5.62021183e-06 [Level 2 step 58] Advanced 75392 cells [Level 1 step 30] ADVANCE with dt = 1.124042366e-05 [Level 1 step 30] Advanced 36800 cells [Level 2 step 59] ADVANCE with dt = 5.62021183e-06 [Level 2 step 59] Advanced 75392 cells [Level 2 step 60] ADVANCE with dt = 5.62021183e-06 [Level 2 step 60] Advanced 75392 cells [STEP 15] Coarse TimeStep time: 0.495127285 [STEP 15] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 15 TIME = 0.000245010683 DT = 2.248084732e-05 Now regridding at level lbase = 1 grid_places() time: 0.000482882 new finest: 2 TIME = 0.000245010683 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 16] ADVANCE with dt = 2.360488969e-05 [Level 0 step 16] Advanced 65536 cells [Level 1 step 31] ADVANCE with dt = 1.180244484e-05 [Level 1 step 31] Advanced 36800 cells [Level 2 step 61] ADVANCE with dt = 5.901222421e-06 [Level 2 step 61] Advanced 75392 cells [Level 2 step 62] ADVANCE with dt = 5.901222421e-06 [Level 2 step 62] Advanced 75392 cells [Level 1 step 32] ADVANCE with dt = 1.180244484e-05 [Level 1 step 32] Advanced 36800 cells [Level 2 step 63] ADVANCE with dt = 5.901222421e-06 [Level 2 step 63] Advanced 75392 cells [Level 2 step 64] ADVANCE with dt = 5.901222421e-06 [Level 2 step 64] Advanced 75392 cells [STEP 16] Coarse TimeStep time: 0.48970246 [STEP 16] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 16 TIME = 0.0002686155726 DT = 2.360488969e-05 Now regridding at level lbase = 0 grid_places() time: 0.000682558 new finest: 2 STEP = 16 TIME = 0.0002686155726 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 17] ADVANCE with dt = 2.478513417e-05 [Level 0 step 17] Advanced 65536 cells [Level 1 step 33] ADVANCE with dt = 1.239256708e-05 [Level 1 step 33] Advanced 36800 cells [Level 2 step 65] ADVANCE with dt = 6.196283542e-06 [Level 2 step 65] Advanced 75392 cells [Level 2 step 66] ADVANCE with dt = 6.196283542e-06 [Level 2 step 66] Advanced 75392 cells [Level 1 step 34] ADVANCE with dt = 1.239256708e-05 [Level 1 step 34] Advanced 36800 cells [Level 2 step 67] ADVANCE with dt = 6.196283542e-06 [Level 2 step 67] Advanced 75392 cells [Level 2 step 68] ADVANCE with dt = 6.196283542e-06 [Level 2 step 68] Advanced 75392 cells [STEP 17] Coarse TimeStep time: 0.495080735 [STEP 17] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 17 TIME = 0.0002934007068 DT = 2.478513417e-05 Now regridding at level lbase = 1 grid_places() time: 0.000495167 new finest: 2 TIME = 0.0002934007068 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 18] ADVANCE with dt = 2.602439088e-05 [Level 0 step 18] Advanced 65536 cells [Level 1 step 35] ADVANCE with dt = 1.301219544e-05 [Level 1 step 35] Advanced 36800 cells [Level 2 step 69] ADVANCE with dt = 6.506097719e-06 [Level 2 step 69] Advanced 75392 cells [Level 2 step 70] ADVANCE with dt = 6.506097719e-06 [Level 2 step 70] Advanced 75392 cells [Level 1 step 36] ADVANCE with dt = 1.301219544e-05 [Level 1 step 36] Advanced 36800 cells [Level 2 step 71] ADVANCE with dt = 6.506097719e-06 [Level 2 step 71] Advanced 75392 cells [Level 2 step 72] ADVANCE with dt = 6.506097719e-06 [Level 2 step 72] Advanced 75392 cells [STEP 18] Coarse TimeStep time: 0.484404883 [STEP 18] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 18 TIME = 0.0003194250977 DT = 2.602439088e-05 Now regridding at level lbase = 0 grid_places() time: 0.000702 new finest: 2 STEP = 18 TIME = 0.0003194250977 : REGRID with lbase = 0 Level 1 25 grids 36800 cells 14.03808594 % of domain smallest grid: 8 x 8 biggest grid: 40 x 64 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 19] ADVANCE with dt = 2.732561042e-05 [Level 0 step 19] Advanced 65536 cells [Level 1 step 37] ADVANCE with dt = 1.366280521e-05 [Level 1 step 37] Advanced 36800 cells [Level 2 step 73] ADVANCE with dt = 6.831402605e-06 [Level 2 step 73] Advanced 75392 cells [Level 2 step 74] ADVANCE with dt = 6.831402605e-06 [Level 2 step 74] Advanced 75392 cells [Level 1 step 38] ADVANCE with dt = 1.366280521e-05 [Level 1 step 38] Advanced 36800 cells [Level 2 step 75] ADVANCE with dt = 6.831402605e-06 [Level 2 step 75] Advanced 75392 cells [Level 2 step 76] ADVANCE with dt = 6.831402605e-06 [Level 2 step 76] Advanced 75392 cells [STEP 19] Coarse TimeStep time: 0.499152664 [STEP 19] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 19 TIME = 0.0003467507081 DT = 2.732561042e-05 Now regridding at level lbase = 1 grid_places() time: 0.000499683 new finest: 2 TIME = 0.0003467507081 : REGRID with lbase = 1 Level 2 58 grids 75392 cells 7.189941406 % of domain smallest grid: 8 x 8 biggest grid: 56 x 56 [Level 0 step 20] ADVANCE with dt = 2.869189094e-05 [Level 0 step 20] Advanced 65536 cells [Level 1 step 39] ADVANCE with dt = 1.434594547e-05 [Level 1 step 39] Advanced 36800 cells [Level 2 step 77] ADVANCE with dt = 7.172972736e-06 [Level 2 step 77] Advanced 75392 cells [Level 2 step 78] ADVANCE with dt = 7.172972736e-06 [Level 2 step 78] Advanced 75392 cells [Level 1 step 40] ADVANCE with dt = 1.434594547e-05 [Level 1 step 40] Advanced 36800 cells [Level 2 step 79] ADVANCE with dt = 7.172972736e-06 [Level 2 step 79] Advanced 75392 cells [Level 2 step 80] ADVANCE with dt = 7.172972736e-06 [Level 2 step 80] Advanced 75392 cells [STEP 20] Coarse TimeStep time: 0.494730586 [STEP 20] FAB kilobyte spread across MPI nodes: [18114 ... 22286] STEP = 20 TIME = 0.0003754425991 DT = 2.869189094e-05 PLOTFILE: file = dustcollapse-2d-poissonn_plt00020 Write plotfile time = 0.01391075 seconds Ending run at 06:31:13 UTC on 2022-01-17. Run time = 10.13158229 Run time without initialization = 9.928508086 Average number of zones advanced per microsecond: 0.888 Average number of zones advanced per microsecond per rank: 0.111 TinyProfiler total time across processes [min...avg...max]: 10.13 ... 10.13 ... 10.13 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 140 1.7657 2.0987 2.3317 23.01% MLCGSolver::ParallelAllReduce 243542 0.8523 1.069 1.346 13.28% MLPoisson::Fsmooth() 54976 0.8304 0.922 1.017 10.04% MultiFab::min() 140 0.2581 0.4982 0.8331 8.22% FillBoundary_finish() 157859 0.4509 0.5929 0.7843 7.74% FillBoundary_nowait() 157859 0.4929 0.6504 0.768 7.58% FabArray::ParallelCopy_finish() 21119 0.3021 0.4248 0.6648 6.56% MLCellLinOp::applyBC() 165252 0.2112 0.2834 0.3633 3.59% MLPoisson::Fapply() 108875 0.2546 0.29 0.3105 3.06% MLCGSolver::bicgstab 1420 0.2089 0.2326 0.2487 2.46% MultiFab::LinComb() 288336 0.1604 0.2004 0.2294 2.26% FabArray::ParallelCopy_nowait() 21119 0.1542 0.1858 0.2121 2.09% MultiFab::Dot() 193316 0.1556 0.1825 0.2004 1.98% FabArray::setVal() 27604 0.1401 0.1744 0.1979 1.95% Castro::reset_internal_energy() 1189 0.1477 0.1696 0.1822 1.80% Castro::normalize_species() 1182 0.1016 0.1121 0.1233 1.22% MLPoisson::normalize() 98078 0.09716 0.1125 0.1205 1.19% Castro::estTimeStep() 228 0.08045 0.09078 0.1143 1.13% MLMG::ResNormInf() 2383 0.05469 0.07778 0.1019 1.01% Castro::construct_new_gravity_source() 260 0.06612 0.07594 0.08228 0.81% Castro::computeTemp() 1189 0.06135 0.06906 0.07692 0.76% amrex::average_down 8093 0.06027 0.06689 0.07288 0.72% Castro::initData() 7 0.04338 0.05565 0.0716 0.71% CellConservativeLinear::interp() 8794 0.06531 0.06683 0.06809 0.67% CGSolver::sxay() 288086 0.06259 0.06516 0.06728 0.66% MultiFab::Saxpy() 1180 0.05361 0.06203 0.06641 0.66% MLMG::addInterpCorrection() 6101 0.04795 0.05274 0.05768 0.57% FabArray::FillBoundary() 157859 0.05238 0.0536 0.05505 0.54% MLCellLinOp::defineAuxData() 360 0.03668 0.04204 0.04968 0.49% FillPatchIterator::Initialize 829 0.04276 0.04586 0.04959 0.49% amrex::average_down_w_geom 248 0.03218 0.0382 0.04411 0.44% FillPatchSingleLevel 1517 0.02262 0.03368 0.04129 0.41% MLMG::prepareForSolve() 360 0.03044 0.03534 0.04103 0.40% MLCellLinOp::apply() 108875 0.03887 0.03982 0.04065 0.40% Amr::regrid() 21 0.02618 0.03151 0.04044 0.40% Castro::reflux() 60 0.02631 0.0342 0.04038 0.40% FabArrayBase::CPC::define() 4019 0.02806 0.03344 0.03812 0.38% Gravity::actual_solve_with_mlmg() 360 0.02267 0.02771 0.03509 0.35% MultiFab::Xpay() 12217 0.02859 0.03175 0.03383 0.33% FabArrayBase::getFB() 157859 0.03016 0.03125 0.03245 0.32% MLMG::interpCorrection_1 771 0.02178 0.02567 0.02952 0.29% FluxRegister::Reflux() 960 0.02006 0.02535 0.02919 0.29% FabArrayBase::getCPC() 29601 0.02744 0.02836 0.02882 0.28% MLMG::solve() 360 0.008835 0.01958 0.0287 0.28% Gravity::fill_multipole_BCs() 70 0.02671 0.02776 0.02864 0.28% MLCellLinOp::reflux() 951 0.02149 0.02442 0.028 0.28% FillPatchTwoLevels 716 0.02534 0.02657 0.02773 0.27% Castro::initialize_do_advance() 140 0.02208 0.02555 0.02714 0.27% Castro::enforce_min_density() 1182 0.01871 0.02126 0.02376 0.23% Castro::do_advance_ctu() 140 0.01699 0.0221 0.02368 0.23% Castro::expand_state() 140 0.01976 0.02175 0.02361 0.23% VisMF::Write(FabArray) 6 0.007517 0.00987 0.02352 0.23% Gravity::get_new_grav_vector() 263 0.01604 0.01962 0.0233 0.23% MLCellLinOp::updateSolBC() 871 0.01155 0.01656 0.02329 0.23% MLMG::oneIter() 1843 0.01867 0.021 0.02256 0.22% Castro::construct_new_source() 1300 0.02059 0.02148 0.02252 0.22% MultiFab::contains_nan() 280 0.01634 0.01978 0.02235 0.22% Amr::writePlotFile() 2 0.005412 0.01916 0.02154 0.21% MLCellLinOp::updateCorBC() 771 0.0108 0.01522 0.02131 0.21% BndryData::define() 540 0.01221 0.01576 0.02113 0.21% Castro::finalize_advance() 140 0.01498 0.01785 0.0204 0.20% FPinfo::FPinfo() 7 0.001215 0.01153 0.01778 0.18% MLCellLinOp::smooth() 27488 0.01665 0.0171 0.01752 0.17% Gravity::get_old_grav_vector() 140 0.008706 0.01084 0.01437 0.14% StateData::define() 140 0.0091 0.01067 0.01336 0.13% Castro::initialize_advance() 140 0.009026 0.0112 0.01276 0.13% MLCellLinOp::setLevelBC() 450 0.008006 0.01006 0.01268 0.13% MLPoisson::FFlux() 7882 0.006804 0.01045 0.01263 0.12% Castro::construct_old_source() 700 0.01009 0.01095 0.01187 0.12% MLCellLinOp::defineBC() 360 0.008215 0.009556 0.0115 0.11% MLCellLinOp::compGrad() 450 0.008815 0.01009 0.01104 0.11% Castro::FluxRegFineAdd() 140 0.005352 0.008413 0.01048 0.10% Castro::construct_old_gravity_source() 140 0.007736 0.009152 0.01016 0.10% Castro::swap_state_time_levels() 140 0.005938 0.00761 0.009672 0.10% Gravity::gravity_sync() 60 0.007519 0.009008 0.009616 0.09% FabArray::ParallelCopy() 21119 0.008808 0.009011 0.009391 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003827 0.006752 0.008541 0.08% Amr::timeStep() 140 0.002961 0.004128 0.007714 0.08% MultiFab::max() 90 0.003335 0.004961 0.0075 0.07% Gravity::solve_for_phi() 280 0.006009 0.006883 0.007298 0.07% FabArray::mult() 1063 0.005412 0.006183 0.007099 0.07% Castro::init(old) 28 0.005303 0.006128 0.006473 0.06% BoxList::pci 22 0.0004612 0.003317 0.005801 0.06% Gravity::applyMetricTerms() 90 0.0048 0.005167 0.0057 0.06% DistributionMapping::LeastUsedCPUs() 12 0.000123 0.002874 0.005635 0.06% AmrMesh::MakeNewGrids() 23 0.002637 0.004967 0.005559 0.05% StateData::FillBoundary(geom) 685 0.001077 0.003051 0.005405 0.05% Gravity::average_fine_ec_onto_crse_ec() 90 0.003836 0.004478 0.005309 0.05% MLLinOp::defineGrids() 360 0.003908 0.004337 0.005175 0.05% MLMG::MLRhsNormInf() 360 0.003864 0.004532 0.005024 0.05% MLCellLinOp::prepareForSolve() 360 0.002825 0.003714 0.00494 0.05% Amr::bldFineLevels() 1 0.003076 0.003549 0.004664 0.05% Castro::construct_new_gravity() 140 0.003507 0.00412 0.004655 0.05% MultiFab::norm0(mask) 270 0.003087 0.003912 0.004648 0.05% Castro::construct_old_gravity() 140 0.003471 0.004098 0.004633 0.05% MLCellLinOp::correctionResidual() 9063 0.004072 0.004283 0.004481 0.04% MLMG::computeResWithCrseSolFineCor() 771 0.003348 0.003751 0.004347 0.04% FabArray::setDomainBndry() 1517 0.003357 0.00363 0.0042 0.04% MLMG::mgVcycle() 3385 0.003761 0.003945 0.0041 0.04% MLMG::computeResWithCrseCorFineCor() 771 0.002905 0.003356 0.003838 0.04% MLMG::actualBottomSolve() 1843 0.002598 0.00283 0.003467 0.03% Gravity::update_max_rhs() 30 0.002856 0.003158 0.00338 0.03% FillPatchInterp(Fab) 688 0.00286 0.003165 0.00328 0.03% Gravity::GetCrsePhi() 250 0.001898 0.002458 0.003069 0.03% Amr::coarseTimeStep() 20 0.0008101 0.001609 0.003041 0.03% Gravity::create_comp_minus_level_grad_phi() 60 0.002061 0.002508 0.00296 0.03% MultiFab::Subtract() 420 0.001874 0.00238 0.002916 0.03% Amr::defBaseLevel() 1 0.002006 0.00226 0.00289 0.03% MultiFab::Copy() 450 0.001882 0.00217 0.002497 0.02% MLMG::MLResNormInf() 440 0.0006571 0.001396 0.002417 0.02% MLMG:computeResOfCorrection() 6101 0.002188 0.002255 0.002351 0.02% MLLinOp::makeSubCommunicator() 70 0.001377 0.001645 0.002283 0.02% MLCellLinOp::solutionResidual() 3154 0.001847 0.001903 0.001964 0.02% MLMG::mgVcycle_bottom 3385 0.001852 0.001904 0.001945 0.02% MLMG::mgVcycle_down::0 1843 0.001763 0.001837 0.001914 0.02% Gravity::solve_phi_with_mlmg() 300 0.001004 0.001245 0.001697 0.02% Gravity::multilevel_solve_for_new_phi() 20 0.001129 0.00141 0.001583 0.02% MLMG::mgVcycle_down::1 1843 0.00147 0.001512 0.001578 0.02% StateDataPhysBCFunct::() 1517 0.001308 0.001435 0.001553 0.02% TagBoxArray::collate() 34 0.0007025 0.0008936 0.001521 0.02% Castro::clean_state() 1182 0.001417 0.00148 0.001516 0.01% AMRErrorTag::operator() 34 0.001011 0.001205 0.0014 0.01% ClusterList::chop() 4 0 0.0001749 0.001399 0.01% MLMG::mgVcycle_up::1 1843 0.001288 0.001334 0.001397 0.01% MLMG::mgVcycle_up::0 1843 0.001088 0.00114 0.001193 0.01% FabArrayBase::TheFPinfo() 688 0.0009146 0.0009859 0.001144 0.01% MLPoisson::define() 360 0.0007798 0.0008593 0.001136 0.01% MLMG::buildFineMask() 360 0.0009376 0.001015 0.001074 0.01% Gravity::actual_multilevel_solve() 20 0.0006905 0.000849 0.0009131 0.01% MLMG::computeResidual() 1843 0.0007897 0.0008166 0.0008918 0.01% main() 1 0.000697 0.0007417 0.0008238 0.01% Castro::do_new_sources() 260 0.0005918 0.0006427 0.000728 0.01% Castro::finalize_do_advance() 140 0.0004708 0.0006045 0.0007226 0.01% MLMG::miniCycle() 1542 0.0005993 0.0006274 0.0006575 0.01% FabArrayBase::FB::FB() 299 0.0001952 0.0004467 0.0006559 0.01% Amr::grid_places() 23 0.0003079 0.0003745 0.0006328 0.01% Castro::build_fine_mask() 40 0.0005138 0.0005791 0.0006303 0.01% Castro::derive() 34 0.0004711 0.0005444 0.000627 0.01% Castro::apply_tagging_restrictions() 34 0.0004508 0.0005154 0.00057 0.01% ClusterList::intersect() 4 0 6.71e-05 0.0005368 0.01% MLLinOp::define() 360 0.0004013 0.0004487 0.0005136 0.01% Castro::advance() 140 0.0003904 0.0004295 0.0004987 0.00% Castro::apply_source_to_state() 520 0.0004147 0.0004695 0.0004873 0.00% Castro::subcycle_advance_ctu() 140 0.0003358 0.0003949 0.0004671 0.00% Amr::InitAmr() 1 0.0002676 0.000329 0.0004514 0.00% MLMG::mgVcycle_down::2 483 0.0003655 0.0004041 0.0004419 0.00% MLMG::mgVcycle_down::4 483 0.0003716 0.0003999 0.0004226 0.00% MLMG::mgVcycle_down::3 483 0.0003353 0.0003643 0.0004015 0.00% Castro::enforce_speed_limit() 1182 0.0003134 0.000331 0.0003898 0.00% MLPoisson::prepareForSolve() 360 0.0002572 0.0002889 0.0003701 0.00% MLMG::mgVcycle_down::6 483 0.0003425 0.0003509 0.0003648 0.00% Castro::do_old_sources() 140 0.0003199 0.0003415 0.0003621 0.00% MLMG::computeMLResidual() 440 0.0002782 0.0003135 0.0003486 0.00% MLMG::mgVcycle_down::5 483 0.0003227 0.0003311 0.0003377 0.00% MLMG::mgVcycle_up::6 483 0.0002862 0.0002999 0.0003214 0.00% MLMG::mgVcycle_up::2 483 0.0002638 0.0002758 0.0003032 0.00% AmrMesh-cluster 4 0 3.693e-05 0.0002955 0.00% Gravity::swapTimeLevels() 140 0.0002528 0.0002746 0.0002883 0.00% makeSFC 350 0.0002253 0.0002502 0.0002766 0.00% MLMG::mgVcycle_up::5 483 0.0002449 0.0002514 0.0002646 0.00% MLMG::getGradSolution() 360 0.0002272 0.0002385 0.000263 0.00% MLMG::mgVcycle_up::3 483 0.0002187 0.0002379 0.0002573 0.00% MLMG::mgVcycle_up::4 483 0.0002259 0.0002359 0.0002464 0.00% AmrLevel::AmrLevel(dm) 35 0.0001845 0.0002 0.0002202 0.00% OwnerMask() 34 0.0001728 0.0001887 0.0002185 0.00% TagBoxArray::mapPRD 34 0.0001892 0.0002015 0.0002163 0.00% MultiFab::Multiply() 40 0.0001956 0.0002063 0.0002157 0.00% Castro::check_for_nan() 280 0.0001635 0.0001809 0.0002101 0.00% MLLinOp::makeAgglomeratedDMap 70 0.0001468 0.000162 0.0001891 0.00% DistributionMapping::Distribute() 355 0.0001574 0.0001732 0.0001884 0.00% Castro::post_regrid() 66 0.0001578 0.0001719 0.0001872 0.00% Castro::avgDown(state_indx) 248 0.0001563 0.0001746 0.0001851 0.00% Castro::enforce_consistent_e() 7 7.038e-05 0.000105 0.0001841 0.00% Castro::post_timestep() 140 0.0001406 0.0001567 0.0001698 0.00% Amr::FinalizeInit() 1 3.69e-06 1.996e-05 0.0001256 0.00% knapsack() 7 0.0001024 0.0001072 0.0001178 0.00% FabArray::RecvLayoutMask() 90 9.394e-05 0.0001064 0.0001161 0.00% Gravity::solve_for_delta_phi 60 8.815e-05 9.745e-05 0.0001141 0.00% Castro::retry_advance_ctu() 140 7.239e-05 8.754e-05 0.0001052 0.00% Castro::create_source_corrector() 140 8.142e-05 8.864e-05 0.0001028 0.00% BoxList::complementIn 574 7.802e-05 8.401e-05 9.335e-05 0.00% Amr::writeSmallPlotFile() 1 4.466e-05 5.874e-05 7.578e-05 0.00% Castro::errorEst() 34 6.232e-05 6.951e-05 7.499e-05 0.00% Castro::avgDown() 62 6.61e-05 6.772e-05 7.331e-05 0.00% Castro::computeNewDt() 28 3.767e-05 4.636e-05 5.924e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 5 2.979e-05 3.299e-05 3.991e-05 0.00% BoxList::parallelComplementIn() 57 2.546e-05 2.743e-05 3.153e-05 0.00% DistributionMapping::KnapSackDoIt() 7 2.291e-05 2.455e-05 2.77e-05 0.00% Gravity::set_mass_offset() 21 1.867e-05 2.307e-05 2.6e-05 0.00% Castro::post_init() 3 8.19e-06 1.163e-05 2.499e-05 0.00% Amr::initSubcycle() 1 1.177e-05 1.448e-05 2.041e-05 0.00% Castro::apply_problem_tags() 34 1.593e-05 1.755e-05 2.036e-05 0.00% Amr::init() 1 1.733e-06 2.593e-06 7.196e-06 0.00% Amr::InitializeInit() 1 1.956e-06 3.028e-06 6.711e-06 0.00% Castro::computeInitialDt() 2 3.017e-06 3.504e-06 4.113e-06 0.00% Amr::initialInit() 1 9.03e-07 1.181e-06 1.685e-06 0.00% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 10.13 10.13 10.13 100.00% Amr::coarseTimeStep() 20 9.913 9.913 9.913 97.84% Amr::timeStep() 140 9.88 9.897 9.9 97.72% Castro::advance() 140 7.28 7.284 7.286 71.92% Castro::subcycle_advance_ctu() 140 7.078 7.101 7.136 70.44% Castro::do_advance_ctu() 140 7.078 7.1 7.136 70.43% Gravity::actual_solve_with_mlmg() 360 5.566 5.582 5.617 55.44% MLMG::solve() 360 5.389 5.396 5.404 53.34% MLMG::oneIter() 1843 5.006 5.034 5.051 49.85% MLMG::mgVcycle() 3385 4.62 4.667 4.702 46.41% Gravity::solve_phi_with_mlmg() 300 4.205 4.23 4.257 42.01% Gravity::solve_for_phi() 280 3.56 3.584 3.609 35.62% MLMG::mgVcycle_bottom 3385 3.175 3.195 3.217 31.75% Castro::construct_new_gravity() 140 2.838 2.841 2.848 28.11% MLMG::actualBottomSolve() 1843 2.804 2.812 2.831 27.94% MLCGSolver::bicgstab 1420 2.8 2.808 2.826 27.90% Castro::construct_ctu_hydro_source() 140 1.766 2.099 2.332 23.01% Castro::post_timestep() 140 1.853 1.87 1.875 18.51% Castro::reflux() 60 1.74 1.755 1.768 17.45% MLCellLinOp::applyBC() 165252 1.367 1.567 1.755 17.32% MLCellLinOp::smooth() 27488 1.485 1.548 1.598 15.77% FabArray::FillBoundary() 157859 1.127 1.329 1.55 15.30% Gravity::gravity_sync() 60 1.499 1.499 1.5 14.80% Gravity::solve_for_delta_phi 60 1.425 1.425 1.426 14.07% MLCGSolver::ParallelAllReduce 243542 0.9504 1.162 1.425 14.07% MLCellLinOp::apply() 108875 1.111 1.265 1.406 13.88% MLPoisson::Fsmooth() 54976 0.8304 0.922 1.017 10.04% Castro::construct_old_gravity() 140 0.8525 0.8756 0.8947 8.83% FabArray::ParallelCopy() 21119 0.5601 0.6729 0.8754 8.64% MultiFab::min() 140 0.2581 0.4982 0.8331 8.22% Amr::regrid() 21 0.7938 0.8013 0.8087 7.98% FillBoundary_nowait() 157859 0.5246 0.6821 0.7992 7.89% FillBoundary_finish() 157859 0.4509 0.5929 0.7843 7.74% FabArray::ParallelCopy_finish() 21119 0.3021 0.4248 0.6648 6.56% Gravity::multilevel_solve_for_new_phi() 20 0.6617 0.6634 0.6644 6.56% Gravity::actual_multilevel_solve() 20 0.6602 0.662 0.6633 6.55% Castro::post_regrid() 66 0.6299 0.632 0.6341 6.26% FillPatchIterator::Initialize 829 0.4271 0.4727 0.5374 5.30% MLMG::mgVcycle_down::0 1843 0.4506 0.4707 0.4876 4.81% FillPatchTwoLevels 716 0.3685 0.412 0.4799 4.74% MLMG::mgVcycle_up::0 1843 0.4264 0.4379 0.445 4.39% Castro::clean_state() 1182 0.3303 0.3725 0.4059 4.01% MLMG::miniCycle() 1542 0.3584 0.383 0.4003 3.95% Castro::initialize_do_advance() 140 0.2839 0.2972 0.3191 3.15% FillPatchSingleLevel 1517 0.205 0.24 0.3116 3.08% MLPoisson::Fapply() 108875 0.2546 0.29 0.3105 3.06% MLCellLinOp::correctionResidual() 9063 0.2547 0.2797 0.2945 2.91% CGSolver::sxay() 288086 0.22 0.262 0.2943 2.90% FabArray::ParallelCopy_nowait() 21119 0.2018 0.2391 0.2687 2.65% Castro::computeTemp() 1189 0.209 0.2386 0.2591 2.56% Castro::do_new_sources() 260 0.2072 0.2357 0.2531 2.50% Castro::expand_state() 140 0.1954 0.2124 0.2457 2.43% MLCellLinOp::solutionResidual() 3154 0.2013 0.2167 0.2316 2.29% MultiFab::LinComb() 288336 0.1604 0.2004 0.2294 2.26% MLMG::mgVcycle_down::1 1843 0.2091 0.2151 0.2248 2.22% Amr::init() 1 0.2024 0.2026 0.2026 2.00% MultiFab::Dot() 193316 0.1556 0.1825 0.2004 1.98% FabArray::setVal() 27604 0.1401 0.1744 0.1979 1.95% Amr::initialInit() 1 0.188 0.1881 0.1882 1.86% MLMG::computeResWithCrseSolFineCor() 771 0.1476 0.169 0.1865 1.84% Castro::reset_internal_energy() 1189 0.1477 0.1696 0.1822 1.80% Amr::FinalizeInit() 1 0.1745 0.1782 0.1817 1.79% MLMG::mgVcycle_up::1 1843 0.1628 0.1702 0.1748 1.72% Castro::initialize_advance() 140 0.1142 0.1458 0.1653 1.63% amrex::average_down 8093 0.1088 0.1311 0.162 1.60% MLMG::computeResidual() 1843 0.1147 0.1299 0.1363 1.35% Castro::construct_new_source() 1300 0.1133 0.1274 0.1363 1.35% MLMG::addInterpCorrection() 6101 0.07822 0.1108 0.1351 1.33% MLMG:computeResOfCorrection() 6101 0.1232 0.1259 0.1285 1.27% Castro::normalize_species() 1182 0.1016 0.1121 0.1233 1.22% MLPoisson::normalize() 98078 0.09716 0.1125 0.1205 1.19% Castro::estTimeStep() 228 0.08045 0.09078 0.1143 1.13% Castro::do_old_sources() 140 0.08506 0.09847 0.1086 1.07% Castro::avgDown() 62 0.06047 0.08405 0.1084 1.07% Castro::avgDown(state_indx) 248 0.06041 0.08398 0.1083 1.07% amrex::average_down_w_geom 248 0.06025 0.0838 0.1081 1.07% MLPoisson::define() 360 0.07814 0.09079 0.1075 1.06% MLMG::mgVcycle_up::2 483 0.02794 0.05976 0.1053 1.04% MLMG::ResNormInf() 2383 0.0571 0.08041 0.1041 1.03% Amr::bldFineLevels() 1 0.0901 0.09513 0.1037 1.02% Gravity::get_new_grav_vector() 263 0.09593 0.09728 0.09997 0.99% MLCellLinOp::setLevelBC() 450 0.02611 0.05138 0.09801 0.97% MLMG::computeResWithCrseCorFineCor() 771 0.08335 0.09459 0.09757 0.96% MLCellLinOp::reflux() 951 0.06721 0.07869 0.08717 0.86% Gravity::GetCrsePhi() 250 0.02789 0.05109 0.08544 0.84% Castro::post_init() 3 0.0693 0.07822 0.08346 0.82% Castro::construct_new_gravity_source() 260 0.06612 0.07594 0.08228 0.81% Castro::initData() 7 0.04685 0.06005 0.07809 0.77% FillPatchInterp(Fab) 688 0.06817 0.07 0.07137 0.70% MLMG::computeMLResidual() 440 0.05415 0.06259 0.0712 0.70% CellConservativeLinear::interp() 8794 0.06531 0.06683 0.06809 0.67% FabArrayBase::getCPC() 29601 0.0555 0.06181 0.06674 0.66% MultiFab::Saxpy() 1180 0.05361 0.06203 0.06641 0.66% MLMG::prepareForSolve() 360 0.05947 0.06303 0.06542 0.65% MLMG::mgVcycle_up::3 483 0.004268 0.02813 0.06392 0.63% MLCellLinOp::updateSolBC() 871 0.04432 0.05563 0.0623 0.61% MLCellLinOp::defineAuxData() 360 0.04577 0.05325 0.06207 0.61% Gravity::get_old_grav_vector() 140 0.05908 0.06032 0.0617 0.61% MLCellLinOp::updateCorBC() 771 0.04614 0.05511 0.06132 0.61% Castro::init(old) 28 0.04716 0.05351 0.058 0.57% MLMG::interpCorrection_1 771 0.0383 0.04448 0.05713 0.56% FluxRegister::Reflux() 960 0.045 0.04843 0.05247 0.52% Amr::grid_places() 23 0.01687 0.03409 0.0421 0.42% AmrMesh::MakeNewGrids() 23 0.01652 0.03372 0.04179 0.41% Castro::finalize_advance() 140 0.03356 0.03708 0.03995 0.39% MLCellLinOp::defineBC() 360 0.02334 0.02968 0.03814 0.38% FabArrayBase::CPC::define() 4019 0.02806 0.03344 0.03812 0.38% Castro::apply_source_to_state() 520 0.02845 0.03358 0.03669 0.36% Castro::computeNewDt() 28 0.01536 0.01963 0.03514 0.35% MLMG::mgVcycle_down::6 483 0.005555 0.009493 0.03415 0.34% MultiFab::Xpay() 12217 0.02859 0.03175 0.03383 0.33% MLMG::mgVcycle_down::2 483 0.0309 0.03192 0.03331 0.33% FabArrayBase::getFB() 157859 0.03052 0.0317 0.03276 0.32% MLMG::mgVcycle_up::6 483 0.004748 0.008407 0.03264 0.32% Castro::construct_old_source() 700 0.027 0.02975 0.03234 0.32% Gravity::fill_multipole_BCs() 70 0.02755 0.02854 0.02947 0.29% Amr::writePlotFile() 2 0.02893 0.02903 0.02907 0.29% Castro::errorEst() 34 0.007998 0.02213 0.028 0.28% BndryData::define() 540 0.01489 0.01985 0.0263 0.26% Castro::derive() 34 0.006282 0.02033 0.02621 0.26% Castro::enforce_min_density() 1182 0.01871 0.02126 0.02376 0.23% VisMF::Write(FabArray) 6 0.007517 0.00987 0.02352 0.23% MLMG::mgVcycle_down::3 483 0.006203 0.01413 0.0235 0.23% Castro::check_for_nan() 280 0.01653 0.01996 0.02254 0.22% MultiFab::contains_nan() 280 0.01634 0.01978 0.02235 0.22% FabArrayBase::TheFPinfo() 688 0.002355 0.01271 0.019 0.19% Gravity::average_fine_ec_onto_crse_ec() 90 0.01693 0.01764 0.01882 0.19% MLMG::getGradSolution() 360 0.01366 0.01571 0.01797 0.18% FPinfo::FPinfo() 7 0.001411 0.01172 0.01797 0.18% MLCellLinOp::compGrad() 450 0.01342 0.01547 0.01775 0.18% Gravity::update_max_rhs() 30 0.0133 0.01414 0.01605 0.16% Amr::InitializeInit() 1 0.006554 0.009899 0.01368 0.13% Amr::defBaseLevel() 1 0.006548 0.009896 0.01367 0.13% AmrLevel::AmrLevel(dm) 35 0.009313 0.01087 0.01358 0.13% StateData::define() 140 0.0091 0.01067 0.01336 0.13% MLPoisson::FFlux() 7882 0.006804 0.01045 0.01263 0.12% MLMG::mgVcycle_down::4 483 0.005711 0.006695 0.01127 0.11% Castro::FluxRegFineAdd() 140 0.005352 0.008413 0.01048 0.10% MLMG::MLResNormInf() 440 0.007635 0.008895 0.0104 0.10% Castro::construct_old_gravity_source() 140 0.007736 0.009152 0.01016 0.10% Castro::swap_state_time_levels() 140 0.005938 0.00761 0.009672 0.10% MLMG::mgVcycle_up::4 483 0.004291 0.004895 0.008711 0.09% FabArray::setVal(val, thecmd, scomp, ncomp) 8510 0.003827 0.006752 0.008541 0.08% MLMG::mgVcycle_down::5 483 0.005491 0.005988 0.008199 0.08% MLLinOp::define() 360 0.006465 0.007006 0.007891 0.08% Castro::computeInitialDt() 2 0.0007591 0.004491 0.007816 0.08% MultiFab::max() 90 0.003335 0.004961 0.0075 0.07% MLLinOp::defineGrids() 360 0.006017 0.006557 0.007378 0.07% FabArray::mult() 1063 0.005412 0.006183 0.007099 0.07% StateDataPhysBCFunct::() 1517 0.002385 0.004487 0.006948 0.07% MLMG::mgVcycle_up::5 483 0.004419 0.004733 0.006493 0.06% MLMG::MLRhsNormInf() 360 0.005285 0.00581 0.006326 0.06% BoxList::parallelComplementIn() 57 0.0005074 0.003358 0.00584 0.06% BoxList::pci 22 0.0004612 0.003317 0.005801 0.06% Gravity::applyMetricTerms() 90 0.0048 0.005167 0.0057 0.06% DistributionMapping::LeastUsedCPUs() 12 0.000123 0.002874 0.005635 0.06% DistributionMapping::SFCProcessorMapDoIt() 5 0.0001146 0.002852 0.005607 0.06% StateData::FillBoundary(geom) 685 0.001077 0.003051 0.005405 0.05% MLPoisson::prepareForSolve() 360 0.003195 0.004003 0.005214 0.05% MLCellLinOp::prepareForSolve() 360 0.002825 0.003714 0.00494 0.05% MultiFab::norm0(mask) 270 0.003087 0.003912 0.004648 0.05% Gravity::swapTimeLevels() 140 0.00314 0.003844 0.004268 0.04% FabArray::setDomainBndry() 1517 0.003357 0.00363 0.0042 0.04% Gravity::create_comp_minus_level_grad_phi() 60 0.002668 0.003199 0.003774 0.04% MultiFab::Subtract() 420 0.001874 0.00238 0.002916 0.03% MultiFab::Copy() 450 0.001882 0.00217 0.002497 0.02% MLLinOp::makeSubCommunicator() 70 0.001377 0.001645 0.002283 0.02% TagBoxArray::mapPRD 34 0.001217 0.001951 0.002234 0.02% AmrMesh-cluster 4 0 0.0002789 0.002231 0.02% TagBoxArray::collate() 34 0.0007025 0.0008936 0.001521 0.02% MLMG::buildFineMask() 360 0.001254 0.001335 0.001436 0.01% AMRErrorTag::operator() 34 0.001011 0.001205 0.0014 0.01% ClusterList::chop() 4 0 0.0001749 0.001399 0.01% Castro::finalize_do_advance() 140 0.0004708 0.0006045 0.0007226 0.01% FabArrayBase::FB::FB() 299 0.0001952 0.0004467 0.0006559 0.01% MLLinOp::makeAgglomeratedDMap 70 0.0005345 0.0005745 0.0006305 0.01% Castro::build_fine_mask() 40 0.0005138 0.0005791 0.0006303 0.01% Castro::apply_tagging_restrictions() 34 0.0004508 0.0005154 0.00057 0.01% ClusterList::intersect() 4 0 6.71e-05 0.0005368 0.01% Amr::InitAmr() 1 0.0002815 0.0003435 0.0004718 0.00% makeSFC 350 0.0003771 0.0004125 0.0004492 0.00% Castro::enforce_speed_limit() 1182 0.0003134 0.000331 0.0003898 0.00% OwnerMask() 34 0.0001728 0.0001887 0.0002185 0.00% MultiFab::Multiply() 40 0.0001956 0.0002063 0.0002157 0.00% DistributionMapping::KnapSackDoIt() 7 0.0001917 0.0001975 0.0002066 0.00% DistributionMapping::Distribute() 355 0.0001574 0.0001732 0.0001884 0.00% Castro::enforce_consistent_e() 7 7.038e-05 0.000105 0.0001841 0.00% knapsack() 7 0.0001024 0.0001072 0.0001178 0.00% FabArray::RecvLayoutMask() 90 9.394e-05 0.0001064 0.0001161 0.00% Castro::retry_advance_ctu() 140 7.239e-05 8.754e-05 0.0001052 0.00% Castro::create_source_corrector() 140 8.142e-05 8.864e-05 0.0001028 0.00% BoxList::complementIn 574 7.802e-05 8.401e-05 9.335e-05 0.00% Amr::writeSmallPlotFile() 1 4.466e-05 5.874e-05 7.578e-05 0.00% Gravity::set_mass_offset() 21 1.867e-05 2.307e-05 2.6e-05 0.00% Amr::initSubcycle() 1 1.177e-05 1.448e-05 2.041e-05 0.00% Castro::apply_problem_tags() 34 1.593e-05 1.755e-05 2.036e-05 0.00% -------------------------------------------------------------------------------------------- AMReX (22.01-26-g65f906216a5e) finalized