MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.03-7-g6d30e83c944e) initialized Starting run at 06:46:26 UTC on 2023-03-13. Successfully read inputs file ... Castro git describe: 23.03-2-g0304294be AMReX git describe: 23.03-7-g6d30e83c9 Microphysics git describe: 23.03-12-g1f07dde0 radiation initialized, nGroups = 1 reading extern runtime parameters ... 1 Species: X Radiation::nGroups = 1 Successfully read inputs file ... Creating Radiation object processors = 8 do_sync = 1 c = 2.99792458e+10 sigma = 5.670373e-05 reltol = 1e-06 abstol = 0 maxiter = 50 relInTol = 0.0001 absInTol = 0 maxInIter = 30 delta_e_rat_dt_tol = 100 delta_T_rat_dt_tol = 100 limiter = 0 closure = 3 update_limiter = 1000 update_planck = 1000 update_rosseland = 1000 delta_temp = 0.0001 underfac = 1 do_multigroup = 0 accelerate = 1 verbose = 2 SolverType = 5: SGFLDSolver rad_hydro_combined = 1 comoving = 1 dimension 0 rad boundary conditions = 102, 102 dimension 1 rad boundary conditions = 102, 102 dimension 2 rad boundary conditions = 102, 102 Regridding radiation object at level 0... done hmabec.bho = 0 hmabec.use_subgrids = 0 hmabec.verbose = 1 hmabec.verbose_threshold = 0 Warning: the following castro.* parameters are ignored castro.gravity = 0 grid_places() time: 0.017964074 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 Now regridding at level lbase = 0 grid_places() time: 0.014567275 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 4096 cells 0.0244140625 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 Integrated Fluid Mass is 0.015394862320617770657 Integrated Fluid Energy is 29997674.940313063562 Integrated Radiant Energy is 0 Flux Register Energy is 0 Integrated Total Energy is 29997674.940313063562 INITIAL GRIDS Level 0 512 grids 2097152 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 1 8 grids 4096 cells 0.0244140625 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 PLOTFILE: file = rad-thermalwave-3d_plt00000 Write plotfile time = 1.088415475 seconds [Level 0 step 1] ADVANCE with dt = 1e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... hmabec.kdim = 5 hmabec.struct_flag = HYPRE_PFMG hmabec.pfmg_relax_type = 1 hmabec.pfmg_pre_relax = 1 hmabec.pfmg_post_relax = 1 Radiation Update: Iteration 1, Relative = 1302911.375186907826 Absolute = 30717.669438446420827 Radiation Update: Iteration 2, Relative = 0.99981662868864995541 Absolute = 23038.180019796534907 Radiation Update: Iteration 3, Relative = 2.5049675977856615816 Absolute = 17278.601887119148159 Radiation Update: Iteration 4, Relative = 0.2499976931502309041 Absolute = 12958.883447859625448 Radiation Update: Iteration 5, Relative = 0.24999144178766968816 Absolute = 9718.9498998517119617 Radiation Update: Iteration 6, Relative = 0.24997036239891964882 Absolute = 7288.6810285310093604 Radiation Update: Iteration 7, Relative = 0.24990069025204844633 Absolute = 5465.2035999699801323 Radiation Update: Iteration 8, Relative = 0.24967414999257170338 Absolute = 4095.7292139944893279 Radiation Update: Iteration 9, Relative = 0.2489435218793252802 Absolute = 3064.138345963525353 Radiation Update: Iteration 10, Relative = 0.24661312439044863476 Absolute = 2279.7979112415941927 Radiation Update: Iteration 11, Relative = 0.23933584867758372905 Absolute = 1666.8862893659916153 Radiation Update: Iteration 12, Relative = 0.21783412647545336016 Absolute = 1154.0299950771404838 Radiation Update: Iteration 13, Relative = 0.16356869747329380593 Absolute = 677.78232869804242 Radiation Update: Iteration 14, Relative = 0.093400978741454462884 Absolute = 253.16058222777019182 Radiation Update: Iteration 15, Relative = 0.037594186600442197621 Absolute = 32.948220825791395328 Radiation Update: Iteration 16, Relative = 0.013496216648835906993 Absolute = 0.51586165244816584163 Radiation Update: Iteration 17, Relative = 0.0035380391166708199079 Absolute = 0.00012546752714115427807 Radiation Update: Iteration 18, Relative = 0.00067881126669380243473 Absolute = 6.8453354484798722979e-07 Radiation Update: Iteration 19, Relative = 2.860667392143744868e-16 Absolute = 9.0949470177292823792e-13 done [Level 0 step 1] Advanced 2097152 cells [Level 1 step 1] ADVANCE with dt = 5e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 1740874.6688549935352 Absolute = 58670.981734533736017 Radiation Update: Iteration 2, Relative = 1.3693198091184299869 Absolute = 44003.166299775097286 Radiation Update: Iteration 3, Relative = 8.419640682605638915 Absolute = 33002.356568688643165 Radiation Update: Iteration 4, Relative = 0.37636607390890908231 Absolute = 24751.70969527302077 Radiation Update: Iteration 5, Relative = 0.28749646911704862529 Absolute = 18563.708290616239537 Radiation Update: Iteration 6, Relative = 0.24999528368166121228 Absolute = 13922.634914905989717 Radiation Update: Iteration 7, Relative = 0.24998543712192419775 Absolute = 10441.630569243545324 Radiation Update: Iteration 8, Relative = 0.24995183422730840594 Absolute = 7830.3222983312807628 Radiation Update: Iteration 9, Relative = 0.24984318291364171483 Absolute = 5870.5658970819858951 Radiation Update: Iteration 10, Relative = 0.2494945806880975725 Absolute = 4397.7005530554160941 Radiation Update: Iteration 11, Relative = 0.24838332641064106432 Absolute = 3285.7977767612683238 Radiation Update: Iteration 12, Relative = 0.24487943197622155656 Absolute = 2434.8213845715126808 Radiation Update: Iteration 13, Relative = 0.23412915130706507538 Absolute = 1757.8693295807570394 Radiation Update: Iteration 14, Relative = 0.20363467702261919823 Absolute = 1170.950060656999085 Radiation Update: Iteration 15, Relative = 0.1344143515864385241 Absolute = 615.52348193750549399 Radiation Update: Iteration 16, Relative = 0.044161267403394710573 Absolute = 174.17271981381782098 Radiation Update: Iteration 17, Relative = 0.014457635510783441515 Absolute = 12.704806842327798222 Radiation Update: Iteration 18, Relative = 0.0033113792966396682696 Absolute = 0.06413466756021080073 Radiation Update: Iteration 19, Relative = 0.0013412046076229323585 Absolute = 2.8354981784772803621e-06 Radiation Update: Iteration 20, Relative = 3.7960979312931694988e-16 Absolute = 1.3642420526593923569e-12 done [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE with dt = 5e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 1.1293800200770882647 Absolute = 58.814656583404484991 Radiation Update: Iteration 2, Relative = 0.24676661791180254379 Absolute = 1.4191275508765102131 Radiation Update: Iteration 3, Relative = 0.038876324387613812872 Absolute = 0.00081055567079602042213 Radiation Update: Iteration 4, Relative = 0.0026439701273685560674 Absolute = 5.6305707456516529419e-06 Radiation Update: Iteration 5, Relative = 3.8575994825843236132e-16 Absolute = 1.3642420526593923569e-12 done [Level 1 step 2] Advanced 4096 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394862320617770657 Integrated Fluid Energy is 709447.77384859812446 Integrated Radiant Energy is 29288227.166465062648 Flux Register Energy is -1.162261753602664722e-06 Integrated Total Energy is 29997674.940312497318 [STEP 1] Coarse TimeStep time: 14.24173847 [STEP 1] FAB kilobyte spread across MPI nodes: [395684 ... 395684] STEP = 1 TIME = 1e-15 DT = 1e-15 [Level 0 step 2] ADVANCE with dt = 1.05e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 41.075798320370708439 Absolute = 285.14215141043223412 Radiation Update: Iteration 2, Relative = 0.70128009910487620893 Absolute = 33.627916367236139195 Radiation Update: Iteration 3, Relative = 0.084541388220853899704 Absolute = 0.54191828436341893394 Radiation Update: Iteration 4, Relative = 0.0040435740078626700167 Absolute = 0.00013980735775476205163 Radiation Update: Iteration 5, Relative = 0.00023937764697501740549 Absolute = 8.0258337664673717882e-07 Radiation Update: Iteration 6, Relative = 4.1346495890416320348e-16 Absolute = 9.0949470177292823792e-13 done [Level 0 step 2] Advanced 2097152 cells [Level 1 step 3] ADVANCE with dt = 5.25e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.54641284635441822459 Absolute = 2.943624464462921253 Radiation Update: Iteration 2, Relative = 0.083948168272416148761 Absolute = 0.024972607350381537117 Radiation Update: Iteration 3, Relative = 0.0076108392528985305617 Absolute = 0.00018989121619306104094 Radiation Update: Iteration 4, Relative = 3.3824238086103671142e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE with dt = 5.25e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.35303629913330941692 Absolute = 2.9178944731206577501 Radiation Update: Iteration 2, Relative = 0.036936704463442812663 Absolute = 0.020380594366432802644 Radiation Update: Iteration 3, Relative = 0.0022787336352683984497 Absolute = 0.00013162435777047676311 Radiation Update: Iteration 4, Relative = 2.1478205325067846024e-14 Absolute = 9.0949470177292823792e-13 done [Level 1 step 4] Advanced 4096 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394862320617770657 Integrated Fluid Energy is 710342.77262448787224 Integrated Radiant Energy is 29287332.167688909918 Flux Register Energy is -9.7548753887645159065e-07 Integrated Total Energy is 29997674.940312422812 [STEP 2] Coarse TimeStep time: 4.159835207 [STEP 2] FAB kilobyte spread across MPI nodes: [395905 ... 395905] STEP = 2 TIME = 2.05e-15 DT = 1.05e-15 Now regridding at level lbase = 0 grid_places() time: 0.011505643 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 STEP = 2 TIME = 2.05e-15 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 0.1953125 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 [Level 0 step 3] ADVANCE with dt = 1.1025e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 20.853193544900342715 Absolute = 285.13246179569932792 Radiation Update: Iteration 2, Relative = 0.58147683183852671984 Absolute = 33.626313170630965033 Radiation Update: Iteration 3, Relative = 0.04988372098437889729 Absolute = 0.54187769457439571852 Radiation Update: Iteration 4, Relative = 0.0026300192682640580362 Absolute = 0.00013994879009260330349 Radiation Update: Iteration 5, Relative = 0.00013963780368088883881 Absolute = 8.6663357645733185564e-07 Radiation Update: Iteration 6, Relative = 2.8841654045367306109e-16 Absolute = 9.0949470177292823792e-13 done [Level 0 step 3] Advanced 2097152 cells [Level 1 step 5] ADVANCE with dt = 5.5125e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.27369076291214472496 Absolute = 3.0411087480216050238 Radiation Update: Iteration 2, Relative = 0.021992160092044642922 Absolute = 0.019316320396177033558 Radiation Update: Iteration 3, Relative = 0.00094537318954255537395 Absolute = 0.00011619634420867441804 Radiation Update: Iteration 4, Relative = 2.2282572219850919393e-14 Absolute = 9.0949470177292823792e-13 done [Level 1 step 5] Advanced 32768 cells [Level 1 step 6] ADVANCE with dt = 5.5125e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.214671963455638104 Absolute = 3.0206419259917058895 Radiation Update: Iteration 2, Relative = 0.013431330131245214354 Absolute = 0.017036881970934558694 Radiation Update: Iteration 3, Relative = 0.00049108510404969035051 Absolute = 9.205482120222541198e-05 Radiation Update: Iteration 4, Relative = 1.6659614140720528382e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 6] Advanced 32768 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394862320617925047 Integrated Fluid Energy is 711281.07259683695156 Integrated Radiant Energy is 29286393.867715489119 Flux Register Energy is 9.276520769545866674e-14 Integrated Total Energy is 29997674.940312325954 [STEP 3] Coarse TimeStep time: 4.125663608 [STEP 3] FAB kilobyte spread across MPI nodes: [395905 ... 395905] STEP = 3 TIME = 3.1525e-15 DT = 1.1025e-15 [Level 0 step 4] ADVANCE with dt = 1.157625e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 14.59475485414557383 Absolute = 285.07206111116738612 Radiation Update: Iteration 2, Relative = 0.51099978466234785568 Absolute = 33.613575909575047262 Radiation Update: Iteration 3, Relative = 0.036631894152134872322 Absolute = 0.54147749418871171656 Radiation Update: Iteration 4, Relative = 0.0020179461202736261906 Absolute = 0.00013984414545120671391 Radiation Update: Iteration 5, Relative = 4.6879371074670606551e-15 Absolute = 8.1854523159563541412e-12 done [Level 0 step 4] Advanced 2097152 cells [Level 1 step 7] ADVANCE with dt = 5.788125e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.1854133078333077278 Absolute = 3.1526844403844727083 Radiation Update: Iteration 2, Relative = 0.0098401135622737251341 Absolute = 0.016934946691190333468 Radiation Update: Iteration 3, Relative = 0.00039205049443860595908 Absolute = 8.7635873470048863965e-05 Radiation Update: Iteration 4, Relative = 1.8625811883709301365e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 7] Advanced 32768 cells [Level 1 step 8] ADVANCE with dt = 5.788125e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.15628586633639340864 Absolute = 3.1347432355308662011 Radiation Update: Iteration 2, Relative = 0.0069133105575895923214 Absolute = 0.01543235836408385353 Radiation Update: Iteration 3, Relative = 0.00029546802934620131553 Absolute = 7.36117732458296814e-05 Radiation Update: Iteration 4, Relative = 1.5099478275432147557e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 8] Advanced 32768 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394862320617925047 Integrated Fluid Energy is 712256.71972726588137 Integrated Radiant Energy is 29285418.220585085452 Flux Register Energy is -7.5475644353645015166e-13 Integrated Total Energy is 29997674.940312352031 [STEP 4] Coarse TimeStep time: 3.540515457 [STEP 4] FAB kilobyte spread across MPI nodes: [398797 ... 398797] STEP = 4 TIME = 4.310125e-15 DT = 1.157625e-15 Now regridding at level lbase = 0 grid_places() time: 0.01581864 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 STEP = 4 TIME = 4.310125e-15 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 0.1953125 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE with dt = 1.21550625e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 11.529747076407815598 Absolute = 285.00830918719248075 Radiation Update: Iteration 2, Relative = 0.46308164709588778285 Absolute = 33.6000980342200819 Radiation Update: Iteration 3, Relative = 0.029571895105505126289 Absolute = 0.5410534340931008046 Radiation Update: Iteration 4, Relative = 0.0016787271648403927216 Absolute = 0.00013971970520287868567 Radiation Update: Iteration 5, Relative = 7.269900045286520642e-15 Absolute = 1.0004441719502210617e-11 done [Level 0 step 5] Advanced 2097152 cells [Level 1 step 9] ADVANCE with dt = 6.07753125e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.14182061814646054754 Absolute = 3.2742810833836735185 Radiation Update: Iteration 2, Relative = 0.0056134926065436862447 Absolute = 0.015706872603409749445 Radiation Update: Iteration 3, Relative = 0.0002514156635199079671 Absolute = 7.3175931493807411243e-05 Radiation Update: Iteration 4, Relative = 1.7771949245841021698e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 9] Advanced 32768 cells [Level 1 step 10] ADVANCE with dt = 6.07753125e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.12412021608235490611 Absolute = 3.2576373964193123811 Radiation Update: Iteration 2, Relative = 0.0042605287980598399722 Absolute = 0.014576246833332362485 Radiation Update: Iteration 3, Relative = 0.00019911742446565195591 Absolute = 6.3535372536449585823e-05 Radiation Update: Iteration 4, Relative = 1.4787944692008772949e-14 Absolute = 9.0949470177292823792e-13 done [Level 1 step 10] Advanced 32768 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394862320617925047 Integrated Fluid Energy is 713272.29498282133136 Integrated Radiant Energy is 29284402.645329594612 Flux Register Energy is -7.3713322727327423244e-13 Integrated Total Energy is 29997674.940312415361 [STEP 5] Coarse TimeStep time: 3.602338243 [STEP 5] FAB kilobyte spread across MPI nodes: [398797 ... 398797] STEP = 5 TIME = 5.52563125e-15 DT = 1.21550625e-15 PLOTFILE: file = rad-thermalwave-3d_plt00005 Write plotfile time = 0.716337485 seconds Ending run at 06:46:58 UTC on 2023-03-13. Deleting radiation in variableCleanUp... done Run time = 31.94503405 Run time without initialization = 30.41182261 Average number of zones advanced per microsecond: 0.352 Average number of zones advanced per microsecond per rank: 0.044 TinyProfiler total time across processes [min...avg...max]: 31.94 ... 31.94 ... 31.95 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- HypreMultiABec::setupSolver 98 10.4017 10.4293 10.4663 32.76% HypreMultiABec::solve 98 8.754 8.791 8.819 27.61% Radiation::compute_eta 98 1.235 1.244 1.262 3.95% HypreMultiABec::clearSolver 98 0.7361 0.77 0.8088 2.53% Radiation::get_planck_and_temp 98 0.793 0.7986 0.8068 2.53% amrex::Copy() 1222 0.7028 0.7417 0.7938 2.48% Castro::derive() 144 0.7171 0.7288 0.7371 2.31% update_rosseland_from_temp 83 0.7217 0.7276 0.7339 2.30% HypreMultiABec::finalizeMatrix 98 0.6525 0.6935 0.7199 2.25% HypreMultiABec::loadMatrix 98 0.5533 0.5674 0.581 1.82% FabArray::setVal() 959 0.3889 0.4694 0.5659 1.77% FabArray::ParallelCopy_finish() 963 0.2323 0.4455 0.5378 1.68% RadSolve::levelBCoeffs 98 0.4043 0.4133 0.4413 1.38% FillPatchIterator::Initialize 258 0.3795 0.39 0.3967 1.24% RadSolve::levelRhs 98 0.3704 0.3775 0.3957 1.24% HypreMultiABec::loadLevelVectors 98 0.3318 0.3349 0.3389 1.06% FabArray::ParallelCopy_nowait() 963 0.3068 0.3226 0.3374 1.06% VisMF::Write(FabArray) 4 0.2439 0.2585 0.3096 0.97% Radiation::compute_exchange 98 0.2625 0.2649 0.2707 0.85% FillPatchSingleLevel 308 0.1924 0.2087 0.2401 0.75% Castro::reset_internal_energy(Fab) 9910 0.2199 0.2219 0.2242 0.70% Amr::writePlotFile() 2 0.1197 0.1713 0.1881 0.59% RadSolve::levelFlux 98 0.164 0.1693 0.1786 0.56% RadSolve::levelFluxReg 98 0.1564 0.1604 0.1666 0.52% Radiation::get_rosseland 15 0.1546 0.1552 0.156 0.49% Castro::initialize_do_advance() 15 0.0912 0.102 0.1421 0.44% FluxRegister::Reflux() 156 0.1143 0.1177 0.1234 0.39% Radiation::internal_energy_update 98 0.1028 0.1092 0.1124 0.35% Castro::computeTemp() 106 0.09666 0.09918 0.1095 0.34% FillBoundary_finish() 181 0.04504 0.07056 0.1054 0.33% HypreMultiABec::vectorSetBoxValues 5362 0.09519 0.09739 0.1006 0.31% Radiation::get_c_v 10625 0.09665 0.09697 0.09721 0.30% Radiation::single_group_update 15 0.07786 0.08099 0.08621 0.27% Castro::initialize_advance() 15 0.06858 0.0778 0.08465 0.26% Castro::normalize_species() 88 0.08207 0.08324 0.08403 0.26% Radiation::scaledGradient 98 0.07564 0.07857 0.08383 0.26% StateData::FillBoundary(geom) 1184 0.07145 0.07546 0.07927 0.25% Castro::Castro() 5 0.05749 0.07146 0.07743 0.24% MultiFab::contains_nan() 30 0.04266 0.04807 0.07467 0.23% StateData::define() 15 0.04996 0.05655 0.074 0.23% HypreMultiABec::finalizeVectors 98 0.0584 0.06671 0.07298 0.23% RadSolve::levelACoeffs 98 0.06882 0.06987 0.07071 0.22% HypreMultiABec::hmbc 8043 0.06765 0.06835 0.06929 0.22% Radiation:fluxLimiter 98 0.05599 0.05873 0.06096 0.19% Castro::initMFs() 5 0.05179 0.0529 0.05575 0.17% HypreMultiABec::hmmat3 1968 0.04994 0.05141 0.05282 0.17% Castro::swap_state_time_levels() 15 0.04739 0.04831 0.04896 0.15% FillBoundary_nowait() 181 0.04617 0.04737 0.04854 0.15% Castro::enforce_min_density() 88 0.03474 0.03573 0.03732 0.12% Castro::initData() 3 0.03254 0.0343 0.03626 0.11% Castro::volWgtSum() 36 0.03042 0.03183 0.03466 0.11% HypreMultiABec::hmac 2681 0.0306 0.03118 0.03184 0.10% FabArray::setDomainBndry() 308 0.02722 0.02948 0.03151 0.10% Castro::buildMetrics() 5 0.02267 0.02381 0.02734 0.09% main() 1 0.01916 0.02224 0.02515 0.08% HypreMultiABec::getAbsoluteResidual 98 0.02011 0.02373 0.02463 0.08% HypreMultiABec::getSolution 98 0.01883 0.01948 0.02282 0.07% HypreMultiABec::boundaryFlux 98 0.01854 0.01898 0.01955 0.06% HypreMultiABec::vectorGetBoxValues 2681 0.01827 0.01855 0.01895 0.06% AMRErrorTag::operator() 4 0.007881 0.009022 0.01295 0.04% AmrMesh::MakeNewGrids() 4 0.01004 0.01032 0.01044 0.03% FillPatchInterp(MF) 50 0.000597 0.006541 0.009545 0.03% Castro::apply_tagging_restrictions() 4 0.007739 0.008333 0.008527 0.03% Castro::expand_state() 30 0.003306 0.004178 0.005284 0.02% FabArrayBase::CPC::define() 190 0.003303 0.003517 0.00371 0.01% Castro::enforce_consistent_e() 3 0.002027 0.002643 0.002803 0.01% DistributionMapping::LeastUsedCPUs() 10 0.0003607 0.001761 0.002766 0.01% Castro::reset_internal_energy(MultiFab) 106 0.002159 0.002194 0.00232 0.01% FillPatchTwoLevels 138 0.0007735 0.001607 0.002111 0.01% FabArrayBase::getCPC() 787 0.001746 0.001877 0.002033 0.01% Radiation::Regrid 5 0.001736 0.001796 0.001864 0.01% Castro::finalize_advance() 15 0.0005485 0.0009372 0.001786 0.01% Castro::build_fine_mask() 18 0.001046 0.001272 0.001467 0.00% TagBoxArray::collate() 4 0.0005154 0.000944 0.001215 0.00% Amr::regrid() 3 0.0003972 0.0005445 0.001153 0.00% FabArray::ParallelCopy() 963 0.001026 0.001075 0.001128 0.00% Radiation::getBndryData 15 0.0009674 0.001014 0.001055 0.00% OwnerMask() 4 0.0007981 0.000864 0.0009391 0.00% RadSolve::levelSolve 98 0.0007826 0.0008155 0.0008669 0.00% Castro::post_timestep() 15 0.0004984 0.0005503 0.0008172 0.00% Amr::InitAmr() 1 0.0007795 0.0007949 0.0008131 0.00% FabArrayBase::FB::FB() 27 0.0006848 0.0007138 0.0007529 0.00% StateDataPhysBCFunct::() 308 0.0006814 0.0007198 0.0007431 0.00% Amr::coarseTimeStep() 5 0.0004107 0.0006943 0.000739 0.00% amrex::average_down 19 0.0006491 0.0006939 0.000732 0.00% Amr::FinalizeInit() 1 5.046e-06 7.755e-05 0.0005635 0.00% Amr::timeStep() 15 0.0002828 0.0003878 0.0004654 0.00% HypreMultiABec::bCoefficients 294 0.0003042 0.0003364 0.0003621 0.00% FabArray::FillBoundary() 181 0.0003105 0.000325 0.0003407 0.00% Castro::clean_state() 88 0.0002075 0.0002368 0.0002986 0.00% Castro::finalize_do_advance() 15 0.0002233 0.0002461 0.0002914 0.00% Amr::grid_places() 4 0.0001959 0.0002115 0.0002795 0.00% TagBoxArray::mapPRD 4 0.0001952 0.0002015 0.0002089 0.00% Castro::do_advance_ctu() 15 0.0001494 0.0001726 0.0001932 0.00% Radiation::init_flux 10 3.124e-05 6.031e-05 0.0001797 0.00% FabArrayBase::getFB() 181 0.0001442 0.0001574 0.0001757 0.00% HypreMultiABec::aCoefficients 98 0.0001377 0.0001472 0.0001599 0.00% Radiation::deferred_sync_setup 5 9.04e-05 0.000104 0.0001415 0.00% Castro::post_init() 2 6.224e-05 8.553e-05 0.0001345 0.00% Castro::advance() 15 9.937e-05 0.0001077 0.0001156 0.00% Castro::check_for_nan() 30 3.87e-05 5.029e-05 0.0001066 0.00% FabSetT::linComb() 30 9.835e-05 0.0001003 0.0001025 0.00% FPinfo::FPinfo() 7 6.88e-05 7.918e-05 9.637e-05 0.00% Castro::errorEst() 4 7.868e-05 8.763e-05 9.418e-05 0.00% FabArrayBase::TheFPinfo() 50 6.946e-05 7.794e-05 9.032e-05 0.00% Castro::estTimeStep() 32 5.294e-05 6.618e-05 8.893e-05 0.00% Amr::defBaseLevel() 1 5.506e-05 6.78e-05 8.213e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 3 5.732e-05 6.515e-05 7.536e-05 0.00% Castro::subcycle_advance_ctu() 15 5.751e-05 6.231e-05 7.009e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.621e-05 4.73e-05 6.563e-05 0.00% Castro::enforce_speed_limit() 88 4.671e-05 4.989e-05 5.806e-05 0.00% Castro::create_source_corrector() 15 1.382e-05 1.98e-05 4.904e-05 0.00% Radiation::pre_timestep 15 3.676e-05 3.974e-05 4.137e-05 0.00% Amr::writeSmallPlotFile() 1 3.615e-05 3.68e-05 3.813e-05 0.00% Castro::avgDown(state_indx) 19 1.877e-05 2.35e-05 3.141e-05 0.00% Amr::initSubcycle() 1 1.523e-05 2.086e-05 3.125e-05 0.00% RadSolve::levelBndry 15 1.698e-05 2.316e-05 2.94e-05 0.00% Castro::post_regrid() 8 1.795e-05 2.155e-05 2.575e-05 0.00% ClusterList::intersect() 0 0 3.095e-06 2.476e-05 0.00% Castro::retry_advance_ctu() 15 1.362e-05 1.715e-05 2.43e-05 0.00% Castro::init(old) 2 1.97e-05 2.074e-05 2.271e-05 0.00% DistributionMapping::Distribute() 3 7.582e-06 1.094e-05 1.992e-05 0.00% Radiation::filBndry 10 1.384e-05 1.454e-05 1.57e-05 0.00% Amr::bldFineLevels() 1 1.35e-05 1.433e-05 1.558e-05 0.00% amrex::average_down_w_geom 19 7.403e-06 9.394e-06 1.42e-05 0.00% AmrMesh-cluster 0 0 1.534e-06 1.227e-05 0.00% Castro::computeNewDt() 6 7.814e-06 8.421e-06 9.48e-06 0.00% Castro::apply_problem_tags() 4 5.498e-06 7.051e-06 8.513e-06 0.00% Castro::avgDown() 6 6.051e-06 7.033e-06 8.191e-06 0.00% Amr::InitializeInit() 1 2.182e-06 3.316e-06 7.544e-06 0.00% BoxList::complementIn 8 2.281e-06 3.145e-06 4.94e-06 0.00% Castro::computeInitialDt() 2 3.267e-06 4.179e-06 4.93e-06 0.00% BoxList::parallelComplementIn() 8 3.298e-06 3.467e-06 3.772e-06 0.00% Amr::initialInit() 1 1.8e-06 2.582e-06 3.645e-06 0.00% Amr::init() 1 1.759e-06 2.043e-06 2.713e-06 0.00% ClusterList::chop() 0 0 3.14e-07 2.512e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 31.94 31.94 31.95 100.00% Amr::coarseTimeStep() 5 29.67 29.67 29.67 92.88% Amr::timeStep() 15 29.67 29.67 29.67 92.88% Castro::advance() 15 29.48 29.48 29.48 92.29% Radiation::single_group_update 15 27.51 27.52 27.54 86.21% RadSolve::levelSolve 98 21.91 21.96 22.01 68.90% HypreMultiABec::setupSolver 98 10.4 10.43 10.47 32.76% HypreMultiABec::solve 98 8.754 8.791 8.819 27.61% Amr::writePlotFile() 2 1.805 1.806 1.806 5.65% FillPatchIterator::Initialize 258 1.377 1.606 1.697 5.31% Castro::subcycle_advance_ctu() 15 1.499 1.551 1.608 5.03% Castro::do_advance_ctu() 15 1.499 1.551 1.608 5.03% Amr::init() 1 1.532 1.532 1.532 4.80% Castro::derive() 144 1.374 1.382 1.388 4.34% Radiation::compute_eta 98 1.332 1.34 1.359 4.25% FillPatchSingleLevel 308 0.8831 1.151 1.252 3.92% Castro::expand_state() 30 0.8172 1.02 1.12 3.51% FabArray::ParallelCopy() 963 0.721 0.9511 1.065 3.33% Castro::initialize_do_advance() 15 0.8182 0.8689 0.9218 2.89% HypreMultiABec::clearSolver 98 0.7361 0.77 0.8088 2.53% Radiation::get_planck_and_temp 98 0.793 0.7986 0.8068 2.53% update_rosseland_from_temp 83 0.7869 0.7926 0.7984 2.50% amrex::Copy() 1222 0.7028 0.7417 0.7938 2.48% HypreMultiABec::loadMatrix 98 0.7045 0.7183 0.7312 2.29% HypreMultiABec::finalizeMatrix 98 0.6525 0.6935 0.7199 2.25% FabArray::setVal() 959 0.3889 0.4694 0.5659 1.77% FabArray::ParallelCopy_finish() 963 0.2323 0.4455 0.5378 1.68% FabArray::ParallelCopy_nowait() 963 0.4876 0.5045 0.5268 1.65% RadSolve::levelBCoeffs 98 0.4607 0.4742 0.5085 1.59% Amr::initialInit() 1 0.443 0.4431 0.4436 1.39% HypreMultiABec::loadLevelVectors 98 0.4276 0.4323 0.438 1.37% Castro::initialize_advance() 15 0.3238 0.369 0.425 1.33% Castro::clean_state() 88 0.3921 0.3967 0.4052 1.27% RadSolve::levelRhs 98 0.3778 0.3849 0.4031 1.26% Amr::InitializeInit() 1 0.3617 0.3644 0.3669 1.15% Amr::defBaseLevel() 1 0.3617 0.3644 0.3669 1.15% Radiation::get_rosseland 15 0.3305 0.3424 0.3562 1.11% Castro::computeTemp() 106 0.3187 0.3232 0.3334 1.04% RadSolve::levelFlux 98 0.2518 0.286 0.3186 1.00% VisMF::Write(FabArray) 4 0.2439 0.2585 0.3096 0.97% FillPatchTwoLevels 138 0.2732 0.2746 0.276 0.86% Radiation::compute_exchange 98 0.2625 0.2649 0.2707 0.85% Castro::reset_internal_energy(MultiFab) 106 0.222 0.2241 0.2265 0.71% Castro::reset_internal_energy(Fab) 9910 0.2199 0.2219 0.2242 0.70% RadSolve::levelFluxReg 98 0.1947 0.2024 0.2066 0.65% Castro::Castro() 5 0.1594 0.1768 0.1834 0.57% FluxRegister::Reflux() 156 0.1463 0.16 0.1695 0.53% FabArray::FillBoundary() 181 0.09367 0.1191 0.1538 0.48% Castro::initData() 3 0.1403 0.143 0.1455 0.46% Radiation::internal_energy_update 98 0.1028 0.1092 0.1124 0.35% Amr::regrid() 3 0.11 0.1106 0.1114 0.35% Castro::post_timestep() 15 0.1083 0.1084 0.1084 0.34% FillBoundary_finish() 181 0.04504 0.07056 0.1054 0.33% HypreMultiABec::vectorSetBoxValues 5362 0.09519 0.09739 0.1006 0.31% Radiation::get_c_v 10625 0.09665 0.09697 0.09721 0.30% RadSolve::levelACoeffs 98 0.0902 0.09384 0.09676 0.30% Castro::normalize_species() 88 0.08207 0.08324 0.08403 0.26% Radiation::scaledGradient 98 0.07564 0.07857 0.08383 0.26% Amr::FinalizeInit() 1 0.07619 0.07873 0.08137 0.25% StateDataPhysBCFunct::() 308 0.07213 0.07618 0.07998 0.25% StateData::FillBoundary(geom) 1184 0.07145 0.07546 0.07927 0.25% Castro::check_for_nan() 30 0.0427 0.04812 0.07477 0.23% MultiFab::contains_nan() 30 0.04266 0.04807 0.07467 0.23% AmrLevel::AmrLevel(dm) 5 0.05001 0.0566 0.07406 0.23% StateData::define() 15 0.04996 0.05655 0.074 0.23% HypreMultiABec::finalizeVectors 98 0.0584 0.06671 0.07298 0.23% HypreMultiABec::hmbc 8043 0.06765 0.06835 0.06929 0.22% Castro::post_regrid() 8 0.06585 0.0665 0.06743 0.21% HypreMultiABec::bCoefficients 294 0.05645 0.06092 0.06723 0.21% Radiation:fluxLimiter 98 0.05599 0.05873 0.06096 0.19% Amr::grid_places() 4 0.05478 0.05724 0.05997 0.19% AmrMesh::MakeNewGrids() 4 0.05457 0.05703 0.05977 0.19% Castro::initMFs() 5 0.05179 0.0529 0.05575 0.17% Amr::bldFineLevels() 1 0.0501 0.05229 0.05532 0.17% HypreMultiABec::hmmat3 1968 0.04994 0.05141 0.05282 0.17% FillBoundary_nowait() 181 0.04706 0.04825 0.04941 0.15% Castro::swap_state_time_levels() 15 0.04739 0.04831 0.04896 0.15% HypreMultiABec::getSolution 98 0.03715 0.03802 0.04164 0.13% Castro::errorEst() 4 0.03432 0.03641 0.04106 0.13% Castro::enforce_min_density() 88 0.03474 0.03573 0.03732 0.12% Castro::volWgtSum() 36 0.03177 0.0331 0.03571 0.11% HypreMultiABec::hmac 2681 0.0306 0.03118 0.03184 0.10% Castro::buildMetrics() 5 0.02776 0.02951 0.03167 0.10% FabArray::setDomainBndry() 308 0.02722 0.02948 0.03151 0.10% Radiation::getBndryData 15 0.01111 0.01619 0.02884 0.09% HypreMultiABec::aCoefficients 98 0.02138 0.02398 0.02627 0.08% HypreMultiABec::getAbsoluteResidual 98 0.02011 0.02373 0.02463 0.08% HypreMultiABec::boundaryFlux 98 0.01854 0.01898 0.01955 0.06% HypreMultiABec::vectorGetBoxValues 2681 0.01827 0.01855 0.01895 0.06% Castro::post_init() 2 0.01385 0.01422 0.01477 0.05% TagBoxArray::mapPRD 4 0.005611 0.008785 0.01378 0.04% AMRErrorTag::operator() 4 0.007881 0.009022 0.01295 0.04% FillPatchInterp(MF) 50 0.000597 0.006541 0.009545 0.03% Castro::finalize_do_advance() 15 0.003656 0.006415 0.009326 0.03% Castro::apply_tagging_restrictions() 4 0.007739 0.008333 0.008527 0.03% Castro::init(old) 2 0.006102 0.006138 0.006182 0.02% FabArrayBase::getCPC() 787 0.005184 0.005394 0.005654 0.02% FabArrayBase::CPC::define() 190 0.003303 0.003517 0.00371 0.01% Radiation::pre_timestep 15 0.002501 0.002627 0.00295 0.01% Radiation::init_flux 10 0.002462 0.002588 0.002909 0.01% FabArrayBase::TheFPinfo() 50 0.0004611 0.001819 0.002828 0.01% Castro::enforce_consistent_e() 3 0.002027 0.002643 0.002803 0.01% DistributionMapping::LeastUsedCPUs() 10 0.0003607 0.001761 0.002766 0.01% FPinfo::FPinfo() 7 0.0003916 0.001741 0.002748 0.01% Radiation::Regrid 5 0.001736 0.001796 0.001864 0.01% Castro::finalize_advance() 15 0.0005485 0.0009372 0.001786 0.01% Castro::build_fine_mask() 18 0.001046 0.001272 0.001467 0.00% Radiation::filBndry 10 0.001154 0.001249 0.001307 0.00% TagBoxArray::collate() 4 0.0005154 0.000944 0.001215 0.00% Castro::avgDown() 6 0.0008843 0.000963 0.001114 0.00% Castro::avgDown(state_indx) 19 0.0008817 0.0009594 0.00111 0.00% amrex::average_down_w_geom 19 0.000863 0.0009359 0.00109 0.00% amrex::average_down 19 0.0008556 0.0009265 0.001081 0.00% OwnerMask() 4 0.0007981 0.000864 0.0009391 0.00% FabSetT::linComb() 30 0.0008194 0.0008655 0.0009296 0.00% FabArrayBase::getFB() 181 0.000844 0.0008712 0.0009106 0.00% Amr::InitAmr() 1 0.0008031 0.0008157 0.0008367 0.00% FabArrayBase::FB::FB() 27 0.0006848 0.0007138 0.0007529 0.00% DistributionMapping::SFCProcessorMapDoIt() 3 0.000101 0.0001752 0.0002012 0.00% Radiation::deferred_sync_setup 5 9.04e-05 0.000104 0.0001415 0.00% Castro::estTimeStep() 32 5.294e-05 6.618e-05 8.893e-05 0.00% Castro::enforce_speed_limit() 88 4.671e-05 4.989e-05 5.806e-05 0.00% Castro::create_source_corrector() 15 1.382e-05 1.98e-05 4.904e-05 0.00% AmrMesh-cluster 0 0 4.944e-06 3.955e-05 0.00% Amr::writeSmallPlotFile() 1 3.615e-05 3.68e-05 3.813e-05 0.00% Amr::initSubcycle() 1 1.523e-05 2.086e-05 3.125e-05 0.00% RadSolve::levelBndry 15 1.698e-05 2.316e-05 2.94e-05 0.00% ClusterList::intersect() 0 0 3.095e-06 2.476e-05 0.00% Castro::retry_advance_ctu() 15 1.362e-05 1.715e-05 2.43e-05 0.00% DistributionMapping::Distribute() 3 7.582e-06 1.094e-05 1.992e-05 0.00% Castro::computeNewDt() 6 1.591e-05 1.746e-05 1.864e-05 0.00% Castro::apply_problem_tags() 4 5.498e-06 7.051e-06 8.513e-06 0.00% BoxList::parallelComplementIn() 8 5.658e-06 6.612e-06 8.493e-06 0.00% BoxList::complementIn 8 2.281e-06 3.145e-06 4.94e-06 0.00% Castro::computeInitialDt() 2 3.267e-06 4.179e-06 4.93e-06 0.00% ClusterList::chop() 0 0 3.14e-07 2.512e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.gravity(nvals = 1) :: [0] [TOP]::habec.verbose(nvals = 1) :: [1] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 3 B 3 B 4 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.03-7-g6d30e83c944e) finalized