MPI initialized with 8 MPI processes MPI initialized with thread support level 3 AMReX (23.07-44-g49dd703558c5) initialized Starting run at 06:06:29 UTC on 2023-07-27. Successfully read inputs file ... Castro git describe: 23.07-20-g4174f17eb AMReX git describe: 23.07-44-g49dd70355 Microphysics git describe: 23.07-48-g588beb9c radiation initialized, nGroups = 1 reading extern runtime parameters ... 1 Species: X Radiation::nGroups = 1 Successfully read inputs file ... Creating Radiation object processors = 8 do_sync = 1 c = 2.99792458e+10 sigma = 5.670373e-05 reltol = 1e-06 abstol = 0 maxiter = 50 relInTol = 0.0001 absInTol = 0 maxInIter = 30 delta_e_rat_dt_tol = 100 delta_T_rat_dt_tol = 100 limiter = 0 closure = 3 update_limiter = 1000 update_planck = 1000 update_rosseland = 1000 delta_temp = 0.0001 underfac = 1 do_multigroup = 0 accelerate = 1 verbose = 2 SolverType = 5: SGFLDSolver rad_hydro_combined = 1 comoving = 1 dimension 0 rad boundary conditions = 102, 102 dimension 1 rad boundary conditions = 102, 102 dimension 2 rad boundary conditions = 102, 102 Regridding radiation object at level 0... done hmabec.bho = 0 hmabec.use_subgrids = 0 hmabec.verbose = 1 hmabec.verbose_threshold = 0 Warning: the following castro.* parameters are ignored castro.gravity = 0 grid_places() time: 0.027310069 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 Now regridding at level lbase = 0 grid_places() time: 0.01386892 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 4096 cells 0.0244140625 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 Integrated Fluid Mass is 0.015394863670274892831 Integrated Fluid Energy is 29997674.940313063562 Integrated Radiant Energy is 0 Flux Register Energy is 0 Integrated Total Energy is 29997674.940313063562 INITIAL GRIDS Level 0 512 grids 2097152 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 1 8 grids 4096 cells 0.0244140625 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 PLOTFILE: file = rad-thermalwave-3d_plt00000 Write plotfile time = 1.11240376 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 1e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... hmabec.kdim = 5 hmabec.struct_flag = HYPRE_PFMG hmabec.pfmg_relax_type = 1 hmabec.pfmg_pre_relax = 1 hmabec.pfmg_post_relax = 1 Radiation Update: Iteration 1, Relative = 1302911.3751869073603 Absolute = 30717.669438446406275 Radiation Update: Iteration 2, Relative = 0.99981662868865028848 Absolute = 23038.180019796520355 Radiation Update: Iteration 3, Relative = 2.5049676886893670336 Absolute = 17278.601887119162711 Radiation Update: Iteration 4, Relative = 0.24999769808886579403 Absolute = 12958.890609044661687 Radiation Update: Iteration 5, Relative = 0.24999136871489596734 Absolute = 9718.9517189824473462 Radiation Update: Iteration 6, Relative = 0.24997034509016052839 Absolute = 7288.6842628490339848 Radiation Update: Iteration 7, Relative = 0.24990068428997203043 Absolute = 5465.2062970578372187 Radiation Update: Iteration 8, Relative = 0.24967417681954887088 Absolute = 4095.7314557644167508 Radiation Update: Iteration 9, Relative = 0.24894352392640109461 Absolute = 3064.1399230131682998 Radiation Update: Iteration 10, Relative = 0.24661312837637117124 Absolute = 2279.7991164082250179 Radiation Update: Iteration 11, Relative = 0.23933587622854929355 Absolute = 1666.8873412593475223 Radiation Update: Iteration 12, Relative = 0.21783417974901370107 Absolute = 1154.0308078500111151 Radiation Update: Iteration 13, Relative = 0.16356882590200996774 Absolute = 677.78311949784119861 Radiation Update: Iteration 14, Relative = 0.093401067433613857438 Absolute = 253.16120207243830009 Radiation Update: Iteration 15, Relative = 0.037594276910639594369 Absolute = 32.948377915311084507 Radiation Update: Iteration 16, Relative = 0.013496216738669608234 Absolute = 0.51586630100746333483 Radiation Update: Iteration 17, Relative = 0.0035380401655716602234 Absolute = 0.00012547822916531004012 Radiation Update: Iteration 18, Relative = 0.00067881560898078185679 Absolute = 6.8453431956161381322e-07 Radiation Update: Iteration 19, Relative = 2.8606673921437502915e-16 Absolute = 9.0949470177292823792e-13 done [Level 0 step 1] Advanced 2097152 cells [Level 1 step 1] ADVANCE at time 0 with dt = 5e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 1740874.668854993768 Absolute = 58670.981734533677809 Radiation Update: Iteration 2, Relative = 1.3693198093305025687 Absolute = 44003.211727789370343 Radiation Update: Iteration 3, Relative = 8.4196406770147440568 Absolute = 33002.391901588940527 Radiation Update: Iteration 4, Relative = 0.3763660719885507655 Absolute = 24751.700721644869191 Radiation Update: Iteration 5, Relative = 0.28749652133241437868 Absolute = 18563.684361251551309 Radiation Update: Iteration 6, Relative = 0.24999540301672773523 Absolute = 13922.629596605205734 Radiation Update: Iteration 7, Relative = 0.24998542763614073348 Absolute = 10441.619538746959734 Radiation Update: Iteration 8, Relative = 0.24995183963189296361 Absolute = 7830.3145918788723066 Radiation Update: Iteration 9, Relative = 0.24984311118478511049 Absolute = 5870.558264735260309 Radiation Update: Iteration 10, Relative = 0.24949458091791984482 Absolute = 4397.6963824600443331 Radiation Update: Iteration 11, Relative = 0.24838332961586254144 Absolute = 3285.7945296728576068 Radiation Update: Iteration 12, Relative = 0.24487940019794587898 Absolute = 2434.8186206622967802 Radiation Update: Iteration 13, Relative = 0.23412909031066816978 Absolute = 1757.867178250006873 Radiation Update: Iteration 14, Relative = 0.20363451317251798911 Absolute = 1170.9480837558912754 Radiation Update: Iteration 15, Relative = 0.13441403470795371122 Absolute = 615.52161358528519486 Radiation Update: Iteration 16, Relative = 0.044161135494306925919 Absolute = 174.17163121083012811 Radiation Update: Iteration 17, Relative = 0.014457617083403137559 Absolute = 12.704644132393241307 Radiation Update: Iteration 18, Relative = 0.0033113586836228804493 Absolute = 0.064133107201541861286 Radiation Update: Iteration 19, Relative = 0.0013411947672423718287 Absolute = 2.8354446013345580013e-06 Radiation Update: Iteration 20, Relative = 3.796097931293171471e-16 Absolute = 1.3642420526593923569e-12 done [Level 1 step 1] Advanced 4096 cells [Level 1 step 2] ADVANCE at time 5e-16 with dt = 5e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 1.1293800200035124526 Absolute = 58.814655124160253763 Radiation Update: Iteration 2, Relative = 0.2467666178888859585 Absolute = 1.4191275445136852795 Radiation Update: Iteration 3, Relative = 0.038876324362990849481 Absolute = 0.00081057948682428104803 Radiation Update: Iteration 4, Relative = 0.0026439701353413976384 Absolute = 5.6305549236412844039e-06 Radiation Update: Iteration 5, Relative = 3.8575994825840642752e-16 Absolute = 1.3642420526593923569e-12 done [Level 1 step 2] Advanced 4096 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394863670274892831 Integrated Fluid Energy is 709447.77384859859012 Integrated Radiant Energy is 29288227.166465062648 Flux Register Energy is -1.1622617533884714772e-06 Integrated Total Energy is 29997674.940312497318 [STEP 1] Coarse TimeStep time: 14.36567358 [STEP 1] FAB kilobyte spread across MPI nodes: [381765 ... 381765] STEP = 1 TIME = 1e-15 DT = 1e-15 [Level 0 step 2] ADVANCE at time 1e-15 with dt = 1.05e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 41.075798326101647717 Absolute = 285.14214365272982832 Radiation Update: Iteration 2, Relative = 0.70128009911549027411 Absolute = 33.627909301009822229 Radiation Update: Iteration 3, Relative = 0.084541388193911159998 Absolute = 0.54191828428429289488 Radiation Update: Iteration 4, Relative = 0.0040435739469876731331 Absolute = 0.00013980735730001470074 Radiation Update: Iteration 5, Relative = 0.00023937773254537758356 Absolute = 8.0258557444423672678e-07 Radiation Update: Iteration 6, Relative = 4.1346495104311542288e-16 Absolute = 9.0949470177292823792e-13 done [Level 0 step 2] Advanced 2097152 cells [Level 1 step 3] ADVANCE at time 1e-15 with dt = 5.25e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.54641284635438802653 Absolute = 2.9436244644628546396 Radiation Update: Iteration 2, Relative = 0.083948168272664158707 Absolute = 0.024972607350365549905 Radiation Update: Iteration 3, Relative = 0.0076108392531983141971 Absolute = 0.0001898912162001664683 Radiation Update: Iteration 4, Relative = 3.3611508343302327603e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 3] Advanced 4096 cells [Level 1 step 4] ADVANCE at time 1.525e-15 with dt = 5.25e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.35303629913329459544 Absolute = 2.9178944731206399865 Radiation Update: Iteration 2, Relative = 0.036936704463492682493 Absolute = 0.020380594366431026288 Radiation Update: Iteration 3, Relative = 0.0022787336353348535377 Absolute = 0.00013162435776692404943 Radiation Update: Iteration 4, Relative = 2.1636132208591836343e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 4] Advanced 4096 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394863670274892831 Integrated Fluid Energy is 710342.7726244883379 Integrated Radiant Energy is 29287332.167688909918 Flux Register Energy is -9.7548753893197968254e-07 Integrated Total Energy is 29997674.940312422812 [STEP 2] Coarse TimeStep time: 4.170047622 [STEP 2] FAB kilobyte spread across MPI nodes: [381956 ... 381956] STEP = 2 TIME = 2.05e-15 DT = 1.05e-15 Now regridding at level lbase = 0 grid_places() time: 0.011297343 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 STEP = 2 TIME = 2.05e-15 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 0.1953125 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 [Level 0 step 3] ADVANCE at time 2.05e-15 with dt = 1.1025e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 20.853193549348414848 Absolute = 285.13245403782912035 Radiation Update: Iteration 2, Relative = 0.58147683155102625197 Absolute = 33.626305412898091163 Radiation Update: Iteration 3, Relative = 0.049883721653645782257 Absolute = 0.54187769460577328573 Radiation Update: Iteration 4, Relative = 0.0026300182932386803256 Absolute = 0.00013994342498335754499 Radiation Update: Iteration 5, Relative = 0.00013963658154538105397 Absolute = 8.6660387221826340465e-07 Radiation Update: Iteration 6, Relative = 1.442082702268482895e-16 Absolute = 4.5474735088646411896e-13 done [Level 0 step 3] Advanced 2097152 cells [Level 1 step 5] ADVANCE at time 2.05e-15 with dt = 5.5125e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.27369076291213612073 Absolute = 3.041108748021590813 Radiation Update: Iteration 2, Relative = 0.021992160092094120705 Absolute = 0.019316320396171704488 Radiation Update: Iteration 3, Relative = 0.00094537318976123223008 Absolute = 0.00011619634423354341379 Radiation Update: Iteration 4, Relative = 2.2282573087317014389e-14 Absolute = 9.0949470177292823792e-13 done [Level 1 step 5] Advanced 32768 cells [Level 1 step 6] ADVANCE at time 2.60125e-15 with dt = 5.5125e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.21467196345547268077 Absolute = 3.0206419259916810205 Radiation Update: Iteration 2, Relative = 0.013431330131291625146 Absolute = 0.017036881971190354079 Radiation Update: Iteration 3, Relative = 0.0004910851041875662808 Absolute = 9.2054821504206074678e-05 Radiation Update: Iteration 4, Relative = 1.6865288004540081796e-14 Absolute = 9.0949470177292823792e-13 done [Level 1 step 6] Advanced 32768 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394863670274819972 Integrated Fluid Energy is 711281.07259683741722 Integrated Radiant Energy is 29286393.867715492845 Flux Register Energy is 9.2765207909382522376e-14 Integrated Total Energy is 29997674.94031232968 [STEP 3] Coarse TimeStep time: 4.253054481 [STEP 3] FAB kilobyte spread across MPI nodes: [381956 ... 381956] STEP = 3 TIME = 3.1525e-15 DT = 1.1025e-15 [Level 0 step 4] ADVANCE at time 3.1525e-15 with dt = 1.157625e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 14.594754855335613897 Absolute = 285.07206111059667819 Radiation Update: Iteration 2, Relative = 0.5109997846712267533 Absolute = 33.613575909707378742 Radiation Update: Iteration 3, Relative = 0.036631894175244705814 Absolute = 0.54147748268451323383 Radiation Update: Iteration 4, Relative = 0.0020179458718468145165 Absolute = 0.0001398441459059540648 Radiation Update: Iteration 5, Relative = 4.6879369783048846024e-15 Absolute = 9.5496943686157464981e-12 done [Level 0 step 4] Advanced 2097152 cells [Level 1 step 7] ADVANCE at time 3.1525e-15 with dt = 5.788125e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.18541330783330803311 Absolute = 3.1526844403844336284 Radiation Update: Iteration 2, Relative = 0.0098401135622878770082 Absolute = 0.016934946691197438895 Radiation Update: Iteration 3, Relative = 0.00039205049452336503601 Absolute = 8.763587348425971868e-05 Radiation Update: Iteration 4, Relative = 1.8625811883701273917e-14 Absolute = 1.8189894035458564758e-12 done [Level 1 step 7] Advanced 32768 cells [Level 1 step 8] ADVANCE at time 3.7313125e-15 with dt = 5.788125e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.15628586633639343639 Absolute = 3.1347432355308235685 Radiation Update: Iteration 2, Relative = 0.0069133105575879113744 Absolute = 0.015432358364080300817 Radiation Update: Iteration 3, Relative = 0.00029546802883574456704 Absolute = 7.3611773114379275285e-05 Radiation Update: Iteration 4, Relative = 1.5099478276500325176e-14 Absolute = 1.3642420526593923569e-12 done [Level 1 step 8] Advanced 32768 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394863670274819972 Integrated Fluid Energy is 712256.71972726634704 Integrated Radiant Energy is 29285418.220585085452 Flux Register Energy is -7.547564434728409521e-13 Integrated Total Energy is 29997674.940312352031 [STEP 4] Coarse TimeStep time: 3.574072708 [STEP 4] FAB kilobyte spread across MPI nodes: [384692 ... 384692] STEP = 4 TIME = 4.310125e-15 DT = 1.157625e-15 Now regridding at level lbase = 0 grid_places() time: 0.011353505 new finest: 1 Regridding radiation object at level 1... done Warning: the following castro.* parameters are ignored castro.gravity = 0 STEP = 4 TIME = 4.310125e-15 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 0.1953125 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 4.310125e-15 with dt = 1.21550625e-15 Radiation flux initialization at level 0... done Radiation implicit update, level 0... Radiation Update: Iteration 1, Relative = 11.529747077234953068 Absolute = 285.00830918719248075 Radiation Update: Iteration 2, Relative = 0.46308164710702742761 Absolute = 33.600098034219627152 Radiation Update: Iteration 3, Relative = 0.029571895692444762072 Absolute = 0.5410534341181119089 Radiation Update: Iteration 4, Relative = 0.0016787271579305274635 Absolute = 0.0001397197074766154401 Radiation Update: Iteration 5, Relative = 7.1245023713514584285e-15 Absolute = 9.0949470177292823792e-12 done [Level 0 step 5] Advanced 2097152 cells [Level 1 step 9] ADVANCE at time 4.310125e-15 with dt = 6.07753125e-16 Radiation flux initialization at level 1... done Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.14182061814645935405 Absolute = 3.2742810833836877293 Radiation Update: Iteration 2, Relative = 0.005613492606542485816 Absolute = 0.015706872603331589744 Radiation Update: Iteration 3, Relative = 0.00025141566387413118253 Absolute = 7.3175931277091876836e-05 Radiation Update: Iteration 4, Relative = 1.7771949245497882982e-14 Absolute = 9.0949470177292823792e-13 done [Level 1 step 9] Advanced 32768 cells [Level 1 step 10] ADVANCE at time 4.917878125e-15 with dt = 6.07753125e-16 Radiation implicit update, level 1... Radiation Update: Iteration 1, Relative = 0.12412021608235491998 Absolute = 3.2576373964192733013 Radiation Update: Iteration 2, Relative = 0.004260528798059499099 Absolute = 0.014576246833328809771 Radiation Update: Iteration 3, Relative = 0.00019911742456090323673 Absolute = 6.3535372568424008932e-05 Radiation Update: Iteration 4, Relative = 1.4787944796379750232e-14 Absolute = 9.0949470177292823792e-13 done [Level 1 step 10] Advanced 32768 cells Radiation deferred sync setup for coarse level 0... done Integrated Fluid Mass is 0.015394863670274819972 Integrated Fluid Energy is 713272.29498282179702 Integrated Radiant Energy is 29284402.645329594612 Flux Register Energy is -7.3713322725346370106e-13 Integrated Total Energy is 29997674.940312415361 [STEP 5] Coarse TimeStep time: 3.66062594 [STEP 5] FAB kilobyte spread across MPI nodes: [384692 ... 384692] STEP = 5 TIME = 5.52563125e-15 DT = 1.21550625e-15 PLOTFILE: file = rad-thermalwave-3d_plt00005 Write plotfile time = 0.707443087 seconds Ending run at 06:07:02 UTC on 2023-07-27. Deleting radiation in variableCleanUp... done Run time = 32.67239488 Run time without initialization = 31.15039681 Average number of zones advanced per microsecond: 0.343 Average number of zones advanced per microsecond per rank: 0.043 TinyProfiler total time across processes [min...avg...max]: 32.67 ... 32.67 ... 32.67 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- HypreMultiABec::setupSolver 98 11.1269 11.1466 11.1859 34.24% HypreMultiABec::solve 98 8.763 8.802 8.822 27.00% Radiation::compute_eta 98 1.218 1.225 1.245 3.81% HypreMultiABec::clearSolver 98 0.811 0.835 0.8525 2.61% Radiation::get_planck_and_temp 98 0.7916 0.7983 0.815 2.49% update_rosseland_from_temp 83 0.7197 0.7317 0.7616 2.33% AmrLevel::derive() 144 0.6943 0.7117 0.7255 2.22% HypreMultiABec::finalizeMatrix 98 0.656 0.6765 0.6925 2.12% amrex::Copy() 1205 0.6213 0.6583 0.6853 2.10% HypreMultiABec::loadMatrix 98 0.5926 0.6072 0.6185 1.89% FabArray::setVal() 959 0.4008 0.484 0.5837 1.79% RadSolve::levelBCoeffs 98 0.4052 0.4125 0.4388 1.34% FabArray::ParallelCopy_finish() 919 0.1695 0.3071 0.4041 1.24% Amr::coarseTimeStep() 5 0.3983 0.3986 0.3986 1.22% RadSolve::levelRhs 98 0.3675 0.3744 0.3824 1.17% HypreMultiABec::loadLevelVectors 98 0.3715 0.3756 0.3805 1.16% FillPatchIterator::Initialize 240 0.3503 0.3605 0.3678 1.13% VisMF::Write(FabArray) 4 0.2464 0.2591 0.328 1.00% Radiation::compute_exchange 98 0.2634 0.265 0.2715 0.83% FabArray::ParallelCopy_nowait() 919 0.2259 0.2316 0.2363 0.72% Amr::writePlotFile() 2 0.1288 0.1896 0.2092 0.64% RadSolve::levelFlux 98 0.1595 0.1623 0.1648 0.50% RadSolve::levelFluxReg 98 0.156 0.1595 0.1641 0.50% Radiation::get_rosseland 15 0.1507 0.1524 0.1562 0.48% Castro::reset_internal_energy(Fab) 7294 0.1482 0.1505 0.1525 0.47% FillBoundary_finish() 181 0.04779 0.1127 0.1501 0.46% FillPatchSingleLevel 277 0.1194 0.1321 0.1451 0.44% Castro::Castro() 5 0.06629 0.1027 0.1198 0.37% FluxRegister::Reflux() 156 0.108 0.1138 0.1166 0.36% Radiation::internal_energy_update 98 0.09743 0.1045 0.1068 0.33% HypreMultiABec::vectorSetBoxValues 5362 0.09544 0.09914 0.1048 0.32% Castro::initialize_do_advance() 15 0.09791 0.1003 0.1015 0.31% Radiation::get_c_v 10625 0.09548 0.09587 0.09633 0.29% Radiation::single_group_update 15 0.07688 0.08298 0.0898 0.27% Castro::initialize_advance() 15 0.08123 0.08333 0.08502 0.26% Radiation::scaledGradient 98 0.07495 0.07723 0.08114 0.25% HypreMultiABec::finalizeVectors 98 0.06102 0.07088 0.07949 0.24% Castro::computeTemp() 76 0.0638 0.06627 0.07382 0.23% Castro::initMFs() 5 0.05383 0.0594 0.07278 0.22% HypreMultiABec::hmbc 8043 0.0675 0.06839 0.07266 0.22% RadSolve::levelACoeffs 98 0.07023 0.07101 0.07201 0.22% StateData::define() 15 0.04577 0.05335 0.06818 0.21% Radiation:fluxLimiter 98 0.0588 0.05993 0.06069 0.19% StateData::FillBoundary(geom) 962 0.05671 0.05853 0.0605 0.19% Castro::normalize_species() 58 0.05471 0.05525 0.0559 0.17% HypreMultiABec::hmmat3 1968 0.05104 0.05337 0.0556 0.17% FillBoundary_nowait() 181 0.045 0.04617 0.0481 0.15% Castro::swap_state_time_levels() 15 0.04492 0.04532 0.04593 0.14% Castro::initData() 3 0.03155 0.03471 0.03909 0.12% AmrLevel::FillPatch() 225 0.02865 0.03371 0.037 0.11% Castro::buildMetrics() 5 0.02363 0.02734 0.03472 0.11% Castro::volWgtSum() 36 0.03086 0.03189 0.03471 0.11% HypreMultiABec::hmac 2681 0.03055 0.03101 0.03151 0.10% Castro::enforce_min_density() 58 0.02196 0.02278 0.02403 0.07% FabArray::setDomainBndry() 277 0.02056 0.02271 0.02396 0.07% HypreMultiABec::getAbsoluteResidual 98 0.02007 0.02191 0.02279 0.07% main() 1 0.01825 0.02016 0.0213 0.07% MultiFab::contains_nan() 15 0.01785 0.01931 0.02064 0.06% HypreMultiABec::getSolution 98 0.01847 0.0191 0.02063 0.06% HypreMultiABec::boundaryFlux 98 0.01832 0.01884 0.01936 0.06% HypreMultiABec::vectorGetBoxValues 2681 0.01722 0.01755 0.01786 0.05% AmrMesh::MakeNewGrids() 4 0.01023 0.01046 0.01108 0.03% FillPatchInterp(MF) 37 0.0006187 0.006119 0.0092 0.03% Castro::apply_tagging_restrictions() 4 0.007835 0.008419 0.008605 0.03% AMRErrorTag::operator() 4 0.008146 0.008405 0.00851 0.03% FabArrayBase::CPC::define() 165 0.003046 0.00331 0.003519 0.01% DistributionMapping::LeastUsedCPUs() 11 0.0005431 0.001522 0.002347 0.01% Castro::enforce_consistent_e() 3 0.00192 0.00204 0.002305 0.01% Radiation::Regrid 5 0.001813 0.001933 0.002068 0.01% FabArrayBase::getCPC() 742 0.001759 0.001859 0.001944 0.01% TagBoxArray::collate() 4 0.0002719 0.001202 0.001676 0.01% Castro::reset_internal_energy(MultiFab) 76 0.001531 0.001586 0.001645 0.01% FillPatchTwoLevels 126 0.0006667 0.001274 0.00162 0.00% Castro::build_fine_mask() 18 0.0009266 0.001251 0.001464 0.00% Radiation::getBndryData 15 0.001036 0.001112 0.001218 0.00% OwnerMask() 4 0.0008306 0.0009057 0.001193 0.00% Amr::regrid() 3 0.0004025 0.0005554 0.001191 0.00% FabArray::ParallelCopy() 919 0.001003 0.001091 0.001153 0.00% Castro::finalize_advance() 15 0.0005626 0.0006762 0.0009739 0.00% RadSolve::levelSolve 98 0.0008792 0.0009009 0.0009184 0.00% Castro::post_timestep() 15 0.0005022 0.0005585 0.0008145 0.00% amrex::average_down 19 0.0007151 0.0007515 0.000808 0.00% StateDataPhysBCFunct::() 277 0.0006297 0.0006741 0.000758 0.00% FabArrayBase::FB::FB() 27 0.0006724 0.0007152 0.0007551 0.00% Amr::FinalizeInit() 1 6.128e-06 8.001e-05 0.0005856 0.00% Amr::InitAmr() 1 0.0005463 0.0005584 0.0005711 0.00% Amr::timeStep() 15 0.0002851 0.000373 0.0004305 0.00% Castro::finalize_do_advance() 15 0.0002371 0.0002696 0.0004153 0.00% FillPatchIterator::FillFromLevel0() 114 0.0003114 0.0003483 0.0003739 0.00% HypreMultiABec::bCoefficients 294 0.0003455 0.0003606 0.0003727 0.00% FabArray::FillBoundary() 181 0.0003165 0.0003302 0.0003567 0.00% Amr::grid_places() 4 0.0001873 0.0002093 0.0002818 0.00% Castro::derive() 144 0.0002007 0.0002213 0.0002422 0.00% TagBoxArray::mapPRD 4 0.000187 0.0002026 0.0002393 0.00% Radiation::deferred_sync_setup 5 9.799e-05 0.0001142 0.0001741 0.00% HypreMultiABec::aCoefficients 98 0.0001509 0.0001594 0.0001717 0.00% Radiation::init_flux 10 3.353e-05 5.757e-05 0.0001715 0.00% FabArrayBase::getFB() 181 0.0001389 0.0001521 0.0001623 0.00% Castro::clean_state() 58 0.0001425 0.000151 0.0001622 0.00% Castro::advance() 15 0.0001136 0.0001246 0.0001443 0.00% Castro::post_init() 2 6.024e-05 8.793e-05 0.0001415 0.00% FillPatchIterator::FillFromTwoLevels() 126 0.0001139 0.0001245 0.000134 0.00% Castro::do_advance_ctu() 15 0.0001077 0.0001141 0.0001198 0.00% FabSetT::linComb() 30 9.827e-05 0.0001032 0.0001097 0.00% Amr::writeSmallPlotFile() 1 3.49e-05 4.497e-05 0.0001096 0.00% FPinfo::FPinfo() 8 7.923e-05 9.298e-05 0.0001065 0.00% Castro::do_old_sources() 15 4.949e-05 5.864e-05 8.758e-05 0.00% Castro::subcycle_advance_ctu() 15 6.331e-05 7.13e-05 8.587e-05 0.00% FabArrayBase::TheFPinfo() 37 5.988e-05 6.811e-05 8.447e-05 0.00% Castro::errorEst() 4 7.074e-05 7.842e-05 8.346e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 3 5.901e-05 6.844e-05 8.174e-05 0.00% Castro::do_new_sources() 15 3.877e-05 5.256e-05 7.389e-05 0.00% Radiation::pre_timestep 15 3.888e-05 4.409e-05 6.339e-05 0.00% AmrLevel::AmrLevel(dm) 5 3.628e-05 4.813e-05 6.25e-05 0.00% Castro::avgDown(state_indx) 19 1.796e-05 3.28e-05 5.176e-05 0.00% Castro::retry_advance_ctu() 15 1.31e-05 2.039e-05 5.132e-05 0.00% Amr::defBaseLevel() 1 3.377e-05 4.205e-05 4.779e-05 0.00% Castro::expand_state() 15 3.078e-05 3.78e-05 4.476e-05 0.00% amrex::average_down_w_geom 19 7.856e-06 1.253e-05 3.709e-05 0.00% Castro::enforce_speed_limit() 58 3.32e-05 3.546e-05 3.694e-05 0.00% Castro::estTimeStep() 32 2.751e-05 3.224e-05 3.674e-05 0.00% RadSolve::levelBndry 15 1.559e-05 2.273e-05 3.05e-05 0.00% ClusterList::intersect() 0 0 3.425e-06 2.74e-05 0.00% Castro::check_for_nan() 15 1.857e-05 2.045e-05 2.413e-05 0.00% Castro::post_regrid() 8 1.866e-05 2.075e-05 2.232e-05 0.00% Radiation::filBndry 10 1.447e-05 1.606e-05 2.158e-05 0.00% DistributionMapping::Distribute() 3 7.448e-06 1.024e-05 1.942e-05 0.00% Castro::create_source_corrector() 15 1.372e-05 1.633e-05 1.878e-05 0.00% Amr::initSubcycle() 1 9.402e-06 1.215e-05 1.869e-05 0.00% Castro::apply_problem_tags() 4 1.2e-05 1.373e-05 1.671e-05 0.00% Amr::init() 1 1.917e-06 5.455e-06 1.621e-05 0.00% Amr::bldFineLevels() 1 1.29e-05 1.433e-05 1.593e-05 0.00% Castro::computeNewDt() 6 7.997e-06 9.924e-06 1.354e-05 0.00% BoxList::parallelComplementIn() 8 3.182e-06 4.79e-06 1.317e-05 0.00% AmrMesh-cluster 0 0 1.495e-06 1.196e-05 0.00% Castro::init(old) 2 6.356e-06 6.969e-06 7.758e-06 0.00% Castro::avgDown() 6 5.923e-06 6.959e-06 7.686e-06 0.00% Amr::InitializeInit() 1 2.307e-06 3.087e-06 6.788e-06 0.00% Castro::computeInitialDt() 2 2.777e-06 3.59e-06 4.651e-06 0.00% BoxList::complementIn 8 2.712e-06 3.209e-06 3.895e-06 0.00% Amr::initialInit() 1 1.846e-06 2.12e-06 2.535e-06 0.00% ClusterList::chop() 0 0 2.896e-07 2.317e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 32.67 32.67 32.67 100.00% Amr::coarseTimeStep() 5 30.42 30.42 30.42 93.11% Amr::timeStep() 15 30.02 30.02 30.02 91.89% Castro::advance() 15 29.87 29.87 29.87 91.42% Radiation::single_group_update 15 28.39 28.44 28.49 87.20% RadSolve::levelSolve 98 22.81 22.83 22.84 69.90% HypreMultiABec::setupSolver 98 11.13 11.15 11.19 34.24% HypreMultiABec::solve 98 8.763 8.802 8.822 27.00% Amr::writePlotFile() 2 1.821 1.821 1.821 5.57% Amr::init() 1 1.521 1.521 1.521 4.66% Castro::derive() 144 1.375 1.385 1.405 4.30% AmrLevel::derive() 144 1.375 1.385 1.405 4.30% Radiation::compute_eta 98 1.313 1.321 1.341 4.11% AmrLevel::FillPatch() 225 1.234 1.293 1.334 4.08% FillPatchIterator::Initialize 240 1.119 1.233 1.313 4.02% Castro::subcycle_advance_ctu() 15 0.9936 1.031 1.063 3.25% Castro::do_advance_ctu() 15 0.9935 1.03 1.063 3.25% Castro::initialize_do_advance() 15 0.7952 0.8588 0.9047 2.77% FillPatchSingleLevel 277 0.7107 0.8277 0.8942 2.74% update_rosseland_from_temp 83 0.8195 0.8481 0.8621 2.64% HypreMultiABec::clearSolver 98 0.811 0.835 0.8525 2.61% Radiation::get_planck_and_temp 98 0.7916 0.7983 0.815 2.49% FabArray::ParallelCopy() 919 0.5653 0.7054 0.8131 2.49% HypreMultiABec::loadMatrix 98 0.7458 0.76 0.7719 2.36% FillPatchIterator::FillFromLevel0() 114 0.5561 0.6775 0.7516 2.30% HypreMultiABec::finalizeMatrix 98 0.656 0.6765 0.6925 2.12% amrex::Copy() 1205 0.6213 0.6583 0.6853 2.10% Castro::expand_state() 15 0.5481 0.6143 0.6603 2.02% FabArray::setVal() 959 0.4008 0.484 0.5837 1.79% RadSolve::levelBCoeffs 98 0.4597 0.4723 0.4955 1.52% HypreMultiABec::loadLevelVectors 98 0.4679 0.4747 0.4815 1.47% Radiation::get_rosseland 15 0.3413 0.3916 0.4415 1.35% Castro::initialize_advance() 15 0.3122 0.3636 0.4331 1.33% Amr::initialInit() 1 0.4075 0.4076 0.4081 1.25% FabArray::ParallelCopy_nowait() 919 0.3903 0.3972 0.4079 1.25% FabArray::ParallelCopy_finish() 919 0.1695 0.3071 0.4041 1.24% RadSolve::levelRhs 98 0.3745 0.3817 0.3895 1.19% Amr::InitializeInit() 1 0.3258 0.3314 0.3368 1.03% Amr::defBaseLevel() 1 0.3258 0.3314 0.3368 1.03% VisMF::Write(FabArray) 4 0.2464 0.2591 0.328 1.00% RadSolve::levelFlux 98 0.2556 0.2686 0.2938 0.90% Radiation::compute_exchange 98 0.2634 0.265 0.2715 0.83% Castro::clean_state() 58 0.2575 0.2593 0.2636 0.81% Castro::computeTemp() 76 0.2138 0.2184 0.2279 0.70% Castro::Castro() 5 0.1977 0.2125 0.2201 0.67% RadSolve::levelFluxReg 98 0.1946 0.2001 0.2047 0.63% FabArray::FillBoundary() 181 0.095 0.1601 0.1975 0.60% FluxRegister::Reflux() 156 0.1477 0.1608 0.1752 0.54% FillPatchIterator::FillFromTwoLevels() 126 0.171 0.1725 0.1738 0.53% FillPatchTwoLevels 126 0.1709 0.1723 0.1737 0.53% Castro::reset_internal_energy(MultiFab) 76 0.1497 0.1521 0.1542 0.47% Castro::reset_internal_energy(Fab) 7294 0.1482 0.1505 0.1525 0.47% FillBoundary_finish() 181 0.04779 0.1127 0.1501 0.46% Radiation::internal_energy_update 98 0.09743 0.1045 0.1068 0.33% Castro::do_new_sources() 15 0.04392 0.07642 0.1064 0.33% HypreMultiABec::vectorSetBoxValues 5362 0.09544 0.09914 0.1048 0.32% RadSolve::levelACoeffs 98 0.09158 0.09499 0.09736 0.30% Radiation::get_c_v 10625 0.09548 0.09587 0.09633 0.29% Castro::post_timestep() 15 0.09254 0.0926 0.09275 0.28% Amr::regrid() 3 0.0882 0.08857 0.08912 0.27% Castro::initData() 3 0.07138 0.07704 0.08218 0.25% Amr::FinalizeInit() 1 0.07074 0.07614 0.08166 0.25% Radiation::scaledGradient 98 0.07495 0.07723 0.08114 0.25% HypreMultiABec::finalizeVectors 98 0.06102 0.07088 0.07949 0.24% Castro::initMFs() 5 0.05383 0.0594 0.07278 0.22% HypreMultiABec::hmbc 8043 0.0675 0.06839 0.07266 0.22% HypreMultiABec::bCoefficients 294 0.05136 0.05979 0.06829 0.21% AmrLevel::AmrLevel(dm) 5 0.04581 0.0534 0.06823 0.21% StateData::define() 15 0.04577 0.05335 0.06818 0.21% Amr::grid_places() 4 0.05302 0.05821 0.06393 0.20% AmrMesh::MakeNewGrids() 4 0.05282 0.058 0.06373 0.20% StateDataPhysBCFunct::() 277 0.05738 0.05921 0.06126 0.19% Radiation:fluxLimiter 98 0.0588 0.05993 0.06069 0.19% StateData::FillBoundary(geom) 962 0.05671 0.05853 0.0605 0.19% Amr::bldFineLevels() 1 0.04841 0.0534 0.05949 0.18% Castro::normalize_species() 58 0.05471 0.05525 0.0559 0.17% HypreMultiABec::hmmat3 1968 0.05104 0.05337 0.0556 0.17% Castro::do_old_sources() 15 0.04905 0.05278 0.05461 0.17% FillBoundary_nowait() 181 0.04591 0.04704 0.04895 0.15% Castro::post_regrid() 8 0.0468 0.04724 0.04795 0.15% Castro::swap_state_time_levels() 15 0.04492 0.04532 0.04593 0.14% Castro::errorEst() 4 0.03467 0.0413 0.04459 0.14% Castro::buildMetrics() 5 0.02827 0.03348 0.04186 0.13% HypreMultiABec::getSolution 98 0.03578 0.03665 0.03849 0.12% Castro::volWgtSum() 36 0.03221 0.03314 0.03563 0.11% HypreMultiABec::hmac 2681 0.03055 0.03101 0.03151 0.10% HypreMultiABec::aCoefficients 98 0.02136 0.02398 0.02667 0.08% Castro::enforce_min_density() 58 0.02196 0.02278 0.02403 0.07% FabArray::setDomainBndry() 277 0.02056 0.02271 0.02396 0.07% HypreMultiABec::getAbsoluteResidual 98 0.02007 0.02191 0.02279 0.07% Castro::check_for_nan() 15 0.01787 0.01933 0.02066 0.06% MultiFab::contains_nan() 15 0.01785 0.01931 0.02064 0.06% Radiation::getBndryData 15 0.01023 0.01431 0.01953 0.06% HypreMultiABec::boundaryFlux 98 0.01832 0.01884 0.01936 0.06% HypreMultiABec::vectorGetBoxValues 2681 0.01722 0.01755 0.01786 0.05% Castro::finalize_do_advance() 15 0.00432 0.005982 0.01639 0.05% Castro::post_init() 2 0.01347 0.014 0.01436 0.04% FillPatchInterp(MF) 37 0.0006187 0.006119 0.0092 0.03% Castro::apply_tagging_restrictions() 4 0.007835 0.008419 0.008605 0.03% AMRErrorTag::operator() 4 0.008146 0.008405 0.00851 0.03% TagBoxArray::mapPRD 4 0.003602 0.004421 0.006739 0.02% Castro::init(old) 2 0.005482 0.005548 0.005598 0.02% FabArrayBase::getCPC() 742 0.004866 0.005169 0.005464 0.02% FabArrayBase::CPC::define() 165 0.003046 0.00331 0.003519 0.01% Radiation::pre_timestep 15 0.002025 0.002502 0.002887 0.01% Radiation::init_flux 10 0.001986 0.002458 0.002823 0.01% FabArrayBase::TheFPinfo() 37 0.0005523 0.001578 0.002454 0.01% FPinfo::FPinfo() 8 0.000487 0.00151 0.002392 0.01% DistributionMapping::LeastUsedCPUs() 11 0.0005431 0.001522 0.002347 0.01% Castro::enforce_consistent_e() 3 0.00192 0.00204 0.002305 0.01% Radiation::Regrid 5 0.001813 0.001933 0.002068 0.01% TagBoxArray::collate() 4 0.0002719 0.001202 0.001676 0.01% Radiation::filBndry 10 0.001328 0.001445 0.001556 0.00% Castro::build_fine_mask() 18 0.0009266 0.001251 0.001464 0.00% OwnerMask() 4 0.0008306 0.0009057 0.001193 0.00% Castro::avgDown() 6 0.0009694 0.001017 0.001086 0.00% Castro::avgDown(state_indx) 19 0.0009655 0.001014 0.001083 0.00% FabSetT::linComb() 30 0.0009034 0.0009668 0.00104 0.00% amrex::average_down_w_geom 19 0.0009328 0.0009809 0.001031 0.00% amrex::average_down 19 0.0009239 0.0009684 0.001021 0.00% Castro::finalize_advance() 15 0.0005626 0.0006762 0.0009739 0.00% FabArrayBase::getFB() 181 0.0008225 0.0008673 0.0009144 0.00% FabArrayBase::FB::FB() 27 0.0006724 0.0007152 0.0007551 0.00% Amr::InitAmr() 1 0.0005559 0.0005706 0.0005823 0.00% DistributionMapping::SFCProcessorMapDoIt() 3 0.0001418 0.0001835 0.0002118 0.00% Radiation::deferred_sync_setup 5 9.799e-05 0.0001142 0.0001741 0.00% Amr::writeSmallPlotFile() 1 3.49e-05 4.497e-05 0.0001096 0.00% Castro::retry_advance_ctu() 15 1.31e-05 2.039e-05 5.132e-05 0.00% AmrMesh-cluster 0 0 5.21e-06 4.168e-05 0.00% Castro::enforce_speed_limit() 58 3.32e-05 3.546e-05 3.694e-05 0.00% Castro::estTimeStep() 32 2.751e-05 3.224e-05 3.674e-05 0.00% RadSolve::levelBndry 15 1.559e-05 2.273e-05 3.05e-05 0.00% ClusterList::intersect() 0 0 3.425e-06 2.74e-05 0.00% Castro::computeNewDt() 6 1.594e-05 1.913e-05 2.136e-05 0.00% DistributionMapping::Distribute() 3 7.448e-06 1.024e-05 1.942e-05 0.00% Castro::create_source_corrector() 15 1.372e-05 1.633e-05 1.878e-05 0.00% Amr::initSubcycle() 1 9.402e-06 1.215e-05 1.869e-05 0.00% Castro::apply_problem_tags() 4 1.2e-05 1.373e-05 1.671e-05 0.00% BoxList::parallelComplementIn() 8 5.894e-06 7.999e-06 1.617e-05 0.00% Castro::computeInitialDt() 2 2.777e-06 3.59e-06 4.651e-06 0.00% BoxList::complementIn 8 2.712e-06 3.209e-06 3.895e-06 0.00% ClusterList::chop() 0 0 2.896e-07 2.317e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.gravity(nvals = 1) :: [0] [TOP]::habec.verbose(nvals = 1) :: [1] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 8 8 3 B 4 B 7 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------------- AMReX (23.07-44-g49dd703558c5) finalized