=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x721336] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BLBackTrace.cpp:179 1: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x723fd9] amrex::BLBackTrace::handler(int) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BLBackTrace.cpp:85 2: /lib64/libc.so.6(+0x3da60) [0x7fb4a0bfea60] __restore_rt ??:0 3: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x5e4f04] void amrex::BaseFab::setVal<(amrex::RunOn)1>(int const&, amrex::Box const&, amrex::DestComp, amrex::NumComps)::{lambda(int, int, int, int)#1}::operator()(int, int, int, int) const inlined at /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Loop.H:210 in void amrex::BaseFab::setVal<(amrex::RunOn)1>(int const&, amrex::Box const&, amrex::DestComp, amrex::NumComps) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BaseFab.H:3567 void amrex::LoopConcurrentOnCpu::setVal<(amrex::RunOn)1>(int const&, amrex::Box const&, amrex::DestComp, amrex::NumComps)::{lambda(int, int, int, int)#1}>(amrex::Box const&, int, void amrex::BaseFab::setVal<(amrex::RunOn)1>(int const&, amrex::Box const&, amrex::DestComp, amrex::NumComps)::{lambda(int, int, int, int)#1}&&) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Loop.H:210 void amrex::BaseFab::setVal<(amrex::RunOn)1>(int const&, amrex::Box const&, amrex::DestComp, amrex::NumComps) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BaseFab.H:3567 4: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x5e5ec8] RadBndryData::define(amrex::BoxArray const&, amrex::DistributionMapping const&, int, ProxyGeometry const&) /raid/testing/castro-gpu/Castro//Source/radiation/_interpbndry/RadBndryData.cpp:90 5: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x5e7b4e] RadBndryData::RadBndryData(amrex::BoxArray const&, amrex::DistributionMapping const&, int, ProxyGeometry const&) /raid/testing/castro-gpu/Castro//Source/radiation/_interpbndry/RadBndryData.cpp:27 6: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x5e3577] RadInterpBndryData::RadInterpBndryData(amrex::BoxArray const&, amrex::DistributionMapping const&, int, amrex::Geometry const&) /raid/testing/castro-gpu/Castro//Source/radiation/_interpbndry/RadInterpBndryData.cpp:52 7: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x5aad08] RadBndry::RadBndry(amrex::BoxArray const&, amrex::DistributionMapping const&, amrex::Geometry const&) /raid/testing/castro-gpu/Castro//Source/radiation/RadBndry.cpp:26 8: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x5b1d73] Radiation::single_group_update(int, int, int) /raid/testing/castro-gpu/Castro//Source/radiation/SGRadSolver.cpp:129 9: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x4706ef] Castro::advance(double, double, int, int) /raid/testing/castro-gpu/Castro//Source/driver/Castro_advance.cpp:118 10: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x79b25a] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:2015 11: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x790a09] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:2125 12: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x42f92a] main /raid/testing/castro-gpu/Castro//Source/driver/main.cpp:151 13: /lib64/libc.so.6(__libc_start_main+0xf2) [0x7fb4a0be91e2] __libc_start_main ??:0 14: ./Castro1d.gnu.TPROF.MPI.CUDA.ex() [0x43a7be] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Radiation::single_group_update