=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro3d.pgi.TPROF.CUDA.ex() [0x6ce426] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_BLBackTrace.cpp:174 1: ./Castro3d.pgi.TPROF.CUDA.ex() [0x6cfff2] amrex::BLBackTrace::handler(int) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_BLBackTrace.cpp:80 2: ./Castro3d.pgi.TPROF.CUDA.ex() [0x6084b8] amrex::Gpu::Device::synchronize() tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_GpuDevice.cpp:586 3: ./Castro3d.pgi.TPROF.CUDA.ex() [0x68cf15] amrex::Gpu::synchronize() inlined at tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_MFIter.cpp:209 in amrex::MFIter::~MFIter() /raid/testing/castro-gpu/amrex//Src/Base/AMReX_GpuDevice.H:190 amrex::MFIter::~MFIter() tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_MFIter.cpp:209 4: ./Castro3d.pgi.TPROF.CUDA.ex() [0x43a0b5] std::unique_ptr >::~unique_ptr() inlined at tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/Castro.cpp:3277 in Castro::apply_tagging_func(amrex::TagBoxArray&, double, int) /opt/gcc/gcc/7.3/include/c++/7.3.0/bits/unique_ptr.h:267 Castro::apply_tagging_func(amrex::TagBoxArray&, double, int) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/Castro.cpp:3277 5: ./Castro3d.pgi.TPROF.CUDA.ex() [0x43a773] Castro::errorEst(amrex::TagBoxArray&, int, int, double, int, int) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/Castro.cpp:3185 6: ./Castro3d.pgi.TPROF.CUDA.ex() [0x73125c] amrex::AmrMesh::MakeNewGrids(int, double, int&, amrex::Vector >&) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_AmrMesh.cpp:574 7: ./Castro3d.pgi.TPROF.CUDA.ex() [0x73f04e] amrex::Amr::grid_places(int, double, int&, amrex::Vector >&) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_Amr.cpp:3219 8: ./Castro3d.pgi.TPROF.CUDA.ex() [0x7401c1] amrex::Amr::bldFineLevels(double) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_Amr.cpp:3268 9: ./Castro3d.pgi.TPROF.CUDA.ex() [0x7409f6] amrex::Amr::FinalizeInit(double, double) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_Amr.cpp:1328 10: ./Castro3d.pgi.TPROF.CUDA.ex() [0x7431da] amrex::Amr::initialInit(double, double, amrex::BoxArray const*, amrex::Vector > const*) inlined at tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_Amr.cpp:1143 in amrex::Amr::init(double, double) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_Amr.cpp:1262 amrex::Amr::init(double, double) tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/AMReX_Amr.cpp:1143 11: ./Castro3d.pgi.TPROF.CUDA.ex() [0x40d6c9] main tmp_build_dir/s/3d.pgi.TPROF.CUDA.EXE/main.cpp:131 12: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7f9c63fb61a3] __libc_start_main ??:0 13: ./Castro3d.pgi.TPROF.CUDA.ex() [0x41b28e] _start ??:0 ===== TinyProfilers ====== main() Amr::init() Amr::initialInit() Amr::FinalizeInit() Amr::bldFineLevels() Amr::grid_places() AmrMesh::MakeNewGrids() Castro::errorEst() Castro::apply_tagging_func()