=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro2d.pgi.CUDA.ex() [0x62ff86] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_BLBackTrace.cpp:108 1: ./Castro2d.pgi.CUDA.ex() [0x631872] amrex::BLBackTrace::handler(int) at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_BLBackTrace.cpp:55 2: ./Castro2d.pgi.CUDA.ex() [0x5a1269] amrex::Cuda::Device::synchronize() at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_CudaDevice.cpp:305 3: ./Castro2d.pgi.CUDA.ex() [0x60ec8d] amrex::MFIter::~MFIter() at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_MFIter.cpp:192 (discriminator 1) 4: ./Castro2d.pgi.CUDA.ex() [0x6169da] amrex::Geometry::GetVolume(amrex::MultiFab&) const at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_Geometry.cpp:187 5: ./Castro2d.pgi.CUDA.ex() [0x42805b] Castro::buildMetrics() at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/Castro.cpp:713 6: ./Castro2d.pgi.CUDA.ex() [0x42905a] Castro::Castro(amrex::Amr&, int, amrex::Geometry const&, amrex::BoxArray const&, amrex::DistributionMapping const&, double) at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/Castro.cpp:519 7: ./Castro2d.pgi.CUDA.ex() [0x47c7b1] CastroBld::operator()(amrex::Amr&, int, amrex::Geometry const&, amrex::BoxArray const&, amrex::DistributionMapping const&, double) at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/CastroBld.cpp:57 8: ./Castro2d.pgi.CUDA.ex() [0x678e82] amrex::Amr::defBaseLevel(double, amrex::BoxArray const*, amrex::Vector > const*) at /opt/gcc/gcc/7.3/include/c++/7.3.0/bits/move.h:198 (discriminator 1) (inlined by) ?? at /opt/gcc/gcc/7.3/include/c++/7.3.0/bits/unique_ptr.h:374 (discriminator 1) (inlined by) amrex::Amr::defBaseLevel(double, amrex::BoxArray const*, amrex::Vector > const*) at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_Amr.cpp:2825 (discriminator 1) 9: ./Castro2d.pgi.CUDA.ex() [0x683c33] amrex::Amr::init(double, double) at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_Amr.cpp:1332 (inlined by) amrex::Amr::init(double, double) at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/AMReX_Amr.cpp:1207 10: ./Castro2d.pgi.CUDA.ex() [0x40c41c] main at /raid/testing/castro-gpu/Castro/Exec/hydro_tests/Sedov/tmp_build_dir/s/2d.pgi.CUDA.EXE/main.cpp:121 11: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7f230f786413] ?? ??:0 12: ./Castro2d.pgi.CUDA.ex() [0x410ede] _start at ??:?