=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro2d.gnu.TPROF.CUDA.ex() [0x64bdd6] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BLBackTrace.cpp:179:35 1: ./Castro2d.gnu.TPROF.CUDA.ex() [0x64df4d] amrex::BLBackTrace::handler(int) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BLBackTrace.cpp:85:7 2: /lib64/libc.so.6(+0x3da60) [0x7f04e2edca60] __restore_rt ??:0 3: ./Castro2d.gnu.TPROF.CUDA.ex() [0x5643ab] amrex::BaseFab::setVal<(amrex::RunOn)1>(double const&, amrex::Box const&, amrex::DestComp, amrex::NumComps)::{lambda(int, int, int, int)#1}::operator()(int, int, int, int) const inlined at /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Loop.H:210:2 in void amrex::BaseFab::setVal<(amrex::RunOn)1>(double const&, amrex::Box const&, amrex::DestComp, amrex::NumComps) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BaseFab.H:3567:123 void amrex::LoopConcurrentOnCpu::setVal<(amrex::RunOn)1>(double const&, amrex::Box const&, amrex::DestComp, amrex::NumComps)::{lambda(int, int, int, int)#1}>(amrex::Box const&, int, amrex::BaseFab::setVal<(amrex::RunOn)1>(double const&, amrex::Box const&, amrex::DestComp, amrex::NumComps)::{lambda(int, int, int, int)#1}&&) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Loop.H:210:2 void amrex::BaseFab::setVal<(amrex::RunOn)1>(double const&, amrex::Box const&, amrex::DestComp, amrex::NumComps) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BaseFab.H:3567:36 4: ./Castro2d.gnu.TPROF.CUDA.ex() [0x66e160] std::vector, std::allocator > >::size() const inlined at /raid/testing/castro-gpu/amrex//Src/AmrCore/AMReX_FluxRegister.cpp:601:53 in amrex::FluxRegister::ClearInternalBorders(amrex::Geometry const&) /usr/include/c++/10/bits/stl_vector.h:919:69 amrex::FluxRegister::ClearInternalBorders(amrex::Geometry const&) /raid/testing/castro-gpu/amrex//Src/AmrCore/AMReX_FluxRegister.cpp:601:53 5: ./Castro2d.gnu.TPROF.CUDA.ex() [0x43bd6c] Castro::reflux(int, int) /raid/testing/castro-gpu/Castro//Source/driver/Castro.cpp:2702:12 6: ./Castro2d.gnu.TPROF.CUDA.ex() [0x43d3bb] Castro::post_timestep(int) /raid/testing/castro-gpu/Castro//Source/driver/Castro.cpp:1999:6 7: ./Castro2d.gnu.TPROF.CUDA.ex() [0x6c34ee] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:2075:30 8: ./Castro2d.gnu.TPROF.CUDA.ex() [0x6c34c2] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:2062:1 9: ./Castro2d.gnu.TPROF.CUDA.ex() [0x6c34c2] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:2062:1 10: ./Castro2d.gnu.TPROF.CUDA.ex() [0x6b6359] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:2126:11 11: ./Castro2d.gnu.TPROF.CUDA.ex() [0x421f65] main /raid/testing/castro-gpu/Castro//Source/driver/main.cpp:151:29 12: /lib64/libc.so.6(__libc_start_main+0xf2) [0x7f04e2ec71e2] __libc_start_main ??:0 13: ./Castro2d.gnu.TPROF.CUDA.ex() [0x4292be] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Amr::timeStep() Amr::timeStep() Castro::post_timestep() Castro::reflux()