=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x9a9f02] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:175:29 1: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x9a9a36] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:85:15 2: /lib64/libc.so.6(+0x3da70) [0x7f432f5aba70] __restore_rt ??:0 3: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x5a0956] load_input_states(int, int, int, int, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, RiemannState&, RiemannState&, RiemannAux&) inlined at /raid/testing/castro-gfortran/Castro//Source/hydro/riemann_solvers.H:1337:20 in riemann_state(int, int, int, int, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, RiemannState&, amrex::GeometryData const&, bool, bool, amrex::GpuArray const&, amrex::GpuArray const&) /raid/testing/castro-gfortran/Castro//Source/hydro/riemann.H:198:27 riemann_state(int, int, int, int, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, RiemannState&, amrex::GeometryData const&, bool, bool, amrex::GpuArray const&, amrex::GpuArray const&) /raid/testing/castro-gfortran/Castro//Source/hydro/riemann_solvers.H:1337:20 4: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x58cdb7] Castro::cmpflx_plus_godunov(amrex::Box const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, int, bool)::{lambda(int, int, int)#1}::operator()(int, int, int) const /raid/testing/castro-gfortran/Castro//Source/hydro/riemann.cpp:88:26 5: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x58f788] call_f&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, int, bool):: > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:30:5 6: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x58f722] ParallelFor&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, int, bool):: > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:118:5 7: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x58f316] Castro::cmpflx_plus_godunov(amrex::Box const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, int, bool) /raid/testing/castro-gfortran/Castro//Source/hydro/riemann.cpp:206:1 8: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x536b0a] Castro::construct_ctu_hydro_source(double, double) /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_hydro.cpp:960:26 9: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x4b643a] Castro::do_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:168:39 10: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x4b79bc] Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:649:90 11: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x4b3ae3] Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:55 12: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0xaa38b0] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2015:44 13: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0xaa40c2] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2125:26 14: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x4cca02] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:136:5 15: /lib64/libc.so.6(__libc_start_main+0xf2) [0x7f432f5961e2] __libc_start_main ??:0 16: ./Castro3d.gnu.DEBUG.TPROF.MPI.ex() [0x40ba6e] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::subcycle_advance_ctu() Castro::do_advance_ctu() Castro::construct_ctu_hydro_source()