=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x1b4335) [0x55e73757c335] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:176:39 1: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x1b5f66) [0x55e73757df66] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:80:8 2: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x31167) [0x55e7373f9167] std::__cxx11::basic_string, std::allocator >::_M_is_local() const inlined at /usr/include/c++/9/bits/basic_string.h:231:6 in Castro::check_for_nan(amrex::MultiFab&, int) /usr/include/c++/9/bits/basic_string.h:222:26 std::__cxx11::basic_string, std::allocator >::_M_dispose() /usr/include/c++/9/bits/basic_string.h:231:6 std::__cxx11::basic_string, std::allocator >::~basic_string() /usr/include/c++/9/bits/basic_string.h:658:9 Castro::check_for_nan(amrex::MultiFab&, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.cpp:4033:154 3: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x45de5) [0x55e73740dde5] Castro::do_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:103:27 4: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x4684c) [0x55e73740e84c] advance_status::operator=(advance_status&&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:560:90 in Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.H:144:8 Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:560:90 5: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x44d6a) [0x55e73740cd6a] double const& std::min(double const&, double const&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 in Castro::advance(double, double, int, int) /usr/include/c++/9/bits/stl_algobase.h:205:14 Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 6: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x223f3d) [0x55e7375ebf3d] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2054:81 7: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x215cfa) [0x55e7375ddcfa] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 in amrex::Amr::coarseTimeStep(double) /usr/include/c++/9/bits/stl_vector.h:1042:2 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2381:26 8: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x2292c) [0x55e7373ea92c] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 9: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7fb82bf401a3] __libc_start_main ??:0 10: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x2af7e) [0x55e7373f2f7e] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::subcycle_advance_ctu() Castro::do_advance_ctu() Castro::check_for_nan()