=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x1daab0) [0x5637db33cab0] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:174:39 1: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x1dd016) [0x5637db33f016] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:80:8 2: /lib64/libc.so.6(+0x3c6b0) [0x7fcf7f34b6b0] __restore_rt ??:0 3: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x8df58) [0x5637db1eff58] operator() inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:68:10 in Castro::ctoprim(amrex::Box const&, double, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&) /raid/testing/castro-gfortran/Castro//Source/hydro/advection_util.cpp:60:5 ParallelFor&, const amrex::Array4&, const amrex::Array4&):: > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:68:10 Castro::ctoprim(amrex::Box const&, double, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&) /raid/testing/castro-gfortran/Castro//Source/hydro/advection_util.cpp:55:21 4: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x8360e) [0x5637db1e560e] Castro::construct_ctu_hydro_source(double, double) [clone ._omp_fn.0] /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_hydro.cpp:208:61 5: /lib64/libgomp.so.1(GOMP_parallel+0x46) [0x7fcf7f5284c6] GOMP_parallel ??:0 6: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x82660) [0x5637db1e4660] Castro::construct_ctu_hydro_source(double, double) /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_hydro.cpp:1476:50 7: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x5df0b) [0x5637db1bff0b] Castro::do_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:182:36 8: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x5eb8b) [0x5637db1c0b8b] advance_status::operator=(advance_status&&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:655:90 in Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.H:150:8 Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:655:90 9: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x5ca1a) [0x5637db1bea1a] double const& std::min(double const&, double const&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 in Castro::advance(double, double, int, int) /usr/include/c++/9/bits/stl_algobase.h:205:14 Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 10: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x247306) [0x5637db3a9306] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:1973:44 11: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x23964a) [0x5637db39b64a] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 in amrex::Amr::coarseTimeStep(double) /usr/include/c++/9/bits/stl_vector.h:1042:2 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2083:26 12: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x27d0c) [0x5637db189d0c] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 13: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7fcf7f3361a3] __libc_start_main ??:0 14: ./Castro2d.gnu.TEST.TPROF.MPI.OMP.ex(+0x313de) [0x5637db1933de] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::subcycle_advance_ctu() Castro::do_advance_ctu() Castro::construct_ctu_hydro_source()