=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x1b36c0) [0x5601f5de46c0] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:179:39 1: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x1b5500) [0x5601f5de6500] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:85:8 2: /lib64/libc.so.6(+0x3c6b0) [0x7ff225a4b6b0] __restore_rt ??:0 3: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0xc5873) [0x5601f5cf6873] void dgefa<6>(ArrayUtil::MathArray2D<1, 6, 1, 6>&, amrex::Array1D&, int&) inlined at /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:362:25 in sdc_newton_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int, double&, int&) /raid/testing/castro-gfortran/Microphysics//util/linpack.H:94:28 sdc_newton_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int, double&, int&) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:362:25 4: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0xc128a) [0x5601f5cf228a] sdc_newton_subdivide(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int, double&, int&) inlined at /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:142:29 in Castro::do_sdc_update(int, int, double) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:224:28 sdc_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:142:29 sdc_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:122:1 sdc_solve(int, int, int, double, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:113:14 sdc_update_centers_o4(int, int, int, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, double, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:853:18 operator() /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc.cpp:245:38 ParallelFor > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:69:10 Castro::do_sdc_update(int, int, double) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc.cpp:242:31 5: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x51777) [0x5601f5c82777] Castro::do_advance_sdc(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_sdc.cpp:224:18 6: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x4bfc0) [0x5601f5c7cfc0] Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:62:42 7: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x20e516) [0x5601f5e3f516] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:1973:44 8: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x20186a) [0x5601f5e3286a] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:36:54 in amrex::Amr::coarseTimeStep(double) /usr/include/c++/9/bits/stl_vector.h:1042:2 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:36:54 amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2083:26 9: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x2302c) [0x5601f5c5402c] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 10: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7ff225a361a3] __libc_start_main ??:0 11: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex(+0x2d8be) [0x5601f5c5e8be] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::do_advance_sdc() Castro::do_sdc_update()