=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x607e56] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:179:39 1: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x609fcd] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:85:8 2: /lib64/libc.so.6(+0x3da60) [0x7fb0fcba4a60] __restore_rt ??:0 3: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x51f571] dvhin(burn_t&, dvode_t&, double&, int&, int&) inlined at /raid/testing/castro-gfortran/Microphysics//integration/VODE/vode_dvode.H:70:10 in sdc_vode_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) /raid/testing/castro-gfortran/Microphysics//integration/VODE/vode_dvhin.H:81:43 dvode(burn_t&, dvode_t&) /raid/testing/castro-gfortran/Microphysics//integration/VODE/vode_dvode.H:70:10 sdc_vode_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:569:23 4: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x51335f] sdc_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) inlined at /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:822:18 in void amrex::ParallelFor(amrex::Box const&, Castro::do_sdc_update(int, int, double)::{lambda(int, int, int)#1}&&) [clone .constprop.0] /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:150:23 sdc_update_o2(int, int, int, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, double, int, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:822:18 operator() /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc.cpp:194:30 ParallelFor > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:69:10 5: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x5166c1] amrex::Gpu::Elixir::~Elixir() inlined at /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc.cpp:148:40 in Castro::do_sdc_update(int, int, double) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuElixir.H:37:23 Castro::do_sdc_update(int, int, double) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc.cpp:148:40 6: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x459ab1] Castro::do_advance_sdc(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_sdc.cpp:224:18 7: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x4554e2] Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:62:42 8: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x658419] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:36:52 in amrex::Amr::timeStep(int, double, int, int, double) /usr/include/c++/10/bits/stl_vector.h:1046:39 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:36:52 amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:1976:68 9: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x64d270] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2083:13 10: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x427855] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 11: /lib64/libc.so.6(__libc_start_main+0xf2) [0x7fb0fcb8f1e2] __libc_start_main ??:0 12: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x43564e] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::do_advance_sdc() Castro::do_sdc_update()