=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x1a4e25) [0x5556ed2ece25] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:178:39 1: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x1a6a56) [0x5556ed2eea56] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:82:8 2: /lib64/libc.so.6(+0x3c6b0) [0x7fe7ea2a56b0] __restore_rt ??:0 3: /lib64/libc.so.6(gsignal+0x145) [0x7fe7ea2a5625] raise ??:0 4: /lib64/libc.so.6(abort+0x12b) [0x7fe7ea28e8d9] abort ??:0 5: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x42af8) [0x5556ed18aaf8] .annobin__ZSt20__replacement_assertPKciS0_S0_.end ??:0 6: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x6819f) [0x5556ed1b019f] .annobin__ZN5amrex8FabArrayINS_9FArrayBoxEE5arrayIS1_Li0EEENS_6Array4IdEERKNS_6MFIterE.end /usr/include/c++/9/bits/stl_vector.h:1042:2 7: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x82088) [0x5556ed1ca088] mom_flux_has_p(int, int, int) inlined at /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_hydro.cpp:1372:45 in Castro::construct_ctu_hydro_source(double, double) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_util.H:46:9 Castro::construct_ctu_hydro_source(double, double) /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_hydro.cpp:1372:45 8: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x4e1bf) [0x5556ed1961bf] Castro::do_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:181:28 9: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x4e7f3) [0x5556ed1967f3] advance_status::operator=(advance_status&&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:570:90 in Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.H:148:8 Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:570:90 10: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x4d05a) [0x5556ed19505a] double const& std::min(double const&, double const&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 in Castro::advance(double, double, int, int) /usr/include/c++/9/bits/stl_algobase.h:205:14 Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 11: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x20976d) [0x5556ed35176d] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2050:81 12: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x1fb7da) [0x5556ed3437da] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 in amrex::Amr::coarseTimeStep(double) /usr/include/c++/9/bits/stl_vector.h:1042:2 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2377:26 13: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x229fc) [0x5556ed16a9fc] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 14: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7fe7ea2901a3] __libc_start_main ??:0 15: ./Castro2d.gnu.TEST.TPROF.MPI.SMPLSDC.ex(+0x2f44e) [0x5556ed17744e] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::subcycle_advance_ctu() Castro::do_advance_ctu() Castro::construct_ctu_hydro_source()