=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x2499d0) [0x55c0890db9d0] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:174:39 1: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x24b830) [0x55c0890dd830] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:80:8 2: /lib64/libc.so.6(+0x3c6b0) [0x7ff31d8c16b0] __restore_rt ??:0 3: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x924c4) [0x55c088f244c4] MC(double) inlined at /raid/testing/castro-gfortran/Castro//Source/radiation/RadHydro.H:172:65 in Castro::ctu_rad_consup(amrex::Box const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, int&, amrex::Array4 const&, double) /raid/testing/castro-gfortran/Castro//Source/radiation/RadHydro.H:49:59 dudt(double*, double*, double const*, int, double*) /raid/testing/castro-gfortran/Castro//Source/radiation/RadHydro.H:172:65 update_one_species(int, double*, double*, double const*, double, int&) /raid/testing/castro-gfortran/Castro//Source/radiation/RadHydro.H:276:11 operator() /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_rad.cpp:323:27 call_f, Castro::ctu_rad_consup(const amrex::Box&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, int&, const amrex::Array4&, amrex::Real):: > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Reduce.H:693:24 eval, Castro::ctu_rad_consup(const amrex::Box&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, const amrex::Array4&, int&, const amrex::Array4&, amrex::Real):: > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Reduce.H:714:24 Castro::ctu_rad_consup(amrex::Box const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, int&, amrex::Array4 const&, double) /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_rad.cpp:185:19 4: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x7b7e7) [0x55c088f0d7e7] Castro::construct_ctu_hydro_source(double, double) /raid/testing/castro-gfortran/Castro//Source/hydro/Castro_ctu_hydro.cpp:1298:17 5: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x50adc) [0x55c088ee2adc] Castro::do_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:182:36 6: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x5117b) [0x55c088ee317b] advance_status::operator=(advance_status&&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:618:90 in Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.H:148:8 Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:618:90 7: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x47589) [0x55c088ed9589] double const& std::min(double const&, double const&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 in Castro::advance(double, double, int, int) /usr/include/c++/9/bits/stl_algobase.h:204:9 Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 8: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x2bfc6d) [0x55c089151c6d] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:1977:81 9: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x2b1eda) [0x55c089143eda] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 in amrex::Amr::coarseTimeStep(double) /usr/include/c++/9/bits/stl_vector.h:1042:2 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:34:54 amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2087:26 10: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x2504c) [0x55c088eb704c] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 11: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7ff31d8ac1a3] __libc_start_main ??:0 12: ./Castro3d.gnu.TEST.TPROF.MPI.ex(+0x2d79e) [0x55c088ebf79e] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::subcycle_advance_ctu() Castro::do_advance_ctu() Castro::construct_ctu_hydro_source()