=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro3d.gnu.TPROF.CUDA.ex() [0x75a606] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BLBackTrace.cpp:179 1: ./Castro3d.gnu.TPROF.CUDA.ex() [0x75d2a9] amrex::BLBackTrace::handler(int) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BLBackTrace.cpp:85 2: ./Castro3d.gnu.TPROF.CUDA.ex() [0x657fe2] amrex::Arena::allocate_system(unsigned long) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Arena.cpp:148 3: ./Castro3d.gnu.TPROF.CUDA.ex() [0x65dffd] amrex::CArena::alloc(unsigned long) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_CArena.cpp:63 4: ./Castro3d.gnu.TPROF.CUDA.ex() [0x6a62a3] amrex::Box::length(int) const inlined at /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Box.H:338 in amrex::FArrayBox::FArrayBox(amrex::Box const&, int, bool, bool, amrex::Arena*) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Box.H:151 amrex::Box::numPts() const /raid/testing/castro-gpu/amrex//Src/Base/AMReX_Box.H:338 amrex::BaseFab::define() /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BaseFab.H:1927 amrex::BaseFab::BaseFab(amrex::Box const&, int, bool, bool, amrex::Arena*) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_BaseFab.H:1950 amrex::FArrayBox::FArrayBox(amrex::Box const&, int, bool, bool, amrex::Arena*) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_FArrayBox.cpp:133 5: ./Castro3d.gnu.TPROF.CUDA.ex() [0x653518] amrex::FArrayBox*& std::vector >::emplace_back(amrex::FArrayBox*&&) inlined at /opt/gcc/gcc/7.3/include/c++/7.3.0/bits/stl_vector.h:954 in amrex::FabArray::AllocFabs(amrex::FabFactory const&, amrex::Arena*, amrex::Vector, std::allocator >, std::allocator, std::allocator > > > const&) /opt/gcc/gcc/7.3/include/c++/7.3.0/bits/vector.tcc:98 std::vector >::push_back(amrex::FArrayBox*&&) /opt/gcc/gcc/7.3/include/c++/7.3.0/bits/stl_vector.h:954 amrex::FabArray::AllocFabs(amrex::FabFactory const&, amrex::Arena*, amrex::Vector, std::allocator >, std::allocator, std::allocator > > > const&) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_FabArray.H:1506 6: ./Castro3d.gnu.TPROF.CUDA.ex() [0x653a8f] amrex::FabArray::define(amrex::BoxArray const&, amrex::DistributionMapping const&, int, amrex::IntVect const&, amrex::MFInfo const&, amrex::FabFactory const&) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_FabArray.H:1483 7: ./Castro3d.gnu.TPROF.CUDA.ex() [0x6b5761] amrex::MultiFab::define(amrex::BoxArray const&, amrex::DistributionMapping const&, int, amrex::IntVect const&, amrex::MFInfo const&, amrex::FabFactory const&) inlined at /raid/testing/castro-gpu/amrex//Src/Base/AMReX_MultiFab.cpp:589 in amrex::MultiFab::define(amrex::BoxArray const&, amrex::DistributionMapping const&, int, int, amrex::MFInfo const&, amrex::FabFactory const&) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_MultiFab.cpp:602 amrex::MultiFab::define(amrex::BoxArray const&, amrex::DistributionMapping const&, int, int, amrex::MFInfo const&, amrex::FabFactory const&) /raid/testing/castro-gpu/amrex//Src/Base/AMReX_MultiFab.cpp:589 8: ./Castro3d.gnu.TPROF.CUDA.ex() [0x7f7323] amrex::FillPatchIterator::Initialize(int, double, int, int, int) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_AmrLevel.cpp:995 9: ./Castro3d.gnu.TPROF.CUDA.ex() [0x7f7d30] amrex::AmrLevel::FillPatch(amrex::AmrLevel&, amrex::MultiFab&, int, double, int, int, int, int) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_AmrLevel.cpp:2214 10: ./Castro3d.gnu.TPROF.CUDA.ex() [0x7f8114] amrex::AmrLevel::derive(std::__cxx11::basic_string, std::allocator > const&, double, int) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_AmrLevel.cpp:1663 11: ./Castro3d.gnu.TPROF.CUDA.ex() [0x43b0b2] Castro::derive(std::__cxx11::basic_string, std::allocator > const&, double, int) /raid/testing/castro-gpu/Castro//Source/driver/Castro.cpp:3609 12: ./Castro3d.gnu.TPROF.CUDA.ex() [0x49464d] Castro::plotFileOutput(std::__cxx11::basic_string, std::allocator > const&, std::ostream&, amrex::VisMF::How, int) /raid/testing/castro-gpu/Castro//Source/driver/Castro_io.cpp:1129 13: ./Castro3d.gnu.TPROF.CUDA.ex() [0x7e2974] amrex::Amr::writePlotFileDoit(std::__cxx11::basic_string, std::allocator > const&, bool) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:995 14: ./Castro3d.gnu.TPROF.CUDA.ex() [0x7e307f] amrex::Amr::writePlotFile() /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:890 15: ./Castro3d.gnu.TPROF.CUDA.ex() [0x7e8e76] amrex::Amr::init(double, double) /raid/testing/castro-gpu/amrex//Src/Amr/AMReX_Amr.cpp:1151 16: ./Castro3d.gnu.TPROF.CUDA.ex() [0x40c3ee] main /raid/testing/castro-gpu/Castro//Source/driver/main.cpp:139 17: /lib64/libc.so.6(__libc_start_main+0xf2) [0x7f4360cf41e2] __libc_start_main ??:0 18: ./Castro3d.gnu.TPROF.CUDA.ex() [0x41985e] _start ??:0 ===== TinyProfilers ====== main() Amr::init() Amr::writePlotFile() Castro::derive() FillPatchIterator::Initialize