=== If no file names and line numbers are shown below, one can run addr2line -Cfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro2d.gnu.TEST.MPI.ex() [0x544849] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_BLBackTrace.cpp:108 1: ./Castro2d.gnu.TEST.MPI.ex() [0x545e63] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_BLBackTrace.cpp:55 2: /lib64/libc.so.6(+0x346e0) [0x7f68d89a96e0] ?? ??:0 3: /lib64/libc.so.6(gsignal+0x110) [0x7f68d89a9660] ?? ??:0 4: /lib64/libc.so.6(abort+0x151) [0x7f68d89aac41] ?? ??:0 5: /lib64/libc.so.6(+0x76f17) [0x7f68d89ebf17] ?? ??:0 6: /lib64/libc.so.6(+0x7d21a) [0x7f68d89f221a] ?? ??:0 7: /lib64/libc.so.6(+0x7ed5c) [0x7f68d89f3d5c] ?? ??:0 8: ./Castro2d.gnu.TEST.MPI.ex() [0x526123] std::_Rb_tree_iterator >::operator++() /usr/include/c++/7/bits/stl_tree.h:287 amrex::FabArrayBase::flushCPC(bool) const /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_FabArrayBase.cpp:522 9: ./Castro2d.gnu.TEST.MPI.ex() [0x52e4ae] amrex::FabArrayBase::clearThisBD(bool) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_FabArrayBase.cpp:1657 10: ./Castro2d.gnu.TEST.MPI.ex() [0x4eca16] amrex::FabArray::clear() /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_FabArray.H:857 amrex::FabArray::~FabArray() /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_FabArray.H:1029 11: ./Castro2d.gnu.TEST.MPI.ex() [0x54cb93] amrex::FillPatchTwoLevels(amrex::MultiFab&, double, amrex::Vector > const&, amrex::Vector > const&, amrex::Vector > const&, amrex::Vector > const&, int, int, int, amrex::Geometry const&, amrex::Geometry const&, amrex::PhysBCFunctBase&, amrex::PhysBCFunctBase&, amrex::IntVect const&, amrex::Interpolater*, amrex::Vector > const&, amrex::InterpHook const&, amrex::InterpHook const&) /raid/testing/castro-gfortran/AMReX//Src/AmrCore/AMReX_FillPatchUtil.cpp:172 12: ./Castro2d.gnu.TEST.MPI.ex() [0x57552c] std::vector >::~vector() /usr/include/c++/7/bits/stl_vector.h:434 (discriminator 4) amrex::Vector >::~Vector() /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_Vector.H:20 (discriminator 4) amrex::FillPatchIterator::FillFromTwoLevels(double, int, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_AmrLevel.cpp:1070 (discriminator 4) 13: ./Castro2d.gnu.TEST.MPI.ex() [0x57cfa2] amrex::FillPatchIterator::Initialize(int, double, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_AmrLevel.cpp:962 14: ./Castro2d.gnu.TEST.MPI.ex() [0x57d743] amrex::FillPatchIterator::FillPatchIterator(amrex::AmrLevel&, amrex::MultiFab&, int, double, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_AmrLevel.cpp:660 15: ./Castro2d.gnu.TEST.MPI.ex() [0x57d7b5] amrex::AmrLevel::FillPatch(amrex::AmrLevel&, amrex::MultiFab&, int, double, int, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_AmrLevel.cpp:2106 16: ./Castro2d.gnu.TEST.MPI.ex() [0x418e7e] Castro::expand_state(amrex::MultiFab&, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.cpp:3523 17: ./Castro2d.gnu.TEST.MPI.ex() [0x41f3b6] Castro::do_advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:287 18: ./Castro2d.gnu.TEST.MPI.ex() [0x41f5b4] Castro::subcycle_advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:1242 19: ./Castro2d.gnu.TEST.MPI.ex() [0x42242a] Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:103 20: ./Castro2d.gnu.TEST.MPI.ex() [0x5733c8] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:1948 21: ./Castro2d.gnu.TEST.MPI.ex() [0x5734be] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:2005 22: ./Castro2d.gnu.TEST.MPI.ex() [0x5734be] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:2005 23: ./Castro2d.gnu.TEST.MPI.ex() [0x567dab] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:2162 24: ./Castro2d.gnu.TEST.MPI.ex() [0x40951a] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:132 25: /lib64/libc.so.6(__libc_start_main+0xea) [0x7f68d8995f2a] ?? ??:0 26: ./Castro2d.gnu.TEST.MPI.ex() [0x40e53a] _start ??:?