=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x180835) [0x55fef0bfc835] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_BLBackTrace.cpp:167:39 1: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1826d6) [0x55fef0bfe6d6] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_BLBackTrace.cpp:71:8 2: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x870bd) [0x55fef0b030bd] amrex::Error(char const*) inlined at /raid/testing/castro-gfortran/Castro//Source/problems/Castro_bc_fill_nd.cpp:86:19 in ca_statefill(amrex::Box const&, amrex::FArrayBox&, int, int, amrex::Geometry const&, double, amrex::Vector > const&, int, int) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX.H:100:5 ca_statefill(amrex::Box const&, amrex::FArrayBox&, int, int, amrex::Geometry const&, double, amrex::Vector > const&, int, int) /raid/testing/castro-gfortran/Castro//Source/problems/Castro_bc_fill_nd.cpp:86:19 3: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1fad2d) [0x55fef0c76d2d] amrex::StateData::FillBoundary(amrex::Box const&, amrex::FArrayBox&, double, amrex::Geometry const&, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_StateData.cpp:553:22 4: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1fc9a9) [0x55fef0c789a9] amrex::StateDataPhysBCFunct::FillBoundary(amrex::MultiFab&, int, int, amrex::IntVect const&, double, int) [clone ._omp_fn.0] /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_StateData.cpp:898:44 5: /lib64/libgomp.so.1(GOMP_parallel+0x46) [0x7f3ca76634b6] GOMP_parallel ??:0 6: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1f962a) [0x55fef0c7562a] amrex::StateDataPhysBCFunct::FillBoundary(amrex::MultiFab&, int, int, amrex::IntVect const&, double, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_StateData.cpp:1065:1 7: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1f6232) [0x55fef0c72232] std::enable_if::value, void>::type amrex::FillPatchSingleLevel(amrex::MultiFab&, amrex::IntVect const&, double, amrex::Vector > const&, amrex::Vector > const&, int, int, int, amrex::Geometry const&, amrex::PhysBCFunctBase&, int) /raid/testing/castro-gfortran/AMReX//Src/AmrCore/AMReX_FillPatchUtil_I.H:158:1 8: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1ea884) [0x55fef0c66884] std::vector >::~vector() inlined at /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_Vector.H:21:7 in amrex::FillPatchIterator::FillFromLevel0(double, int, int, int, int) /usr/include/c++/9/bits/stl_vector.h:677:15 amrex::Vector >::~Vector() /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_Vector.H:21:7 amrex::FillPatchIterator::FillFromLevel0(double, int, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_AmrLevel.cpp:1088:18 9: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1ebad4) [0x55fef0c67ad4] amrex::FillPatchIterator::Initialize(int, double, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_AmrLevel.cpp:1002:20 10: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1ec6a7) [0x55fef0c686a7] amrex::AmrLevel::FillPatch(amrex::AmrLevel&, amrex::MultiFab&, int, double, int, int, int, int) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_AmrLevel.cpp:2216:19 11: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x282ca) [0x55fef0aa42ca] Castro::expand_state(amrex::MultiFab&, double, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.cpp:3829:1 12: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x3db84) [0x55fef0ab9b84] Castro::initialize_do_advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:170:19 13: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x3fd96) [0x55fef0abbd96] Castro::do_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:45:29 14: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x4073c) [0x55fef0abc73c] advance_status::operator=(advance_status&&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:556:90 in Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.H:128:8 Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:556:90 15: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x3eb4a) [0x55fef0abab4a] double const& std::min(double const&, double const&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 in Castro::advance(double, double, int, int) /usr/include/c++/9/bits/stl_algobase.h:205:14 Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 16: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1da664) [0x55fef0c56664] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:2121:36 17: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1ccc77) [0x55fef0c48c77] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_Vector.H:33:54 in amrex::Amr::coarseTimeStep(double) /usr/include/c++/9/bits/stl_vector.h:1042:2 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_Vector.H:33:54 amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:2439:26 18: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x1f566) [0x55fef0a9b566] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 19: /lib64/libc.so.6(__libc_start_main+0xf3) [0x7f3ca74711a3] __libc_start_main ??:0 20: ./Castro2d.gnu.TEST.MPI.OMP.ex(+0x268ce) [0x55fef0aa28ce] _start ??:0