=== If no file names and line numbers are shown below, one can run addr2line -Cfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro2d.gnu.TEST.MPI.ex() [0x50ab39] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_BLBackTrace.cpp:108 1: ./Castro2d.gnu.TEST.MPI.ex() [0x50c153] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_BLBackTrace.cpp:55 2: /lib64/libc.so.6(+0x346e0) [0x7f6fa47336e0] ?? ??:0 3: /lib64/libc.so.6(gsignal+0x110) [0x7f6fa4733660] ?? ??:0 4: /lib64/libc.so.6(abort+0x151) [0x7f6fa4734c41] ?? ??:0 5: /lib64/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x135) [0x7f6fa50a9025] ?? ??:0 6: /lib64/libstdc++.so.6(+0x8fc16) [0x7f6fa50a6c16] ?? ??:0 7: /lib64/libstdc++.so.6(+0x8fc61) [0x7f6fa50a6c61] ?? ??:0 8: /lib64/libstdc++.so.6(+0x8fea4) [0x7f6fa50a6ea4] ?? ??:0 9: /lib64/libstdc++.so.6(_ZSt20__throw_length_errorPKc+0x3f) [0x7f6fa50d092f] ?? ??:0 10: ./Castro2d.gnu.TEST.MPI.ex() [0x452806] std::vector >::_M_default_append(unsigned long) ??:? 11: ./Castro2d.gnu.TEST.MPI.ex() [0x4fe311] std::vector >::resize(unsigned long) /usr/include/c++/7/bits/stl_vector.h:692 amrex::CoordSys::GetCellLoc(amrex::Vector >&, amrex::Box const&, int) const /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_CoordSys.cpp:375 12: ./Castro2d.gnu.TEST.MPI.ex() [0x592e05] amrex::LayoutData > >::operator[](amrex::MFIter const&) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_LayoutData.H:42 amrex::MLCellLinOp::MetricFactor::MetricFactor(amrex::BoxArray const&, amrex::DistributionMapping const&, amrex::Geometry const&, bool) /raid/testing/castro-gfortran/AMReX//Src/LinearSolvers/MLMG/AMReX_MLCellLinOp.cpp:788 13: ./Castro2d.gnu.TEST.MPI.ex() [0x598bcf] std::enable_if >, std::is_move_constructible, std::is_move_assignable >::value, void>::type std::swap(amrex::MLCellLinOp::MetricFactor*&, amrex::MLCellLinOp::MetricFactor*&) /usr/include/c++/7/bits/move.h:198 std::unique_ptr >::reset(amrex::MLCellLinOp::MetricFactor*) /usr/include/c++/7/bits/unique_ptr.h:374 amrex::MLCellLinOp::defineAuxData() /raid/testing/castro-gfortran/AMReX//Src/LinearSolvers/MLMG/AMReX_MLCellLinOp.cpp:85 14: ./Castro2d.gnu.TEST.MPI.ex() [0x598fc1] amrex::MLCellLinOp::define(amrex::Vector > const&, amrex::Vector > const&, amrex::Vector > const&, amrex::LPInfo const&, amrex::Vector const*, std::allocator const*> > const&) /raid/testing/castro-gfortran/AMReX//Src/LinearSolvers/MLMG/AMReX_MLCellLinOp.cpp:25 15: ./Castro2d.gnu.TEST.MPI.ex() [0x5a7a8c] std::vector >, std::allocator > > >::resize(unsigned long) /usr/include/c++/7/bits/stl_vector.h:691 amrex::MLABecLaplacian::define(amrex::Vector > const&, amrex::Vector > const&, amrex::Vector > const&, amrex::LPInfo const&, amrex::Vector const*, std::allocator const*> > const&) /raid/testing/castro-gfortran/AMReX//Src/LinearSolvers/MLMG/AMReX_MLABecLaplacian.cpp:30 16: ./Castro2d.gnu.TEST.MPI.ex() [0x5a82bb] amrex::MLABecLaplacian::MLABecLaplacian(amrex::Vector > const&, amrex::Vector > const&, amrex::Vector > const&, amrex::LPInfo const&, amrex::Vector const*, std::allocator const*> > const&) /raid/testing/castro-gfortran/AMReX//Src/LinearSolvers/MLMG/AMReX_MLABecLaplacian.cpp:17 17: ./Castro2d.gnu.TEST.MPI.ex() [0x45f7e0] std::vector >::~vector() /usr/include/c++/7/bits/stl_vector.h:434 Diffusion::applyop_mlmg(int, amrex::MultiFab&, amrex::MultiFab&, amrex::MultiFab&, amrex::Vector >, std::allocator > > >&) /raid/testing/castro-gfortran/AMReX//Src/Base/AMReX_Vector.H:20 18: ./Castro2d.gnu.TEST.MPI.ex() [0x45c368] Castro::getTempDiffusionTerm(double, amrex::MultiFab&, amrex::MultiFab&) /raid/testing/castro-gfortran/Castro//Source/diffusion/Castro_diffusion.cpp:172 19: ./Castro2d.gnu.TEST.MPI.ex() [0x45e484] Castro::add_temp_diffusion_to_source(amrex::MultiFab&, amrex::MultiFab&, amrex::MultiFab&, double, double) /raid/testing/castro-gfortran/Castro//Source/diffusion/Castro_diffusion.cpp:72 20: ./Castro2d.gnu.TEST.MPI.ex() [0x45e6a2] Castro::construct_old_diff_source(amrex::MultiFab&, amrex::MultiFab&, double, double) /raid/testing/castro-gfortran/Castro//Source/diffusion/Castro_diffusion.cpp:17 21: ./Castro2d.gnu.TEST.MPI.ex() [0x4418c7] Castro::do_old_sources(amrex::MultiFab&, amrex::MultiFab&, double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/sources/Castro_sources.cpp:91 (discriminator 2) 22: ./Castro2d.gnu.TEST.MPI.ex() [0x4215f0] Castro::do_advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:243 23: ./Castro2d.gnu.TEST.MPI.ex() [0x421af4] Castro::subcycle_advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:1242 24: ./Castro2d.gnu.TEST.MPI.ex() [0x42488a] Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:103 25: ./Castro2d.gnu.TEST.MPI.ex() [0x539748] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:1948 26: ./Castro2d.gnu.TEST.MPI.ex() [0x53983e] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:2005 27: ./Castro2d.gnu.TEST.MPI.ex() [0x52e13b] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/AMReX//Src/Amr/AMReX_Amr.cpp:2162 28: ./Castro2d.gnu.TEST.MPI.ex() [0x408cca] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:132 29: /lib64/libc.so.6(__libc_start_main+0xea) [0x7f6fa471ff2a] ?? ??:0 30: ./Castro2d.gnu.TEST.MPI.ex() [0x40db2a] _start ??:?