=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x5ec826] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:179:39 1: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x5ee99d] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:85:15 2: /lib64/libc.so.6(+0x3da60) [0x7f0a8c543a60] __restore_rt ??:0 3: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x594a3a] void amrex::Subtract(amrex::FabArray&, amrex::FabArray const&, int, int, int, amrex::IntVect const&) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_FabArrayUtility.H:1537:13 4: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x59007f] amrex::MultiFab::Subtract(amrex::MultiFab&, amrex::MultiFab const&, int, int, int, amrex::IntVect const&) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_MultiFab.cpp:238:13 in amrex::MultiFab::minus(amrex::MultiFab const&, int, int, int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_MultiFab.cpp:249:5 amrex::MultiFab::Subtract(amrex::MultiFab&, amrex::MultiFab const&, int, int, int, int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_MultiFab.cpp:238:13 amrex::MultiFab::minus(amrex::MultiFab const&, int, int, int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_MultiFab.cpp:1096:23 5: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x4d43a3] Gravity::create_comp_minus_level_grad_phi(int, amrex::MultiFab&, amrex::Vector > const&, amrex::MultiFab&, amrex::Vector >, std::allocator > > >&) /raid/testing/castro-gfortran/Castro//Source/gravity/Gravity.cpp:1199:23 6: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x4ed927] std::vector >::~vector() inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:25:7 in Castro::construct_old_gravity(int, int, double) /usr/include/c++/10/bits/stl_vector.h:680:15 amrex::Vector >::~Vector() /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:25:7 Castro::construct_old_gravity(int, int, double) /raid/testing/castro-gfortran/Castro//Source/gravity/Castro_gravity.cpp:81:74 7: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x456e4a] std::__uniq_ptr_impl >::_M_ptr() const inlined at /usr/include/c++/10/bits/unique_ptr.h:422:27 in Castro::do_advance_ctu(double, double, int, int) /usr/include/c++/10/bits/unique_ptr.h:173:58 std::unique_ptr >::get() const /usr/include/c++/10/bits/unique_ptr.h:422:27 std::unique_ptr >::operator*() const /usr/include/c++/10/bits/unique_ptr.h:408:13 amrex::StateData::oldData() /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_StateData.H:341:77 amrex::AmrLevel::get_old_data(int) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_AmrLevel.H:304:89 Castro::do_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:127:52 8: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x4579ad] advance_status::operator=(advance_status&&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:645:90 in Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro.H:133:8 Castro::subcycle_advance_ctu(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_ctu.cpp:645:90 9: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x45638a] double const& std::min(double const&, double const&) inlined at /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 in Castro::advance(double, double, int, int) /usr/include/c++/10/bits/stl_algobase.h:237:14 Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:55:92 10: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x661e79] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:37:59 in amrex::Amr::timeStep(int, double, int, int, double) /usr/include/c++/10/bits/stl_vector.h:1046:39 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:37:59 amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2018:68 11: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x661fd2] amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2061:13 12: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x6584e0] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2125:13 13: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x426d35] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:148:33 14: /lib64/libc.so.6(__libc_start_main+0xf2) [0x7f0a8c52e1e2] __libc_start_main ??:0 15: ./Castro3d.gnu.TEST.TPROF.MPI.ex() [0x42ee3e] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Amr::timeStep() Castro::advance() Castro::subcycle_advance_ctu() Castro::do_advance_ctu() Castro::construct_old_gravity() Gravity::create_comp_minus_level_grad_phi() MultiFab::Subtract()