=== If no file names and line numbers are shown below, one can run addr2line -Cpfie my_exefile my_line_address to convert `my_line_address` (e.g., 0x4a6b) into file name and line number. Or one can use amrex/Tools/Backtrace/parse_bt.py. === Please note that the line number reported by addr2line may not be accurate. One can use readelf -wl my_exefile | grep my_line_address' to find out the offset for that line. 0: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x5d0236] amrex::BLBackTrace::print_backtrace_info(_IO_FILE*) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:179:39 1: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x5d23ad] amrex::BLBackTrace::handler(int) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_BLBackTrace.cpp:85:8 2: /lib64/libc.so.6(+0x3da60) [0x7f6d0975ca60] __restore_rt ??:0 3: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x474e9a] sneut5(double, double, double, double, double&, double&, double&, double&, double&) /raid/testing/castro-gfortran/Microphysics//neutrinos/sneut5.H:346:11 4: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x4ed1a2] single_zone_jac(amrex::GpuArray const&, burn_t, amrex::Array2D&) /raid/testing/castro-gfortran/Castro//Source/reactions/Castro_react_util.H:219:24 5: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x4f5898] eos_xderivs_t composition_derivatives(eos_t const&) inlined at /raid/testing/castro-gfortran/Castro//Source/sdc/vode_rhs_true_sdc.H:153:47 in sdc_vode_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) /raid/testing/castro-gfortran/Microphysics//EOS/eos_composition.H:68:32 void jac >(burn_t&, dvode_t&, ArrayUtil::MathArray2D<1, 21, 1, 21>&) /raid/testing/castro-gfortran/Castro//Source/sdc/vode_rhs_true_sdc.H:153:47 dvjac(amrex::Array1D&, int&, burn_t&, dvode_t&) /raid/testing/castro-gfortran/Microphysics//integration/VODE/vode_dvjac.H:84:16 dvnlsd(amrex::Array1D&, int&, burn_t&, dvode_t&) /raid/testing/castro-gfortran/Microphysics//integration/VODE/vode_dvnlsd.H:79:18 dvstep(burn_t&, dvode_t&) /raid/testing/castro-gfortran/Microphysics//integration/VODE/vode_dvstep.H:161:28 dvode(burn_t&, dvode_t&) /raid/testing/castro-gfortran/Microphysics//integration/VODE/vode_dvode.H:182:26 sdc_vode_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:596:23 6: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x4e0ea9] sdc_solve(double, amrex::GpuArray const&, amrex::GpuArray&, amrex::GpuArray const&, int) inlined at /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:690:14 in Castro::do_sdc_update(int, int, double) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:650:23 sdc_solve(int, int, int, double, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:690:14 sdc_update_centers_o4(int, int, int, amrex::Array4 const&, amrex::Array4 const&, amrex::Array4 const&, double, int) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc_util.H:778:18 operator() /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc.cpp:245:38 call_f > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:29:10 ParallelFor > /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_GpuLaunchFunctsC.H:119:23 Castro::do_sdc_update(int, int, double) /raid/testing/castro-gfortran/Castro//Source/sdc/Castro_sdc.cpp:242:31 7: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x452bd1] Castro::do_advance_sdc(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance_sdc.cpp:224:18 8: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x44e5c2] Castro::advance(double, double, int, int) /raid/testing/castro-gfortran/Castro//Source/driver/Castro_advance.cpp:62:42 9: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x621249] std::vector >::operator[](unsigned long) inlined at /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:36:52 in amrex::Amr::timeStep(int, double, int, int, double) /usr/include/c++/10/bits/stl_vector.h:1046:39 amrex::Vector >::operator[](unsigned long) /raid/testing/castro-gfortran/amrex//Src/Base/AMReX_Vector.H:36:52 amrex::Amr::timeStep(int, double, int, int, double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:1990:68 10: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x618ce0] amrex::Amr::coarseTimeStep(double) /raid/testing/castro-gfortran/amrex//Src/Amr/AMReX_Amr.cpp:2097:13 11: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x423d55] main /raid/testing/castro-gfortran/Castro//Source/driver/main.cpp:143:33 12: /lib64/libc.so.6(__libc_start_main+0xf2) [0x7f6d097471e2] __libc_start_main ??:0 13: ./Castro1d.gnu.TEST.TPROF.MPI.TRUESDC.ex() [0x43222e] _start ??:0 ===== TinyProfilers ====== main() Amr::coarseTimeStep() Amr::timeStep() Castro::advance() Castro::do_advance_sdc() Castro::do_sdc_update()