GitHub pull request #3154 of commit 11c93f613b43e296f949a231684d544016fd0bcb, has merge conflicts.sha111c93f613b43e296f949a231684d544016fd0bcbghprbActualCommit11c93f613b43e296f949a231684d544016fd0bcbghprbActualCommitAuthorYonghong SongghprbActualCommitAuthorEmailyhs@fb.comghprbAuthorRepoGitUrlhttps://github.com/iovisor/bcc.gitghprbTriggerAuthorghprbTriggerAuthorEmailghprbTriggerAuthorLoginghprbTriggerAuthorLoginMentionghprbPullId3154ghprbTargetBranchmasterghprbSourceBranchyhs_devGIT_BRANCHyhs_devghprbPullAuthorEmailghprbPullAuthorLoginyonghong-songghprbPullAuthorLoginMention@yonghong-songghprbPullDescriptionGitHub pull request #3154 of commit 11c93f613b43e296f949a231684d544016fd0bcb, has merge conflicts.ghprbPullTitlefix compilation issues with latest llvm12 trunkghprbPullLinkhttps://github.com/iovisor/bcc/pull/3154ghprbPullLongDescriptionWith latest llvm12 trunk, we got two compilation bugs.\r\n\r\nBug #1:\r\n /home/yhs/work/bcc/src/cc/frontends/clang/b_frontend_action.cc:\r\n In member function ‘void ebpf::BFrontendAction::DoMiscWorkAround()’:\r\n /home/yhs/work/bcc/src/cc/frontends/clang/b_frontend_action.cc:1706:31:\r\n error: ‘class clang::SourceManage’ has no member named ‘getBuffer’; did you mean ‘getBufferData’?\r\n rewriter_->getSourceMgr().getBuffer(rewriter_->getSourceMgr().getMainFileID())->getBufferSize(),\r\n ^~~~~~~~~\r\n getBufferData\r\n\r\n This is due to upstream change https://reviews.llvm.org/D89394.\r\n To fix, follow upstream examples in https://reviews.llvm.org/D89394.\r\n\r\nBug #2:\r\n /home/yhs/work/bcc/src/cc/bpf_module.cc: In member function ‘int ebpf::BPFModule::finalize()’:\r\n /home/yhs/work/bcc/src/cc/bpf_module.cc:470:11:\r\n error: ‘class llvm::EngineBuilder’ has no member named ‘setUseOrcMCJITReplacement’\r\n builder.setUseOrcMCJITReplacement(false);\r\n ^~~~~~~~~~~~~~~~~~~~~~~~~\r\n\r\n This is due to upstream\r\n https://github.com/llvm/llvm-project/commit/6154c4115cd4b78d0171892aac21e340e72e32bd\r\n\r\n It seems builder.setUseOrcMCJITReplacement() is not needed any more. So just remove it\r\n from bcc.\r\n\r\nSigned-off-by: Yonghong Song <yhs@fb.com>ghprbCommentBodynullghprbGhRepositoryiovisor/bccghprbCredentialsId6d3daf13-69b8-48b1-9c8f-ec535326411373811c93f613b43e296f949a231684d544016fd0bcb11c93f613b43e296f949a231684d544016fd0bcbdetached11c93f613b43e296f949a231684d544016fd0bcb11c93f613b43e296f949a231684d544016fd0bcbdetached11c93f613b43e296f949a231684d544016fd0bcb11c93f613b43e296f949a231684d544016fd0bcbdetachedhttps://github.com/iovisor/bcc.gitfalse<a title="fix compilation issues with latest llvm12 trunk" href="https://github.com/iovisor/bcc/pull/3154">PR #3154</a>: fix compilation issues with...#73812218867460664bcc-pr #738738false7385913SUCCESS1604471102150https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/738/- src/cc/frontends/clang/kbuild_helper.ccc31e9d6c80f70ff39dff14a7ab3ebec07bec0c7f1595355915000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comAdjust the order of linux kernel header include paths
The current order of include paths could cause the following error:
In file included from /virtual/main.c:3:
In file included from include/linux/sched.h:13:
In file included from include/linux/pid.h:4:
In file included from include/linux/rculist.h:10:
In file included from include/linux/rcupdate.h:38:
In file included from include/linux/spinlock.h:50:
In file included from include/linux/preempt.h:80:
In file included from /lib/modules/4.12.14-197.45-default/build/arch/s390/include/generated/asm/preempt.h:1:
include/asm-generic/preempt.h:10:42: error: no member named 'preempt_count' in 'struct thread_info'
return READ_ONCE(current_thread_info()->preempt_count);
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~
include/linux/compiler.h:349:34: note: expanded from macro 'READ_ONCE'
~~~~~~~~~~~~^~~~~
include/linux/compiler.h:342:17: note: expanded from macro '__READ_ONCE'
union { typeof(x) __val; char __c[1]; } __u;
\
...
7 errors generated.
It's supposed to load "asm/preempt.h" from "source/"(*) but accidentally
loaded the one from "build/", so the error showed.
(x86_64 didn't suffer this error because it didn't install the extra
"asm/preempt.h" to "build/".)
For the distros, e.g. SUSE/openSUSE and debian, with separate "build/"
and "source/", all those "generated/" paths only exist in "build/". To
avoid the potential compilation issue, this commit adjusts the include
order for those with split headers to align the include order from
kernel top Makefile.
(*) /lib/modules/4.12.14-197.45-default/source/arch/s390/include/
Signed-off-by: Gary Lin <glin@suse.com>
2020-07-21 11:25:15 -0700c31e9d6c80f70ff39dff14a7ab3ebec07bec0c7fAdjust the order of linux kernel header include pathseditsrc/cc/frontends/clang/kbuild_helper.cc
- libbpf-tools/bin/bpftoollibbpf-tools/tcpconnect.bpf.ca02663be278012a4d0aea357023ea145c1b1c0d91595453158000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: update bpftool and fix .rodata hack
Update bpftool to the latest version, handing const volatile arrays properly
when generating BPF skeletons. Fix tcpconnect tool hack to work around that
issue.
Signed-off-by: Andrii Nakryiko <andriin@fb.com>
2020-07-22 14:25:58 -0700a02663be278012a4d0aea357023ea145c1b1c0d9libbpf-tools: update bpftool and fix .rodata hackeditlibbpf-tools/tcpconnect.bpf.ceditlibbpf-tools/bin/bpftool
- src/cc/libbpf.cba0bacf1714c37e4e99dbdef5559039c28aa7aef1595482811000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comAdd return value check and handling for xattr loading
libbpf_find_vmlinux_btf_id may return error code for different reasons. We
should check and report the error we have just got, rather than let it slip
down the path and give an ambiguous error later.
Signed-off-by: He Zhe <zhe.he@windriver.com>
2020-07-22 22:40:11 -0700ba0bacf1714c37e4e99dbdef5559039c28aa7aefAdd return value check and handling for xattr loadingeditsrc/cc/libbpf.c
- tools/opensnoop.py6889afe0858b38b93f2a2da3ca538343d05f59301595482811000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtools/opensnoop: Snoop all open related syscall stubs
kernel v5.6 introduces fddb5d430ad9 ("open: introduce openat2(2) syscall").
Even though do_sys_open still exists, it might be optimized off final binary
depending on compilers. So we can't catch do_sys_open in some cases.
This patch uses ksymname to try to get entries of open, openat and openat2,
and changes the definitions of the trace functions to snoop them all. This
works for both kprobe and kfunc.
Credit to Yonghong Song for better code organization.
Signed-off-by: He Zhe <zhe.he@windriver.com>
2020-07-22 22:40:11 -07006889afe0858b38b93f2a2da3ca538343d05f5930tools/opensnoop: Snoop all open related syscall stubsedittools/opensnoop.py
- man/man8/tcpconnect.87ce6f646ec6002c0f9a2f2742dc63ed2613b13c31596124943000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comman: fix tcpconnect man page
Add -u and -U options to the synopsis.
Move their description frome the example to the description section.
Add a description to --mntnsmap option.
2020-07-30 09:02:23 -07007ce6f646ec6002c0f9a2f2742dc63ed2613b13c3man: fix tcpconnect man pageeditman/man8/tcpconnect.8
- docs/reference_guide.mdexamples/tracing/hello_perf_output_using_ns.py7928ea0cd71aa8e794ed5ffdf0a6ff1004ab28491596132569000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comAdd example for new helper to documentation.
2020-07-30 11:09:29 -07007928ea0cd71aa8e794ed5ffdf0a6ff1004ab2849Add example for new helper to documentation.editdocs/reference_guide.mdaddexamples/tracing/hello_perf_output_using_ns.py
- libbpf-tools/biopattern.hlibbpf-tools/biopattern.clibbpf-tools/.gitignorelibbpf-tools/Makefilelibbpf-tools/biopattern.bpf.cca5bcd21468709f0fb0e6c8122a48f859d80769b1596132700000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add CO-RE biopattern
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-07-30 11:11:40 -0700ca5bcd21468709f0fb0e6c8122a48f859d80769blibbpf-tools: add CO-RE biopatterneditlibbpf-tools/.gitignoreeditlibbpf-tools/Makefileaddlibbpf-tools/biopattern.bpf.caddlibbpf-tools/biopattern.caddlibbpf-tools/biopattern.h
- libbpf-tools/tcpconnlat.hlibbpf-tools/.gitignorelibbpf-tools/tcpconnlat.bpf.clibbpf-tools/Makefilelibbpf-tools/tcpconnlat.cb6ffa245cc4cd1ba41600f10062f820b6452a69d1596132735000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add CO-RE tcpconnlat
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-07-30 11:12:15 -0700b6ffa245cc4cd1ba41600f10062f820b6452a69dlibbpf-tools: add CO-RE tcpconnlateditlibbpf-tools/.gitignoreaddlibbpf-tools/tcpconnlat.haddlibbpf-tools/tcpconnlat.bpf.ceditlibbpf-tools/Makefileaddlibbpf-tools/tcpconnlat.c
- src/cc/libbpfintrospection/bps.csrc/cc/compat/linux/virtual_bpf.hsrc/cc/export/helpers.h8a164f95ee708495a89a43a243fdb5c8b7eee2901596136613000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comsync with latest libbpf repo
sync with latest libbpf repo
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-07-30 12:16:53 -07008a164f95ee708495a89a43a243fdb5c8b7eee290sync with latest libbpf repoeditsrc/cc/libbpfeditintrospection/bps.ceditsrc/cc/export/helpers.heditsrc/cc/compat/linux/virtual_bpf.h
- libbpf-tools/biosnoop.clibbpf-tools/biosnoop.bpf.clibbpf-tools/biosnoop.hlibbpf-tools/Makefilelibbpf-tools/.gitignoree0e2215833999998b9d654a0a5056d889457b0051596346023000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add CO-RE biosnoop
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-08-01 22:27:03 -0700e0e2215833999998b9d654a0a5056d889457b005libbpf-tools: add CO-RE biosnoopeditlibbpf-tools/Makefileaddlibbpf-tools/biosnoop.heditlibbpf-tools/.gitignoreaddlibbpf-tools/biosnoop.bpf.caddlibbpf-tools/biosnoop.c
- libbpf-tools/maps.bpf.hlibbpf-tools/tcpconnect.bpf.clibbpf-tools/tcpconnect.cf8ac3c6c14519d9d35c88260473585861060d0581596346041000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.com libbpf-tools: fix tcpconnect compile errors
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-08-01 22:27:21 -0700f8ac3c6c14519d9d35c88260473585861060d058libbpf-tools: fix tcpconnect compile errorseditlibbpf-tools/maps.bpf.heditlibbpf-tools/tcpconnect.bpf.ceditlibbpf-tools/tcpconnect.c
- tools/trace.pyd7b427ebc35b4b3e77c7f8dae6a83fcdf7d32e6d1596470669000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comOffset support for uprobe and kprobe
2020-08-03 09:04:29 -0700d7b427ebc35b4b3e77c7f8dae6a83fcdf7d32e6dOffset support for uprobe and kprobeedittools/trace.py
- man/man8/trace.8tools/trace_example.txt8105317c3bbe531801eb03324371462d627cf0ad1596470669000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comUpdate the documentation of the k/uprobe offset support
2020-08-03 09:04:29 -07008105317c3bbe531801eb03324371462d627cf0adUpdate the documentation of the k/uprobe offset supportedittools/trace_example.txteditman/man8/trace.8
- tools/trace_example.txt6432324310b4e46057ca5f55e1d7f16b3b0324971596470669000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtypos
2020-08-03 09:04:29 -07006432324310b4e46057ca5f55e1d7f16b3b032497typosedittools/trace_example.txt
- src/cc/compat/linux/virtual_bpf.hsrc/cc/libbpf9ef20e7aa61f6a4d7576f906fdaf32329bec34bc1597070789000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comsync with latest libbpf repo
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-08-10 07:46:29 -07009ef20e7aa61f6a4d7576f906fdaf32329bec34bcsync with latest libbpf repoeditsrc/cc/libbpfeditsrc/cc/compat/linux/virtual_bpf.h
- src/cc/CMakeLists.txt3fbb6648e9d843c5e835f0b26713b0656cb684a71597276331000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comFixes a problem when LLVM_DEFINITIONS contains a definition with an `=` in it.
add_definitions doesn't seem to parse this type of argument correctly.
2020-08-12 16:52:11 -07003fbb6648e9d843c5e835f0b26713b0656cb684a7Fixes a problem when LLVM_DEFINITIONS contains a definition with an `=` in it.editsrc/cc/CMakeLists.txt
- tools/fileslower.pyb61e65ffe1cd41fb9fe01118540158f98737996e1597276423000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.combcc/tools/fileslower: Attach to vfs_read after failing to attach __vfs_read
__vfs_read has been removed since kernel v5.8-rc5
775802c0571f ("fs: remove __vfs_read"). Then try vfs_read instead.
Signed-off-by: He Zhe <zhe.he@windriver.com>
2020-08-12 16:53:43 -0700b61e65ffe1cd41fb9fe01118540158f98737996ebcc/tools/fileslower: Attach to vfs_read after failing to attach __vfs_readedittools/fileslower.py
- libbpf-tools/tcpconnect.hlibbpf-tools/tcpconnect.c5c272220f1cf8a3bb8fd6814c963b3f9b271fe3a1597373191000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpibbpf-tools: fix tcpconnect types usage
The __int128 is not defined for 32-bit platforms, see [1], so replace it by
a portable array of __u8.
The usage of this type came from the original tcpconnect.py, and __int128 is
still used in most (if not all) original BCC tools to store IPv6 addresses.
[1] https://github.com/iovisor/bcc/issues/3044
Signed-off-by: Anton Protopopov <a.s.protopopov@gmail.com>
2020-08-13 19:46:31 -07005c272220f1cf8a3bb8fd6814c963b3f9b271fe3alibbpibbpf-tools: fix tcpconnect types usageeditlibbpf-tools/tcpconnect.ceditlibbpf-tools/tcpconnect.h
- libbpf-tools/readahead.bpf.clibbpf-tools/readahead.clibbpf-tools/.gitignorelibbpf-tools/Makefilelibbpf-tools/readahead.hfb54a822d54ab80e6e36755e7de5285e6f06f4101597378175000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add CO-RE readahead
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-08-13 21:09:35 -0700fb54a822d54ab80e6e36755e7de5285e6f06f410libbpf-tools: add CO-RE readaheadaddlibbpf-tools/readahead.bpf.ceditlibbpf-tools/.gitignoreeditlibbpf-tools/Makefileaddlibbpf-tools/readahead.caddlibbpf-tools/readahead.h
- libbpf-tools/tcpconnlat.hlibbpf-tools/tcpconnlat.c7d081eb03d8a3412cfcdcf2a5cfc99047eb08bc11597559037000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: fix tcpconnlat types usage
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-08-15 23:23:57 -07007d081eb03d8a3412cfcdcf2a5cfc99047eb08bc1libbpf-tools: fix tcpconnlat types usageeditlibbpf-tools/tcpconnlat.heditlibbpf-tools/tcpconnlat.c
- docs/reference_guide.md639e83ff2a57eacac315f0389f79ae331eaf3e5c1597686399000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comdocs: fix broken links
2020-08-17 10:46:39 -0700639e83ff2a57eacac315f0389f79ae331eaf3e5cdocs: fix broken linkseditdocs/reference_guide.md
- src/python/bcc/__init__.py49beed88ee27c8f86e50ac29064664671757d9301597883349000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comForbid trampolines for archs other than x86_64
The trampoline support check in bcc does not work properly,
so the feature is detected even on architectures that do not
support it - all archs other than x86_64.
We are checking for bpf_trampoline_link_prog to exist in
kernel, which works fine on x86_64 to check if the feature
is supported, but it's global function, so it exists also
in other archs even when the feature is not supported
so it returns True also on other archs.
Adding explicit x86_64 check to support_kfunc function.
Signed-off-by: Jiri Olsa <jolsa@kernel.org>
2020-08-19 17:29:09 -070049beed88ee27c8f86e50ac29064664671757d930Forbid trampolines for archs other than x86_64editsrc/python/bcc/__init__.py
- docs/kernel-versions.mde73e1f67b0167edbbe2e261997e3ae9e72e237571597883458000https://buildbot.iovisor.org/jenkins/user/noreplynoreplynoreply@github.comkernel-versions.md: document map UAPI features (#3058)
Document kernel versions for userspace API features regarding map manipulation.
2020-08-19 17:30:58 -0700e73e1f67b0167edbbe2e261997e3ae9e72e23757kernel-versions.md: document map UAPI features (#3058)editdocs/kernel-versions.md
- man/man8/funccount.8tools/funccount_example.txttools/funccount.pyf4e65ac41bec1613c7cb54270f09d16411aaf89c1597985973000https://buildbot.iovisor.org/jenkins/user/noreplynoreplynoreply@github.comtools/funccount: support funccount on specified CPU (#3059)
A typical case of this feature: count timer setting on a x86 server
for each CPU:
for i in `seq 0 39`;
do ./funccount.py -i 1 lapic_next_deadline -d 5 -c $i;
done
Then we can know the timer setting is balanced of not and do some
futher work.
Signed-off-by: zhenwei pi <pizhenwei@bytedance.com>
2020-08-20 21:59:33 -0700f4e65ac41bec1613c7cb54270f09d16411aaf89ctools/funccount: support funccount on specified CPU (#3059)edittools/funccount_example.txteditman/man8/funccount.8edittools/funccount.py
- src/python/bcc/__init__.py785924b337f27c6e09b5a83ae4afac3d3c3fec7a1597987313000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comExtend PerfType members
You can use
b.attach_perf_event(ev_type=PerfType.RAW, ...)
to attach perf raw event for profiling.
Signed-off-by: Edward Wu <edwardwu@realtek.com>
2020-08-20 22:21:53 -0700785924b337f27c6e09b5a83ae4afac3d3c3fec7aExtend PerfType memberseditsrc/python/bcc/__init__.py
- libbpf-tools/biostacks.bpf.clibbpf-tools/biostacks.hlibbpf-tools/trace_helpers.clibbpf-tools/trace_helpers.hlibbpf-tools/biostacks.clibbpf-tools/Makefilelibbpf-tools/.gitignore71c22fcaa688a1aea92a9588b1a60a7e2329f38b1597988734000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add CO-RE biostacks
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-08-20 22:45:34 -070071c22fcaa688a1aea92a9588b1a60a7e2329f38blibbpf-tools: add CO-RE biostacksaddlibbpf-tools/biostacks.ceditlibbpf-tools/Makefileeditlibbpf-tools/.gitignoreeditlibbpf-tools/trace_helpers.haddlibbpf-tools/biostacks.bpf.caddlibbpf-tools/biostacks.heditlibbpf-tools/trace_helpers.c
- src/cc/libbpfa79ec23adac0b267f1547b938392121da7403eea1598122173000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comsync libbpf repo release 0.1.0
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-08-22 11:49:33 -0700a79ec23adac0b267f1547b938392121da7403eeasync libbpf repo release 0.1.0editsrc/cc/libbpf
- debian/changelogfecd934a9c0ff581890d218ff6c5101694e9b3261598132087000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comprepare for release v0.16.0
add changelog for release v0.16.0
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-08-22 14:34:47 -0700fecd934a9c0ff581890d218ff6c5101694e9b326prepare for release v0.16.0editdebian/changelog
- src/cc/libbpfsrc/cc/bcc_btf.hsrc/cc/compat/linux/virtual_bpf.hsrc/cc/bcc_btf.cc43910c44121999592833cf20e8334997f2b6c4701598136722000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comsync with libbpf repo
sync with latest libbpf repo.
Strut definition for btf_ext_header is defined in libbpf/src/btf.h
previously and used by bcc. Now, the struct is moved to
libbpf/src/libbpf_internal.h and not available to bcc.
We do not want to include libbpf/src/libbpf_internal.h as
it is really libbpf internal. Let us define bcc version
of btf_ext_header with struct name bcc_btf_ext_header.
The new name is to avoid conflict when compiling with
old libbpf package.
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-08-22 15:52:02 -070043910c44121999592833cf20e8334997f2b6c470sync with libbpf repoeditsrc/cc/compat/linux/virtual_bpf.heditsrc/cc/libbpfeditsrc/cc/bcc_btf.cceditsrc/cc/bcc_btf.h
- src/python/bcc/__init__.py60de17161fe7f44b534a8da343edbad2427220e31598593844000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comfix the exits abnormal due to trace buffer
Some data may be left in the trace buffer, and the format cannot be
parsed by trace_fields(), which whill cause an abnormality in the
system.
Re-running the program cannot solved, only restart kernel.
Call trace:
File "/usr/lib/python2.7/site-packages/kwaibcc/__init__.py", line 1273, in trace_fields
pid, cpu, flags, ts = line[:ts_end].split()
ValueError: need more than 2 values to unpack
Prevent problems with exception handling.
Signed-off-by: Chen Guanqiao <chen.chenchacha@foxmail.com>
2020-08-27 22:50:44 -070060de17161fe7f44b534a8da343edbad2427220e3fix the exits abnormal due to trace buffereditsrc/python/bcc/__init__.py
- docs/tutorial_bcc_python_developer.mdfc92caa08f52533dd18cff6bf9e3438c75ca5cb31598595486000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comdoc: fix mismatched link
Signed-off-by: zhuangqh <zhuangqhc@gmail.com>
2020-08-27 23:18:06 -0700fc92caa08f52533dd18cff6bf9e3438c75ca5cb3doc: fix mismatched linkeditdocs/tutorial_bcc_python_developer.md
- tools/capable.py0e7304eab277320bf0b0014a3940541aadea03e01599005285000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtools/capable: support new capabilities
This commit adds the support of below capabilities.
* CAP_PERFMON
* CAP_BPF
* CAP_CHECKPOINT_RESTORE
Signed-off-by: Kenta Tada <Kenta.Tada@sony.com>
2020-09-01 17:08:05 -07000e7304eab277320bf0b0014a3940541aadea03e0tools/capable: support new capabilitiesedittools/capable.py
- examples/networking/http_filter/http-parse-complete.cexamples/networking/http_filter/http-parse-simple.cexamples/networking/vlan_filter/data-plane-tracing.c892475f3c9a98fba4188a5077623e44e2fca9c5e1599005300000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comfix retruning typo
2020-09-01 17:08:20 -0700892475f3c9a98fba4188a5077623e44e2fca9c5efix retruning typoeditexamples/networking/http_filter/http-parse-complete.ceditexamples/networking/http_filter/http-parse-simple.ceditexamples/networking/vlan_filter/data-plane-tracing.c
- tests/cc/test_usdt_args.cc43440348edc4e4687e370427f66a16fca0f34e911599059209000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtests: only run arg parser test on supported arches
Fixes #3077
Signed-off-by: Rafael Fonseca <r4f4rfs@gmail.com>
2020-09-02 08:06:49 -070043440348edc4e4687e370427f66a16fca0f34e91tests: only run arg parser test on supported archesedittests/cc/test_usdt_args.cc
- INSTALL.md7ac370b97bc9284105598460160875b2e52350181599594474000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comAdd instructions on how to install amazon linux 2 from source
2020-09-08 12:47:54 -07007ac370b97bc9284105598460160875b2e5235018Add instructions on how to install amazon linux 2 from sourceeditINSTALL.md
- tools/memleak.pyb8e661fb8238cdf3b2cfa6575e843dc3a2f7f3ec1599633795000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.commemleak: fix false positive on failed allocations
memleak tool reports a failed allocation as a leak,
because the NULL address is never freed.
Signed-off-by: Amir Goldstein <amir73il@gmail.com>
2020-09-08 23:43:15 -0700b8e661fb8238cdf3b2cfa6575e843dc3a2f7f3ecmemleak: fix false positive on failed allocationsedittools/memleak.py
- tools/tcprtt_example.txtman/man8/tcprtt.8tools/tcprtt.pye42ac4176998a6dcf0dbf3b6befeaad0a69cb98a1599633896000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtools/tcprtt: add tcprtt to trace the RTT of TCP
This program traces TCP RTT(round-trip time) to analyze the quality of
network, then help us to distinguish the network latency trouble is
from user process or physical network.
Currently, support source address/port and destination address/port as
tcp filter.
Suggested-by: Edward Wu <edwardwu@realtek.com>
Suggested-by: Martin KaFai Lau <kafai@fb.com>
Signed-off-by: zhenwei pi <pizhenwei@bytedance.com>
2020-09-08 23:44:56 -0700e42ac4176998a6dcf0dbf3b6befeaad0a69cb98atools/tcprtt: add tcprtt to trace the RTT of TCPaddtools/tcprtt_example.txtaddman/man8/tcprtt.8addtools/tcprtt.py
- tools/netqtop.ctools/netqtop.pytools/netqtop_example.txtman/man8/netqtop.8README.mdba73657cb8c4dab83dfb89eed4a8b3866255569a1599847529000https://buildbot.iovisor.org/jenkins/user/noreplynoreplynoreply@github.comNetqtop 3037 (#3048)
The tool netqtop uses tracepoints NET_DEV_START_XMIT and NETIF_RECEIVE_SKB to intercept every transmitted and received packet, as a result, considerable performance descent is expected.
Details for some performance evaluation can be found at
https://github.com/iovisor/bcc/pull/3048
2020-09-11 11:05:29 -0700ba73657cb8c4dab83dfb89eed4a8b3866255569aNetqtop 3037 (#3048)addman/man8/netqtop.8addtools/netqtop.pyaddtools/netqtop.ceditREADME.mdaddtools/netqtop_example.txt
- tools/threadsnoop_example.txttools/threadsnoop.pyman/man8/threadsnoop.8README.md3f95637a304d09921b880b6ba6d2fd04a19514fb1600322181000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comadd threadsnoop
2020-09-16 22:56:21 -07003f95637a304d09921b880b6ba6d2fd04a19514fbadd threadsnoopaddtools/threadsnoop_example.txtaddman/man8/threadsnoop.8addtools/threadsnoop.pyeditREADME.md
- tools/tcpsynbl.pyman/man8/tcpsynbl.8tools/tcpsynbl_example.txtREADME.md12c234f9f68149ab3225a057d011d362416a42f81600322181000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comadd tcpsynbl
2020-09-16 22:56:21 -070012c234f9f68149ab3225a057d011d362416a42f8add tcpsynbladdtools/tcpsynbl_example.txtaddtools/tcpsynbl.pyaddman/man8/tcpsynbl.8editREADME.md
- tools/swapin_example.pyman/man8/swapin.8tools/swapin.pyREADME.mdda8c6a9a3278545842557cb50671a9e051de173c1600322181000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comadd swapin
2020-09-16 22:56:21 -0700da8c6a9a3278545842557cb50671a9e051de173cadd swapinaddtools/swapin_example.pyaddtools/swapin.pyaddman/man8/swapin.8editREADME.md
- libbpf-tools/hardirqs.hlibbpf-tools/hardirqs.bpf.clibbpf-tools/hardirqs.clibbpf-tools/.gitignorelibbpf-tools/Makefile3953c6001e8ee67b9c01abeb0405ffd973f386421600322388000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add hardirqs
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-09-16 22:59:48 -07003953c6001e8ee67b9c01abeb0405ffd973f38642libbpf-tools: add hardirqseditlibbpf-tools/.gitignoreaddlibbpf-tools/hardirqs.bpf.caddlibbpf-tools/hardirqs.heditlibbpf-tools/Makefileaddlibbpf-tools/hardirqs.c
- libbpf-tools/softirqs.clibbpf-tools/softirqs.bpf.clibbpf-tools/softirqs.hlibbpf-tools/.gitignorelibbpf-tools/Makefilebf4668d4a0c0144f1b5e3ed89696e5493daf3af41600322428000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add softirqs
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-09-16 23:00:28 -0700bf4668d4a0c0144f1b5e3ed89696e5493daf3af4libbpf-tools: add softirqsaddlibbpf-tools/softirqs.caddlibbpf-tools/softirqs.bpf.ceditlibbpf-tools/.gitignoreeditlibbpf-tools/Makefileaddlibbpf-tools/softirqs.h
- libbpf-tools/runqlat.bpf.clibbpf-tools/trace_helpers.clibbpf-tools/runqlat.hlibbpf-tools/trace_helpers.hlibbpf-tools/runqlat.clibbpf-tools/.gitignorelibbpf-tools/Makefile48b7d61681ac6d4a32050d696d2eb9b2dd837c5f1600322481000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add runqlat
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-09-16 23:01:21 -070048b7d61681ac6d4a32050d696d2eb9b2dd837c5flibbpf-tools: add runqlateditlibbpf-tools/trace_helpers.heditlibbpf-tools/.gitignoreeditlibbpf-tools/trace_helpers.ceditlibbpf-tools/Makefileaddlibbpf-tools/runqlat.caddlibbpf-tools/runqlat.bpf.caddlibbpf-tools/runqlat.h
- libbpf-tools/runqlen.hlibbpf-tools/runqlen.clibbpf-tools/trace_helpers.clibbpf-tools/trace_helpers.hlibbpf-tools/runqlen.bpf.clibbpf-tools/Makefilelibbpf-tools/.gitignore911ce07ddf156d23e8aabd30040e94f99ce4e5181600405934000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add runqlen
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-09-17 22:12:14 -0700911ce07ddf156d23e8aabd30040e94f99ce4e518libbpf-tools: add runqleneditlibbpf-tools/Makefileaddlibbpf-tools/runqlen.bpf.ceditlibbpf-tools/.gitignoreaddlibbpf-tools/runqlen.ceditlibbpf-tools/trace_helpers.ceditlibbpf-tools/trace_helpers.haddlibbpf-tools/runqlen.h
- libbpf-tools/numamove.bpf.clibbpf-tools/numamove.clibbpf-tools/.gitignorelibbpf-tools/Makefilecaaeb0a87c95f0dd1ac1f1b0c260ec2f6c8a3c941600405964000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add numamove
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-09-17 22:12:44 -0700caaeb0a87c95f0dd1ac1f1b0c260ec2f6c8a3c94libbpf-tools: add numamoveaddlibbpf-tools/numamove.bpf.ceditlibbpf-tools/.gitignoreeditlibbpf-tools/Makefileaddlibbpf-tools/numamove.c
- examples/tracing/strlen_hist_ifunc.py39a2a8f02cc3871ab375b005a00e296aa668d9ec1600541176000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comAdd uretprobe example for indirect function
Already there is strlen_hist.py as a nice example of uretprobe. But it can
not work correctly if strlen is indirect function(IFUNC). So
strlen_hist_ifunc.py is introduced to show how to use uprobe/uretprobe for
indirect functions.
2020-09-19 11:46:16 -070039a2a8f02cc3871ab375b005a00e296aa668d9ecAdd uretprobe example for indirect functionaddexamples/tracing/strlen_hist_ifunc.py
- tools/tcpstates.pye548dd5728332da4bee048cc1b6775af8183f0401601062915000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtools/tcpstates: remove unnecessary checking of TCP
2020-09-25 12:41:55 -0700e548dd5728332da4bee048cc1b6775af8183f040tools/tcpstates: remove unnecessary checking of TCPedittools/tcpstates.py
- tools/readahead_example.txtREADME.mdtools/readahead.pyman/man8/readahead.8561a71e105985ad04f5eb070b3487f5317f063b31601306263000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtool: port readahead tool to bcc
2020-09-28 08:17:43 -0700561a71e105985ad04f5eb070b3487f5317f063b3tool: port readahead tool to bcceditREADME.mdaddtools/readahead.pyaddtools/readahead_example.txtaddman/man8/readahead.8
- tools/tcprtt_example.txtman/man8/tcprtt.8tools/tcprtt.pyREADME.md4cbcd9afa83226405abd773212ed423c5d06fd261601309258000https://buildbot.iovisor.org/jenkins/user/noreplynoreplynoreply@github.comtcprtt: add --byladdr/--byraddr (#3106)
On a server side, a server listens a local port and accepts lots of
connections. To seperate histogram into views by each remote address,
so add --byraddr to support this.
Suggested-by: Brendan Gregg <brendan.d.gregg@gmail.com>
Signed-off-by: zhenwei pi <pizhenwei@bytedance.com>
2020-09-28 09:07:38 -07004cbcd9afa83226405abd773212ed423c5d06fd26tcprtt: add --byladdr/--byraddr (#3106)editREADME.mdeditman/man8/tcprtt.8edittools/tcprtt.pyedittools/tcprtt_example.txt
- tools/funclatency.pytools/funclatency_example.txtaf90bd470a649e1276a7626edb1e5484f0ece8b31601316096000https://buildbot.iovisor.org/jenkins/user/noreplynoreplynoreply@github.comadd average function latency (#3061)
* add average function latency
* update example.txt
2020-09-28 11:01:36 -0700af90bd470a649e1276a7626edb1e5484f0ece8b3add average function latency (#3061)edittools/funclatency_example.txtedittools/funclatency.py
- tools/slabratetop.py788303ead582d5fc70066443b2a94f5c482b53d91601340802000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comslabratetop: Add memcg_cache_params struct def
struct memcg_cache_params moved from include/linux/slab.h to
mm/slab.h in kernel v5.4, causing a compiler error when including
slub_def.h or slab_def.h in slabratetop's bpf program.
It has been removed completely from kernel version 5.9.
Add an empty memcg_cache_params struct in slabratetop's bpf
program so it will compile with kernel versions 5.4 to 5.8.
2020-09-28 17:53:22 -0700788303ead582d5fc70066443b2a94f5c482b53d9slabratetop: Add memcg_cache_params struct defedittools/slabratetop.py
- tools/tcpdrop.py7e3f0c08c7c28757711c0a173b5bd7d9a31cf7ee1601485048000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comFix v6 source (remote) and dest (local) address
For v6, tcpdrop.py would report the source and destination addresses incorrectly - tcp_drop() covers the input path, where the source of the received packet is the daddr stored in the socket, while the destination of the received packet is the local address. This commit swaps them to be correct and leaves a comment since it is not obvious.
2020-09-30 09:57:28 -07007e3f0c08c7c28757711c0a173b5bd7d9a31cf7eeFix v6 source (remote) and dest (local) addressedittools/tcpdrop.py
- tools/tcptracer.py21b810a3b297411452a41336d239002687e5607f1601565460000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtools: tcptracer: fix alignement in tcp_ipv6_event_t
On IPv6, tcptracer ports always appears as zeros:
Tracing TCP established connections. Ctrl-C to end.
T PID COMM IP SADDR DADDR SPORT DPORT
X 7055 nc 4 127.0.0.1 127.0.0.1 49476 9999
C 7074 nc 4 127.0.0.1 127.0.0.1 49478 9999
X 7074 nc 4 127.0.0.1 127.0.0.1 49478 9999
C 7085 nc 6 [::] [0:0:0:1::] 0 0
X 7085 nc 6 [::] [0:0:0:1::] 0 0
C 7086 nc 6 [::] [0:0:0:1::] 0 0
This seems related to alignment issue wrt to the __int128 type in
tcp_ipv6_event_t structure. Moving the u8 field ip to the end of the
structure fixes the issue.
Fixes #2781
2020-10-01 08:17:40 -070021b810a3b297411452a41336d239002687e5607ftools: tcptracer: fix alignement in tcp_ipv6_event_tedittools/tcptracer.py
- tools/biolatency.py87792ce6b783941ea1d8bcd29812a55520930c951601565488000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtools/biolatency: Handle signals from user
2020-10-01 08:18:08 -070087792ce6b783941ea1d8bcd29812a55520930c95tools/biolatency: Handle signals from useredittools/biolatency.py
- libbpf-tools/tcpconnlat.hlibbpf-tools/xfsslower.hlibbpf-tools/bitesize.bpf.clibbpf-tools/tcpconnect.bpf.clibbpf-tools/xfsslower.clibbpf-tools/drsnoop.bpf.clibbpf-tools/biolatency.bpf.clibbpf-tools/trace_helpers.clibbpf-tools/filelife.clibbpf-tools/biopattern.clibbpf-tools/xfsslower.bpf.clibbpf-tools/drsnoop.hlibbpf-tools/tcpconnlat.clibbpf-tools/filelife.bpf.clibbpf-tools/biopattern.hlibbpf-tools/bitesize.hlibbpf-tools/execsnoop.bpf.clibbpf-tools/drsnoop.clibbpf-tools/cpudist.clibbpf-tools/biosnoop.clibbpf-tools/readahead.bpf.clibbpf-tools/biosnoop.hlibbpf-tools/biopattern.bpf.clibbpf-tools/numamove.clibbpf-tools/vfsstat.bpf.clibbpf-tools/biostacks.hlibbpf-tools/drsnoop_example.txtlibbpf-tools/biosnoop.bpf.clibbpf-tools/bitesize.clibbpf-tools/biostacks.clibbpf-tools/tcpconnlat.bpf.clibbpf-tools/biolatency.hlibbpf-tools/opensnoop.bpf.clibbpf-tools/filelife.hlibbpf-tools/readahead.clibbpf-tools/biostacks.bpf.clibbpf-tools/readahead.hlibbpf-tools/biolatency.clibbpf-tools/runqslower.bpf.clibbpf-tools/cpudist.bpf.c73cf23b84d47d437dbd3a9fc7d1f170a1f082a151601565515000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: make some minor refactoring
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-10-01 08:18:35 -070073cf23b84d47d437dbd3a9fc7d1f170a1f082a15libbpf-tools: make some minor refactoringeditlibbpf-tools/execsnoop.bpf.ceditlibbpf-tools/trace_helpers.ceditlibbpf-tools/cpudist.ceditlibbpf-tools/filelife.bpf.ceditlibbpf-tools/readahead.heditlibbpf-tools/biosnoop.ceditlibbpf-tools/readahead.ceditlibbpf-tools/tcpconnlat.bpf.ceditlibbpf-tools/tcpconnlat.ceditlibbpf-tools/xfsslower.ceditlibbpf-tools/biolatency.ceditlibbpf-tools/xfsslower.bpf.ceditlibbpf-tools/biopattern.heditlibbpf-tools/filelife.ceditlibbpf-tools/tcpconnlat.heditlibbpf-tools/filelife.heditlibbpf-tools/drsnoop_example.txteditlibbpf-tools/biosnoop.heditlibbpf-tools/biopattern.bpf.ceditlibbpf-tools/drsnoop.heditlibbpf-tools/biostacks.heditlibbpf-tools/tcpconnect.bpf.ceditlibbpf-tools/xfsslower.heditlibbpf-tools/drsnoop.ceditlibbpf-tools/readahead.bpf.ceditlibbpf-tools/biostacks.bpf.ceditlibbpf-tools/runqslower.bpf.ceditlibbpf-tools/bitesize.heditlibbpf-tools/cpudist.bpf.ceditlibbpf-tools/drsnoop.bpf.ceditlibbpf-tools/vfsstat.bpf.ceditlibbpf-tools/bitesize.ceditlibbpf-tools/biopattern.ceditlibbpf-tools/biosnoop.bpf.ceditlibbpf-tools/biolatency.bpf.ceditlibbpf-tools/biostacks.ceditlibbpf-tools/biolatency.heditlibbpf-tools/numamove.ceditlibbpf-tools/opensnoop.bpf.ceditlibbpf-tools/bitesize.bpf.c
- tools/biolatency.py17e14efccdd1324e39ad9413f2eeba5d93fc6b441601592722000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comRevert "tools/biolatency: Handle signals from user"
This reverts commit 87792ce6b783941ea1d8bcd29812a55520930c95.
Let us have a consensus about how bcc tools should interact with
external signals etc. before applying such changes to this tool
and other tools.
2020-10-01 15:52:02 -070017e14efccdd1324e39ad9413f2eeba5d93fc6b44Revert "tools/biolatency: Handle signals from user"edittools/biolatency.py
- src/cc/libbpfsrc/cc/libbpf.cintrospection/bps.csrc/cc/compat/linux/virtual_bpf.hsrc/cc/export/helpers.hdocs/kernel-versions.mdd0e1c932ff97401640cdfe02317c7583da775f191601604040000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comsync with latest libbpf repo
11 new helpers are added so far in 5.10, added helper function prototypes
and related documentation, etc.
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-10-01 19:00:40 -0700d0e1c932ff97401640cdfe02317c7583da775f19sync with latest libbpf repoeditintrospection/bps.ceditsrc/cc/export/helpers.heditsrc/cc/libbpfeditsrc/cc/compat/linux/virtual_bpf.heditsrc/cc/libbpf.ceditdocs/kernel-versions.md
- docs/reference_guide.mdexamples/cpp/SkLocalStorageIterator.ccsrc/cc/libbpf.hsrc/cc/export/helpers.hexamples/cpp/TaskIterator.ccexamples/cpp/CMakeLists.txtsrc/cc/libbpf.c5fe35766ac0e2860c7e6c1694a2338365e9497a61601911966000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comadd C++ bpf_iter support
bpf iterator is introduced in linux kernel 5.8.
https://lore.kernel.org/bpf/20200509175859.2474608-1-yhs@fb.com/
In 5.8, iterator support for task, task_file, bpf_map, netlink_sock
and ipv6_route. In 5.9, tcp, udp and hash/array/sk_local_storage
map iterators are implemented.
This patch added necessary interface to support bpf_iter in bcc.
A few C++ APIs are added to bcc. Two bpf_iter examples,
task and sk_local_storage_map, are added to illustrate how
bpf iterator can be implemented. Python interface can be added
later if there is a need.
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-10-05 08:32:46 -07005fe35766ac0e2860c7e6c1694a2338365e9497a6add C++ bpf_iter supportaddexamples/cpp/TaskIterator.cceditexamples/cpp/CMakeLists.txtaddexamples/cpp/SkLocalStorageIterator.cceditsrc/cc/export/helpers.heditdocs/reference_guide.mdeditsrc/cc/libbpf.ceditsrc/cc/libbpf.h
- docs/reference_guide.md5e55c22cc76687881e32ee997d79c056558b34791602053085000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comdocs: Add missing code block closure
Signed-off-by: Mauricio Vásquez <mauricio@kinvolk.io>
2020-10-06 23:44:45 -07005e55c22cc76687881e32ee997d79c056558b3479docs: Add missing code block closureeditdocs/reference_guide.md
- tools/tcpconnect.pytools/bindsnoop.py884799f06d7e398f5cf3e1ad28e3feca16b1eac51602131167000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comtools: Use correct key key when deleting item from map
The correct key to use is "tig" instead of "pid".
Signed-off-by: Mauricio Vásquez <mauricio@kinvolk.io>
2020-10-07 21:26:07 -0700884799f06d7e398f5cf3e1ad28e3feca16b1eac5tools: Use correct key key when deleting item from mapedittools/tcpconnect.pyedittools/bindsnoop.py
- tools/sslsniff.py49fdec6a53b524bde53e39d24b2f06ba44531eed1602170518000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comsslsniff: fix comparing bytes to string
Signed-off-by: keyolk <chanhun.jeong@navercorp.com>
2020-10-08 08:21:58 -070049fdec6a53b524bde53e39d24b2f06ba44531eedsslsniff: fix comparing bytes to stringedittools/sslsniff.py
- INSTALL.md6ce68b940bd520ee827b1ff089f3baa2bb30f93b1602658941000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comUpdate installation instructions for Arch Linux
The bcc packages were recently moved from the AUR to the standard Arch
repos, so the installation instructions for Arch should be updated to
reflect that.
Additionally, the Arch "linux-lts" package was upgraded to 4.4.7 in
April 2016, so it is safe to assume that any Arch installations that are
still in use have been upgraded by this point. Therefore, the note about
upgrading to kernel 4.3.1 is removed.
2020-10-14 00:02:21 -07006ce68b940bd520ee827b1ff089f3baa2bb30f93bUpdate installation instructions for Arch LinuxeditINSTALL.md
- tests/python/test_usdt2.py4354c9ce33496df82c8ffd30497141daae28afaa1602659343000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comset larger range to get probes evnet for test_usdt2.py
I test test_usdt2.py on aarch64 with kernel-5.9-rc5,
gcc-9.2.1 and glibc2.32.
with the current range of 3, always get failure:
======================================================================
FAIL: test_attach1 (__main__.TestUDST)
----------------------------------------------------------------------
Traceback (most recent call last):
File "test_usdt2.py", line 170, in test_attach1
self.assertTrue(self.evt_st_6 == 1)
AssertionError: False is not true
----------------------------------------------------------------------
Ran 1 test in 1.068s
FAILED (failures=1)
Signed-off-by: Chunmei Xu <xuchunmei@linux.alibaba.com>
2020-10-14 00:09:03 -07004354c9ce33496df82c8ffd30497141daae28afaaset larger range to get probes evnet for test_usdt2.pyedittests/python/test_usdt2.py
- INSTALL.md5f53dbe182da54d6a05931d69c289ed0a4ebc3391602824753000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comAdd install instructions for Debian
2020-10-15 22:05:53 -07005f53dbe182da54d6a05931d69c289ed0a4ebc339Add install instructions for DebianeditINSTALL.md
- libbpf-tools/runqlen.bpf.clibbpf-tools/softirqs.bpf.c8c2d67e861e07f4125dc2b448f2dc5833b524a171602824888000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: initialize global structs in runqlen and softirqs
Signed-off-by: Juraj Vijtiuk <juraj.vijtiuk@sartura.hr>
2020-10-15 22:08:08 -07008c2d67e861e07f4125dc2b448f2dc5833b524a17libbpf-tools: initialize global structs in runqlen and softirqseditlibbpf-tools/runqlen.bpf.ceditlibbpf-tools/softirqs.bpf.c
- libbpf-tools/llcstat.bpf.clibbpf-tools/llcstat.clibbpf-tools/llcstat.hlibbpf-tools/Makefilelibbpf-tools/.gitignore6929626b4c4ef610ea7dfa0568d5e2267c0063131602825812000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comlibbpf-tools: add llcstat
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2020-10-15 22:23:32 -07006929626b4c4ef610ea7dfa0568d5e2267c006313libbpf-tools: add llcstataddlibbpf-tools/llcstat.bpf.caddlibbpf-tools/llcstat.heditlibbpf-tools/Makefileaddlibbpf-tools/llcstat.ceditlibbpf-tools/.gitignore
- tools/dirtop.py1efba05d3296907bf12558445ed698a459e081c41602872357000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comFix python2.7 support for dirtop tool
* Catch TypeError raised by Python3 glob and fall back to Python2 interface
2020-10-16 11:19:17 -07001efba05d3296907bf12558445ed698a459e081c4Fix python2.7 support for dirtop tooledittools/dirtop.py
- tools/netqtop.pytools/tcprtt.py6ba4dc1fb110b1db4a3ba187fa60a152f64c413f1602873714000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comfix python3 compatible issue for netqtop and tcprtt tools
Otherwise, we have:
...
File "bcc/tools/netqtop.py", line 54
print(hd.center(COL_WIDTH)),
^
TabError: inconsistent use of tabs and spaces in indentation
...
File "bcc/tools/tcprtt.py", line 117, in <module>
bpf_text = bpf_text.replace(b'LPORTFILTER', b'')
TypeError: replace() argument 1 must be str, not bytes
...
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-10-16 11:41:54 -07006ba4dc1fb110b1db4a3ba187fa60a152f64c413ffix python3 compatible issue for netqtop and tcprtt toolsedittools/tcprtt.pyedittools/netqtop.py
- tools/netqtop.pyec3747ed6b16f9eec36a204dfbe3506d3778dcb41603117270000https://buildbot.iovisor.org/jenkins/user/noreplynoreplynoreply@github.comfix netqtop python3 compatible (#3140)
* fix netqtop python3 compatible
* delete import types
2020-10-19 07:21:10 -0700ec3747ed6b16f9eec36a204dfbe3506d3778dcb4fix netqtop python3 compatible (#3140)edittools/netqtop.py
- src/cc/api/BPF.ccsrc/cc/libbpf.csrc/cc/api/BPF.hsrc/cc/libbpf.h50f2009c7521e7d245372839cdb6b9cd6924202b1603137136000https://buildbot.iovisor.org/jenkins/user/danobiDaniel Xudxu@dxuuu.xyzuprobe: Add ref_cnt_offset arg to bpf_attach_uprobe
This argument allows callers to tell the kernel to manage USDT semaphore
counts. It's better than fiddling with the counts in userspace b/c if
the userspace program crashes then the semaphore count does not get
decremented.
It's also better b/c the kernel can activate the semaphore for all
processes that have the target mapped into memory. Currently with bcc,
you have to provide the pid of each process you want to activate a
semaphore for and then bcc will go poke /proc/pid/mem at the right
offset.
2020-10-19 12:52:16 -070050f2009c7521e7d245372839cdb6b9cd6924202buprobe: Add ref_cnt_offset arg to bpf_attach_uprobeeditsrc/cc/libbpf.ceditsrc/cc/api/BPF.heditsrc/cc/libbpf.heditsrc/cc/api/BPF.cc
- src/cc/usdt/usdt.ccsrc/cc/usdt.hsrc/cc/bcc_usdt.hsrc/cc/bcc_elf.hsrc/cc/bcc_elf.c3f0c5f08a57d554640147ad526e0656def0ee2511603137136000https://buildbot.iovisor.org/jenkins/user/danobiDaniel Xudxu@dxuuu.xyzusdt: Calculate and suppply semaphore_offset values in APIs
`semaphore_offset` is the offset from the start of the file the
usdt semaphore can be found. This is different than the already exiting
`semaphore` value which is the virtual address the usdt semaphore can be
found at (after load).
The reason we need to calculate and export this `semaphore_offset` value
is b/c the kernel's uprobe refcount API requires the offset and not the
vaddr.
2020-10-19 12:52:16 -07003f0c5f08a57d554640147ad526e0656def0ee251usdt: Calculate and suppply semaphore_offset values in APIseditsrc/cc/bcc_elf.ceditsrc/cc/bcc_usdt.heditsrc/cc/usdt/usdt.cceditsrc/cc/usdt.heditsrc/cc/bcc_elf.h
- src/cc/api/BPF.cc28a5cef94294a0f91d2c783fe912f0eb951e71dd1603146707000https://buildbot.iovisor.org/jenkins/user/danobiDaniel Xudxu@dxuuu.xyzusdt: Use uprobe refcnt if available in usdt C++ API
2020-10-19 15:31:47 -070028a5cef94294a0f91d2c783fe912f0eb951e71ddusdt: Use uprobe refcnt if available in usdt C++ APIeditsrc/cc/api/BPF.cc
- tests/cc/CMakeLists.txttests/cc/usdt_test_lib.ctests/cc/usdt_test_lib.cctests/python/include/folly/tracing/StaticTracepoint-ELFx86.htests/python/include/folly/tracing/StaticTracepoint-ELF.htests/python/test_usdt.pytests/python/test_usdt2.pytests/python/test_usdt3.pytests/python/include/folly/tracing/StaticTracepoint.h8287f172ddfc488d76b9af8645638da605ac516f1603245505000https://buildbot.iovisor.org/jenkins/user/danobiDaniel Xudxu@dxuuu.xyzfolly: Update tracing headers
Sync to upstream folly.
Also turn all users of the headers to be C++ programs instead of C b/c
folly now #includes <cstddef>.
2020-10-20 18:58:25 -07008287f172ddfc488d76b9af8645638da605ac516ffolly: Update tracing headersdeletetests/cc/usdt_test_lib.cedittests/python/test_usdt.pyaddtests/cc/usdt_test_lib.ccedittests/python/test_usdt2.pyaddtests/python/include/folly/tracing/StaticTracepoint-ELFx86.hdeletetests/python/include/folly/tracing/StaticTracepoint-ELF.hedittests/python/include/folly/tracing/StaticTracepoint.hedittests/cc/CMakeLists.txtedittests/python/test_usdt3.py
- tests/cc/test_usdt_probes.cc50ad6faba240cbb0e8c9d445feb84f2499472a6d1603245550000https://buildbot.iovisor.org/jenkins/user/danobiDaniel Xudxu@dxuuu.xyzusdt: Add test for uprobe refcnt support
2020-10-20 18:59:10 -070050ad6faba240cbb0e8c9d445feb84f2499472a6dusdt: Add test for uprobe refcnt supportedittests/cc/test_usdt_probes.cc
- scripts/docker/build.shscripts/build-deb.sh.gitignore.github/workflows/bcc-test.ymlscripts/docker/push.sh.github/workflows/publish.ymlscripts/docker/auth.shDockerfile.ubuntuscripts/git-tag.shd4aecc6555688911a8b950d99c430e96ef3695761603257415000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comRefactor docker image publishing
This adds support to push docker images to quay.io, like other projects in
the iovisor org.
It separates docker image builds into a separate github workflow, and
refactors the package building process slightly, to be generic, in order to
create builds for both ubuntu 16.04 and ubuntu 18.04.
This provides a means to distribute intermediate apt packages between releases,
and also enables uploading these as CI artifacts.
As recent releases have not annotated their tags, it drops the requirement for
tags to be annotated in selecting the version to use.
2020-10-20 22:16:55 -0700d4aecc6555688911a8b950d99c430e96ef369576Refactor docker image publishingaddscripts/docker/auth.shedit.github/workflows/bcc-test.ymladdscripts/docker/build.shadd.github/workflows/publish.ymleditscripts/build-deb.sheditscripts/git-tag.shaddscripts/docker/push.shedit.gitignoreeditDockerfile.ubuntu
- debian/control.github/workflows/publish.yml20b098ae9d7ad2bcf5cbfb49202012848257b73d1603257415000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comAdd ubuntu 20.04 build support
2020-10-20 22:16:55 -070020b098ae9d7ad2bcf5cbfb49202012848257b73dAdd ubuntu 20.04 build supporteditdebian/controledit.github/workflows/publish.yml
- .github/workflows/publish.ymld35a2dc38514f4a0235f957606ab825c97d651eb1603297763000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comGuard artifact upload with environment variable
2020-10-21 09:29:23 -0700d35a2dc38514f4a0235f957606ab825c97d651ebGuard artifact upload with environment variableedit.github/workflows/publish.yml
- debian/control9269e48712d754b1e0ea91dc2fc21b6e9127c4e61603411549000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comPrefer newer llvm/clang versions in debian packaging
2020-10-22 17:05:49 -07009269e48712d754b1e0ea91dc2fc21b6e9127c4e6Prefer newer llvm/clang versions in debian packagingeditdebian/control
- scripts/docker/build.sh4967a61ddaf032f4d0bd5ee73360bff400f447e51603411549000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comDo not permit errors in docker build
2020-10-22 17:05:49 -07004967a61ddaf032f4d0bd5ee73360bff400f447e5Do not permit errors in docker buildeditscripts/docker/build.sh
- src/python/bcc/table.py48946d2f31afbfb7b4bc7c62a9d3d6f1d2ffc3301603411664000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.compython: import ABCs from collections.abc
Importing Abstract Base Classes (ABCs) from the collections module
is deprecated since Python 3.3, it emits a warning since Python 3.8,
and it will stop working in Python 3.10.
Try importing MutableMapping from collections.abc (the preferred way since
Python 3.3) and, in case of error (Python < 3.3) fall back to importing it
from collections.
2020-10-22 17:07:44 -070048946d2f31afbfb7b4bc7c62a9d3d6f1d2ffc330python: import ABCs from collections.abceditsrc/python/bcc/table.py
- man/man8/tcpconnect.8scripts/build-rpm.shDockerfile.ubuntutools/tcpconnect.pyscripts/bpf_demo.ks.erbtools/tcpconnect_example.txtDockerfile.testsINSTALL.md33817e6c4e61ed36bff81ef83b2f5cceeb7fa87c1603466817000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comadd DNS correlation to connect tracking
2020-10-23 08:26:57 -070033817e6c4e61ed36bff81ef83b2f5cceeb7fa87cadd DNS correlation to connect trackingeditDockerfile.ubuntueditman/man8/tcpconnect.8edittools/tcpconnect_example.txteditscripts/bpf_demo.ks.erbeditDockerfile.testseditINSTALL.mdeditscripts/build-rpm.shedittools/tcpconnect.py
- INSTALL.md1591469305280a9a66635f8af8f0fcb47a839ef71603727145000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comUpdate INSTALL.md
For ubuntu focal fossa only instructions given for Eoan worked for me. If we don't add Focal fossa to list people will go to "For other versions" section. which refers to libllvm3.7 which could not be installed on ubuntu focal. Hence this proposed change
2020-10-26 08:45:45 -07001591469305280a9a66635f8af8f0fcb47a839ef7Update INSTALL.mdeditINSTALL.md
- INSTALL.md5ab0183dcb94eb27d9a180b5abff6ada23a795db1603901017000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comdocs(INSTALL): add libfl-dev to ubuntu dependencies
To compile the software on Ubuntu 20.04 I had trouble compiling the source because my OS is missing the `FlexLexer.h` library. This package is supplied by `libfl-dev`.
2020-10-28 09:03:37 -07005ab0183dcb94eb27d9a180b5abff6ada23a795dbdocs(INSTALL): add libfl-dev to ubuntu dependencieseditINSTALL.md
- src/cc/libbpfsrc/cc/libbpf.csrc/cc/compat/linux/virtual_bpf.hsrc/cc/export/helpers.hdocs/kernel-versions.md15efd46a199522e17efa7abadb73f81c767bc3ba1604015677000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comsync with latest libbpf repo
sync with libbpf v0.2.0
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-10-29 16:54:37 -070015efd46a199522e17efa7abadb73f81c767bc3basync with latest libbpf repoeditsrc/cc/compat/linux/virtual_bpf.heditsrc/cc/export/helpers.heditdocs/kernel-versions.mdeditsrc/cc/libbpf.ceditsrc/cc/libbpf
- debian/changelogad5b82a5196b222ed2cdc738d8444e8c9546a77f1604023439000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comupdate debian changelog for release v0.17.0
* Support for kernel up to 5.9
* usdt: add uprobe refcnt support
* use newer llvm/clang versions in debian packaging if possible
* add bpf iterator C++ support
* new bcc tools: tcprtt, netqtop, swapin, tcpsynbl, threadsnoop
* tcpconnect: add DNS correlation to connect tracking
* new libbpf-tools: llcstat, numamove, runqlen, runqlat, softirgs, hardirqs
* doc update, bug fixes and some additional arguments for tools
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-10-29 19:03:59 -0700ad5b82a5196b222ed2cdc738d8444e8c9546a77fupdate debian changelog for release v0.17.0editdebian/changelog
- src/cc/frontends/clang/arch_helper.hsrc/cc/frontends/clang/b_frontend_action.ccsrc/cc/frontends/clang/loader.ccsrc/cc/export/helpers.h12107c6936c6f5d64dd305c8a7d068c07086fd171604450298000https://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songys114321@gmail.comuse correct arch register for the 4th param of x86_64 syscalls
Fix #3150
On x86_64, for syscalls, the calling convension is to use
r10 instead of rcx for the 4th parameter. I have verified this
with disassembling vmlinux codes.
https://www.systutorials.com/x86-64-calling-convention-by-gcc/
bcc previously used rcx for the 4th parameter for all cases.
This patch fixed the issue by using r10 for syscalls.
A macro PT_REGS_PARM4_SYSCALL() is also introduced in helpers.h
to access the 4th parameter for r10.
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-11-03 16:38:18 -080012107c6936c6f5d64dd305c8a7d068c07086fd17use correct arch register for the 4th param of x86_64 syscallseditsrc/cc/frontends/clang/arch_helper.heditsrc/cc/export/helpers.heditsrc/cc/frontends/clang/b_frontend_action.cceditsrc/cc/frontends/clang/loader.cc
- src/cc/frontends/clang/b_frontend_action.ccsrc/cc/bpf_module.ccsrc/cc/bpf_module_rw_engine.cc11c93f613b43e296f949a231684d544016fd0bcb1604470882000https://buildbot.iovisor.org/jenkins/user/yhsyhsyhs@fb.comfix compilation issues with latest llvm12 trunk
With latest llvm12 trunk, we got two compilation bugs.
Bug #1:
/home/yhs/work/bcc/src/cc/frontends/clang/b_frontend_action.cc:
In member function ‘void ebpf::BFrontendAction::DoMiscWorkAround()’:
/home/yhs/work/bcc/src/cc/frontends/clang/b_frontend_action.cc:1706:31:
error: ‘class clang::SourceManage’ has no member named ‘getBuffer’; did you mean ‘getBufferData’?
rewriter_->getSourceMgr().getBuffer(rewriter_->getSourceMgr().getMainFileID())->getBufferSize(),
^~~~~~~~~
getBufferData
This is due to upstream change https://reviews.llvm.org/D89394.
To fix, follow upstream examples in https://reviews.llvm.org/D89394.
Bug #2:
/home/yhs/work/bcc/src/cc/bpf_module.cc: In member function ‘int ebpf::BPFModule::finalize()’:
/home/yhs/work/bcc/src/cc/bpf_module.cc:470:11:
error: ‘class llvm::EngineBuilder’ has no member named ‘setUseOrcMCJITReplacement’
builder.setUseOrcMCJITReplacement(false);
^~~~~~~~~~~~~~~~~~~~~~~~~
This is due to upstream
https://github.com/llvm/llvm-project/commit/6154c4115cd4b78d0171892aac21e340e72e32bd
It seems builder.setUseOrcMCJITReplacement() is not needed any more. So just remove it
from bcc.
Signed-off-by: Yonghong Song <yhs@fb.com>
2020-11-03 22:21:22 -080011c93f613b43e296f949a231684d544016fd0bcbfix compilation issues with latest llvm12 trunkeditsrc/cc/frontends/clang/b_frontend_action.cceditsrc/cc/bpf_module.cceditsrc/cc/bpf_module_rw_engine.cc
githttps://buildbot.iovisor.org/jenkins/user/noreplynoreplyhttps://buildbot.iovisor.org/jenkins/user/yhsyhshttps://buildbot.iovisor.org/jenkins/user/yonghong-songyonghong-songhttps://buildbot.iovisor.org/jenkins/user/danobiDaniel Xu738https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/label=fc25/738/738https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/label=fc26/738/738https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/label=fc27/738/738https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/label=fc28/738/738https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/label=ubuntu1604/738/738https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/label=ubuntu1710/738/738https://buildbot.iovisor.org/jenkins/user/danobi/my-views/view/all/job/bcc-pr/label=ubuntu1804/738/