Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add support for otel/kafka driver and export #62

Merged
merged 55 commits into from
Jul 12, 2024
Merged

feat: add support for otel/kafka driver and export #62

merged 55 commits into from
Jul 12, 2024

Conversation

asn10038
Copy link

@asn10038 asn10038 commented Apr 16, 2024 •
edited by araujof
Loading

Description
This PR partially addresses #102.

Added

  • Kafka driver for Otel records
  • Kafka exporter for Otel records

araujof
araujof reviewed Apr 16, 2024
View reviewed changes
Dockerfile Outdated Show resolved Hide resolved
@araujof araujof force-pushed the otel branch 2 times, most recently from 9b5619f to e3375e1 Compare April 16, 2024 16:19
@araujof araujof force-pushed the otel branch 2 times, most recently from 7b20cd6 to 219706a Compare April 24, 2024 03:21
Anthony Saieva added 25 commits April 23, 2024 23:23
@araujof
feat: adding otel drivers
57fc9a5 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
chore: removing empty types file
a24d0b9 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: added the otel core
2761249 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: added makefile with backend choice variable
63e6a88 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: added otel types
43f21fc 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: first pass at otel policy engine adapter (broken)
0028da2 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: updated otel operations with constructor and RegExp Evaluation
d813505 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
fix: quick fix to the operator
e5190c3 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
chore: updating references to correct packages
eb269be 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
chore: add otel dependecies
53c3059 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: updated channel type
f42376f 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
chore: fixed typo (backend compiles)
09b4711 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: adding skeleton kafka driver
1faf116 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
fix: push events to the channel after parsing
0dcfff4 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: added otel kafka driver
768301c 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
chore: quick change to naming for neatness
e5a1630 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
chore: added confluent dependency
1b326f6 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
fix: changes to fix compilation errors
007542e 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
chore: wip commit
55329b3 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
fix: working driver
9abb092 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: added encoding option
ecd287a 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
docs: adding sources.md and sf-processor image
935d7f1 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
docs: adding docs for datasources
05250da 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
feat: adding kafka support to otelexporter
1d8c813 
Signed-off-by: Anthony Saieva <[email protected]>
@araujof
fix: cleaning bug in otel event parsing
ec79d0c 
Signed-off-by: Anthony Saieva <[email protected]>
terylpt and others added 9 commits April 23, 2024 23:23
@terylpt @araujof
format: minor efficiency issues
3556ba4 
Signed-off-by: TPT <[email protected]>
@araujof
chore: update sysflow api version
82ff363 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
fix(core, driver): fix otel/flatrecord compilation, remove cyclic dep…
bfadf8c 
…endency between core and driver modules

Signed-off-by: Frederico Araujo <[email protected]>
@araujof
refactor: move otel exporter to exporter package
273e612 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
feat: add producer cleanup to OTEL exporter
38fddbb 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
feat(core,driver)!: refactor core/exporter and driver/otel packages t…
9ba055f 
…o enable passing of kafka client configuration and use of encoder/transport architecture; removed support for IBM findings API

Signed-off-by: Frederico Araujo <[email protected]>
@araujof
chore: go mod tidy dependencies
517d74d 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
fix: parsing of kafka configuration
dfce043 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
chore: update manifest
d12f89b 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof araujof added the enhancement New feature or request label Apr 24, 2024
terylpt and others added 14 commits April 24, 2024 05:24
@terylpt
feat(core): add rules and tagging to otel logs
f775204 
Signed-off-by: TPT <[email protected]>
@terylpt
feat(core): remove printfs
0555a64 
Signed-off-by: TPT <[email protected]>
@terylpt
feat(core): fixed variable name bug
e7a55dc 
Signed-off-by: TPT <[email protected]>
@araujof
feat: add example otel pipeline configuration
e8bd7f1 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
feat: split docker processor target from plugin builder target
c670ace 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
chore: update changelog and readme for release candidate
1264182 
Signed-off-by: Frederico Araujo <[email protected]>
@terylpt
fix(kafka): added better error messaging to kafka driver
980464e 
Signed-off-by: TPT <[email protected]>
@araujof
chore: remove cache-from from processor docker build target
c1cfb4d 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
refactor: include error object in error logs
f50648f 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
fix: update transport enum to include kafka transport
dea45f5 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
chore: update manifest
4b7facd 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
chore: resolve merge conflict
bafae37 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
refactor: move otel processor tags to its own scope logs
ae1903a 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof
chore: remove fmt printfs added previously
eef0d11 
Signed-off-by: Frederico Araujo <[email protected]>
@araujof araujof changed the title Adding support for otel/kafka integration feat: add support for otel/kafka driver and export Jul 12, 2024
@araujof araujof merged commit d3555fd into dev Jul 12, 2024
10 checks passed
@araujof araujof deleted the otel branch July 12, 2024 15:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@terylt terylt terylt left review comments

@araujof araujof araujof left review comments

Assignees

@araujof araujof

@terylt terylt

Labels
enhancement New feature or request
Projects
0.7.0
Status: Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@asn10038 @araujof @terylt @terylpt