Presidio based Otel Collector Processor

[mxab]

Hi,

I made a custom otel collector pipline processor based on presidio. You can use the otel collector build and build a custom collector component with it

mxab/otel-presidio

It sends log bodies as well as selected attributes from logs and traces to presidio for redaction, e.g. gen_ai.input/output.messages

....
processors:
  presidio:
    endpoint: anonymizer:50051
    tls:
      insecure: true
    attributes: 
      - "gen_ai.input.messages"
      - "gen_ai.output.messages"
    include_log_body: true

service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [presidio]
      exporters: [some_where...]
    logs:
      receivers: [otlp]
      processors: [presidio]
      exporters: [some_where...]

Let me know what you think :)

[SharonHart]

Nice, thanks @mxab!
I think that we have a deployment sample around that in https://github.com/data-privacy-stack/presidio/blob/7b6a43abf8828ce77924abeabd3a15c0622f60bc/docs/samples/deployments/redacting-telemetry/index.md
It would be nice if you see something from your work that can be contributed back to the same sample.