Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Add flag to skip legacy duplicate telemetry #4

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

kavirajk
Copy link

@kavirajk kavirajk commented Dec 9, 2024

Merge this PR first. That syncs the main with upstream

Currently we have some legacy metrics with peer_id in the metrics suffix (in addition to same metrics with peer_idd as label)

  1. raft_replication_appendEntries_rpc_peer0
  2. raft_replication_appendEntries_logs_peer0
  3. raft_replication_heartbeat_peer0
  4. raft_replication_installSnapshot_peer0

These metrics may have additional _count or _sum metrics. And each metrics are multiplicative. Meaning if I have 10 peers, these metrics will be 10x.

This PR adds a flag noLegacyTelemetry (default: false) which by setting to true you can skip those duplicate metrics.

Before

Screenshot 2024-12-09 at 23 37 21

After

Screenshot 2024-12-09 at 23 28 28

Currently we have some legacy metrics with `peer_id` in the metrics suffix (in addition to same metrics with `peer_id`d as label)
1. `raft_replication_appendEntries_rpc_peer0`
2. `raft_replication_appendEntries_logs_peer0`
3. `raft_replication_heartbeat_peer0`
4. `raft_replication_installSnapshot_peer0`

These metrics may have additional `_count` or `_sum` metrics. And each metrics are multiplicative. Meaning if I have 10 peers, these metrics will be 10x.

This PR adds a flag `noLegacyTelemetry` (default: false) which by setting to `true` you can skip those duplicate metrics.

Signed-off-by: Kaviraj <[email protected]>
Copy link

@orca-security-eu orca-security-eu bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Orca Security Scan Summary

Status Check Issues by priority
Passed Passed Infrastructure as Code high 0   medium 0   low 0   info 0 View in Orca
Passed Passed Secrets high 0   medium 0   low 0   info 0 View in Orca
Passed Passed Vulnerabilities high 0   medium 0   low 0   info 0 View in Orca

@weaviate-git-bot
Copy link

To avoid any confusion in the future about your contribution to Weaviate, we work with a Contributor License Agreement. If you agree, you can simply add a comment to this PR that you agree with the CLA so that we can merge.

beep boop - the Weaviate bot 👋🤖

PS:
Are you already a member of the Weaviate Slack channel?

kavirajk and others added 2 commits December 12, 2024 12:10
Co-authored-by: Piotr Kazmierczak <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants