Skip to content

Commit 4493fe5

Browse files
indykoningDav1dde
andauthored
feat(filter): Add Storebot-Google to web crawlers list (#5300)
This adds the Google Storebot crawler to the list of known web crawlers https://support.google.com/merchants/answer/13294660?hl=en `Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36` ### Legal Boilerplate Look, I get it. The entity doing business as "Sentry" was incorporated in the State of Delaware in 2015 as Functional Software, Inc. and is gonna need some rights from me in order to utilize my contributions in this here PR. So here's the deal: I retain all rights, title and interest in and to my contributions, and by keeping this boilerplate intact I confirm that Sentry can use, modify, copy, and redistribute my contributions, under Sentry's choice of terms. --------- Co-authored-by: David Herberth <[email protected]>
1 parent 879dbbb commit 4493fe5

File tree

2 files changed

+4
-0
lines changed

2 files changed

+4
-0
lines changed

CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@
1616
- Make referer optional in Vercel Log Drain Transform. ([#5273](https://github.com/getsentry/relay/pull/5273))
1717
- Tag spans' count per root metric with the trace root's transaction instead of the local transaction. ([#5281](https://github.com/getsentry/relay/pull/5281))
1818
- Use `vercel.path` instead of `url.path` for Vercel Log Drain Transform. ([#5274](https://github.com/getsentry/relay/pull/5274))
19+
- Add Google Storebot to the crawler filter list. ([#5300](https://github.com/getsentry/relay/pull/5300))
1920

2021
**Internal**:
2122

relay-filter/src/web_crawlers.rs

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@ static WEB_CRAWLERS: LazyLock<Regex> = LazyLock::new(|| {
1313
AdsBot-Google|
1414
Googlebot|
1515
FeedFetcher-Google|
16+
Storebot-Google|
1617
BingBot| # Bing search
1718
BingPreview|
1819
Baiduspider| # Baidu search
@@ -118,6 +119,8 @@ mod tests {
118119
"AdsBot-Google",
119120
"Googlebot",
120121
"FeedFetcher-Google",
122+
"Storebot-Google",
123+
"Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36",
121124
"BingBot",
122125
"BingPreview",
123126
"Baiduspider",

0 commit comments

Comments
 (0)