Skip to content

Commit

Permalink
pattern updates
Browse files Browse the repository at this point in the history
  • Loading branch information
@deedeeh
deedeeh committed Jan 28, 2025
1 parent ad4b25c commit 2b9a216
Show file tree
Hide file tree
Showing 6 changed files with 143 additions and 28 deletions.
4 changes: 4 additions & 0 deletions CHANGELOG.md
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# Changelog

## [5.1.22](https://github.com/omrilotan/isbot/compare/v5.1.21...v5.1.22)

- [Pattern] Pattern updates

## [5.1.21](https://github.com/omrilotan/isbot/compare/v5.1.20...v5.1.21)

- [Pattern] Pattern updates
Expand Down
2 changes: 1 addition & 1 deletion fixtures/downloaded/downloaded
View file
Original file line number Diff line number Diff line change
@@ -1 +1 @@
Mon, 06 Jan 2025 10:06:06 GMT
Tue, 28 Jan 2025 21:24:32 GMT
107 changes: 83 additions & 24 deletions fixtures/downloaded/myip.ms.json
View file

Large diffs are not rendered by default.

54 changes: 53 additions & 1 deletion fixtures/downloaded/user-agents.net.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -26703,5 +26703,57 @@
"Java/1.8.0_382-internal",
"EmailWolf 1.00 [ip:5.75.174.146]",
"gvfs/1.56.1",
"Apache-HttpClient/4.5.14 (Java/17.0.1)"
"Apache-HttpClient/4.5.14 (Java/17.0.1)",
"Googlebot/3.1(+http://www.google.com/bot.html)",
"Scrapy/2.12.0 (+https://scrapy.org)",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.139 Safari/537.36 [ip:66.249.79.167]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:72.14.199.10]",
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.6778.264 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.66.20]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.66.21]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.66.22]",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML, like Gecko; Mediapartners-Google) Chrome/131.0.6778.204 Mobile Safari/537.36 [ip:66.249.92.22]",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML, like Gecko; Mediapartners-Google) Chrome/131.0.6778.204 Mobile Safari/537.36 [ip:66.249.92.21]",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML, like Gecko; Mediapartners-Google) Chrome/131.0.6778.204 Mobile Safari/537.36 [ip:66.249.92.20]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36",
"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36 PTST/250113.145121",
"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.0.0 Safari/537.36 PTST/250113.145121",
"Snapchat/12.88.0.43 (SM-G9650; Android 10#G9650ZHS9FVA4#29; gzip) V/MUSHROOM grpc-c++/1.48.0 grpc-c/26.0.0 (android; cronet_http)",
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.6834.83 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.66.21]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.66.20]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.77.228]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:74.125.218.230]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:74.125.218.228]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:74.125.218.229]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.77.230]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.77.229]",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML%2C like Gecko; Mediapartners-Google) Chrome/131.0.6778.264 Mobile Safari/537.36",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML%2C like Gecko; Mediapartners-Google) Chrome/131.0.6778.204 Mobile Safari/537.36",
"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML%2C like Gecko) Chrome/56.0.2924.87 Safari/537.36 Google-PageRenderer Google (+https://developers.google.com/+/web/snippet/)",
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML%2C like Gecko) Chrome/132.0.6834.83 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML, like Gecko; Mediapartners-Google) Chrome/131.0.6778.264 Mobile Safari/537.36 [ip:66.249.92.22]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.79.206]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.79.36]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.68.71]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:74.125.150.3]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:72.14.199.192]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:74.125.150.32]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.79.104]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.79.206]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.79.192]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.79.104]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.68.1]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.73.6]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.264 Safari/537.36 [ip:66.249.73.5]",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:66.249.90.196]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.73.7]",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/131.0.6778.204 Safari/537.36 [ip:66.249.73.5]",
"CaptiveNetworkSupport-461.40.3%20wispr",
"Mozilla/5.0 (compatible; Google-Apps-Script; beanserver; +https://script.google.com; id: UAEmdDd9gnN-wRdPU5Yxz9Ry1nNmEpQI1OQ)",
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.6834.110 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML, like Gecko; Mediapartners-Google) Chrome/131.0.6778.264 Mobile Safari/537.36 [ip:66.249.92.20]",
"Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/537.36 (KHTML, like Gecko; Mediapartners-Google) Chrome/131.0.6778.264 Mobile Safari/537.36 [ip:66.249.92.21]",
"Java-http-client/21.0.5",
"AdsBot-Google (+http://www.google.com/adsbot.html) [ip:66.249.92.136]"
]
2 changes: 1 addition & 1 deletion package.json
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "isbot",
"version": "5.1.21",
"version": "5.1.22",
"description": "🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.",
"keywords": [
"bot",
Expand Down
2 changes: 1 addition & 1 deletion src/patterns.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
"\\.com\\b",
"\\btime/",
"^<",
"^[\\w \\.\\-\\(?:\\):]+(?:/v?\\d+(?:\\.\\d+)?(?:\\.\\d{1,10})*?)?(?:,|$)",
"^[\\w \\.\\-\\(?:\\):%]+(?:/v?\\d+(?:\\.\\d+)?(?:\\.\\d{1,10})*?)?(?:,|$)",
"^[^ ]{50,}$",
"^\\d+\\b",
"^\\w*search\\b",
Expand Down

0 comments on commit 2b9a216

Please sign in to comment.