diff options
| author | Xe Iaso <me@xeiaso.net> | 2025-01-17 12:51:57 -0500 |
|---|---|---|
| committer | Xe Iaso <me@xeiaso.net> | 2025-01-17 12:51:57 -0500 |
| commit | afff2e6e8848666a84d8a876c5f58738427f5d5e (patch) | |
| tree | b6a28589290a07d3a9cf6105a2e85331756cc897 /lume/src | |
| parent | c0fab3daf77f8549eb8502cac8733530e6f86104 (diff) | |
| download | xesite-afff2e6e8848666a84d8a876c5f58738427f5d5e.tar.xz xesite-afff2e6e8848666a84d8a876c5f58738427f5d5e.zip | |
i'm a teapot
Signed-off-by: Xe Iaso <me@xeiaso.net>
Diffstat (limited to 'lume/src')
| -rw-r--r-- | lume/src/notes/2025/amazon-crawler.mdx | 17 |
1 files changed, 17 insertions, 0 deletions
diff --git a/lume/src/notes/2025/amazon-crawler.mdx b/lume/src/notes/2025/amazon-crawler.mdx index d726155..f2bdb74 100644 --- a/lume/src/notes/2025/amazon-crawler.mdx +++ b/lume/src/notes/2025/amazon-crawler.mdx @@ -4,6 +4,23 @@ desc: "Please, just stop." date: 2025-01-17 --- +EDIT(2025-01-17 17:50 UTC): + +I added this snippet to the ingress config: + +```yaml +nginx.ingress.kubernetes.io/configuration-snippet: | + if ($http_user_agent ~* "(Amazon)" ){ + return 418; + } +``` + +The bots are still hammering away from a different IP every time. About 10% of the requests do not have the amazonbot user agent. I'm at a loss for what to do next. + +I hate the future. + +--- + Hi all. This is a different kind of post. This is not informative. This is a cry for help. To whoever runs AmazonBot, please add `git.xeserv.us` to your list of blocked domains. If you know anyone at Amazon, please forward this to them and ask them to forward it to the AmazonBot team. |