Hi,
i am using seo friendly urls and have this in my htaccess file:
no acceptable variant: /var/www/vhosts/xdtbn42w.web6.alfahosting-server.de/ralf-kerkhoff.de/picture
AcceptPathInfo On
Options -Indexes +MultiViews
<Files "*.php">
MultiviewsMatch Any
</Files>
What I noticed are some error messages in the server error.log:
no acceptable variant: /path_on_the_server_to_piwigo_installation/picture
That does not happen with each visit, this happen only if the visit come from a specific IP rang:
185.191.171.XX
which belongs to the ripe network - example:
https://who.is/whois-ip/ip-address/185.191.171.45
Any ideas why this happens?
I guess it is a robot?
Cheers
Ralf
Offline
Nothing much to say without seeing the exact request, but if it's like "GET /picture HTTP/1.0" without which picture to obtain that's a bad request and furthermore if it happens only for that IP (range) of yet another SEO bot that doesn't get its URLs right I wouldn't bother at all.
Offline
whois 185.191.171.45
Semrush_Net
Yes, it is a bot. A really bad bot. You need to use iptables or a similar firewall tool to get rid of bots that don't obey robots.txt.
Offline
Hi,
Thanks for your replies. I had a look in the access.log.
It seems to be really a request like:
but if it's like "GET /picture HTTP/1.0
And its always the same ip-range:
185.191.171.XXX
I will try to ban this range with the Ban-IP plugin.
Ralf
Offline
Well, 185.191.171.0 - 185.191.171.255 is org-name: SEMrush CY LTD, so yes.
Just add this to your .htaccess if you really want:
<IfModule mod_rewrite.c> RewriteEngine On RewriteCond %{REMOTE_ADDR} ^185\.191\.171\. [NV] RewriteRule .* - [F,L] </IfModule>
that gives all of them a nice 403 status code for every request.
You could instead also do a match on the user agent to only exclude the bot regardless of which IP it originates; assuming it has "SEMrush/Bot" (I really don't know, check your access logs) in its user agent string that would be something like
RewriteCond %{HTTP_USER_AGENT} "SEMrush/Bot" [NV]
RewriteRule .* - [F,L]
Offline
Hi erAck,
at the moment I have disallowed Semrush bot in the robots.txt.
If that does not help I will add one of your suggestions to the htaccess file.
I will keep an eye on the server log files in the next days.
Cheers
Ralf
Offline