Announcement

#1 2021-11-08 13:30:46

Ralf
Member
Dorsten-Lembeck
2012-05-08
206

Server Error Log

Hi,

i am using seo friendly urls and have this in my htaccess file:


no acceptable variant: /var/www/vhosts/xdtbn42w.web6.alfahosting-server.de/ralf-kerkhoff.de/picture
AcceptPathInfo On
Options -Indexes +MultiViews

<Files "*.php">
MultiviewsMatch Any
</Files>

What I noticed are some error messages in the server error.log:
no acceptable variant: /path_on_the_server_to_piwigo_installation/picture

That does not happen with each visit, this happen only if the visit come from a specific IP rang:
185.191.171.XX

which belongs to the ripe network - example:
https://who.is/whois-ip/ip-address/185.191.171.45

Any ideas why this happens?
I guess it is a robot?

Cheers
Ralf


There are only two kinds of music:
Rock and Roll

https://www.ralf-kerkhoff.de

Offline

 

#2 2021-11-08 13:46:56

erAck
Only trying to help
2015-09-06
1367

Re: Server Error Log

Nothing much to say without seeing the exact request, but if it's like "GET /picture HTTP/1.0" without which picture to obtain that's a bad request and furthermore if it happens only for that IP (range) of yet another SEO bot that doesn't get its URLs right I wouldn't bother at all.


Running Piwigo at https://erack.net/gallery/

Offline

 

#3 2021-11-08 13:55:39

Zentalquabula
Member
2014-05-10
208

Re: Server Error Log

whois 185.191.171.45

Semrush_Net

Yes, it is a bot. A really bad bot. You need to use iptables or a similar firewall tool to get rid of bots that don't obey robots.txt.

Offline

 

#4 2021-11-08 16:10:14

Ralf
Member
Dorsten-Lembeck
2012-05-08
206

Re: Server Error Log

Hi,
Thanks for your replies. I had a look in the access.log.
It seems to be really a request like:
but if it's like "GET /picture HTTP/1.0

And its always the same ip-range:
185.191.171.XXX

I will try to ban this range with the Ban-IP plugin.

Ralf


There are only two kinds of music:
Rock and Roll

https://www.ralf-kerkhoff.de

Offline

 

#5 2021-11-08 17:13:37

erAck
Only trying to help
2015-09-06
1367

Re: Server Error Log

Well, 185.191.171.0 - 185.191.171.255 is org-name: SEMrush CY LTD, so yes.

Just add this to your .htaccess if you really want:

Code:

<IfModule mod_rewrite.c>
    RewriteEngine On
    RewriteCond %{REMOTE_ADDR} ^185\.191\.171\. [NV]
    RewriteRule .* - [F,L]
</IfModule>

that gives all of them a nice 403 status code for every request.

You could instead also do a match on the user agent to only exclude the bot regardless of which IP it originates; assuming it has "SEMrush/Bot" (I really don't know, check your access logs) in its user agent string that would be something like

RewriteCond %{HTTP_USER_AGENT} "SEMrush/Bot" [NV]
RewriteRule .* - [F,L]


Running Piwigo at https://erack.net/gallery/

Offline

 

#6 2021-11-08 18:33:59

Ralf
Member
Dorsten-Lembeck
2012-05-08
206

Re: Server Error Log

Hi erAck,

at the moment I have disallowed Semrush bot in the robots.txt.

If that does not help I will add one of your suggestions to the htaccess file.

I will keep an eye on the server log files in the next days.

Cheers
Ralf


There are only two kinds of music:
Rock and Roll

https://www.ralf-kerkhoff.de

Offline

 

Board footer

Powered by FluxBB

github twitter newsletter Donate Piwigo.org © 2002-2022 · Contact