Hi Olaf,

sorry, I still have to complain. My added bots in whitelisted_bots.txt and bot_limits.json still disappear when I change something in the Whitelist tab (e.g. changing limits on some other bot). I have to reenter my changes into the above files.

Please take care that extra entries are preserved in these files.

Thanks

Schneider-Fotografie wrote:

It's not a bug! Manually adding bots to whitelisted_bots.txt and bot_limits.json is not intended. It's a default list.

So there is a nice option to add for blocking but not for whitelisting?

I also notice some UA strings of bots where I thought they would not be blocked .... but are.
For me it's not clear what the "Recommended Whitelisted Bots" under Whitelist does.
Because it mentions DuckDuckBot with 3-start, but is (for me) also in the "Blocked User-Agents Label" under Bot List Tab.

I removed DuckDuckBot from that list and saved it.
Not sure how it ended up there ... could be me.

For example I also have this in the Statistics Tab with a block count of 13641:
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bin

But is this not just BingBot (and the full UA is cut off)? And I did not Enable Daily Limit for bingbot.
So not sure what is going on there .... or the UA is invalid or what?

Thanks for the update.

Just some note: this time I did see the update in my installation and could successfully upgrade :-)

(corrected typo)

Last edited by matthys (2025-12-24 20:53:25)

Thanks, that explains the behaviour. My expectation was that I can add more bots (which actually do show up in the "Whitelist" tab).
But there is the option I did not see yet is to add new bots on the Whitelist tab at the bottom of the page. That works as intended and I can revert to the standard settings.

Thanks also for the good work (maybe "complain" was a bit too harsh, sorry for that).