Announcement

#1 2021-03-16 16:04:46

buddhabaker
Member
2019-03-28
20

Soft 404 errors

Hello;
Through the new Google Search console for my web site, Google has reported a number of soft 404 errors.
One of 40 addresses that causes this error is given below'

The page in this case shows one and a half pages of different photographs, causes a soft 404 error and content wider than screen error too.
As my site is mobile friendly (according to Google that is!), what must be done or what do I have to do to configure or change Piwigo to remove the causes of these errors?

Environment
Piwigo 11.3.0 Check for upgrade
Operating system: Linux
PHP: 5.6.36 (Show info) [2021-03-16 15:03:04]
MySQL: 5.6.39-log [2021-03-16 15:03:04]
Graphics Library: ImageMagick 6.7.2-7

Piwigo URL: https://www.nineoaks-fisheries.co.uk/pi … 8/start-30

Offline

 

#2 2021-03-16 18:48:02

executive
Member
2017-08-16
1099

Re: Soft 404 errors

I don't get 404 here

Offline

 

#3 2021-03-17 15:28:44

buddhabaker
Member
2019-03-28
20

Re: Soft 404 errors

Hello;
Below, is the latest Google Search Console list of 404 errors:

https://www.nineoaks-fisheries.co.uk/assets/images/png/soft404errors.png

I do not know the cause of these, hence my query yesterday.

All other images that I use throughout the website do not generate or cause these types of issues, which is why I am seeking your expertise in this matter. I hope that you can help or at least shed some light on the cause?
Thank you in advance.
Bill

Offline

 

#4 2021-03-17 16:17:15

jnashpiwigo
Piwigo Team
2014-10-21
248

Re: Soft 404 errors

Each one came through fine for me on several browsers, several times with no 404's

Perhaps a google issue?

Offline

 

#5 2021-03-19 17:30:19

buddhabaker
Member
2019-03-28
20

Re: Soft 404 errors

I am in the process of resubmitting them to Google for re-indexing but can only do a few per day as I exceed the daily Google quota.

Offline

 

#6 2021-03-27 09:29:08

buddhabaker
Member
2019-03-28
20

Re: Soft 404 errors

Hello (again);
My soft 404 error count has now been reduced from 41 to 10.
Through the Google Search console, those 10 are requested to be re-indexed. The next day I have 10 more soft 404 errors, and I am daily requesting re-indexing with the new 10.
It would appear that this won't stop until Google has re-indexed every page.

Offline

 

#7 2021-04-28 15:06:19

buddhabaker
Member
2019-03-28
20

Re: Soft 404 errors

Hi All;
just making you aware, after re-indexing the previous 41 404 errors, this morning Google has reported another 18!
I have asked my ISP to investigate if there is anything they or I could do to improve server response time. Is there anything you guys could suggest?

As we have hundreds of images this could be ongoing for some time.

Hoping you can offer some advice?

Thanks
Bill

Offline

 

#8 2021-04-28 15:20:42

jnashpiwigo
Piwigo Team
2014-10-21
248

Re: Soft 404 errors

Sounds like your ISP/Host may be having some load/demand/resource issues occasionally.

I have over 300k photos in my collection with no degradation in performance.

I'd have your host look at their logs and utilization in an effort to assist.

Offline

 

#9 2021-04-28 15:30:56

buddhabaker
Member
2019-03-28
20

Re: Soft 404 errors

Hi jnashpiwigo
Thank you for your feedback, much appreciated.

I am already talking to them and will provide them with your answer and see what they say.

Muchas Gracias.
Bill

Offline

 

#10 2021-04-28 15:47:55

jnashpiwigo
Piwigo Team
2014-10-21
248

Re: Soft 404 errors

Sorry there isn't anything else I can offer, as it would be host and the logs for SQL and Web Services that would be the indicators for any 404 errors.  (and or potential traffic blocks - but not likely on an individual account unless you chose to throttle)

Offline

 

#11 2021-04-28 17:16:12

buddhabaker
Member
2019-03-28
20

Re: Soft 404 errors

Thank you

Offline

 

#12 2021-04-30 09:03:03

buddhabaker
Member
2019-03-28
20

Re: Soft 404 errors

Hello;
I believe that I have resolved the actual cause of my apparent performance issues and why was I getting some odd errors and the spurious soft 404 errors? These were slowly going away as I asked Google to re-index them? Nearly all were from images held within the Piwigo photo albums. As you know from earlier messages it was difficult to shed any light on the cause and were suggesting that there may be some processing hold-up within my ISP's servers.

However, I was periodically generating new Google xml site maps and uploading them to my website, expecting Google to find them and slowly work its way through the latest version.

Alas, this was not the case.

Meanwhile, I had some Google errors that I couldn't fathom out, such as no viewport set when that was not the case. Why I wondered was this and why hadn't Google found them in the latest copies on my site?
Also, being an ex-computer manager and consultant, I had always wondered how Google indexed each site, where was the processing done, when was it done; overnight or at some other time without impacting on my ISP's server's (34sp in my case) ability to respond to requests? All the while only part of my site was being indexed.

I know it takes a while for Google to work its way through a site so I was not unduly concerned by this, but was wondering when it would complete it?

By accident all became clear. I was browsing through Google's new Search Console when I finally checked in on Sitemaps. The recorded entry was 3 years old! Even though I had updated my site many times and the xml sitemap too, I didn't know (and presumably neither do a lot of other people) that I also had to manually record the latest generation within Google, believing that all I was doing was making Google aware that one existed at the time I created my first one. The one that I had originally recorded had 2000 image references but my latest had 8800. This is where I then began to understand how Google indexed and why I had spurious errors.

Each time I generated a new xml site map even though it was uploaded it was not recorded within Google. Google sort-of took a half look at it. But the real crux is that Google's indexing must take place on its own servers, so there is no performance degradation at each host's site. Based on my experience, I believe that when recording the latest xml site map Google takes a copy of each site and slowly works its way through it as it indexed it on its servers. As my recorded site map was 3 years old it was basing its result, errors etc. on an older copy and size of my own site. So, the soft 404 errors are caused by new images being present, that Google finds, but are not in the recorded copy of the sitemap or of my site as of 3 years ago.

So, it sort of tells you something is wrong but without being explicit about the cause.
So, the solution I believe is a simple one, each time a new site map is generated, inform Google that it exists and delete the previous version. Then it can base its indexing etc. on the latest data.

I trust that is not too onerous to read and that it helps you to understand the causes and solution to this type of problem?
Is the latest version of the xml sitemap the one that is recorded within the search console, and if not make it so.

Offline

 

Board footer

Powered by FluxBB

github twitter newsletter Donate Piwigo.org © 2002-2022 · Contact