Blazingpie
08-21-2007, 08:50 AM
Im posting this here as i had Google more in mind for this,but it does affect all SEs...
Normally SEOers say that custom 404 error pages MUST return the 404 error code (for obvious reasons).
However, I was thinking - why not try create a more spider-friendly Page Not Found page. My thinking is this: if the 404 page had to contain links, would Google still follow them? If not, then why not create a normal (code 200) page for the 404 page, then simply add 'noindex, noarchive, follow' meta commands to it? The links would be followed but the page would not be indexed, etc, thus the spider would not meet a dead-end while spidering.
What do you guys think?
Normally SEOers say that custom 404 error pages MUST return the 404 error code (for obvious reasons).
However, I was thinking - why not try create a more spider-friendly Page Not Found page. My thinking is this: if the 404 page had to contain links, would Google still follow them? If not, then why not create a normal (code 200) page for the 404 page, then simply add 'noindex, noarchive, follow' meta commands to it? The links would be followed but the page would not be indexed, etc, thus the spider would not meet a dead-end while spidering.
What do you guys think?