Welcome to the Q&A Forum

Cheers @Andy & @Patrick

Hi Fred,

I haven't performed an extensive check, but the SEO Spider crawls around 35 URLs with /pi/ in the string, which is presumably not all the products on the site

Patrick actually mentions the issue in one of his points above. Essentially it looks like the site uses JavaScript on category pages for products, example - http://www.netspiren.dk/pl/Helse-Homøopati-Allergica-Ron-serien_58721.aspx

If you disable JS in your browser, you'll see a blank page where the products were. Our tool doesn't execute JS, although Google is much smarter and often can.

However, I'll leave you to verify that -

http://webcache.googleusercontent.com/search?q=cache:HBwmVULX5zYJ:www.netspiren.dk/pl/Helse-Hom%25C3%25B8opati-Allergica-Ron-serien_58721.aspx+&cd=1&hl=en&ct=clnk&gl=uk

Hope that helps!

Cheers

Dan

Cheers for the tweet Andy.

Chris, I'd recommend running through this list here in our FAQ -

http://www.screamingfrog.co.uk/seo-spider/faq/#17

In particular, I'd recommend reducing the crawl speed & adjusting the user-agent.

You can also pop it through to our support (http://www.screamingfrog.co.uk/seo-spider/support/) & we can advise. All confidential etc.

Cheers

Dan

Thanks for helping out with the above query guys, all good answers.

Hey @Margarita,

If you'd like to drop an email through to [email protected], I can tell you what the exact issue is

Cheers,

Dan

Hello

I spotted this thread and was just about to reply, but Dirk has answered it all perfectly. Thanks Dirk!

Under 'reports' there's also a 'canonical errors' report which will show canonicals with various technical issues - Those that are blocked by robots.txt, have no response, 3XX redirect, 4XX or 5XX error (essentially anything other than a 200 ‘OK’ response). It will also show any URLs discovered only via a canonical, that are not linked to internally from the sites own link structure (in the ‘unlinked’ column when ‘true’).

Hope that helps anyway.

Cheers!

Dan

Hi Luke,

As the guys above replied with, sounds like an a href with a phone number

If you check the 'inlinks' (via the lower window tab), you'll be able to see the source of these errors (the pages they are located). Obviously you can then view the source code & find the exact link, and what might be the issue.

Hope that helps!

Feel free to pop through any further questions directly to our support btw (http://www.screamingfrog.co.uk/seo-spider/support/), I only spotted this via a Google alert.

(We try and reply super quick & will always look into any problems!)

Cheers.

Dan