Screaming frog, Xenu, Moz giving wrong results
-
Hello guys and gals,
This is a very odd one, I've a client's website and most of the crawlers I'm using are giving me weird/ wrong results.
For now lets focus on screaming frog, when I crawl the site it will list e.g. meta titles as missing (not all of them though), however going into the site the title is not missing, and Google seems to be indexing the site fine. The robots.txt are not affecting the site (I've also tried changing the user agent).
The other odd thing is SF gives a 200 code but as a status tells me "connection refused" even though it's giving me data.
I'm unable to share the clients site, has any one else seen this very odd issue? And solutions for it?
Many thanks in advanced for any help,
-
Thanks Dan!
-
^ That's customer service!
-
Cheers for the tweet Andy.
Chris, I'd recommend running through this list here in our FAQ -
http://www.screamingfrog.co.uk/seo-spider/faq/#17
In particular, I'd recommend reducing the crawl speed & adjusting the user-agent.
You can also pop it through to our support (http://www.screamingfrog.co.uk/seo-spider/support/) & we can advise. All confidential etc.
Cheers
Dan
-
I have shared this question with Dan from Screaming Frog for you
-Andy
-
Hi Chris
This is hard to answer without an example - do you have a URL or two that you can share with the community?
Thanks so much!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz shows an F grade and 0 keywords on a previously high ranking page - Please help
Hi all, Moz is showing an F grade and 0 keywords across all URL, Title, Meta, H1, Meta and IMG ALT. My page has also dropped from 1st page rankings for numerous pages to 2nd and 3rd page. The page I am talking about is: http://year13.com.au/10-highest-paying-jobs-you-can-get-without-a-degree/ The keywords/phrases we were previously ranking very well for are: High paying jobs in Australia High paying jobs Highest paying jobs you can get with no degree Etc Etc I have also seen reduction in rankings on other keywords/ pages as well. Does anyone know why this might have happened? And what might be happening? Thanks in advance!
Moz Pro | | Stubs0 -
Following moz guideliness complety, will it certainly improve keyword rankings, domain authority
Hi! G’day to you. I am Naresh from Dotline Infotech. I’d like to take up couple of concerns to be clarified for my better understanding on Moz tool. Indeed, Moz is a nice SEO tool that helps in improving Search engine optimization comprehensive process. We are moz pro member since a year. Moz has equally bifurcated every SEO activity and rate it according to its own benchmark. I intend to ask a series of concerns; Q1. Moz has page grading system A to F. According to Moz guidelines, if the keywords on the page gets repeated minimum 4 times, Moz consider it as ‘A’ grading (one of Moz metric to evaluating the page). Whereas, Google indicates repetition of same keywords time and again is treated as keyword stuffing. According to me, if keywords are already within the content one or two time and furnishing relevant information, why keywords re-occurrence to be 4 time. Does the repetition of same keywords 4 times will lead to give more valuable information? Just a request to let me share why we should unnecessarily repeat keywords? Q2. As per Google guidelines, only 3 keywords can be placed in title tag and also advisable to use only one h1 tag instead of multiple. Among 3 keywords in title tag, only one main keyword can be used in H1 tag. Moz gives much weight age to that particular keyword placed in H1 tag but rest two keywords does not get any importance. I just like to know if we use three H1 tags within page, will it increase the page grading or not. Q3. Does Moz tool have its own index data or refer to Google’s ones? Q4. Following the Moz guidelines completely, will it be 100% sure all our keyword rankings, page authority, domain authority certainly be improved. Looking forward to hear you soon. Thanks
Moz Pro | | dotlineseo0 -
Issues with Moz producing 404 Errors from sitemap.xml files recently.
My last campaign crawl produced over 4k 404 errors resulting from Moz not being able to read some of the URLs in our sitemap.xml file. This is the first time we've seen this error and we've been running campaigns for almost 2 months now -- no changes were made to the sitemap.xml file. The file isn't UTF-8 encoded, but rather Content-Type:text/xml; charset=iso-8859-1 (which is what Moveable Type uses). Just wondering if anyone has had a similar issue?
Moz Pro | | BriceSMG0 -
Internal and external links showing in Webmaster Tools but not in MOZ
Hi there I set up a campaign 2 weeks ago but I am registering zero internal or external links for my website. It's a small site with only about 300 external links but they show in Webmaster tools but not in my link report or Open Site Explorer. Do I need to wait until the next OSE crawl or is something wrong with my set up? Thanks in advance! Laurie
Moz Pro | | turnbullholdingsltd0 -
Mozbar SERP Control Panel Help: Export Results Option Not Available
Hi everyone. For some strange reason, the "Export" option is no longer appearing in my SERP Control panel when trying to export results from the SERP Overlay. It worked fine before SEOMoz changed over to Moz, but now the option is no longer available. Is there something I can do to restore this feature?
Moz Pro | | bashseo2 -
Moz is incorrect
So i have had my latest crawl, and the keyword report is showing that using google.co.uk i have some keywords not within the top 50 - i have just done a spot check (coping & pasting) direct from Moz to google.co.uk and out of 4 i have checked 1 keyword i am number 4 and 1 keyword i am page 3 - therefore within the top 50. This leads me to believe that there is something wrong with Moz - here is 1 example "land in the cayman islands" i am showing in moz as not in the top 50 when i am showing on Google as number.4
Moz Pro | | OasisLandDevelopment0 -
Discrepancy between the Moz Trust Number and Chart, same thing for Moz rank.
I am showing a difference between my Moz rank and Moz Trust Number and their respective charts. Is anyone else seeing this issue?
Moz Pro | | EcommerceSite0 -
Is anyone noticing a difference between Google position when you view ten and when you view a hundred results per page?
We have noticed a gap as large as 30 places when using UK Google. Interested in whether other people are seeing this and if anyone can offer an explaination. Thanks Turkey
Moz Pro | | Turkey0