Possible bug in Crawl Issues report?
-
Hi all -
My crawl issues report shows 3 pages with missing titles. These are just google verification files and the robot.txt file - shouldn't these be excluded?
Pages with Title Missing or Emptyas of May 11
URL Page Authority Linking Root Domains
https://www.mysite.com/googlea87e28121c071983.html
1 0
https://www.mysite.com/robots.txt
1 0
https://www.mysite.com/google9b9dc57478f61677.html -
Wow that is interesting. Thanks for the info and direction Lynn. I will look into that.
Matt
-
Hi Matthew,
I think you will find that those urls are included in your sitemap.xml and that is why they are being crawled. They are also being indexed by google - you can search for the name of the verification files and they show up in the results. Remove them from the sitemap and you should be ok!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is the update site crawl feature following robot.txt rules?
I noticed that most of the errors would not be occurring if Moz's tool followed the rules implemented in sites robots.txt. Has anyone else seen this problem and do you know if Moz will fix this?
Moz Bar | | jamestown0 -
A good ranking Tool to generate reports for multiple markets
Hi, Unfortunately, Moz doesn't offer any feature to generate 1 report with the multiple keywords I have across different campaigns. Since I am running around 10-11 campaigns, it's quite time consuming to create the reports manually. Could you please suggest any good tool/service that can generate a report for multiple keywords across different campaigns ?
Moz Bar | | ebsbarschools0 -
Keyword Ranking Report Blank
I have a custom ranking report set up to run every month. The module that shows the overall changes (how many improved, how many dropped, number in rank #1-3, etc.) populates with data, but the keyword ranking for tracked keywords listing is blank for all keywords, all search engines. I haven't changed anything in my campaigns - why is this reporting blank? Thanks!
Moz Bar | | GranthamUniversity0 -
Ok, I have a strange duplicate content issue.
Just ran MOZ against my site and about fell of my chair, over 1k pages being flagged as having duplicate content. That's about every page on the site. I downloaded the CSV file and things got even more confusing, The URL's under "URL" and " Duplicate Page Content" area exactly the same. Am I missing something? I would expect the URL under Duplicate Page Content to show a different URL, to the page with the exact same content. Any help would be appreciated, traffic is tanking and I need to get this figured out. Thanks,
Moz Bar | | Trigger130 -
How is this possible, Keyword Difficulty tool has some problems
Hello guys, I have some concerns or misunderstanding. If I am about to look for [software development] using Google first, it shows that the Exact match for the keyword is 16,574, then I choose Bing and I had the same number 16,574. Yahoo is the showing the same figure. Do I miss something in here or this tool doesn't work? odd_zps2388b5a9.png
Moz Bar | | Askalexis0 -
Keyword Difficulty Report - Google Engine selected, however system is return Bing results
Is there happening for anybody else?? We run a Keyword difficulty report and select Google Australia, however in the results it is showing the values for Bing search volume ... instead of Google 1083.jpg
Moz Bar | | L10Group1