Help with Roger finding phantom links
-
It Monday and Roger has done another crawl and now I have a couple of issues:
- I have two pages showing 404->302 or 500 because these links do not exist. I have to fix the 500 but the 404 is trapped correctly.
http://www.oznappies.com/nappies.faq & http://www.oznappies.com/store/value-packs/\
The issue is when I do a site scan there is no anchor text that contains these links. So, what I would like to find out is where is Roger finding them. I cannot see any where in the Crawl Report that tells me where the origin of these links is.
- I also created a blog on Tumblr and now every tag and rss feed entry is producing a duplicate content error in the crawl stats. I cannot see anywhere in Tumblr to fix this issue.
Any Ideas?
-
Thanks again Ryan, you have been very helpful answering al lot of my questions.
-
Someone else asked the same question regarding tag pages yesterday. I would suggest asking a separate Q&A on that topic.
Tag pages & forum category pages are both often used as containers. They don't have any content except links to articles. I would ask for feedback as to the best practice. I suspect noindex, following those pages would be best, but I don't have the experience to feel comfortable offering that advice.
-
I have been looking at the data that Roger is reporting for the duplicate content and in ALL cases there is either a 301 or a NoIndex. So now I do not know why Roger is reporting them as a duplicate, robots should not see the second entry.
-
I did not think of looking at the csv report. I see it now thanks Ryan. There should be a soft 404 handler in place to process the bad urls, I will have to see why it is not working.
With tumblr, I was looking for an easy way to add a blog to the site.
The RSS is coming from tumblr as is all the content.
When we specify Tags in tumblr it creates urls e.g. mypage.com/article/tag1 mypage.com/article/tag2 mypage.com/article/tag3 which all contain the content of mypage.com/article with out a canonical to the original. It is a really strange non-seo friendly approach, and so I wondered if anyone had similar problems.
-
The crawl report offers a "referrer" field. That field offers where Roger found the offending link. In my experience that field has always been accurate.
When I try to access www.oznappies.com/faq I receive a 302 redirect and a 500 error. I would recommend adjusting non-existant pages to a soft 404 page. Still provide a 404 response to browsers, but offer users a friendly way to find information (i.e. links / search) and stay on your site.
A great example of a soft 404 page is http://www.orangecoat.com/a-404-page.html
For the Tumblr issue, I am not clear on the problem. Are you writing content and publishing on both the oznappies.com site and your tumblr site? Then this content is being published again on your site via a RSS import?
-
I removed the links and just left the text so these will cut and paste now. It confuses me where Roger found the links.
Thanks for running the Xenu scan. I have tried other site scanner and come up blank.
-
That second link is anchored to the wrong place.
Regardless I also cannot find the .faq page. I just ran Xenu over it to see what it could find, but no broken links showed up.
Afraid I don't use Tumblr either, so eh, pretty useless post. Sorry.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Same linking c-blocks trend as competitor
I noticed in our competitive link report that our number of linking c-blocks has risen and fallen in the exact same pattern as one of our competitors. Is there a reason why this would be happening?
Moz Pro | | ZoomInformation0 -
Forums and soical network pages - link analysis
Hi, I am working on reputation management project and i reach the point when i found that forums pages and social pages are hard to analyse their links and page rank. for example if you search these kind of pages on http://www.opensiteexplorer.org/ , it wont show any result And if you try to find the page rank on Moz toolbar it will show 1 pagerank How would you do guys when u are in this situation, Do you consider these kind of pages different than normal pages? Thanks
Moz Pro | | MohammadSabbagh0 -
I don't see new links in Just Discovered
I noticed that new links are not displayed for my domain (new links have been added yesterday). How is that? My site is http://www.phraseexpander.com Thanks. Andrea
Moz Pro | | nagar0 -
Tracking External Followed Inbound Links - Are We Getting Fooled?
This question is not about how to use SEOMOZ Link tools. It's about the numbers themselves and how their fluctuations are causing confidence issues.... My client wants to track inbound followed links over time. But as I understand it, this number will vary depending on the Linkscape crawling success (or even outages or partial crawls.) In the past few reports, we've had wild fluctuations which have made them very nervous. If my client wants to track inbound followed links over time, what SEOMOZ metric should we use for the most reliable progress checks?
Moz Pro | | scottclark0 -
How come there are no links to my website according to SEOmoz Competive domain analysis, while in google webmaster i do see links.?
I dont see any links to at all when i do a Competitive Domain Analysis in SEOmoz. However i do see links in google webmaster tools. this strikes me as odd. Also when i use open site exployer my website dont seem te be found. In google im on page 9 on my focus keyword so i do think there are links to my site. I would like to know what i can do so i can analyse my links in seomoz Competitive domain analysis. Many thanks. url: http://www.sadpanda.nl
Moz Pro | | Aquive0 -
No follow Internal Links
Hello, I am comparing my site with my competitors. According to Open Site Explorer, my site has 541 internal follow links, and a total of 1,286 total internal links, implying I have 745 no follow internal links. I tried to drill into these internal no follow links using the "Inbound Links" report in OSE. But I'm receiving an error stating that No Data is Available for this URL. Does anyone have any insight to this? I'd really like to understand where those no follow links are coming from. Thanks in advance. eh70
Moz Pro | | TheBOTWGuys0 -
Why is open site explorer not showing the top links that if found previously.
In previous months ago open site explorer listed many other sites linking to mine. I have checked those sites and they are still linking to my site. Why doesn't open site explorer list them?
Moz Pro | | call4help0 -
Why is the crawler following form action links?
I have an issue with one of my sites where the SEOMoz crawler is following some form action links. It is my understanding that the crawler will ignore these links. Why would it not be ignoring them in certain cases. If you need more detail, please ask. Thanks.
Moz Pro | | AmberHanson0