Can anyone tell me why the bot has only picked up one page?
-
www.namebadgesinternational.co.nz
After the 2nd week, I changed the robots.txt file to allow ALL robots on the website, but it still hasn't gone through any pages after another crawl
Any help would be hugely appreciated.
-
Hi again,
Since there are a lot of directives in this that are specific to certain conditions in your site that we cannot see, you should leave them alone.
Your redirect should appear at the beginning of the .htaccess anyway, so your best course of action is:
- Make a copy of your existing .htaccess file with a different name so that you cannot accidentally lose it by overwriting
- Place your redirect code at the beginning of the .htaccess (remembering that "RewriteEngine On" should appear only once)
- Save and upload your new .htaccess file
- Check in your browser to see if the redirect works (as many known pages as possible)
- If it works, CELEBRATE!
- It it breaks, replace your file with your copy of the original and ask the original developer, or one with access to the detail of your site to sort it out for you.
Incidentally, the rule you have above will redirect from www to non-www...just to be sure that is what you intended.
Hope that helps,
Sha
-
This post by the help desk about why a full crawl isn't being done may also be helpful.
-
Hi designsecrets,
I'm assuming that you are referring to the SEOmoz bot (Roger) and seeing only one page of your site crawled.
If this is correct, then there has been a similar known issue in the past.
You will need to go to SEOmoz Help and ask the Help Team to look at the campaign and sort out the problem for you. Make sure that you provide them with your campaign number and/or domain to make it easy for them to locate the problem.
You can also access the Help area by clicking the Help link at the top right of any page on the site.
Hope that helps,
Sha
-
Hi,
A quick search on Google for site:namebadgesinternational.co.nz shows other pages are being indexed.
I can see a few other issues too, for instance the canonicalization of your domain and homepage, your homepage can be accessed via www, non-www, index.php and though root /
It may be a good idea to log into your Google Webmaster tools account (assuming you have one) and check Diagnostics for crawl errors and similar.
Also our robots blocks /cgi-bin but leaves 404 and login pages open to indexation (i would personally block these as i don't want my visitors landing on them).
Check out http://www.seomoz.org/learn-seo/canonicalization for more info on canonicals.
best of luck...
Aran
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our protected pages 302 redirect to a login page if not a member. Is that a problem for SEO?
We have a membership site that has links out in our unprotected pages. If a non-member clicks on these links it sends a 302 redirect to the login / join page. Is this an issue for SEO? Thanks!
Technical SEO | | rimix1 -
Wrong Page Ranking?!?
I did some research today, one of our keywords is "mobile column lifts." I recently redid a page on our website to target this keyword. When I Google search this keyword I see that a page on our site titled "Reconditioned Mobile Lifts" is ranking for this keyword. I took a look with Moz, our mobile column lifts page ranks 90 for the keyword, and the reconditioned lifts page ranks 73 the keyword. Why is this happening? How can I fix this? https://www.slec.com/mobile-column-lifts/ https://www.slec.com/reconditioned-mobile-lifts/
Technical SEO | | slecinc0 -
Duplicate page issue
Hi, i have a serious duplicate page issue and not sure how it happened and i am not sure if anyone will be able to help as my site was built in joomla, it has been done through k2, i have never come across this issue before i am seem to have lots of duplicate pages under author names, example http://www.in2town.co.uk/blog/diane-walker this page is showing the full articles which is not great for seo and it is also showing that there are hundreds more articles at the bottom on the semoz tool i am using, it is showing these as duplicates although there are hundreds of them and it is causing google to see lots of duplicate pages. Diane Walker
Technical SEO | | ClaireH-184886
http://www.in2town.co.uk/blog/diane-walker/Page-2 5 1 0
Diane Walker
http://www.in2town.co.uk/blog/diane-walker/Page-210 1 1 0
Diane Walker
http://www.in2town.co.uk/blog/diane-walker/Page-297 1 1 0
Diane Walker
http://www.in2town.co.uk/blog/diane-walker/Page-3 5 1 0
Diane Walker can anyone please help me to sort this important issue out.0 -
Seomoz pages error
Hi
Technical SEO | | looktouchfeel
I have a problem with seomoz, it is saying my website http://www.clearviewtraffic.com has page errors on 19,680 pages. Most of the errors are for duplicate page titles. The website itself doesn't even have 100 pages. Does anyone know how I can fix this? Thanks Luke0 -
I need help compiling solid documentation and data (if possible) that having tons of orphaned pages is bad for SEO - Can you help?
I spent an hour this afternoon trying to convince my CEO that having thousands of orphaned pages is bad for SEO. His argument was "If they aren't indexed, then I don't see how it can be a problem." Despite my best efforts to convince him that thousands of them ARE indexed, he simply said "Unless you can prove it's bad and prove what benefit the site would get out of cleaning them up, I don't see it as a priority." So, I am turning to all you brilliant folks here in Q & A and asking for help...and some words of encouragement would be nice today too 🙂 Dana
Technical SEO | | danatanseo0 -
Can Not Save the SEO Settings on Attachement/Media Page
I am trying to save SEO settings to a wordpress gallery attachment page for a picture. When I fill up all info and hit save all the writing disappear from from the form. Is it a software bug or there is a solution for it??
Technical SEO | | ExpertSolutions0 -
Hundreds of 404 Pages, What Should I do?
Hi, My client just had there website redeveloped within wordpress. I just ran a crawl errors test for their website using Google Webmasters. I discovered that the client has about six hundred, 404 pages. Most of the error pages originated from their previous image gallery. I already have a custom 404 page set-up, but is there something else I should be doing? Is it worth while to 301 redirect every single page within the .htaccess file, or will Google filter these pages out of its index naturally? Thanks Mozers!
Technical SEO | | calindaniel0 -
Keywords Ranking Dropped from 1st Page to Above 5th Page
Hello, My site URL is http://bit.ly/161NeE and our site was ranked first page for over hundred keywords before March, 30. But all of a sudden, all the keywords on first page dropped to 5th or 6th page. When we search for our site name without ".com", the results appeared on first page are all from other sites. And our page can only be seen on 6th page. We think we have been penalized by Google. But we don't know the exact reason. Can anyone please help? Some extra info on our site: 1. We have been building links by posting blog, articles and PR. All the articles are unique, written by the writers we hire. It has been working fine all the time. We also varied the anchor text a lot. 2. We didn't make any change to the website. But one real problem with our site is that the server is very slow recently and when google crawl our website, many errors were found, mostly 503, 404 errors. And the total number of errors have reach to over 50,000. Do you think this might be a problem for Google not displaying us on first page? Our technicals are working hard to solve server problem. And if it is solved, shall our rankings be back? Please advise. Thanks.
Technical SEO | | Milanoocom0