Remove image URL from a google crawl
-
hello
one of the warnings Im getting is that one of my urls has too many on page links
here's the page:
http://cheap-airport-taxis.com/airport-cab/?show=gallery
but the url is being auto generated due to the wordpress plugin NextGen Gallery
anyway I can exclude these from the site crawl. This page has no purpose, as the core path shows these images anyway.
James
-
Hi James,
There are two ways to do this;
1. In Webmaster tools, there is a link under the Optimization menu to remove a URL,
2. Or if you'rve got access to your robots.txt file, just add the following to the bottom:
Disallow: /airport-cab/?show=gallery
This will remove it from the Google index next time the file is crawled.
If you are on Wordpress, and do not currently have an SEO plugin, try Yoast's, and use the Edit Files sub-menu to edit your robots file there.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Webinar: Get to Know the New Site Crawl Recording
Good morning all, Does anyone have the recording for Friday, June 9th's webinar? I was at an off-site event that day and couldn't listen in. The recording isn't listed in the moz.com/webinars section. Any help is appreciated, thank you!
SEO Learn Center | | Corporate_Synergies1 -
Site migration 301's list on Apache server - when do I take the old migrated URLs off our 301 list?
Howdy! The site was migrated last year to a new platform, therefore the URLs were migrated over using 301 redirect rules. Since then, the server has a huuuuge list of rules for URLs and I wanted to know when can we start taking these off of the list? And, how can I test to see if they are still indexing, do I simply just add the url to the google search bar? Thanks Guys! Kay
SEO Learn Center | | eLab_London0 -
Can you have same product name and description on a local and national site at the same time without getting dinged by google?
My question is regarding a few sites we own which are all related. The local site (http://location.company.com) is a extension of the national main site (http://company.com.) We are in the process of launching these new sites as replacements to older sites we created years ago. My first question regarding SEO is it important to the search engines to have unique product content on both sites even though they promote the same products (with same pictures) and brands or can we keep the same product names and descriptions as I hope? I ask this because essentially they are the same site but with with the exception of the local extension..... We thought by re writing all the content on the main pages of both sites along with different; title tags, page title and meta descriptions that that would make the sites different enough to get away with this. Is that the case? Thank you in advance for your assistance, Jake
SEO Learn Center | | Closetstogo0 -
Google Analytics setup tips and tricks?
I want to see (and possibly compile) other marketers tips and tricks when it came to setting up their Google Analytics. I feel like I sometimes get into a rut when I setup GA for clients and I want to make sure that I'm not getting rusty with it. Some of the things I'm interested in (but not limited to): How do you use dashboards? What funnels do you setup? How do you utilize goals? What are your favorite metrics to report to clients? What are the top items on your checklist when setting up GA? And many others I could include here... I'd be interested in seeing what other marketers include in their GA setup and reporting. These can be super simple or expert level tips and tricks. It's a personal curiosity I have so that I make sure I'm staying up to date with everything but if there is enough participation I will compile everything into a YouMoz post or something as a guide for us to use and share. So please share this question with others if you can. Thanks!
SEO Learn Center | | HashtagJeff2 -
My Wordpress Organic Blog traffic disappeared and Google is indexing Viagra and Online Med titles for some articles. How to fix that?
Hello, I'm worried that all my organic traffic has disappeared according to Analytics from past friday and now Google is showing results from my title tags in the last days as you can see here: http://goo.gl/QFSgy Is there any additional resources I can read apart from Google Clean Your site Guidelines here https://support.google.com/webmasters/answer/163634 or the Wordpress FAQ for hacked sites here? http://codex.wordpress.org/FAQ_My_site_was_hacked Very much appreciated all of your help! Regards.
SEO Learn Center | | viventuraSEO0 -
How do you eliminate negative "Searches Related To This" on Google?
I have a client who when you type in their company name in Google there are some negative terms in the space that says "Searches related to this" ... Is there any way to eliminate these? We are not sure why it is showing up since it has nothing to do with their company but it does look bad...
SEO Learn Center | | JChronicle0 -
For Newbies! | Matt Cutts on "How does Google use human raters in web search?"
I answer many questions here in Q&A. Instead of helping one individual, I thought this would help many newbies understand how Google uses human raters for web search. Watch Matt and learn why you should not SPAM or make sorry titles. http://youtu.be/nmo3z8pHX1E?hd=1 I hope this short video helps you! Leave a comment if you wish.
SEO Learn Center | | Francisco_Meza2 -
How do I get google to crawl white papers that displays a form for human visitors?
How do I get Google to crawl white papers that displays a form for human visitors? I have been looking into this and understand that I need to set the form up as a GET form which has been done. Google said they want you to "avoid" forms that require personal information but to what extent do they want you to do that? The form is used as a lead generator so we need to collect information such as name, company name, email, ect.The information we require currently is: Name, Company name, Email, Phone Number and Number of employees. Once a user puts in their information they have access to the rest of the content and they don't need to re-enter the information in so I assume once Google gets past this feature they can gain access to the rest of the content. I understand that I need to have a form that doesn't ask for personal information which is the dilemma. So what should we do to work around this? Is there a solution that will allow me to obtain some personal information while still allowing Google to crawl the pages? Thoughts and any feedback is much appreciated, TJ
SEO Learn Center | | SEO_com0