WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at [email protected] with the Campaign you're working.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Open Site Explorer Showing Blank Screen
Hi Moz Community, When I go to search for backlinks for any site, I am getting a blank screen after starting the search. This is happening to every search I perform for any URL or root domain. It's been happening for about a week now and I am not able to find any solutions. Any help would be greatly appreciated. Thanks! Ryan
Link Explorer | | RyanRhodesGW0 -
Exportable Bulk PA Analysis for Entire Site?
Is there a way to run a report through Moz's Open Site Explorer to produce an MS Excel or Google Sheets spreadsheet showing Page Authority (PA) for all the individual pages on my site?
Link Explorer | | micromano0 -
Can you compare social profiles (FB, Twitter, Instagram, Linkedin) for sites - in a similar way you can compare sites using OSE
Can you compare social profiles (FB, Twitter, Instagram, Linkedin) for competitors sites - in a similar way to how you can compare sites stats - (DA, PA, Backlinks etc) using OSE's compare tool?
Link Explorer | | mike8780 -
Spam Score and crawling of my site
Hello, I'm trying to analyze the spam score of my site which is 9/17 Actually I have few backlinks and all of them have a low spam score (max 4/17, just one). I think there's some kind of issue with the crawler since I get strange spam factors: Large Site with Few Links (likely true, I recently deleted a lot of tags used once) Low Number of Pages Found (wasn't it a "Large Site"??) Low Number of Internal Links (I got a considerable number) No Contact Info (I have a link to my facebook in the menu and a "contacts" page) Thin Content (It's just a blog with min 300 words per post, why thin?) Site Link Diversity is Low (likely true) Ratio of Followed to Nofollowed Subdomains (likely true) Low MozTrust or MozRank Score (true) Ratio of Followed to Nofollowed Domains (likely true) Can you please help me to understand it, is it a crawling problem or similar? If needed I will post the url of the website. Thank you so much Marco
Link Explorer | | MarcoBP0 -
Spam score question on shortened URLs
Hello, Our agency owns a URL, thejoint.co, specifically for url shortening. There is no content on this url. When we post client's content to social media channels, we use the shortener which 301s to the normal URL. Now, when I use Moz Open Site Explorer to view a client's webpage (http://chiropractorphoenix-thejoint.com/scottsdale/shea/ or chiropractorglendaleca-thejoint.com), I see thejoint.co with a spam score of 9. I'm looking for clarification if this is a real problem in regards to my clients website health? If so, is there any way to keep the shortner without the negative effects? Thank you, P.S. Does this mean Moz's Spam tool also recognizes Bit.ly and other similar services as spam?
Link Explorer | | Overthet0p0 -
My Backlinks are Coming ZERO in Open SIte Explorer
I have made many links for my website, I checked in majestic it showed me about 40. But MOZ is showing Zero. The last i remember I checked: Add noodp meta robots tag sitewide in SEO YOAST. It said it prevents search engines from using the DMOZ description for pages from this site in the search results. Also I have a NoIndex (canonical ) on category, archive, author, tag to avoid Duplicate Data. But when i see the source of my website, it shows <rel link="canonical">on every single page and post of website. Can this be the reason why MOZ is not showing any backlinks? </rel>
Link Explorer | | himanshu22630 -
Error message coming up for Open Site Explorer
When in Open Site Explorer there seems to be an error getting the data for http://vagabondtoursofireland.ie/ or www.vagabondtoursofireland.ie I have used this with other websites and have never had a problem. Thanks.
Link Explorer | | Johnny_AppleSeed0 -
Really odd 404 URL's
Hi I'm getting some really odd 202 errors, I can't think that someone would link to me like this " http://sussexchef.com/contact-us/http.sussexchef.com/contact-us/ " There are 95 of them to deal with, I've checked my site and I can click though all the links on my site with out coming across 1 404. Any ideas? All the best Ben hiZnv0Y
Link Explorer | | SussexChef830