WP Events Calendar Creates URLs Too Long in Site Crawler
-
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples.
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003
- https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034
- https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873
Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar.
Thanks!
-
Pretty sure it would be:
- User-agent: Rogerbot
- Disallow: /*?ajaxCalendar
- Disallow: /*&ajaxCalendar
That would pretty much handle OPs concern there
-
Hi there!
Thanks so much for the great question! Sorry for the trouble here. If you're looking to keep rogerbot from crawling and reporting issues on those calendar pages all together, you could block us from those pages using a disallow directive in your robots.txt file. It may look something like this:
User-agent: Rogerbot
Disallow: /?fullor whatever tag you're wanting to block us from crawling. I have a guide here that talks more about rogerbot and this technique that may be helpful, as well. I would recommend also checking your robots file in a robots.txt checker after making changes just so that no surprises come up!
If you'd like us to look into where we're finding these links or if you have any other questions, please feel free to email us at [email protected] with the Campaign you're working.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why am I not seeing search.yahoo.com in my site's backlink profile?
When looking at the backlinks for a client's competitor I found that they had a backlink on search.yahoo.com/reviews and our domain (harmonyhit.com) did not. I was using the Link Explorer tool. However, when I go to yahoo Search I see that the website of harmonyhit.com is indexed in Yahoo search and has links to the site. Also, it's sitemap has been recently crawled in Bing webmaster tools which Yahoo uses. Why does our client have the backlink accounted for and we do not?
Link Explorer | | DigitalThirdCoast0 -
Non owned URL showing up in rank tracker report
Hello, In my weekly rank tracker report, I have a non owned URL showing up with GA UTM params in there. How is this possible and how is it possibly ranking under a different domain?
Link Explorer | | dlarusso.teguar1 -
Open Site Explorer external + follow links percentage
Hi how are you my root domain according to open site explorer has 90% of total links, external + follow. whereas my competitors have 5 - 6% how do I get this down to look more natural. Also what does this metric mean and how do I work out the percentage? Also I only have around 100 pages on my website which is a Shopify store and I have a small amount of internal followed links is this important for an ecommerce website as it is small number in comparison to my competitors. Thank you regards Adam
Link Explorer | | hourspy1 -
Page Authority different between Moz Open Site Explorer and On Page analyser
I have a client who has an old URL with 3 linking root domains and 4 links, with a PA of 24. This is on the open site explorer. There is a 301 redirect in place to direct this old url to the new url. When he uses the Moz bar on page, it shows that he has a PA of only 1 with no LRDs or inbound links? Can anyone please explain why this is happening and if this could affect further page links across his site? It would be appreciated. Kind regards
Link Explorer | | lisa_rothery0 -
Is open site explorer the best way to find backlinks?
I know my websites have links from other sites, but I don't see it listed using the open explorer tool. perhaps the reputation of the external link is a factor? _Cindy
Link Explorer | | cceebar0 -
Spam score question on shortened URLs
Hello, Our agency owns a URL, thejoint.co, specifically for url shortening. There is no content on this url. When we post client's content to social media channels, we use the shortener which 301s to the normal URL. Now, when I use Moz Open Site Explorer to view a client's webpage (http://chiropractorphoenix-thejoint.com/scottsdale/shea/ or chiropractorglendaleca-thejoint.com), I see thejoint.co with a spam score of 9. I'm looking for clarification if this is a real problem in regards to my clients website health? If so, is there any way to keep the shortner without the negative effects? Thank you, P.S. Does this mean Moz's Spam tool also recognizes Bit.ly and other similar services as spam?
Link Explorer | | Overthet0p0 -
Open Site Explorer is finding old html Files that havn't been on my site in two years... even after a 301 Redirect. HELP!
Hello!
Link Explorer | | morganlindsaycole
My problem started when I became aware that when I checked my backlinks for the past two years, it states that no backlinks have been found. When I ran a site analysis on SEMrush - No backlinks are found on the URL, or Domain. There are 7 Backlinks on the Root Domain and those were configured in 2012. I made a second domain www.columbusweddingphotographersreviews.comwhere I linked to my domain at www.morganlindsayphotography.com so I could test that google had crawled both websites and after, still no backlink was found. I have also been published on a dozen or so wedding websites that has linked to my website where they are follow links and still nothing. (http://www.brendasweddingblog.com/blogs/2015/2/23/an-elegant-fall-wedding-in-ohio-with-morgan-lindsay-photography) **Website Background- **
In 2012 I had two separate websites - One for Seniors that was an HTML website I build in Dreamweaver at www.morganlindsayphotography/seniors and another for Wedding Clients found at www.morganlindsayphotography.com/Wedding - (wordpress) I had a Splash page wish was found atwww.morganlindsayphotography.com. Two years ago when I became aware splash pages were frowned upon in Google, I combined the two websites and stayed with the Wordpress which was www.morganlindsayphotography.com/Wedding
Because I did not want users to have to go to www.morganlindsayphotography.com/Wedding to view my url, Godaddy moved my wordpress site from thewww.morganlindsyphotography.com/Wedding directory towww.morganlindsayphotography.com When I ran the Open Site Explorer with Moz I found after runningwww.morganlindsayphotography.com the TOP pages on this domain according to Page Authority are old HTML files from my senior website, as well as old Posts from when my wordpress site was found atwww.moragnlindsayphotography.com/Weddings
No current pots or pages are showing up besideswww.morganlindsyphotography.com I do run a cache management system to speed up my system and recently cleaned out my .htcacess folder and still had no luck. This is difficulty something **Last night I made a 301 Redirect in my htaccess for all the old links pointing to the new links as best as I could. My htacess folder looks like this.. BEGIN WordPress <ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /
RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]</ifmodule> END WordPress Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding/ http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /about.html http://www.morganlindsayphotography.com/about-morgan-lindsay/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /app.html http://www.morganlindsayphotography.com/blog/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /experience.html http://www.morganlindsayphotography.com/senior-sessions/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /index.html http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /senior.html http://www.morganlindsayphotography.com/ohio-senior-photographer/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /seniorsconstruction.html http://www.morganlindsayphotography.com/ohio-senior-photographer/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding/2012/06/22/brittany-reis-jason-mcclaflin-tiffin-ohio-wedding/ http://www.morganlindsayphotography.com/holy-family-church-columbus-wedding/ After I ran the open site moz explorer and the www.morganlindsayphotography/Wedding was still there..0 -
Open Site Explorer and Expired Links?
Hi guys, I've been checking a few domains for SEO purposes and it appears that OSE is indexing a lot of links which no longer exist, this has been the case for over 6 months - does OSE cleanse expired links? As I'm sure they will be contributing to authority in the eyes of Moz?
Link Explorer | | lotterybase0