Sites Blocking Open Site Explorer? Penguin related.
-
Last week I was looking at a competitors site who has a link scheme going on and I could actually check the links for each anchor text.
This week they don't work at all, do you think they're blocking the rogerbot on their domains? Or is there a problem with open site explorer?
http://www.opensiteexplorer.org/anchors?site=www.decks.ca
If you're interested in the background, all the links are to instant-home-biz . com which then redirects decks . ca - it's a tricky technique. Pretty much all of the links are from sketchy sites like:
airpr23.vacation-4-free.com/airpr23.blogfreeradio.net/airpr23.blogomatik.com/http://www.morcandirect.com/mortgages/resources2.php which I thought Penguin was supposed to catch…
-
Hello Nathan,
It seems that www.decks.ca redirects to www.decks.ca/. The forward slash at the end of the address should be included in your OSE search. Please try that and confirm that it works for you. We apologize for the confusion on this one.
I've confirmed the data displays properly here: http://www.opensiteexplorer.org/anchors?site=www.decks.ca%2F
Abe Schmidt
SEOmoz Help Team
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Rogerbot blocked by cloudflare and not display full user agent string.
Hi, We're trying to get MOZ to crawl our site, but when we Create Your Campaign we get the error:
Moz Pro | | BB_NPG
Ooops. Our crawlers are unable to access that URL - please check to make sure it is correct. If the issue persists, check out this article for further help. robot.txt is fine and we actually see cloudflare is blocking it with block fight mode. We've added in some rules to allow rogerbot but these seem to be getting ignored. If we use a robot.txt test tool (https://technicalseo.com/tools/robots-txt/) with rogerbot as the user agent this get through fine and we can see our rule has allowed it. When viewing the cloudflare activity log (attached) it seems the Create Your Campaign is trying to crawl the site with the user agent as simply set as rogerbot 1.2 but the robot.txt testing tool uses the full user agent string rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, [email protected]) albeit it's version 1.0. So seems as if cloudflare doesn't like the simple user agent. So is it correct the when MOZ is trying to crawl the site it uses the simple string of just rogerbot 1.2 now ? Thanks
Ben Cloudflare activity log, showing differences in user agent strings
2022-07-01_13-05-59.png0 -
Which backlinks sites to use for full competitive research
Hello, Doing competitive research for really gentle basic link building campaign. Which sites do I need to get a backlink list from besides open site explorer to be most successful? Thanks.
Moz Pro | | BobGW0 -
Relation between domain age and domain authority?
what is relation between domain age and domain authority? Old registered domain help for domain authority higher or not? if so, but i am still in confused, http://www.green-lotus-trekking.com/ this is too old domain but authority is only 33?
Moz Pro | | agsln1 -
403 error for a member site
Perhaps a stupid question but SEOmoz registers 403 errors for pages behind a membersite (ie. they are restricted on purpose). Should I noindex these pages or just let SEOmoz register these "errors"?
Moz Pro | | Crunchii0 -
Site Not Indexing & SEOMoz Reporting ZERO On-Page Report Crawls
Any help on this would be MUCH appreciated. One of my sites, aironeairsolutionsinc.com, has recently been rebuilt and the pages tweaked for some basic optimization. Based on my experience, those tweaks (geared toward keywords with relatively low competition locally) usually bump my local sites up into the top 20 or 30 at worst. 3 weeks later, it seems my site is still not indexing with Google. In addition, I AM NOTICING THAT THE ON PAGE REPORTS IN SEO MOZ ARE NOT REGISTERING THAT ANY PAGES ARE BEING CRAWLED. Again, any help from Moz staff would be awesome! :} Thanks, Ricky
Moz Pro | | RickyShockley0 -
Opens Site Explorer sees two pages that are one
www.mysite.com/ and www.mysite.com/default.asp are both showing up in open site explorer. How do I make sure that these are not being interpreted as two pages when they are the same page? (Both in search engines and OSE.)
Moz Pro | | EugeneF0 -
"Loading" error in Open Site Explorer
The "top pages" keeps hanging while trying to retrieve social metrics "FB Shares" "Tweets" and "Google +1". I've tried in Chrome and Firefox. Can I just turn these off? ose-hanging.jpg
Moz Pro | | cpaddock0 -
Open Site Explorer Issue - Pullng up No-follow links when settings ask for Follow + 301 Redirect..
Anybody else having this issue? Here lately when I am doing competitive research on open site explorer I set it to only pull up followed + 301 redirects and it will still pull up no-follow competitors links. Can anybody help me out here?
Moz Pro | | axzm0