Issue with a particular command of robots.txt! Help needed!
-
Hi all,I'm facing a strange issue with a website: www.foodmood.itI've written this robots.txt: www.foodmood.it/robots.txt in which I'm using all commands I've tested and used on other websites.The problem is that this website is not indexing correctly, and my fear is that I've written the robots in a wrong way.In this forum I've been taught that this command Disallow: /*? should be substituted with Disallow: /? in order to be sure the crawler is not indexing all the URLs containing a question mark.My question is: do you think this command modified in the above way can cause a problem to my website?I repeat that I've used it on several sites and this is the first time I'm having this kind of problems.Thanks in advance for your help.A.
-
I would in future tend to trust sources closer to being official rather than someone on a forum. Remove the extra * so its just Disallow: /*?
You can find more info here - https://support.google.com/webmasters/answer/156449
You can also test your robots in your webmaster tools so don't forget to give that a go if in doubt.
Hope that helps.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Issue for Sales Team & Funnelling Smaller Orders
Hi, Hoping somebody might have some suggestions for funnelling smaller orders and larger orders on different journeys. Basically, 90% of our business comes from 10% of customers with larger orders, like contractors and organisations who fill out leads or call us. But about 90% of the sales teams time is taken up from handling lots of smaller calls, which account for <5% of our revenue. Obviously we still want these smaller orders, but would anyone have any suggestions on moving these customers away from phone calls? We've tried to add as much content to the site as possible to answer they're questions, but they seem to just call anyway. Hope you can help!
Conversion Rate Optimization | | Frankie-BTDublin
Thanks1 -
Facebook conversions - issue in calculation
Hi, I have a few campaigns for conversions on Facebook, but any of them don't show to me real numbers. There are 4 times more conversions on Facebook than in GA. I did a little research. The problem is that - Facebook pixel calculates all possible conversions from all sources, and because my campaign results are wrong e.g.: Facebook campaign results: Conversions: 10 | Cost per conversion: 1 GA for that campaign (real numbers): Conversions 1 | Cost per conversion: 1 GA from all campaigns and sources: 10 It's that correct? Pls help. Br. Marco
Conversion Rate Optimization | | marcop21 -
What kind of home page need to be, to show good results of SEO?
Hello, i have couple questions about new home page building. I want to start build new home page to replace old one. At this moment my home page is obsolete and shows low conversion. My costumers often have negative thoughts about existing one. My knowledges in coding is weak, where should i pay more attention to design, to section placement, to pictures and video gallery? Can hosting positively or negatively affect to SEO results? How to make the new website load faster? Here's my website's example. http://www.skydas.lv http://www.m-lux.lv http://www.sosdienests.lv Thank you very much, waiting for replay.
Conversion Rate Optimization | | Felter0 -
Will hreflang indication help single language site?
I have read a few articles that say indicating a language per webpage with hreflang really only helps sites that use multiple languages. Although my site is only in English, I see that it is ranking for a few foreign language keywords in Google Search Console (not sure exact traffic but roughly 15% of visitors from Search are non English preferred). My thought is that indicating language will help my single-language site because it will weed out the non-english speakers who are probably bouncing from the site. Overall I am thinking it might improve the quality of my search traffic. Do you think my logic is sound, or is adding hreflang not beneficial to my site? All feedback welcomed. Thanks!
Conversion Rate Optimization | | Jonathan.Smith0 -
HELP: Analysing data to make decisions, SEO vs PPC
Hi mozers! I have recently been seeing good results in the serps lately for my main keywords in my country NZ, now I'm seeing good results in Australia for these keywords and our USA domain is not far behind and making good progress... However, our NZ results show that we may get around 1 conversion every 3 days from our organic search. I read other places that click share for ppc was much higher, but there is no way we can match our competitors budgets from 3k - 300k per month. So our option was to focus on SEO. To me, the SEO results seem quiet low, however I'm not really sure how to go about diving deep into the analytics of it all to find out where I need to improve or focus on, which keywords are bringing these conversions. Maybe I need to go for long tail keywords etc... It seems my rankings are coming from general keywords which are still highly competitive, but even so, we are not performing to what I know we should be. Our competitors are mostly paying ppc, however I was told my ROI would be better spent via SEO. Any suggestions perhaps what I might be missing or doing wrong in this case. (I have recently done a new design overhaul with a new registration process) I have 3 top level domains you can see the site here http://bit.ly/1yhz96v
Conversion Rate Optimization | | edward-may0 -
Help: Trouble converting customers with new adwords campaign for a new site
I have just launched my brand new e-commerce site www.zenory.co.nz We are wanting to expand global as you can see we have com.au and also .com but due to our min budget we had to start with NZ first for organic search and a min monthly budget on adwords which doesn't come close to what our competitors are paying. Really is it worth paying out our limited budget with adwords? Or should be put that into ranking organic search. While we have only just started our adwords PPC campaign and I think it has only been roughly two weeks - We have had around 18 people sign up, to which we have a 3 step process, however, we are struggling to convert and complete a transaction which customer places credit card details in step 3. Does anyone have any ideas around how we could better optimize or perhaps make any suggestions? Our competitors spend rather large amounts of up to 3000k - 300k per month on adwords, and there is just no competing with that. Any suggestions I would definitely be open to... Thanks alot
Conversion Rate Optimization | | edward-may0 -
Does adding a well scripted and produced video help significantly in conversions from visits to my divorce lawyer website to calls for my services?
Should the addition of well scripted and produced video to my divorce lawyer website increase my conversions and, if so, to what extent?
Conversion Rate Optimization | | hildebrandlaw0 -
Need help Tracking PPC vs Organic and respective ROI
So I have a client who uses PPC and Organic SEO to drive traffic. Once a user gets to the site, the most common action is to fill out a form. I have Auto Tagging enabled in Adwords so all PPC clicks have "gclid" in the url. I am also grabbing the Google Cookie and parsing it out to determine if the visitor is PPC or Organic. So I have an if statement in my form code to pass PPC vs organic through the form for tracking purposes: $url = 'http://' . $_SERVER['SERVER_NAME'] . $_SERVER['REQUEST_URI']; if (false !== strpos($url,'gclid')) { ?> Essentially this is saying: If gclid is in the url, or if the cookie contains PPC
Conversion Rate Optimization | | tjsherrill
set the Web field as PPC Else
Set it as Organic. this is working about 80% of the time. I am trying to raise the accuracy. any ideas where I might be missing some data? thanks0