Hi,
I’ve faced a strange problem. In google webmaster I see that my site is ok for mobile devices, but when I analyse the site with google developers tools it says that the site is not optimised for mobiles.
I looked through some forums and they say, that the problem is in robots.txt
Could you please suggest what files should be allowed to google bot, so that he sees optimised version?
Sincerely,
Vladimir
Often the problem with a robots.txt file is that it can, by default, block areas of the WP install which actually have the elements needed to render the mobile version, such as the theme folder, or similar. However, this is usually done by a developer, or an automatic file created by server side hosting WP auto-installers, etc.
The theme is responsive, which means the same theme is being loaded for desktop and mobile devices, and only the CSS changes for the “viewport” … meaning, the same style.css file is loaded by either device, but the mobile deice “reads” the part of the CSS that pertains to that size (“viewport”).
Technically, if you have an issue in your robots.txt file, you can actually open that and look at it; and remove everything except any special blocking you might have in place for an abusive content bot, or any directive to Google to NOT index something like a /members/ folder, etc.
Put another way, simply empty your robots.txt file if you feel it’s blocking something! WordPress technically doesn’t use it for anything.
Old school folks might want to put link to their xml sitemap for those spiders which don’t know how to find it (e.g., Google and Bing – you should be submitting that in your webmaster accounts); and again might want to put in some directives for certain bots to not scrape content — but bad bots ignore those anyway.
