Site not coming up in google cause of robot.txt

Posted in: Newspaper
Post count: 14

Hi,

What is the problem with that?

“A description for this result is not available because of this site’s robots.txt – learn more.”

Havent changed anything at robot.txt file.

Same thing with twq sites??!?!?!

Post count: 854

hi,
we are only developing the theme not having anything to do with robot.txt

have you try google for that issue?

Thanks for you message.
Radu A.

Post count: 14

yea buy you say it is 100% good for SEO, how can it be good if it does not rank for google as default?

Post count: 9544

Why not simply create a robots.txt file ?

Robots text file is not needed for SEO; it’s primary purpose is to identify which sections of website NOT to search for robots, and to point at your sitemap.

If you have already submitted sitemap to Google and Bing webmaster tools, it’s kind of redundant for some things.

You might look at my example robots.txt file in the SEO/pagespeed sticky thread, to see what one looks like.

A robots.txt file is intended to give directions to search bots, hence name of file. It’s not seen in Google search results, and has nothing to do with your site content SEO which is all done “on page” and “per post” on your site.

If you need one, simply create a text file: robots.txt and upload to your root area of your website; you may need to change write permissions (775 or 777) if you want something like Yoast to be able to edit the file. Some WordPress installs automatically create the file now, with exceptions to inform robots/spiders to skip the wp-admin folder, etc.

wp settings > reading
Further: if you put the WRONG entries in your robots.txt file like saying “ignore my posts directory” then nothing will be seen by Google. The robots.txt file is often used to tell Google your site is under construction… if you have such a setting “hide from search engines” in your wp settings > reading … then that may be your issue.

Robots.txt is *NOT* part of the theme.

  • This reply was modified 12 years by simchris.
  • This reply was modified 12 years by simchris.
Viewing 4 posts - 1 through 4 (of 4 total)
The forum ‘Newspaper’ is closed to new topics and replies.