how to set robots.txt Newspaper theme for gud .js and .css on google bot?

Posted in: Newspaper
Post count: 30
dodikmulyanto
#84624
Dec 16, 2015 at 4:26 pm

hy , please help how to set robots.txt Newspaper theme for gud .js and .css on google bot? . I mean that google bot not block java script and css in default of a newspaper theme . on my web http://www.postku.com , I only use this command User-agent : *
Disallow: / wp – admin
I see a lot of files at the block robots.txt google search on the dashboard console as in this picture :
link Screen shoot >>> http://prntscr.com/9ev2gq

Post count: 22421
Bogdan B.
#84632
Dec 16, 2015 at 4:54 pm

Hi,

Please check these resources and make sure you have your robots.txt file configure accordingly.

– https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt?hl=en
– https://www.ostraining.com/blog/coding/googlebot-cant-access/
– http://www.shoutmeloud.com/what-is-robots-txt-file-and-how-to-optimize-for-wordpress-blogs.html

Hope this helps!
Thanks.

Post count: 30
dodikmulyanto
#84640
Dec 16, 2015 at 5:16 pm

i try now to use this rules :
#Googlebot
User-agent: Googlebot
Allow: *.css*
Allow: *.js*

# Global
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Allow: /wp-includes/js/
Allow: /wp-content/plugins/
Allow: /wp-content/themes/
Allow: /wp-content/cache/
Disallow: /xmlrpc.php

any idea or coment bos ???

Post count: 9544
simchris
#84677
Dec 16, 2015 at 10:53 pm

You don’t need to “allow” Google to read anything — Google reads everything unless you tell them to NOT read something. So, it’s not necesssary.

Viewing 4 posts - 1 through 4 (of 4 total)
The forum ‘Newspaper’ is closed to new topics and replies.