Allow WordPress Plugins Directory in Robot.txt

Posted in: Newspaper
Post count: 109

Not sure if every person is aware of this, but thought I’d share. I’ve been having trouble with my rankings in the G engine.

Google sent out an email to webmasters:”Googlebot cannot access CSS and JS files on yourdomain.com

basically make sure in your robots.txt file that you allow wordpress/plugins directory. that’s it. Hope my rankings come back.

more info: http://www.shoutmeloud.com/fix-googlebot-cannot-access-css-js-warning.html

also yoast: https://yoast.com/wordpress-robots-txt-example/

“So, what should be in your WordPress robots.txt? Ours is very clean now. The only thing we still block is our /out/ directory for our affiliate links, as discussed in this post. We no longer block our /wp-content/plugins/ directory, as plugins might output JavaScript or CSS that Google needs to render the page, nor do we block our /wp-includes/ directory, as the default JavaScripts that come with WordPress, which many a theme uses, come from these directories.”

good luck everyone!

Post count: 555

I get that same email also and went and fix the issues by removing the folders from my robots.txt file it was making issues with mobile devices…it seem something has change with the theme new version are google change something on there end..

These folders should not be in robots.txt file as follow..removed them A.S.A.P if you don’t want your site to get BANNED..

wp-includes
wp-plugins

  • This reply was modified 11 years by Steven.
Post count: 109

also, remove the .htaccess file in the wp-content directory. That was a huge problem for me. Just discovered that after 2 years. I look forward to more improved rankings now that it is removed.

Viewing 3 posts - 1 through 3 (of 3 total)
The forum ‘Newspaper’ is closed to new topics and replies.