Home User profile
tagDiv Member
This user did not write anything. So we are just showing here some random text to make the profile page look nice :)
karl_pietsch
tagDiv Member

Thanks Bogdan, I didn’t actually log the post headers or check if it was the ajax view count or the ajax load more posts, thanks for pointing that out.

karl_pietsch
tagDiv Member

I have caching enabled and am using the ajax view count but i have noticed the google web crawler bot has now started hitting the ajax view count, which would increase the number of views compared to those shown in google analytics now that it will count bot hits.
Also importantly, i don’t want the web crawler wasting time with these extra requests, i’m happy for it to used cached view count each hit.

default robots.txt for wordpress is this:

User-agent: *
Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php

Do you think changing robots.txt to the latter would work? There is a lot conjecture about order of precedence of rules?

User-agent: *
Disallow: /wp-admin/

Allow: /wp-admin/admin-ajax.php
Disallow: /wp-admin/admin-ajax.php?td_theme_name=Newspaper&v=7.3

Also if you aren’t already, consider not updating the count if its a bot hit.

EDit: actually google robots.txt tester says the latter should block it but the first version not. Are there any frontend resources or anything loaded via /wp-admin/admin-ajax.php?td_theme_name=Newspaper&v=7.3 that i shoudl be aware of i may be affecting?

Viewing 2 posts - 1 through 2 (of 2 total)