Welcome to WebmasterWorld Guest from 54.227.48.147

Forum Moderators: incrediBILL & martinibuster

Google AdSense Crawler Tool Errors and robots.txt

     
5:04 pm on Feb 3, 2018 (gmt 0)

New User

joined:Feb 2, 2018
posts: 8
votes: 0



System: The following 6 messages were cut out of thread at: https://www.webmasterworld.com/google_adsense/4880967.htm [webmasterworld.com] by engine - 6:01 pm on Feb 5, 2018 (utc 0)


I am from Bosnia and Herzegovina. I have this problem 7-8 days, and I do not know how to fix it. My adsense account writes a notification: Crawler tools errors may appear that can lead to lost revenue.
I use Adsense for about a year, so far it was all perfectly ok. I do not know how to contact support, I do not have $ 25 a week to send mail. I've put custom ads.txt in my blogs. I plugged in this robots.txt, I do not know if it is effective. Please help, if I need to change something, add it to my blog. help me


User-agent: *
Allow: /

Sitemap:
6:23 pm on Feb 3, 2018 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:May 29, 2007
posts:802
votes: 94


@Salese Welcome to the forum! This is what I have at the top of my robots.txt file. Perhaps mine is incorrect. I don't know.

User-agent: Mediapartners-Google
Allow: /

You can send feedback to Google. Go to your AdSense dashboard, and it's the last item in the left hand menu.
6:33 pm on Feb 3, 2018 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Sept 25, 2005
posts:1655
votes: 238


To test your robots.txt file, go to "Crawl" > "robots.txt Tester" in the Search Console. There you can select "Mediapartners-Google".
6:35 pm on Feb 3, 2018 (gmt 0)

New User

joined:Feb 2, 2018
posts: 8
votes: 0



OK thanks. Please, write me the correct robots.txt file. I'm getting tired for days. Very thrilling for me and my earnings.
Please let me know the correct robots.txt
thank you
6:53 pm on Feb 3, 2018 (gmt 0)

Senior Member

WebmasterWorld Senior Member Top Contributors Of The Month

joined:Apr 1, 2016
posts:1575
votes: 422


@salese I am going to give you some advice that you may not like hear, but I urge you to seriously consider.

I do not know how to contact support, I do not have $ 25 a week to send mail.

I suggest that you remove the AdSense code from your website, not worry about AdSense at all and focus on:
1- Creating a website that is not only good quality content but also provides value to user
2- Promote your website, such that you are able to grow your traffic
3- Learn as much as you can about how Google search rankings (and others), and AdSense works

Once you have established a solid user base that engages with your content, then you can re-implement AdSense and you will be able to begin earning much more than 25$ a weeks with less effort than your spending now. If now at this stage you choose to focus your energy on trying to maintain earnings of a few dollars a weeks, you will forever be wasting energy fighting for a few dollars a week. It is not worth the stress.
7:02 pm on Feb 3, 2018 (gmt 0)

New User

joined:Feb 2, 2018
posts: 8
votes: 0


I do not know how to explain. I have two very serious google blogs, and sometimes over 10,000 daily visits per day, I keep them regularly, my content is very good. I also try to keep my blogs in these days, can not just remove codes, I have visits to my blogs with quality content, I do not really know.

I use adsense for one year, I have one payment, and on one blog I have over 1000 posts in another over 2100 posts and super visits