Forum Moderators: open
I cannot trace any visits from the Googlebot in the last two months.
Several sites with a PR4 or more link to my site. They do not show up when searching on link:www.domain.com.
Would appreciate any advice on improving the situation.
Thanks a lot, take care,
Josefu & Coco.
Kind of got me to thinking, wouldn't an efficient way of crawling be 1) sending out a pathfinder 'listbot' to follow known links and look for new and changed ones (or 'unexplored doorways') and would based on its findings, compile a list which would be forwarded to 2) an army of 'deep crawlers'?
Just an idea I had, perhaps off-topic. Fantasy? based on what I've seen over the past days, perhaps that's what's happening...
And finally yesterday it started grabbing other pages. Only 50 out of thousands but still, it's a start ...
Don't despair just yet
Anata mo, nihonjin desu! I'm wondering if, since our site (and yours?) is in Japanese, google treats 'foriegn languages' differently?
I had almost been happy that there were no visits as I did not want to publish an unfinished site, but now that it's up... To tell the truth, I still have no idea how google found it (in its unpublished, unfinished 'cover page only version) in the first place. Do they check for new domain names? Just wondering...
Oh, I have tons of questions - just trying to make the grade as fast as possible from being a 'newbie' to becoming a 'knowbie' : )
take care,
Josefu.
No, it's not just sites in other languages. Google treats new sites in English the same way. The course that you and totsubo describe are exactly what has happened with my latest site.
What worked for me, and I would recommend for you, is a plain HTML site map, at root level, with a plain HTML text link from your "index' page. If that's present, and the googglebots know that you exist( i.e. they are coming around and checking robots.txt and "/") you will evenutally get crawled.
goes on for 4 months now.
all other bots crawl all sites with no problems.
I have no dynamic pages, links from dmoz, zeal, pagerank 5 sites, nothing helps it seems.
Googlebot doesnt like my site :(
Disallow: /
I had uploaded our new site content from our test server and without realizing it had uploaded the test server's robot.txt file! (which was set to disallow everything!)
Googlebot is busy catching up on lost data. Do not worry. "/" is your site, your index page, you will therefore be listed shortly, be happy.
Higher PR sites are being crawled like there is no tomorrow at this stage. Google has a catch up job to do. If you want to impress Google. Start finding people to link to you and link to you well. Visit other areas of these forums and don't get blinkered just on Google. If you focus on Google, you will miss out on things that will help you with Google ;-).
Look for directories you can list in. Find regional SE's that will list you. Maybe some of these allow Google to crawl them. And if Google sees a link to you on their site, they will think you are worth another, perhaps longer visit ;-)
It seems your problem is now fixed. Your home page is now shown when searching for 'site:www.domain.com -asdfa' and so is the link-page (although without title/snippet). So I suppose the other pages will be indexed later too.
If there is a ressource for the parameters that can be passed to a google search could you let me know?
I just tried for my site and no results came up :(
Up until 6 days ago... we were getting fast, full crawls all over the place and regularly across many sites...
Something's HAS changed a little... either a blip or (and we prepare for worst case) something different.
This IS impacting high PR sites, too...
Bottom line, full crawls aren't happening nearly as much, linking SEEMS to more closely follow the concept of 'themes' (intersite-wide), and some skimpy stop at robots and stop at home and stop at sitemap ARE happening.
Anyone notice anything interesting in the past 6 days? Thoughts?
This is from SBD SEO for many years... always reacting and ultimately winning... but we're a little irked right now. Never ones to react too strongly or worry, but just curious if any big guns out there are seeing anything similar.
07/21: 12
07/22: 10
07/23: 1
07/24: 0
07/25: 2
07/26: 0
07/27: 2
07/28: 65
07/29: 26
07/30: 7
And most of the pages spidered are always the same :(
I wish Google would spider more pages each time it visits.
Thanks again,
Josefu
1 - Searching on mydomain.com now reveals lots of results.
2 - Searching on www.mydomain.com is the same.
3 - Searching on link:www.mydomain.com is the same - one link. We have links from around 100 sites, varying PR from 3 to 7.
4 - Traffic from Google to my site has increased by 900%, commencing 3 days ago.
Why is there no gell between 1 and 3?
1 - Searching on mydomain.com now reveals lots of results.
2 - Searching on www.mydomain.com is the same.
3 - Searching on link:www.mydomain.com is the same - one link. We have links from around 100 sites, varying PR from 3 to 7.
4 - Traffic from Google to my site has increased by 900%.
Why is there no gell between 1 and 3?
Oddly, G - Bot pulled out of my servers at about 05:00 on the 5th, over 48 hours ago from the time of this post.
I normally can find a G - Bot someplace in the servers, but not now.
I would venture to guess that if we are going to see another dance of the past, it will happen within then next few days.
Backlinks have changed on some datacentres.
For some sites the first change in backlinks in perhaps 3 or 4 months (but not all for the better).
