homepage Welcome to WebmasterWorld Guest from 54.166.84.82
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Depth of google crawl
Thaparian

5+ Year Member



 
Msg#: 3032890 posted 1:42 pm on Aug 3, 2006 (gmt 0)

Google crawled my site on 31st july.

They indexed only 17 pages out of 80, can u explain why it is so?

Do depth of crawl depends upon PR too?

Earlier i had 72 pages indexed in google, then my link was removed from a site with 4 PR after that i had only 27 pages indexed and now only 17.

Why it is so?

Now i got a 5 PR link with 12 outbound links, what will be my new PR?

Will i ever get whole site indexed?

Please give me tips.

 

jimbeetle

WebmasterWorld Senior Member jimbeetle us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3032890 posted 3:52 pm on Aug 3, 2006 (gmt 0)

Yep, the new Google crawl scheme is highly dependent on PR and is one of the main reasons people are seeing pages popping in and out of the supplemental index. About the only thing you can do is keep acquiring quality links. You'll be in even better shape if you can get links to your interior pages.

Quadrille

WebmasterWorld Senior Member quadrille us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3032890 posted 4:22 pm on Aug 3, 2006 (gmt 0)

I agree.

Do check your site navigation, do try to get links to internal pages, and consider a Google sitemap (so long as your site is "clean").

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 1:55 am on Aug 7, 2006 (gmt 0)

The navigation system is fine.

I have also submitted sitemap.

What to do? Please help.

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 6:22 pm on Aug 13, 2006 (gmt 0)

My site has only 4 pages indexed in google out of 70.

I have 3 backlinks from 5 pr site, 2-3 from 4 pr site, 3-4 from 2 pr sites.

Today i changed the coding of my site from .html to .php ,
also i used '-' instead of '_' for naming files.

Now i have better navigation system for deeper pages.

Homepages links to main categories.
All the pages under one category are linked to each other.
Category links are on every page.

Why google is not indexing all pages?

F_Rose

5+ Year Member



 
Msg#: 3032890 posted 8:32 pm on Aug 13, 2006 (gmt 0)

Thaparian,

Have you done a 301 redirect from your old url's to your new rewritten url's?

shogun_ro

5+ Year Member



 
Msg#: 3032890 posted 10:50 pm on Aug 13, 2006 (gmt 0)

Here is a link to consider:
[google.com...]

SuddenlySara



 
Msg#: 3032890 posted 11:35 pm on Aug 13, 2006 (gmt 0)

You need to explain how old your site is. I think Goooogle has introduced many filters to judge your site based on age alone. Does your site offer anything new that 1,000,000s of sites may want to cover?

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 3:41 am on Aug 14, 2006 (gmt 0)

I haven't used 301 redirect.

My site's content is not unique but not duplicate.

I expect 4 PR for homepage.

Will google index whole of my site considering PR?

arbitrary

5+ Year Member



 
Msg#: 3032890 posted 5:14 am on Aug 14, 2006 (gmt 0)

re-read what jimbettle says, that is the answer.

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 9:41 am on Aug 15, 2006 (gmt 0)

Yesterday i got 2 more linksk to my site one from 5 pr site and one from 3 pr site.

I checked my stats , google bot didn't crawled whole site.

It only crawled 10-12 pages out of 80.

What do i do?

I also have 2 5pr links from wikipedia article, which i got 3-4 days ago.

The pages that has link to my site have not latest cache in google.
In the cache of those pages in google , there are no no links.

When will google trace my links?
When it crawls the site that links to me?

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 12:35 pm on Aug 15, 2006 (gmt 0)

i have also provided sitemap.xml link on my homepage at the bottom , but google still not indexing my pages.

I am getting mad.

Please help.

shogun_ro

5+ Year Member



 
Msg#: 3032890 posted 12:47 pm on Aug 15, 2006 (gmt 0)

Links from wikipedia are with rel="nofollow" .

jrs_66

10+ Year Member



 
Msg#: 3032890 posted 1:21 pm on Aug 15, 2006 (gmt 0)

--- Does your site offer anything new that 1,000,000s of sites may want to cover?

Is capitalism dead? I don't think google ever infered jumping into a crowded market would result in not getting indexed. This statement is not true.

--- Links from wikipedia are with rel="nofollow" .

This statement is not true.

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 1:28 pm on Aug 15, 2006 (gmt 0)

The links i got from wikipedia are not with "no follow" tag.

I got two linmks from wikipedia pages, but both the pages have old version as cache in google.

I expect a 4 pr for my site.

Will 4 pr make sure that whole site is indexed?

I recently changes coding of my site from html to php, but msn has indexed old html pages.

MSN has indexed some new php pages which do not show up in serps but old pages are not yet removed.

shogun_ro

5+ Year Member



 
Msg#: 3032890 posted 2:43 pm on Aug 15, 2006 (gmt 0)

"This statement is not true"

See the ro subdomain of wikipedia.
For all external links has rel="nofollow"

Maybe not the same for all subdomains.

For you Thaparian :
All you have to do is to wait some more days.

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 3:50 pm on Aug 15, 2006 (gmt 0)

I am waiting for 3+ weeks.

What if i got my pages indexed now and later again i face same problem.

Any way to completely solve the problem?

Isn't 4 pr good enough?

walkman



 
Msg#: 3032890 posted 6:41 pm on Aug 15, 2006 (gmt 0)

>> I expect a 4 pr for my site.

Just because you expect, does not mean you will get it. Plus, Google has been stingy with the PR lately so you might want to lower your expetations. Lastly, Google needs to visit the sites that linked first (their updated cache is the clue) and then decide how PR trickled to you. Based on that you might get the crawl you want.

Bewenched

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 3032890 posted 7:42 pm on Aug 15, 2006 (gmt 0)

See the ro subdomain of wikipedia.
For all external links has rel="nofollow"

they do not have the rel nofollow on external links at least not on the ones I looked at today.

jrs_66

10+ Year Member



 
Msg#: 3032890 posted 11:41 pm on Aug 15, 2006 (gmt 0)

--- I am waiting for 3+ weeks.

Hate to rain on your parade, but I, like MANY others have been waiting 10 months for this to happen. Sit back... relax... and maybe think about a day job!

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 6:04 am on Aug 16, 2006 (gmt 0)

Hate to rain on your parade, but I, like MANY others have been waiting 10 months for this to happen. Sit back... relax... and maybe think about a day job!

My domain is registered for one year only , i can't wait for 10 months.

My site stats shows that google and msn bots crawls my site daily.
Yesterday i got very intense crawl by msn and google both.

But pages are not in index.

After how much time of webcrawl , are the pages indexed?

Or the bots index the pages simultaneously as they crawl the site?

[edited by: Thaparian at 6:06 am (utc) on Aug. 16, 2006]

shogun_ro

5+ Year Member



 
Msg#: 3032890 posted 9:28 am on Aug 16, 2006 (gmt 0)

What we see today in 16 Aug was crawled on 14 Aug.
So be patient .Tomorow you'll see the results.

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 9:51 am on Aug 16, 2006 (gmt 0)

What we see today in 16 Aug was crawled on 14 Aug.
So be patient .Tomorow you'll see the results.

Does it apply to MSN also?

My site's stats show that google crawled about 35 pages of my site.

Does it means i will have 35 pages in google now?

Also i am using missing.html file in my site.

Will missing.html stop google to remove broken link pages indexed in google?
I want those old html pages to be removed from index.

shogun_ro

5+ Year Member



 
Msg#: 3032890 posted 12:10 pm on Aug 16, 2006 (gmt 0)

Sometimes MSN is faster.
For G you must put the code for stats at the end of the page.
It's possible that a record in stats to be just a ping from Google to see if something has changed on that page since last crawl.

Itchym

5+ Year Member



 
Msg#: 3032890 posted 12:50 pm on Aug 16, 2006 (gmt 0)

My domain is registered for one year only , i can't wait for 10 months.

ROFMLAO ...... well looks like your have to

listen to what people are telling you after all youve only been doing it for 2 months..... Sit back and wait posting every hour asking when your site will be fully index isnt going to help ..... and reregistar your domain for another year and then your have 22 months ;)

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 4:49 pm on Aug 16, 2006 (gmt 0)

youve only been doing it for 2 months.....

I am doing adsense thing since november 2005, i have also got my first check, but in june i purchased this new paid domain.

goubarev

5+ Year Member



 
Msg#: 3032890 posted 9:40 pm on Aug 16, 2006 (gmt 0)

"expect PR4" -- Ha-ha, funny guy... :)
I have a site that has 3 PR8 links, 2000+ PR5, plus much more little ones... Yahoo counts the total backlinks to that site over 100K, google reports 2k+, MSN 18K+

The PR on the home page of that site is 1!...
Been like that for 5 months now...
In this case - low PR has nothing to do in traffic,
Site is ranked high on some great keywords...

Yeah, "expect" and "PR" don't go together in one sentence...

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 7:14 am on Aug 17, 2006 (gmt 0)

Google crawled 35 of my new pages continous time interval- according to my site's stats.

Those pages were never been indexed before.
Does it means these 35 pages will get indexed for sure?

Thaparian

5+ Year Member



 
Msg#: 3032890 posted 7:22 am on Aug 17, 2006 (gmt 0)

"Google is weird"

I rebuild my whole site like a week ago.

I changed the html files into php files.

File name were also changed.

Now i just noticed that google has re-indexed those old html pages.

Can anyone explain this?
Old pages were removed, more than a week ago.
Google has been crawling my site for last week.
I got intense deep crawl yesterday and today for new pages.

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 3032890 posted 5:37 pm on Aug 17, 2006 (gmt 0)

You're expecting Google to act as if it were one computer -- when in reality it is hundreds of thousands of servers, distributed around the planet in a huge network. The data that we get to see changes, reverts, and swills around in many ways that woud never happen on your desktop. The visible results are ony the top slice of many different copies of data that Google works with, massages, cleans, runs experiments on and so forth.

In other words, watching Google too intensively can be bad for your stress level.

[edited by: tedster at 3:51 pm (utc) on Aug. 19, 2006]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved