Getting Your Site Indexed

Any tips?

[Mansi_Khan]

Hello People,
About 1 week ago i opened up a site related to quotations & essays. As we all know traffic is wat feeds adsense, and the best means of traffic is search engines. The trouble is that my site aint getting indexed or perhaps it does take more time since i am an amateur in this field. Naturally i want my site to indexed, so that i can tweak with my keywords for good ranking.
And i have also heard that google doesnt index new domains for 6 months! Is it true? If so then what can i do to get traffic.
So i would really like to know when can i hope to get to see my site indexed. I know that its never a guarantee than your site may even get listed but with the kind of site i have , i dont think i can be penalised for something. So i would really appreciate some tips & advice.

[digic]

actually this is not the right forum for this. Anyway, it will take from 2 weeks to 2 months before you can see your site on searches. I have launched my 2nd adsense site 3 weeks ago, but it wasnt indexed until now. Have you submit it?

[Mansi_Khan]

Ofcourse i have submitted it. Yeah i though it might not be the place to post this, but i have seen that this place has better ppl and response then in search engine related forums. Well then , do you know any alternative way of traffic untill such time?

[sem4u]

Do you have any external links pointing to your site? You will need these to get your site indexed. You can submit to directories, trade links, beg for links, etc. Links can also bring in traffic while you wait for your site to be indexed and ranked by the search engines.

[Mansi_Khan]

Well yeah i am trying to get as much link popularity as i can by writing to webmasters , offering them link exchange and ofcourse free services too. I am also trying to submit to as much as directories as possible. But i am not getting good results as yet. After reading and researching a lot on the net i know that most search engines heavily emphasis on link popularity or incoming links. Though still its not fruitfull for me. I am getting about like 30 page impressions a day S: . And i dont think it brings much traffic . And i am also mostly writing to sites related to mine , and having good ranks. But its difficult to get a response out of them.

[sem4u]

Your site has only been up a week! You need to give it time...any pages with links you have got may not be re-indexed yet with your information on it.

[Mansi_Khan]

Well yeah i know its been just a week :). Guess i am being too impatient.Thanks for your help. Though i would still like if i could develop about 500 impressions a day through some alternative way.
And yeah about that google policy, is it true that they dont index new domains for six months?

[Hobbs]

>they dont index new domains for six months
not true, as said it can be weeks to months, you might want to look up the google sandbox legend.

>this place has better ppl and response then in search engine related forums
:)
just do your homework: Reading a lot before posting and before making changes to your site and you will be fine.

[Mansi_Khan]

Hello Hobbs.
Well about google not indexing new domains, i heard this from a SEO who mentioned that google introduced this policy in April 2005 . But i do hope that you are right. Looks like a waiting game for me at the moment which i despise since i cannot afford to wait b-coz now is the only major time i have since after next month or so i will have to prepare for my O' Level papers. Anyways thanks for your help. And if you or any other member here wants banners or stuff especially in flash or help in writing articles etc. then please dont hesitate to ask b-coz i am pretty much free at the moment.

[bts111]

Start planning six to eight months in advance and be prepared to pay to host a site with no content -- a pretty logo will do the trick :)

You can have new sites indexed in less than one week and new pages indexed the following day ;)

Don't go overboard with the links. Two a week will do the trick.

[Mansi_Khan]

Hello bts111,
Well i already have a site and i AM paying for hosting so i didnt get what you said. And certainly its been more than one week since i submitted my site to all the major search engines. Whats more i even created a sitemap and submitted it to google but it always shows no 'data available at this time'. My stats show that last time google bot visited my site was on 7th Jan 2005 , but it didnt index my site. Thanks for everything though, i would still like an alternate way of generating about 500 impressions per day.

[bts111]

At this time your best bet would be Adwords or Overture. Try and look for keywords that are related to your site but won't cost you an arm and a leg.

Good luck with your site :)

[Mansi_Khan]

Dont have a credit card to pay for adwords or overture. And it certainly costs more to me because i am a pakistani and approximately 1 $ = 60 Rs. :)

[Mansi_Khan]

Any other pointers people?

[rajun]

I m ameture too in webdesign & hosting. I upload my new site which have a new domain name january 1 and it indexed by google within 3 days and msn indexed it within 4 days but i m not lucky in case of yohoo. Yahoo indexed my site today.

I just submit my site to search engines & directories as much as possible. But i dont spend a single bucks in that purpose.

Get listed with high ranked directories and major search engines. I think thats the effective way to get indexed quickly. And also u need a luck :) .

U may also submit rss or xml if u create it. There r lots of site where u can submit rss/xml.

[Mansi_Khan]

Hello Rajun,
Well i have even fed google with my xml feed but even then nothing seems to be happening. Infact when i look at my site's stats it shows that Google bot visited my website today. I would say its more of a case of luck .
I cant do much at this moment except make sure that my site doesn't contain anything that i might be penalised for, or try writing to webmasters. But what i am trying to do is to get other means of traffic which i cannot find.
So Rajun , on another note i would say that aren't you indian? If so then are u waiting for the Indian / Pakistan Series , eh? Whom do u place ur bet on? I would say that Pakistan would crush India! Bring them on!

[wrgvt]

This isn't a get-rich-quick scheme. If you're going to rely on free search engine traffic, then you're going to have to be patient. Getting indexed is one thing, getting on the first or second page of SERPs for your most popular search keywords is a completely different thing. It depends on your competition for those keywords, not just from SERPs, but from PPC advertising too.

To move up in the SERPs, you need good inbound links, preferably non-reciprocal links. That tells search engines that other people find your web site's content interesting enough to link to without anything in return for that link. If your content is not good enough to draw those links, then traffic will continually be weak. To build those type of quality inbound links takes time, unless you've been smart enough or lucky enough to have a web page surge in popularity right out of the chute.

[europeforvisitors]

Since this is the AdSense forum, it's worth pointing out that getting indexed is only half the battle. If you want to earn decent money from AdSense, your topic and audience matter, too. AdSense works best when your readers are researching ways to spend their money. If they're looking up a Churchill quotation or researching a school report on Descartes, they may not even notice the ads (let alone click on them)--which means you might be better off with CPM banners from a banner-ad network like FastClick, once you have enough traffic to get accepted by such a network.

[Mansi_Khan]

Hello wrgvt,
Yeah i am trying to get as much inbound links as possible , writing to as many webmasters as possible manually and offering them services too. I am also trying to submit to directories and stuff. I know that getting a GOOD RANK is a real waiting game, but atleast i should get indexed first, and that is wat i am worried about. And if this indexing takes months then how do i get traffic untill such time. If i pay for adwords which i cant , even then i think i would go negative in blance as earning with adsense would still be lower i think. Thanks for your advice. As i stated earlier if anyone wants any help here like getting banners or something both in simple or flash then he/she can ask me.

[Mansi_Khan]

Hello there , europeforvisitors,
Man i disagree with you on this. I did a research on quotations and essays related keyowrds and the most words that came up were simply "essays" or "quotations" . So even if i can get rankings with them or advertise with these keywords i can still get traffic. Its the indexing thingy thats troubling me, especially the fact the google bot HAS visited my site 3 or 4 times.

[Mansi_Khan]

And ppl, i wanted to ask whether its necessary to have robots.txt? Because in my stats it shows that majority of 404 Error occured when the visitor/robot tried to access robots.txt . And i dont have a robots.txt because i read somewhere that its not really good.

[digic]

My first site who was indexed by google 1 week after publishing does not have robots.txt and even robots tags. The second site which I published last december was indexed but only the main page.

Tried putting robots.txt last week bcoz of 404 error. i reviewed again the logs and 404 error was gone but until now only the 1st page was indexed. So in my own opinion, robots.txt does not give weight if you want to index the whole site. Nobody knows how G algorithm works.

Maybe, this second site is an old domain who republished and hosted on another server have some bad experiences with crawlers and it is blocked or not prioritized, I really dont know. i just keep on waiting.

[percentages]

>And i have also heard that google doesnt index new domains for 6 months! Is it true?

Get your site listed at Dmoz.org, it will appear in Google within 7 days of the Dmoz listing appearing. It will also appear in MSN, Yahoo & Ask about the same time.

There is no magic to getting a new site indexed in any major search engine, Dmoz will do the trick!

You can also achieve this goal by getting links from other major websites. That might be harder to achieve though?

Getting a listing, and ranking high in SERPs are totally different animals. Just because your site gets listed doesn't mean it will ever be seen in SERPs!

To be seen you need "lots" of backlinks from other sites. The more powerful and independant these sites are the better. One way links are now the way to go :)

Getting listed is easy, getting to be #1 for all your major keywords is going to either require a lot of effort or a big Adwords/Overture budget!

[Ricky_G]

I can get any site indexed in all Search Engines within a week. Yahoo indexes any domain in just 3 little days. Even less.

Just start blog and ping and add your XML to My Yahoo, My MSN and My Google. Use pingomatic and thats all. Just mention your link at the bottom of each blog post and Spider will visit that page and more if it wants to (depends upon crawler to crawler, like Yahoo will go in more depth than Google crawler)

Post articles on Article directories and that will help too in the same direction. Plus it will start earning you some wonderful one sided back links.

If you start linking from the day one, you will get a dull response as your site is new and webmasters wont be willing to link you back.

Get some pages indexed in the SE and then start requesting links.

Works everytime for me!

And next time someone says you that GOOGLE DOESnt INDEXES B4 6 MONTHS - SLAP him real HARD!
I cant believe an SEO said that. GOSH! That was a real stupid statement.

[Mansi_Khan]

Lolz Ricky.
Well today the strangest of things happened. I searched my site on yahoo with the exact name and for the first time in a few days what comes up is my sites name though with the header : Index of /" with the description : " Index of / Name Last modified Size Description " .
Does that make any sense? It seems as if it couldnt find my site's index page o_O . But my site is up & running, with the index page ( home page ) still intact.

When i search my site in google what comes up is JUST my site's name with no description or anything.
On the contrary when i search my site on MSN it does show my site's first level pages with descriptions .

[Mansi_Khan]

Any clue as to why this happened?

[PumpkinHead]

Are you using a robots.txt file? If so and you want your whole site indexed, get rid of it as the default is index,follow.

Also, do you have a page title? PM me the url if you want and I'll have a quick look.

[KeywordCountry]

I searched my site on yahoo with the exact name and for the first time in a few days what comes up is my sites name though with the header : Index of /" with the description : " Index of / Name Last modified Size Description " .
Does that make any sense?

Usually, Crawlers pickup the TITLE TAG text and make it HEADING or HEADER of their Search Result. Do you have this title tag? Also, try to see the cached version of the page from the SERP on Yahoo. Do you see the title tag there?

If you are using a DATABASE Based Script that controls the TITLE too on the programming level, then maybe thats the fault there. When your Script is down, not connected to Database or your Host made a STUPID MOVE, and at the same time the CRAWLER crawled your website - thats the worst thing that can happen to you.

This immediately results in downfall of your earnings.

When i search my site in google what comes up is JUST my site's name with no description or anything.
On the contrary when i search my site on MSN it does show my site's first level pages with descriptions .

That means Google has crawled your website and is going to index it soon. Thats an indication.
It can also mean that Google has stopped crawling your website and may crawl it again in X amount of time. (X depends upon Google's internal policies) Which is bad.

But for newer sites, it means its going to be indexed soon.

Just discovered that Google is monitoring the newely registered domains now. Maybe it has grown agressive after Yahoo has crossed the number pages Google has indexed in such a short span of time.

[edited by: KeywordCountry at 1:21 pm (utc) on Jan. 11, 2006]

[KeywordCountry]

Its important to have a Robots.txt
Dont delete that. Maybe it makes the crawler sure that they are someone is there to care for them and respects them. :)

Write this in TXT file and post it on your domain : www.domain.com/robots.txt

#
#
#

[PumpkinHead]

I don't see why having a robots.txt is important if the default is index/follow. It's only used to stop spiders reading/indexing certain areas/URLs of your site.

The only reason for having an empty robots.txt is that it reduces the number of 404s showing in your webstats.