Forum Moderators: phranque

Message Too Old, No Replies

Creating a search engine?

possible?

         

jordantheking

6:10 pm on Sep 24, 2005 (gmt 0)

10+ Year Member



Not sure if it belongs here, so sorry.

But, is that possible to start my/your own search engine? HarD to do?

tedster

8:08 pm on Sep 24, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Note: I moved the thread to this forum so a wider discussion would be possible. - Ted

Depends what you mean by a "search engine". A spidering engine that ranks billions of urls according to some alogrithm and is competitive to a respecatble degree? Very challenging -- even at a hardware level alone, to say nothing of a programming level -- and a dollars invested level as well.

A "meta search" that blends the results of various crawling engines? Perhaps not quite so challenging, but still not a one afternoon project, and probably not a one man budget either.

If you just want to do this for the experience, and being competitive isn't part of the picture, it's getting easier and easier to do. There are open source spidering tools and if you just want half a million urls to play with or so, then you've got a "relatively" easy project.

jordantheking

4:07 am on Sep 26, 2005 (gmt 0)

10+ Year Member



Thanks.

I wouldnt need to competitive right now.

But, where would i find the link list?

And, there would be a way so people can add there own links, right?

andrea99

5:19 am on Sep 26, 2005 (gmt 0)



And, there would be a way so people can add there own links, right?

You'll be wise to avoid reinventing the wheel and mimic the big guys at first. They do things they way they do because they have years of experience and zillions of dollars worth of talent.

That's not to say there's no room for improvement or no chance for an upstart. If you're serious about competing big-time your best talents should be recognizing talent in others and motivating them--not to mention writing a decent business plan and knowing a few VC's.

Buy a winning Power Ball ticket for seed money. :)

But, where would i find the link list?

It's out there. Just let your spider follow links, eventually you'll have them all. Begin anywhere, DMOZ or Yahoo are good.

zulu_dude

11:50 am on Sep 26, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



You might find this thread interesting...
[webmasterworld.com ]