Forum Moderators: open

Message Too Old, No Replies

massive number of submissions...

general guidelines needed

         

iggy99

6:37 pm on Aug 7, 2000 (gmt 0)

10+ Year Member



we have 39,982 web pages in our flower shop directory...
one for each shop...

of course i have promised each participating flower shop search engine submission

all of the pages are the same except for the shop name address state and zipcodes which are in the page title, meta tag and twice in the body of the page...

it has taken me 1 1/2 years to finally get this off the ground and the last thing we need is to be blocked from any se's...

over what time should i sublit these?

how many per day?

and lastly, how often should they be re-submitted?

many thanks

rcjordan

8:59 pm on Aug 7, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Like you, I have sites that run into page numbers with a comma in them. The last time I asked the above questions for INK (using Anzwers) the answers were maximum of 25 per day and resubmit every 5 weeks. So spidering engines move to the forefront. To promote deeper spidering, I built a sub-index at each directory level (about 50 total) and had an IP address assigned to each. I submit those 50 to the engines, my content pages are only one level below these.

NFFC

9:37 pm on Aug 7, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>it has taken me 1 1/2 years to finally get this off the ground

That is a *lot* of hard work. Don't throw it all away by submitting 39,000 dupes.

>of course i have promised each participating flower shop search engine submission

Wouldn't we all ;) I am sure they will get it, eventually.

>spidering engines move to the forefront

Do they! The others will follow, explain your strategy to your clients, it will pay off.


rcjordan

10:16 pm on Aug 7, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I should add that the levels of tolerance vary from engine to engine. It's been a while since I tracked this kind of info, but the last daily limit I remember for AV was 5.

iggy99

10:20 pm on Aug 7, 2000 (gmt 0)

10+ Year Member



each age does have a different title...

how should i get these pages going?

they are each in 5000 page dir's...

how about doing a index page for each dir and submitting that?

any experience or ideas on this type of thing is much appreciated

rcjordan

12:17 am on Aug 8, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>how about doing a index page for each dir and submitting that?
Well, it's a start. A problem is that an index page with 5,000 links is going to look like a hallway. My largest was 350 subpages on the index, most were 90-130. And, setting up these index pages as 3rd level domains was a definite plus with some SE's, as it turned out.

I'd start my trial runs using some of the 2nd-tier engines; Fast, Northern Light. And I'd try Google as soon as you think everything is tuned. Moving a 4,000 page site into a few SE's and indexes took me a solid 6 months just to get the first few hundred pages listed; you've definitely got your work cut out for you at 40,000. Managing massive sites is a different world, things that others can do in minutes will require days (two semi-automatic page submittals per minute sounds pretty fast until you try it with 4,000 pages).

tedster

8:08 am on Aug 8, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm doing volunteer work with a not-for-profit site that is planned to run many thousands of pages.

We're going to use second level domains for the main divisions of the site, and where it made sense we've purchased specific TLDs. The hope is that different domain names will get the entire site into the SEs much faster and, hopefully, with better theme focus.

I've never waded into anything this size before, and I'm definitely discovering the point that rc made -- even a small action or decision will have far-ranging implications and require a lot of time and resources.

rcjordan

2:09 pm on Aug 8, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>even a small action or decision will have far-ranging implications and require a lot of time and resources
You are going to need special tools, no doubt about it. Dial-up is out, FTP is out, you have do your work directly on the server or -if browser based- manipulate scripts that write directly en masse. Constructing and maintaining meaningful indexes and subindexes is a huge task, and a necessary one if it's going to be spidered. The site mentioned in this thread [webmasterworld.com] is the 2nd of its kind for me and it's already working extremely well from the management perspective. I suggest taking a look at Links 2 or similar.

tedster

3:45 pm on Aug 8, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks for the tips, RC.

Yes, the full time staff works directly on the server, (actually, on several servers) and a small army of volunteers feeds into them from around the world.

Luckily, we have a project manager with some big ecommerce sites behind him. However, he does not have SEO experience, since that was always done by another company on his projects. When I started doing some graphics optimization for the site, I quickly said "WHOA, what about the search engines?"

And, of course, I was allowed to volunteer to oversee that job. So, thanks especially for the Gossamer-Threads reference. I can see that links-2 will be very handy.

lizzie

11:35 pm on Aug 30, 2000 (gmt 0)

10+ Year Member



I'm reading these with awe and confusion. I've only been submitting sites to SEs for 10 months.
I thought you could only submit one site from a domain per 25 hour period.

It sounds like you pros have ways of submitting hundreds per day.

I've tried hallway pages which were just lists of links but they were just ignored.

If anyone would like to take the time to explain to me
how to get about a dozen pages a day submitted--they don't have to be from the same domain--I would be very grateful. I can't get any new submissions in for the last month and I was only submitting 2 a day from 2 different domains! (They all have the same link and banner to an affiliate program). I am liizzie at lamcnair@yahoo.com.

rcjordan

9:53 pm on Aug 31, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



lizzie,

I rely on spidering SE's, but in directories where the editors will accept deep-linking (under the PROPER category), I write special scripts to submit.

>sounds like you pros have ways of submitting hundreds per day.

See Brett's Collective program on [searchengineworld.com]

mark roach

7:55 am on Sep 1, 2000 (gmt 0)



RC

Would you mind pointing me in the direction of some of these directories which accept deeplinking. My site is about dogs, are any of these directories appropriate ?

Thanks

rcjordan

1:28 pm on Sep 1, 2000 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



MR,

Snap LiveDirectory is the only one that I've used that would be likely to have a "dogs" category. My other ones are geographic-based.