homepage Welcome to WebmasterWorld Guest from 54.224.202.109
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
Forum Library, Charter, Moderators: Receptional & mademetop

Website Analytics - Tracking and Logging Forum

    
Parsing http_referer for search terms
What are all the variable names used by SEs?
coffeebean




msg:902064
 3:13 am on Sep 8, 2004 (gmt 0)

Here's a handful of different querystring parameter names search engines use to pass search terms in the http_referer string. Which ones am I missing?

Google

  • q=
  • as_q=
  • as_epq=

MSN

  • q=

Yahoo

  • p=

AOLsearch

  • query=
  • encquery=

Also, does anyone know how to decode the encquery value sent by AOLsearch?

 

jdMorgan




msg:902065
 3:36 am on Sep 8, 2004 (gmt 0)

Add
Yahoo: va=
Looksmart: key=
Ask Jeeves: q=

The AOL encoding is apparently UTF-16.

Jim

GeorgeGG




msg:902066
 4:16 am on Sep 8, 2004 (gmt 0)

Here are some I use, not updated

abcsearch.¦Terms¦¦¦
about.¦terms¦¦¦
alexa.¦q¦¦¦
allthesites.¦query¦¦¦
alltheweb.¦q¦query¦¦
altvista.¦q¦¦¦
aol.¦query¦¦¦
askjeeve.¦qry¦pt¦ask¦
atomica.¦s¦¦¦
att-net.¦gwd¦qry¦¦
bbccouk.¦q¦¦¦
bellsouth.¦string¦¦¦
cari-com.¦q¦¦¦
cometsys.¦qry¦¦¦
commonname.¦cnqry¦¦¦
cs.¦query¦¦¦
dmoz-org.¦search¦¦¦
dogpile.¦q¦¦¦
earthlnk.¦q¦¦¦
eircom.¦search¦¦¦
exalead.¦q¦¦¦
excite.¦qkw¦¦¦
excite.¦s¦¦¦
fares.¦search¦¦¦
findit.¦search¦¦¦
google.¦q¦query¦as_q¦
hippo.¦q¦¦¦
hot-mail.¦hm___action "=URL"¦hm___action¦¦
hotbot.¦query¦¦¦
innerprise.¦search¦¦¦
lycos.¦query¦MT¦¦
m-crawl.¦qry¦¦¦¦
mamma.¦query¦¦¦
metacraw.¦q¦general¦¦
msn.¦q¦¦¦
munky.¦term¦¦¦
mysearch.¦searchfor¦¦¦
myway.¦searchfor¦¦¦
netscape.¦query¦search¦¦¦
ninemsn.¦q¦¦¦
o2w.¦searchterm¦¦¦
openfind.¦q¦¦¦
overture.¦Keywords¦¦¦
passagen.¦q¦¦¦
scrubtheweb.¦q¦keyword¦¦¦
search.¦q¦¦¦
sympatico.¦query¦¦¦
teoma.¦t¦q¦¦
webmaster.¦member¦¦¦
websearch.¦qkw¦¦¦
wisenut.¦q¦¦¦
xtramsn.¦q¦¦¦
yahoo.¦p¦va¦¦

GeorgeGG

moltar




msg:902067
 4:58 am on Sep 8, 2004 (gmt 0)

This is from awstats stats tool. You can find the file in their archive under /wwwroot/cgi-bin/lib/search_engines.pm.

[perl]
%SearchEnginesKnownUrl=(
# Most common search engines
'alexa','q=',
'alltheweb','q(¦uery)=',
'altavista','q=',
'dmoz','search=',
'google','(p¦q)=',
'google_image','(p¦q)=',
'lycos','query=',
'msn','q=',
'netscape','search=',
'aol','query=',
'terra','query=',
'voila','kw=',
'search.com','q=',
'yahoo','p=',
'sympatico', 'query=',
'excite','search=',
# Minor internationnal search engines
'go','qt=',
'ask','ask=',
'atomz','sp-q=',
'euroseek','query=',
'findarticles','key=',
'go2net','general=',
'hotbot','mt=',
'infospace','qkw=',
'kvasir', 'q=',
'looksmart','key=',
'mamma','query=',
'metacrawler','general=',
'nbci','keyword=',
'northernlight','qr=',
'overture','keywords=',
'dogpile', 'q(¦kw)=',
'spray','string=',
'teoma','q=',
'virgilio','qs=',
'webcrawler','searchText=',
'wisenut','query=',
'ixquick', 'query=',
'earthlink', 'q=',
'iune','(keywords¦q)=',
# Minor brazilian search engines
'engine','p1=', 'miner','q=',
# Minor chinese search engines
'baidu','word=', 'sina', 'word=', 'sohu','word=',
# Minor czech search engines
'atlas','searchtext=', 'seznam','w=', 'quick','query=', 'centrum','q=', 'jyxo','s=', 'najdi','dotaz=', 'redbox','srch=',
# Minor danish search engines
'opasia','q=', 'danielsen','q=', 'sol','q=', 'jubii','soegeord=', 'finddk','words=', 'edderkoppen','query=', 'orbis','search_field=', '1klik','query=', 'ofir','querytext=',
# Minor dutch search engines
'ilse','search_for=', 'vindex','in=',
# Minor english search engines
'askuk','ask=', 'bbc','q=', 'freeserve','q=', 'looksmart','key=',
'mirago','txtsearch=', 'splut','pattern=', 'spotjockey','Search_Keyword=', 'ukindex', 'stext=', 'ukdirectory','k=', 'ukplus','search=', 'searchy', 'search_term=',
# Minor finnish search engines
'haku','w=',
# Minor french search engines
'francite','name=', 'clubinternet', 'q=',
# Minor german search engines
'aolde','q=',
'fireball','q=', 'infoseek','qt=', 'webde','su=',
'abacho','q=', 't-online','q=',
'metaspinner','qry=',
'metacrawler_de','qry=',
# Minor hungarian search engines
'heureka','heureka=', 'origo','(q¦search)=', 'goliat','KERESES=', 'wahoo','q=', 'internetto','searchstr=',
# Minor norvegian search engines
'start','q=',
# Minor polish search engines
'wp','szukaj=',
# Minor russian search engines
'yandex', 'text=', 'rambler','words=', 'aport', 'r=', 'metabot', 'st=',
# Minor swedish search engines
'passagen','q=',
# Minor swiss search engines
'searchch', 'q=', 'bluewin', 'qry='
);
[/perl]

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Website Analytics - Tracking and Logging
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved