Hakia's semantic search: Do we need it?

Posted by: Stephen Baker on September 04

I visited the Wall Street offices of Hakia.com last week. They’re a start-up focusing on semantic search. For some questions, the results are impressive. I just asked Hakia for the three most common elements in the universe. The answer comes back with the results, with no need to open a Web page. A similar Google search gets me close, but needs a click.

Hakia CEO Riza Berkan argues that Google is great for the most frequently asked queries, because the popular Web pages generate links and traffic, and fit into the search algorithm. But how about a page that is hardly ever viewed? He argues that semantic search (that “understands” the question) will service the long tail.

My question is whether we’ve learned how to think like Google and the other leading engines. If we automatically choose words most likely to point to a specific page, or to provide a certain answer, we are providing crucial intelligence to the process. Perhaps, in that case, we can learn to live with a dumber search engine. Is this what’s happening? Is Google poaching our brainpower?

TrackBack URL for this entry: http://blogs.businessweek.com/mt/mt-tb.cgi/

Reader Comments

360 View

September 6, 2007 09:54 AM

Google gives us convenience like never before -- surely something else would emerge but semantic search engines are laying foundation on Google where indexing various sources for answers but may be we need something else to cater our needs -- a different approach!

Yegor Kuznetsov

September 26, 2007 11:43 AM

Stephen, interesting item on Hakia!

As far as I understand, Hakia’s semantic search solution is still based on keyword recognition (like solutions of other players – Google, FAST or Convera).

But what if the keyword is misspelled? Will the semantic search work in this case? Or if you do not know exactly what you are looking for, just have a vague notion?

There are other solutions out there that deal with this problem imitating the work of human brain (we don’t look for keywords, we look for patterns).

For example, Brainware possesses a unique, patent-protected technology that sets it apart from other data capture and enterprise search solutions providers.

Its products are powered by the world's only engine that does not rely on exact definitions to rapidly sift through mountains of unstructured data. Brainware's technology allows it to recognize and find data through inexact definitions, patterns and context, mimicking the way the human brain processes and sorts information.

Here’s a case study showing Brainware in action:
Fulbright & Jaworski: Leading Law Firm Searches And Shares Knowledge Base Smarter, More Accurately
http://www.brainware.com/brain_case_lawfirm.php

David Novakovic

September 30, 2007 05:54 AM

yegor: what you just described is the same in any "smart search"

Any extension to popular IR research is knowing _which_ system to use _when_, and building/learning up lots of parsing rules, thesauri and other supporting processes.

your technology may well be superior in its concept matching capacity, but is it as fast as web search that needs to service random requests in a fraction of a second? Is it running live on the web right now servicing thousands of barely cachable requests every second?

I doubt it. In fact the report you linked to says "under 5 seconds," that isn't acceptable in web search.

Please be careful not to mix web and enterprise IR systems. They are two completely different topics.

Patent flaunting is ridiculous too :)

Yegor Kuznetsov

October 24, 2007 12:44 PM

David,

THankks for the inputs! Where can I read more about the 'smart search' concept?

Post a comment

 

About

In Blogspotting Senior Writer Stephen Baker and Associate Editor Heather Green take a look at how cutting-edge technologies are changing business and society. Whether its blogs or wikis, data crunching or data targeting, technology’s advances are reshaping the world that we live in.

BW Mall - Sponsored Links