Jul

Why Keywords Do Not Cut It on Social Search

Most of the online search is keywords-based. Same in social domain, a vast number of analytical tools, networking platforms and mobile apps use keyword-based technologies as well.

There is a difference, of course, between traditional internet search and social search. The former finds websites. The latter finds conversations, messages, posts. Keyword-based internet search is doing a decent job for us for over 20 years. Keyword-based social search is not doing a decent job at all.

Consider a basic example: finding on Twitter who is interested in buying jeans. We can start by typing ‘jeans’ but that brings up too much noise. Maybe ‘need jeans’? Less noise but then we  people who use expressions like ‘looking for jeans’ or ‘want jeans’ or shopping for jeans’. Not to mention those who use ‘denim’, or brand names. So we have to run multiple searches or create a complex search string using logical AND and OR and hope it works. Neither option is simple, or convenient, and certainly not efficient.

The above example highlights the major flaw with keyword search - it does not capture the meaning of social conversations, and therefore cannot be a reliable source of information about conversations.

It does not provide too much of correct information. And it does provide lots of incorrect information. But the biggest problem is that it has extremely limited potential for improvement.  

So as long as we stick with keyword-based social search the results are destined to be limited.

Why, then, we stick with keyword-based search in social search? Simply because there is no good alternative. Until recently, that is.  

The advanced semantic technologies capable of capturing the meaning, or intent, of conversations are now offering an exciting alternative.

I will discuss these technologies on my next blog.

Interested in reading more? Check out our other blogs:

How nmodes technology is unique



nmodes AI is based on semantic algorithms. They require significantly less computational capacity compared to standard machine learning algorithms used by a majority of conversational AI systems today.

As a result, the infrastructure requirements are drastically reduced. In simple terms, what Google Home or Amazon Alexa do with the help of supercomputers or advanced computer farms, nmodes AI can do on a basic server.

And it gives nmodes ability to delegate conversational capacity to the users.  With the help of nmodes AI every business (and individual) can create their own AI to handle the details of the business (products, customers, etc) not accessible from the outside.

 
READ MORE

Beware the lure of crowdsourced data

Crowdsourced data can often be inconsistent, messy or downright wrong 

We all like something for nothing, that’s why open source software is so popular. (It’s also why the Pirate  Bay exists). But sometimes things that seem too good to be true are just that. 

Repustate is in the text analytics game which means we needs lots and lots of data to model certain  characteristics of written text. We need common words, grammar constructs, human-annotated corpora  of text etc. to make our various language models work as quickly and as well as they do. 

We recently embarked on the next phase of our text analytics adventure: semantic analysis. Semantic  analysis the process of taking arbitrary text and assigning meaning to the individual, relevant components.  For example, being able to identify “apple” as a fruit in the sentence “I went apple picking yesterday” but to  identify “Apple’ the company when saying “I can’t wait for the new Apple product announcement” (note:  even though I used title case for the latter example, casing should not matter)

READ MORE