Insider API: search trends and quick navigation in the texts social. and traditional media

As often, with an array of texts (of any subject) we want to see a thematic distillation? What topics are discussed? What are the most popular? It would be great to enter search words and get the trends around them!
/ > image


The system is able to:
the
    the
  • to Get the array data and store them under Your user.
    • the
  • to Build the list of themes by grouping documents by topics.
    • the
  • to Do realtime search by documents, and to build themes for the sample.


All of these features are available via API, which is easy to use by connecting to one of tariff plans (there is a free trial for a month!).

We indexed the social. media (Twitter, facebook, Vkontakte) in early autumn 2015 and made screenshots of the system for visual assessment.

Consumersi segment: Magnet.
image

Yota:
image

Politics: Putin's speech at the UN.
image

So it would look inside:

image

In the previous screenshot is the contents of the topic “the UN 2015”, including the 7 news.

As you can see from the screenshots, the system consists of a full-fledged search engine (with support Russian morphology) is a convenient tool for quick navigation through arrays of information. We have no restrictions on support topics and type of data the social. media, news feeds or Your corporate documents. All described functions are available as a SAAS product with a user interface and as part of Insider API that you can integrate into Your existing systems and mobile apps.

The principle of using the API:

1. Load the data (posts, articles) in the system.
the 
End-point: /articles/uploadJson
Request type: POST
[
{
"id": 2134657,
"title": "Oscar",
"description": "Our children do not understand all these jokes about Leo and the Oscars. Gone era. But we're a special generation.",
"link": "https://twitter.com/palnom6/status/704979632127418369"
}
]


In one query you can send up to 50 texts. In response, the API responds with code 200, if all goes well.

Note the id parameter: the value of this parameter we get the reference of the post to a specific topic / trend to the next step.

2. To trends either in whole, or in relation to keywords.

the 
End-point: /articles/cluster
Request type: POST
{
"query": ""
}


In response, the API generates trends.

the 
[
{
"labels": [
"Oscar"
],
"score": 1.510325122396045,
"docs": [
"2134657",
"2134656",
"2134655",
"2134654"
]
},
{
"labels": [
"Politics"
],
"score": 1.2447816860782057,
"docs": [
"2134653",
"2134652",
"2134651",
"2134650",
"2134649",
"2134648"
]
}
]


The value of the score shows the relevance of this topic to a user request.
In step two, you can send and certain key word around which will built themes / trends.

Insider API is available here: market.mashape.com/dmitrykey/insiderapi

In addition to trends, other useful features are:

the
Article based on information from habrahabr.ru

Комментарии

Отправить комментарий

Популярные сообщения из этого блога

Templates ESKD and GOST 7.32 for Lyx 1.6.x

Изображение
for more than six months I use a word processor Lyx. Built-in templates is more than enough to write lecture notes, prepare for seminars and to do simple reports for laboratory work. But last semester I had to make two course of the project in accordance with the requirements ESKD. I have begun work in Lyx, but without special templates of documents, my reports in the editor looked like this: A little work, a little reading of the document "Customizing LyX: Features for the Advanced User" and it turned out where the beam: You can use immediately. If you have experience of working in Lyx, problems will not arise. Just in case the attached sample documents. Description of how to make such templates are not yet doing. Someone will ask — will tell. ESKD Screenshot menu select unit type: Group "sections and subsections" appeared due to the fact that the document can be sections with sections without subsections — for their handling of para...
Далее...

Monitoring PostgreSQL + php-fpm + nginx + disk using Zabbix

Изображение
a Lot of information in the network according to Zabbix, and a lot of bespoke templates, I want to introduce to the audience his modification. Zabbix is a very convenient and flexible monitoring tool. Want a hundred monitor, I want a thousand stations, and do not want to — watch a single server, take the cream in all sections. I would not mind to give to github, if anyone collects similar. It so happened that we decided to put on the hosting database wrapper php-fpm+nginx. As the database is postgres. Thoughts to collect data on the machine was before the purchase of hosting is needed, this is useful! Magic kick up the backside to the implementation of the system gave the brakes a hard drive on our VDS stations at the beginning of the script every minute, put the time and measured by the speed in the file, and then build graphs in Excel to compare to as it was/became, take quantitative statistics. And this is just one option! And suddenly the fault is not VDS, and our a...
Далее...

Custom table in MODx Revolution

Изображение
In this article we will examine the following questions: the Creating custom tables for MODx Revolution. the Generation of XML schema and php files classes for xPDO. the Work with custom tables. One of the biggest difficulties in migrating from Evolution to Revolution — an xPDO IMHO. After all, as was previously just got into the muscle via phpMyAdmin, created a sign, and work with it, sending pure SQL queries through $modx->db. Now any changes to the database do not much bother $modx except full drop tables, etc. As linked xPDO and MODx (or rather $modx), I wrote here . Consider the difficulties in working with custom tables in MODx Revolution — a considerable obstacle for many programmers. But really, it's not so difficult. All of the following, the algorithm in three words: the via phpMyAdmin (or other convenient tool to use) to create the needed tables the Using the attached code is generated for the necessary work xPDO files the Using the $...
Далее...