Yacy is a distributed search engine is not censored: three years later



Yacy is a decentralized search engine which allows you to search information on the Internet without local or global censorship, or any other restrictions.

The first and only reference about it on Habre was Nov 29, 2011.

But since that time much has changed, let's look at him again.

Key features and benefits of Yacy:


— Decentralized search and storage of the index in the DHT network.
— Three modes of operation: 1) Global search index, 2) the Group index, 3) Local index
— No ads
— The lack of any kind of censorship (state, copyrites)
— A huge number of settings

General drawbacks:


— Search time (because of the decentralized nature, the search of unpopular content can take considerable time)
— Relevancy (relevancy algorithm was redesigned during these three years, but he still lags behind search giants)

What has changed in three years ?


To support Russian — language search queries
— Tooltips have been added to during the enter search query
— Rapid search — as you type yacy is already looking for peers with this content
— Improved search algorithms and results is more relevant the result
and millions of other small changes under the hood.

How does Yacy?


Indexing

Indexing can be initiated in the following ways:
1) the Compulsory indication of the start of scan
2) the Remote request from another feast
3) set up proxying all requests from browser to Yacy with subsequent indexing what you read

After the preparation of the database index, it is stored locally, sending to the network information that you have it, and distributed DHT on the neighboring peers.

Search

During the process of Yacy search first searches for results in the local index and then the global binding for c DHT peers, which is index information of a request/site.

Search results from Yacy:





Official website of the project yacy.net/en
Windows yacy.net/release/yacy_v1.68_20140209_9000.exe
Linux yacy.net/release/yacy_v1.68_20140209_9000.tar.gz
OS X yacy.net/release/yacy_v1.68_20140209_9000.dmg

Test search page search.yacy.net (which can drop from high traffic)

PS my Last article was three years ago, if the users of Habr will be an interesting topic of decentralized search engines, I'm willing to do a review of all functions of the Yacy and to consider in detail how it works
Article based on information from habrahabr.ru

Комментарии

Отправить комментарий

Популярные сообщения из этого блога

Templates ESKD and GOST 7.32 for Lyx 1.6.x

Изображение
for more than six months I use a word processor Lyx. Built-in templates is more than enough to write lecture notes, prepare for seminars and to do simple reports for laboratory work. But last semester I had to make two course of the project in accordance with the requirements ESKD. I have begun work in Lyx, but without special templates of documents, my reports in the editor looked like this: A little work, a little reading of the document "Customizing LyX: Features for the Advanced User" and it turned out where the beam: You can use immediately. If you have experience of working in Lyx, problems will not arise. Just in case the attached sample documents. Description of how to make such templates are not yet doing. Someone will ask — will tell. ESKD Screenshot menu select unit type: Group "sections and subsections" appeared due to the fact that the document can be sections with sections without subsections — for their handling of para...
Далее...

Monitoring PostgreSQL + php-fpm + nginx + disk using Zabbix

Изображение
a Lot of information in the network according to Zabbix, and a lot of bespoke templates, I want to introduce to the audience his modification. Zabbix is a very convenient and flexible monitoring tool. Want a hundred monitor, I want a thousand stations, and do not want to — watch a single server, take the cream in all sections. I would not mind to give to github, if anyone collects similar. It so happened that we decided to put on the hosting database wrapper php-fpm+nginx. As the database is postgres. Thoughts to collect data on the machine was before the purchase of hosting is needed, this is useful! Magic kick up the backside to the implementation of the system gave the brakes a hard drive on our VDS stations at the beginning of the script every minute, put the time and measured by the speed in the file, and then build graphs in Excel to compare to as it was/became, take quantitative statistics. And this is just one option! And suddenly the fault is not VDS, and our a...
Далее...

Custom table in MODx Revolution

Изображение
In this article we will examine the following questions: the Creating custom tables for MODx Revolution. the Generation of XML schema and php files classes for xPDO. the Work with custom tables. One of the biggest difficulties in migrating from Evolution to Revolution — an xPDO IMHO. After all, as was previously just got into the muscle via phpMyAdmin, created a sign, and work with it, sending pure SQL queries through $modx->db. Now any changes to the database do not much bother $modx except full drop tables, etc. As linked xPDO and MODx (or rather $modx), I wrote here . Consider the difficulties in working with custom tables in MODx Revolution — a considerable obstacle for many programmers. But really, it's not so difficult. All of the following, the algorithm in three words: the via phpMyAdmin (or other convenient tool to use) to create the needed tables the Using the attached code is generated for the necessary work xPDO files the Using the $...
Далее...