searxng/searx/data
Alexandre Flament 931e1f6503 searx.utils.detect_language : add model from fastlangid
The project fastlangid has a FastText model to achieve higher accuracy
for Japanese, Korean, Chinese languages.

This commits includes the model from this project,
and change searx.utils.detect_language to rely on that model
as a second stage.

The model is lazy loaded when the base model detect Japanese, Korean or Chinese.

https://github.com/currentslab/fastlangid
2023-09-17 09:31:47 +00:00
..
__init__.py [mod] replace engines_languages.json by engines_traits.json 2023-03-24 10:37:42 +01:00
ahmia_blacklist.txt Update searx.data - update_ahmia_blacklist.py 2023-08-29 07:21:21 +02:00
currencies.json Update searx.data - update_currencies.py 2023-08-29 07:20:42 +02:00
engine_descriptions.json Update searx.data - update_engine_descriptions.py 2023-08-29 07:20:06 +02:00
engine_traits.json [mod] make data.traits: add Odysee 2023-09-13 21:41:33 +02:00
external_bangs.json Update searx.data - update_external_bangs.py 2022-10-29 01:46:27 +00:00
external_urls.json [mod] add external_urls.json and wikidata_units.json 2020-10-28 08:09:25 +01:00
lid.176.ftz [mod] new plugin: Autodetect search language 2022-12-10 13:11:47 +01:00
model_s.ftz searx.utils.detect_language : add model from fastlangid 2023-09-17 09:31:47 +00:00
osm_keys_tags.json [upd] make data.all 2023-06-28 21:21:53 +02:00
useragents.json Update searx.data - update_firefox_version.py 2023-08-29 07:21:46 +02:00
wikidata_units.json Update searx.data - update_wikidata_units.py 2023-08-29 07:17:44 +02:00