f3515041af
Lazy load fasttext-predict
2022-12-26 18:44:23 +00:00
735e388cec
Merge branch 'master' into fasttext
2022-12-16 19:43:10 +00:00
1f8f8c1e91
Replace langdetect with fasttext
2022-12-16 21:07:39 +02:00
2a51c85672
Merge pull request #1974 from fehho/query-string-deserial
...
[fix] Deserialize preferences which are explicitly blank strings
2022-12-16 18:56:30 +01:00
03ce848e04
[translations] update from Weblate
...
4cf39daef67457cfdee211c29eeb4290
2022-12-16 07:15:19 +00:00
9e9f57e48b
Merge pull request #1954 from dalf/fix.redis.init.2
...
[fix] follow up of PR-1856
2022-12-14 07:08:19 +01:00
ed901ab18e
[mod] improve 'Autodetect search language' plugin
...
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model
Reosurces::
import fasttext # --> +10 MB
fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB
Suggested-by: @dalf
- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
libc) --> patch Dockerfile and build from fastetxt:
sed -i s/fasttext-wheel/fasttext/ requirements.txt
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-11 11:26:07 +01:00
9925a20950
[mod] new plugin: Autodetect search language
2022-12-10 13:11:47 +01:00
b971167ced
move searx.shared.redisdb to searx.redisdb
2022-12-10 09:26:38 +01:00
34e260f88f
[fix] follow up of PR-1856
...
- the environment variable SEARXNG_REDIS_URL overrides the setting value redis.url
- ./manage sets SEARXNG_REDIS_URL to unix:///usr/local/searxng-redis/run/redis.sock if:
- the socket exists
- SEARXNG_REDIS_URL is not already defined
Update of PR #1856
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-10 09:26:38 +01:00
759d53c892
[translations] update from Weblate
...
1b4600d0e3b49827975217cf
2022-12-09 07:15:14 +00:00
269326063a
Fix: don't crash when engine or name is missing in settings.yml
...
SearXNG crashes if the engine or name fields are missing.
With this commit, the app displays an error in the log and keeps loading.
Close #1951
2022-12-04 23:43:59 +01:00
f40d1c0004
[translations] update from Weblate
...
cc5cf5d897776fbfc3c9f988a1cf339e4429167c
2022-12-02 07:15:43 +00:00
e19218c6a9
Copy client connection kwargs before mutating
2022-11-29 12:15:18 +00:00
a8359dd4d3
Merge pull request #1981 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-11-29 07:48:26 +01:00
1b2f1c17f6
Merge pull request #1982 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-11-29 07:47:52 +01:00
3579a38a2d
Merge pull request #1983 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-11-29 07:46:49 +01:00
82af2f4460
Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-11-29 07:45:51 +01:00
a508cdbd4b
Update searx.data - update_engine_descriptions.py
2022-11-29 01:34:42 +00:00
c4512cf64d
Update searx.data - update_ahmia_blacklist.py
2022-11-29 01:24:48 +00:00
b0b45fd2d0
Update searx.data - update_currencies.py
2022-11-29 01:24:39 +00:00
a9be73b4da
Update searx.data - update_wikidata_units.py
2022-11-29 01:24:38 +00:00
9fc72419e1
Update searx.data - update_firefox_version.py
2022-11-29 01:24:35 +00:00
981a2c9626
[translations] update from Weblate
...
c13727fc21f638f6b8ed9e1c
2022-11-25 07:16:11 +00:00
7cab51f98f
Deserialize explicitly blank strings
...
Default behavior of urllib.parse_qs is to discard blank values, causing a preference of none to be deserialized as undefined, using the instance default rather than the selected preference.
2022-11-24 13:14:12 -06:00
9d06115d07
[translations] update from Weblate
...
7569f2666418da9aacc0dc1a6c2beba6b49457e3
2022-11-19 16:21:15 +00:00
7a39952558
[translations] update from Weblate
...
f123be21fa2cfa8f
2022-11-18 07:17:51 +00:00
46ad32343a
Switch back to protobuf for raw HTML
2022-11-11 07:39:48 +00:00
78be4b4c70
Fix Google search engine.
...
- Fix broken links. Resolves #1794
- Fix missing results. Resolves #1829
2022-11-11 07:34:19 +01:00
408200c87e
[fix] disabling zlibrary due to z-lib.org domain seizure
2022-11-10 21:18:21 +01:00
ee4475ff4b
Merge pull request #1934 from dalf/fix_user_agent
...
User agent: don't include the patch number in the Firefox version
2022-11-09 06:50:33 +01:00
73b5a58d9e
[FIX] Redis initialization
...
redis.Redis.from_url(url) doesn't check if the url is valid
Before this commit: actual error are detected later when the client is actually used.
With this commit, client() makes sure to return a valid Redis client or None.
Also, the code makes sure not to log the password of the Redis URL
2022-11-07 22:08:32 +00:00
8f19bdaf17
Merge pull request #1882 from fehho/metacpan
...
Add MetaCPAN engine
2022-11-07 21:54:11 +01:00
fe351c2802
Add MetaCPAN engine
2022-11-07 08:07:06 -06:00
1517724615
Update network.py
2022-11-06 20:35:30 +01:00
2dc5c0e1d6
Merge pull request #1928 from searxng/translations_update
...
Update translations
2022-11-06 11:29:28 +01:00
4fe5463671
Merge pull request #1869 from vgerak/1836-ddg-weather
...
Fix floating point format in DDG weather humidity
2022-11-05 22:46:50 +01:00
d8dee21277
searx.locale: add Dhivehi language
2022-11-05 21:26:15 +00:00
20d951fc5c
searx.locales: improve support for languages not supported by babel
...
* refactor get_translations() to rely on ADDITIONAL_TRANSLATIONS and LOCALE_BEST_MATCH
* update RTL_LOCALES for languages in ADDITIONAL_TRANSLATIONS
2022-11-05 21:26:07 +00:00
e473addaff
User agent: don't include the patch number in the Firefox version
...
The Firefox version in the user agent doesn't include the patch version: 106.0 not 106.0.2
Close #1914
2022-11-05 22:04:37 +01:00
e92755d358
Initialize Redis in searx/webapp.py
...
settings.yml:
* The default URL was unix:///usr/local/searxng-redis/run/redis.sock?db=0
* The default URL is now "false"
The default URL makes the log difficult to deal with:
if the admin didn't install a Redis instance, the logs record a false error.
It worked before because SearXNG initialized the Redis connection when the limiter started.
In this commit, SearXNG initializes Redis in searx/webapp.py
so various components can use Redis without taking care of the initialization step.
2022-11-05 17:45:52 +01:00
fe419e355b
The checker requires Redis
...
Remove the abstraction in searx.shared.SharedDict.
Implement a basic and dedicated scheduler for the checker using a Redis script.
2022-11-05 12:04:50 +01:00
7438e48d13
[translations] update from Weblate
...
41ebf8e71de65e6afff11c22f677049febf69b4aa21b6221ac384800c4736fd41b967129
2022-11-04 07:18:35 +00:00
fc9986de0a
Merge pull request #1905 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-10-29 08:22:43 +02:00
3f1d594c23
Merge pull request #1906 from searxng/update_data_update_external_bangs.py
...
Update searx.data - update_external_bangs.py
2022-10-29 08:21:33 +02:00
a9deead102
Merge pull request #1907 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-10-29 08:20:53 +02:00
d49ccb54ea
Merge pull request #1908 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-10-29 08:20:27 +02:00
fa59ff9b78
Merge pull request #1909 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-10-29 08:19:56 +02:00
e70589c598
Update searx.data - update_engine_descriptions.py
2022-10-29 01:56:57 +00:00
985a2a87a6
Update searx.data - update_currencies.py
2022-10-29 01:46:40 +00:00
Alexandre Flament