Commit Graph

4260 Commits

Author SHA1 Message Date
Markus Heiser
ed901ab18e [mod] improve 'Autodetect search language' plugin
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model

Reosurces::

    import fasttext                                    # --> +10 MB
    fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB

Suggested-by: @dalf

- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
  py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
  libc) --> patch Dockerfile and build from fastetxt:

     sed -i s/fasttext-wheel/fasttext/ requirements.txt

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-11 11:26:07 +01:00
ArtikusHG
9925a20950 [mod] new plugin: Autodetect search language 2022-12-10 13:11:47 +01:00
searxng-bot
759d53c892 [translations] update from Weblate
1b4600d0 - 2022-12-08 - JohnyPeaN <johnypean@gmail.com>
e3b49827 - 2022-12-04 - Markus Heiser <markus.heiser@darmarit.de>
975217cf - 2022-12-02 - Markus Heiser <markus.heiser@darmarit.de>
2022-12-09 07:15:14 +00:00
Alexandre Flament
269326063a Fix: don't crash when engine or name is missing in settings.yml
SearXNG crashes if the engine or name fields are missing.
With this commit, the app displays an error in the log and keeps loading.

Close #1951
2022-12-04 23:43:59 +01:00
searxng-bot
f40d1c0004 [translations] update from Weblate
cc5cf5d8 - 2022-11-30 - Chathura madusanka <mcchathuer216@gmail.com>
97776fbf - 2022-11-29 - Markus Heiser <markus.heiser@darmarit.de>
c3c9f988 - 2022-11-29 - Markus Heiser <markus.heiser@darmarit.de>
a1cf339e - 2022-11-29 - Markus Heiser <markus.heiser@darmarit.de>
4429167c - 2022-11-25 - Markus Heiser <markus.heiser@darmarit.de>
2022-12-02 07:15:43 +00:00
Ryan Kaskel
e19218c6a9
Copy client connection kwargs before mutating 2022-11-29 12:15:18 +00:00
Markus Heiser
a8359dd4d3
Merge pull request #1981 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
2022-11-29 07:48:26 +01:00
Markus Heiser
1b2f1c17f6
Merge pull request #1982 from searxng/update_data_update_wikidata_units.py
Update searx.data - update_wikidata_units.py
2022-11-29 07:47:52 +01:00
Markus Heiser
3579a38a2d
Merge pull request #1983 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
2022-11-29 07:46:49 +01:00
Markus Heiser
82af2f4460
Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
2022-11-29 07:45:51 +01:00
dalf
a508cdbd4b Update searx.data - update_engine_descriptions.py 2022-11-29 01:34:42 +00:00
dalf
c4512cf64d Update searx.data - update_ahmia_blacklist.py 2022-11-29 01:24:48 +00:00
dalf
b0b45fd2d0 Update searx.data - update_currencies.py 2022-11-29 01:24:39 +00:00
dalf
a9be73b4da Update searx.data - update_wikidata_units.py 2022-11-29 01:24:38 +00:00
dalf
9fc72419e1 Update searx.data - update_firefox_version.py 2022-11-29 01:24:35 +00:00
searxng-bot
981a2c9626 [translations] update from Weblate
c13727fc - 2022-11-21 - MSI Shafik <shafik.te@gmail.com>
21f638f6 - 2022-11-19 - Markus Heiser <markus.heiser@darmarit.de>
b8ed9e1c - 2022-11-24 - Markus Heiser <markus.heiser@darmarit.de>
2022-11-25 07:16:11 +00:00
searxng-bot
9d06115d07 [translations] update from Weblate
7569f266 - 2022-11-18 - Markus Heiser <markus.heiser@darmarit.de>
6418da9a - 2022-11-18 - mikni <mikni@proton.me>
acc0dc1a - 2022-11-18 - Markus Heiser <markus.heiser@darmarit.de>
6c2beba6 - 2022-11-19 - Alexandre Flament <alex@al-f.net>
b49457e3 - 2022-11-18 - Markus Heiser <markus.heiser@darmarit.de>
2022-11-19 16:21:15 +00:00
searxng-bot
7a39952558 [translations] update from Weblate
f123be21 - 2022-11-13 - Markus Heiser <markus.heiser@darmarit.de>
fa2cfa8f - 2022-11-13 - Markus Heiser <markus.heiser@darmarit.de>
2022-11-18 07:17:51 +00:00
Émilien Devos
46ad32343a Switch back to protobuf for raw HTML 2022-11-11 07:39:48 +00:00
ngosang
78be4b4c70 Fix Google search engine.
- Fix broken links. Resolves #1794
- Fix missing results. Resolves #1829
2022-11-11 07:34:19 +01:00
Ryan Draga
408200c87e [fix] disabling zlibrary due to z-lib.org domain seizure 2022-11-10 21:18:21 +01:00
Markus Heiser
ee4475ff4b
Merge pull request #1934 from dalf/fix_user_agent
User agent: don't include the patch number in the Firefox version
2022-11-09 06:50:33 +01:00
Alexandre FLAMENT
73b5a58d9e [FIX] Redis initialization
redis.Redis.from_url(url) doesn't check if the url is valid

Before this commit: actual error are detected later when the client is actually used.
With this commit, client() makes sure to return a valid Redis client or None.

Also, the code makes sure not to log the password of the Redis URL
2022-11-07 22:08:32 +00:00
Alexandre Flament
8f19bdaf17
Merge pull request #1882 from fehho/metacpan
Add MetaCPAN engine
2022-11-07 21:54:11 +01:00
fehho
fe351c2802 Add MetaCPAN engine 2022-11-07 08:07:06 -06:00
Evhorizon
1517724615
Update network.py 2022-11-06 20:35:30 +01:00
Alexandre Flament
2dc5c0e1d6
Merge pull request #1928 from searxng/translations_update
Update translations
2022-11-06 11:29:28 +01:00
Alexandre Flament
4fe5463671
Merge pull request #1869 from vgerak/1836-ddg-weather
Fix floating point format in DDG weather humidity
2022-11-05 22:46:50 +01:00
Alexandre FLAMENT
d8dee21277 searx.locale: add Dhivehi language 2022-11-05 21:26:15 +00:00
Alexandre FLAMENT
20d951fc5c searx.locales: improve support for languages not supported by babel
* refactor get_translations() to rely on ADDITIONAL_TRANSLATIONS and LOCALE_BEST_MATCH
* update RTL_LOCALES for languages in ADDITIONAL_TRANSLATIONS
2022-11-05 21:26:07 +00:00
Alexandre Flament
e473addaff User agent: don't include the patch number in the Firefox version
The Firefox version in the user agent doesn't include the patch version: 106.0 not 106.0.2

Close #1914
2022-11-05 22:04:37 +01:00
Alexandre FLAMENT
e92755d358 Initialize Redis in searx/webapp.py
settings.yml:
* The default URL was unix:///usr/local/searxng-redis/run/redis.sock?db=0
* The default URL is now "false"

The default URL makes the log difficult to deal with:
if the admin didn't install a Redis instance, the logs record a false error.

It worked before because SearXNG initialized the Redis connection when the limiter started.

In this commit, SearXNG initializes Redis in searx/webapp.py
so various components can use Redis without taking care of the initialization step.
2022-11-05 17:45:52 +01:00
Alexandre Flament
fe419e355b The checker requires Redis
Remove the abstraction in searx.shared.SharedDict.
Implement a basic and dedicated scheduler for the checker using a Redis script.
2022-11-05 12:04:50 +01:00
searxng-bot
7438e48d13 [translations] update from Weblate
41ebf8e7 - 2022-10-31 - Landhoo School Students <landhooschoolstudents@gmail.com>
1de65e6a - 2022-10-29 - Markus Heiser <markus.heiser@darmarit.de>
fff11c22 - 2022-10-30 - Markus Heiser <markus.heiser@darmarit.de>
f677049f - 2022-10-30 - Markus Heiser <markus.heiser@darmarit.de>
ebf69b4a - 2022-10-30 - Markus Heiser <markus.heiser@darmarit.de>
a21b6221 - 2022-11-02 - Markus Heiser <markus.heiser@darmarit.de>
ac384800 - 2022-11-03 - ptomljanovic <phill2605@gmail.com>
c4736fd4 - 2022-11-03 - alexfs2015 <alex04fs@gmail.com>
1b967129 - 2022-10-31 - Landhoo School Students <landhooschoolstudents@gmail.com>
2022-11-04 07:18:35 +00:00
Markus Heiser
fc9986de0a
Merge pull request #1905 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
2022-10-29 08:22:43 +02:00
Markus Heiser
3f1d594c23
Merge pull request #1906 from searxng/update_data_update_external_bangs.py
Update searx.data - update_external_bangs.py
2022-10-29 08:21:33 +02:00
Markus Heiser
a9deead102
Merge pull request #1907 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
2022-10-29 08:20:53 +02:00
Markus Heiser
d49ccb54ea
Merge pull request #1908 from searxng/update_data_update_wikidata_units.py
Update searx.data - update_wikidata_units.py
2022-10-29 08:20:27 +02:00
Markus Heiser
fa59ff9b78
Merge pull request #1909 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
2022-10-29 08:19:56 +02:00
dalf
e70589c598 Update searx.data - update_engine_descriptions.py 2022-10-29 01:56:57 +00:00
dalf
985a2a87a6 Update searx.data - update_currencies.py 2022-10-29 01:46:40 +00:00
dalf
c0ecc2f865 Update searx.data - update_wikidata_units.py 2022-10-29 01:46:38 +00:00
dalf
c24abc2f8c Update searx.data - update_firefox_version.py 2022-10-29 01:46:34 +00:00
dalf
f0c7898445 Update searx.data - update_external_bangs.py 2022-10-29 01:46:27 +00:00
dalf
799c5270ae Update searx.data - update_ahmia_blacklist.py 2022-10-29 01:46:24 +00:00
Markus Heiser
5a181ea1f5
Merge pull request #1901 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/svgo-3.0.0
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
2022-10-28 10:22:56 +02:00
Markus Heiser
d913f0d8aa [build] /static 2022-10-28 10:17:56 +02:00
searxng-bot
bc3db6fd16 [translations] update from Weblate
bf52cdbc - 2022-10-22 - Markus Heiser <markus.heiser@darmarit.de>
fbb36c76 - 2022-10-22 - forvirretfrukt <lillelilli87@gmail.com>
18cc8a36 - 2022-10-22 - Markus Heiser <markus.heiser@darmarit.de>
7314d2b6 - 2022-10-24 - Markus Heiser <markus.heiser@darmarit.de>
b25147b9 - 2022-10-27 - Markus Heiser <markus.heiser@darmarit.de>
d39ade65 - 2022-10-24 - Markus Heiser <markus.heiser@darmarit.de>
cb835cdc - 2022-10-24 - Markus Heiser <markus.heiser@darmarit.de>
563f4e0b - 2022-10-26 - Markus Heiser <markus.heiser@darmarit.de>
a698a2e9 - 2022-10-24 - Markus Heiser <markus.heiser@darmarit.de>
df5ce281 - 2022-10-22 - Markus Heiser <markus.heiser@darmarit.de>
55b369a3 - 2022-10-22 - Markus Heiser <markus.heiser@darmarit.de>
3eddf243 - 2022-10-24 - zaioti <zaioti@tuta.io>
edd3871d - 2022-10-24 - zaioti <zaioti@tuta.io>
5aab9f7b - 2022-10-22 - Markus Heiser <markus.heiser@darmarit.de>
0b2cfe68 - 2022-10-22 - tents <remendne@pentrens.jp>
732b7865 - 2022-10-22 - Markus Heiser <markus.heiser@darmarit.de>
d652c20f - 2022-10-22 - Markus Heiser <markus.heiser@darmarit.de>
0bcaaa8d - 2022-10-24 - Markus Heiser <markus.heiser@darmarit.de>
6fd87821 - 2022-10-26 - Markus Heiser <markus.heiser@darmarit.de>
618f213c - 2022-10-21 - Masterix <masterix@duck.com>
30d38ee9 - 2022-10-24 - Markus Heiser <markus.heiser@darmarit.de>
a934ce3b - 2022-10-23 - Markus Heiser <markus.heiser@darmarit.de>
b696c22e - 2022-10-23 - Markus Heiser <markus.heiser@darmarit.de>
6ee1efe2 - 2022-10-23 - Jeewaka Fernando <Jeewakaphotography@gmail.com>
2022-10-28 07:18:50 +00:00
dependabot[bot]
3cade9a7eb
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
Bumps [svgo](https://github.com/svg/svgo) from 2.8.0 to 3.0.0.
- [Release notes](https://github.com/svg/svgo/releases)
- [Changelog](https://github.com/svg/svgo/blob/main/CHANGELOG-old.md)
- [Commits](https://github.com/svg/svgo/compare/v2.8.0...v3.0.0)

---
updated-dependencies:
- dependency-name: svgo
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-10-28 07:13:58 +00:00
searxng-bot
18ba8628dd [translations] update from Weblate
c7fddee3 - 2022-10-15 - Linerly <linerly@protonmail.com>
f559a626 - 2022-10-17 - Markus Heiser <markus.heiser@darmarit.de>
fe7af662 - 2022-10-17 - Mateusz Bączek <mateusz.baczek1998@gmail.com>
8a7c3da9 - 2022-10-16 - Peter Martin <weblate@pe7er.com>
a84dad5c - 2022-10-16 - Franco Longo <longofrancoale@gmail.com>
9ee1ac8b - 2022-10-20 - prljav <marin.ruskica@gmail.com>
b91bedc4 - 2022-10-16 - Peter Martin <weblate@pe7er.com>
dff99ef4 - 2022-10-16 - Peter Martin <weblate@pe7er.com>
cd639f6c - 2022-10-17 - Markus Heiser <markus.heiser@darmarit.de>
49507a60 - 2022-10-14 - Markus Heiser <markus.heiser@darmarit.de>
ad305582 - 2022-10-16 - Peter Martin <weblate@pe7er.com>
19e97075 - 2022-10-17 - Markus Heiser <markus.heiser@darmarit.de>
97581f70 - 2022-10-14 - Markus Heiser <markus.heiser@darmarit.de>
fcd52cea - 2022-10-14 - Alexandre Flament <alex@al-f.net>
2022-10-21 07:32:09 +00:00