Commit Graph

6798 Commits

Author SHA1 Message Date
ngosang 9417c284d3 Reduce Docker image size
* Remove compiled sources. Most of them are never used. Those in use are compiled in the first run really fast.
* Copy only source code and Docker entypoint
* Image size reduced by 41 MB (195 MB -> 154 MB uncompressed)
2022-11-29 22:32:28 +01:00
Alexandre Flament 768659f2bd
Merge pull request #1988 from ryankask/fix-redis-conn-logging
Copy client connection kwargs before mutating
2022-11-29 19:38:54 +01:00
Ryan Kaskel e19218c6a9
Copy client connection kwargs before mutating 2022-11-29 12:15:18 +00:00
Markus Heiser a8359dd4d3
Merge pull request #1981 from searxng/update_data_update_firefox_version.py
Update searx.data - update_firefox_version.py
2022-11-29 07:48:26 +01:00
Markus Heiser 1b2f1c17f6
Merge pull request #1982 from searxng/update_data_update_wikidata_units.py
Update searx.data - update_wikidata_units.py
2022-11-29 07:47:52 +01:00
Markus Heiser 3579a38a2d
Merge pull request #1983 from searxng/update_data_update_currencies.py
Update searx.data - update_currencies.py
2022-11-29 07:46:49 +01:00
Markus Heiser 82af2f4460
Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py
Update searx.data - update_ahmia_blacklist.py
2022-11-29 07:45:51 +01:00
Markus Heiser 5b19f89286
Merge pull request #1985 from searxng/update_data_update_engine_descriptions.py
Update searx.data - update_engine_descriptions.py
2022-11-29 07:45:17 +01:00
dalf a508cdbd4b Update searx.data - update_engine_descriptions.py 2022-11-29 01:34:42 +00:00
dalf c4512cf64d Update searx.data - update_ahmia_blacklist.py 2022-11-29 01:24:48 +00:00
dalf b0b45fd2d0 Update searx.data - update_currencies.py 2022-11-29 01:24:39 +00:00
dalf a9be73b4da Update searx.data - update_wikidata_units.py 2022-11-29 01:24:38 +00:00
dalf 9fc72419e1 Update searx.data - update_firefox_version.py 2022-11-29 01:24:35 +00:00
Markus Heiser 1314c1c534
Merge pull request #1975 from searxng/dependabot/pip/master/pylint-2.15.6
Bump pylint from 2.15.5 to 2.15.6
2022-11-25 08:25:46 +01:00
Markus Heiser 28ae469f81
Merge pull request #1976 from searxng/dependabot/pip/master/redis-4.3.5
Bump redis from 4.3.4 to 4.3.5
2022-11-25 08:25:24 +01:00
Markus Heiser 5ca6868c98
Merge pull request #1977 from searxng/translations_update
Update translations
2022-11-25 08:24:28 +01:00
searxng-bot 981a2c9626 [translations] update from Weblate
c13727fc - 2022-11-21 - MSI Shafik <shafik.te@gmail.com>
21f638f6 - 2022-11-19 - Markus Heiser <markus.heiser@darmarit.de>
b8ed9e1c - 2022-11-24 - Markus Heiser <markus.heiser@darmarit.de>
2022-11-25 07:16:11 +00:00
dependabot[bot] 72a079fe89
Bump redis from 4.3.4 to 4.3.5
Bumps [redis](https://github.com/redis/redis-py) from 4.3.4 to 4.3.5.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.3.4...v4.3.5)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-11-25 07:00:57 +00:00
dependabot[bot] 2360f98a24
Bump pylint from 2.15.5 to 2.15.6
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.15.5 to 2.15.6.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.15.5...v2.15.6)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-11-25 07:00:54 +00:00
Alexandre Flament b5371b7a85
Merge pull request #1963 from searxng/translations_update
Update translations
2022-11-19 17:26:05 +01:00
searxng-bot 9d06115d07 [translations] update from Weblate
7569f266 - 2022-11-18 - Markus Heiser <markus.heiser@darmarit.de>
6418da9a - 2022-11-18 - mikni <mikni@proton.me>
acc0dc1a - 2022-11-18 - Markus Heiser <markus.heiser@darmarit.de>
6c2beba6 - 2022-11-19 - Alexandre Flament <alex@al-f.net>
b49457e3 - 2022-11-18 - Markus Heiser <markus.heiser@darmarit.de>
2022-11-19 16:21:15 +00:00
Alexandre Flament 1cdadf4bfd
Merge pull request #1948 from searxng/dependabot/pip/master/selenium-4.6.0
Bump selenium from 4.5.0 to 4.6.0
2022-11-18 14:20:11 +01:00
Alexandre Flament fe8b0472dd
Merge pull request #1949 from searxng/translations_update
Update translations
2022-11-18 14:19:51 +01:00
searxng-bot 7a39952558 [translations] update from Weblate
f123be21 - 2022-11-13 - Markus Heiser <markus.heiser@darmarit.de>
fa2cfa8f - 2022-11-13 - Markus Heiser <markus.heiser@darmarit.de>
2022-11-18 07:17:51 +00:00
Markus Heiser 3a765113ee
Merge pull request #1950 from searxng/google-fix-pc
Switch back to protobuf for raw HTML
2022-11-11 10:46:19 +01:00
Émilien Devos 46ad32343a Switch back to protobuf for raw HTML 2022-11-11 07:39:48 +00:00
dependabot[bot] c938324778
Bump selenium from 4.5.0 to 4.6.0
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.5.0 to 4.6.0.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](https://github.com/SeleniumHQ/Selenium/compare/selenium-4.5.0...selenium-4.6.0)

---
updated-dependencies:
- dependency-name: selenium
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-11-11 07:03:36 +00:00
Markus Heiser e63457584b
Merge pull request #1944 from ngosang/feature/google
Fix Google search engine.
2022-11-11 07:42:07 +01:00
ngosang 78be4b4c70 Fix Google search engine.
- Fix broken links. Resolves #1794
- Fix missing results. Resolves #1829
2022-11-11 07:34:19 +01:00
Markus Heiser 117f69fa13
Merge pull request #1937 from BoxingOctopus/fix/disable_zlib
Disabling zlibrary due to z-lib.org domain seizure
2022-11-10 21:29:45 +01:00
Ryan Draga 408200c87e [fix] disabling zlibrary due to z-lib.org domain seizure 2022-11-10 21:18:21 +01:00
Markus Heiser ee4475ff4b
Merge pull request #1934 from dalf/fix_user_agent
User agent: don't include the patch number in the Firefox version
2022-11-09 06:50:33 +01:00
Alexandre Flament d3949269a9
Merge pull request #1942 from dalf/fix_redis_initialization
[FIX] Redis initialization
2022-11-07 23:16:04 +01:00
Alexandre FLAMENT 73b5a58d9e [FIX] Redis initialization
redis.Redis.from_url(url) doesn't check if the url is valid

Before this commit: actual error are detected later when the client is actually used.
With this commit, client() makes sure to return a valid Redis client or None.

Also, the code makes sure not to log the password of the Redis URL
2022-11-07 22:08:32 +00:00
Alexandre Flament 8f19bdaf17
Merge pull request #1882 from fehho/metacpan
Add MetaCPAN engine
2022-11-07 21:54:11 +01:00
fehho fe351c2802 Add MetaCPAN engine 2022-11-07 08:07:06 -06:00
Alexandre Flament ae54c7d525
Merge pull request #1938 from Evhorizon/master
Update network.py
2022-11-06 21:20:38 +01:00
Evhorizon 1517724615
Update network.py 2022-11-06 20:35:30 +01:00
Alexandre Flament 2dc5c0e1d6
Merge pull request #1928 from searxng/translations_update
Update translations
2022-11-06 11:29:28 +01:00
Alexandre Flament 4fe5463671
Merge pull request #1869 from vgerak/1836-ddg-weather
Fix floating point format in DDG weather humidity
2022-11-05 22:46:50 +01:00
Alexandre FLAMENT d8dee21277 searx.locale: add Dhivehi language 2022-11-05 21:26:15 +00:00
Alexandre FLAMENT 20d951fc5c searx.locales: improve support for languages not supported by babel
* refactor get_translations() to rely on ADDITIONAL_TRANSLATIONS and LOCALE_BEST_MATCH
* update RTL_LOCALES for languages in ADDITIONAL_TRANSLATIONS
2022-11-05 21:26:07 +00:00
Alexandre Flament e473addaff User agent: don't include the patch number in the Firefox version
The Firefox version in the user agent doesn't include the patch version: 106.0 not 106.0.2

Close #1914
2022-11-05 22:04:37 +01:00
Alexandre Flament e9f42e1c22
Merge pull request #1918 from LinuxMeow/patch-1
Remove unused volume
2022-11-05 19:45:13 +01:00
Alexandre Flament d37afb8ab9
Merge pull request #1856 from dalf/checker_requires_redis
The checker requires Redis
2022-11-05 17:50:40 +01:00
Alexandre FLAMENT e92755d358 Initialize Redis in searx/webapp.py
settings.yml:
* The default URL was unix:///usr/local/searxng-redis/run/redis.sock?db=0
* The default URL is now "false"

The default URL makes the log difficult to deal with:
if the admin didn't install a Redis instance, the logs record a false error.

It worked before because SearXNG initialized the Redis connection when the limiter started.

In this commit, SearXNG initializes Redis in searx/webapp.py
so various components can use Redis without taking care of the initialization step.
2022-11-05 17:45:52 +01:00
Alexandre Flament fe419e355b The checker requires Redis
Remove the abstraction in searx.shared.SharedDict.
Implement a basic and dedicated scheduler for the checker using a Redis script.
2022-11-05 12:04:50 +01:00
Alexandre Flament d764d94a70
Merge pull request #1927 from searxng/dependabot/pip/master/babel-2.11.0
Bump babel from 2.10.3 to 2.11.0
2022-11-05 11:38:16 +01:00
Alexandre Flament d3a7399ed7
Merge pull request #1929 from dalf/github_workflow_update
GH workflow: various improvements
2022-11-05 11:14:09 +01:00
nathannaveen b5ce39b536 chore: Set permissions for GitHub actions (#3225)
Restrict the GitHub token permissions only to the required ones; this way, even if the attackers will succeed in compromising your workflow, they won’t be able to do much.

- Included permissions for the action. https://github.com/ossf/scorecard/blob/main/docs/checks.md#token-permissions

https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#permissions

https://docs.github.com/en/actions/using-jobs/assigning-permissions-to-jobs

[Keeping your GitHub Actions and workflows secure Part 1: Preventing pwn requests](https://securitylab.github.com/research/github-actions-preventing-pwn-requests/)

Signed-off-by: nathannaveen <42319948+nathannaveen@users.noreply.github.com>
2022-11-04 16:50:43 +00:00