zaclys
/
searxng
mirror of https://github.com/searxng/searxng.git
1
0
Fork 1
Code Issues Packages Projects Releases Wiki Activity
4,888 Commits 5 Branches 17 Tags 71 MiB
Commit Graph

4888 Commits

Author SHA1 Message Date
Markus Heiser 55b30b5b49
[fix] searx_extra/update scripts: set_loggers(wikidata, 'wikidata') (#331) 
* [fix] searx_extra/update scripts: set_loggers(wikidata, 'wikidata')

To test use::

    ./manage pyenv.cmd searx_extra/update/update_currencies.py
    ./manage pyenv.cmd searx_extra/update/update_osm_keys_tags.py
    ./manage pyenv.cmd searx_extra/update/update_wikidata_units.py

The script `update_engine_descriptions.py` seems to have some issues not related
to this patch.

    ./manage pyenv.cmd python -m pip install -U pycld3
    ./manage pyenv.cmd searx_extra/update/update_engine_descriptions.py

Closes: https://github.com/searxng/searxng/issues/328
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-19 11:10:02 +02:00
Alexandre Flament d95c46d646
Merge pull request #329 from searxng/translations_update 
Update translations
 2021-09-17 15:53:45 +02:00
searxng-bot 1bc50c1eb4 [translations] update 
3834942d - 2021-09-15 - ButterflyOfFire <butterflyoffire@protonmail.com>
 2021-09-17 13:50:32 +00:00
Alexandre Flament 07a2633aee
Merge pull request #327 from dalf/pyenv.activate 
[mod] utils/lib.sh: add pyenv.activate
 2021-09-17 15:48:51 +02:00
Markus Heiser 7a3a1cd115 [mod] manage - use pyenv.activate where it makes sense 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-17 15:31:09 +02:00
Alexandre Flament e5e322e8ed [mod] utils/lib.sh: add pyenv.activate 
* initialize virtualenv (pyenv.install)
* activate virtualenv

close #310
 2021-09-17 14:15:35 +02:00
Alexandre Flament dc74df3a55
Merge pull request #261 from dalf/upgrade_httpx 
[upd] upgrade httpx 0.19.0
 2021-09-17 11:48:37 +02:00
Alexandre Flament 0d9959e649
Merge pull request #325 from searxng/dependabot/pip/master/pylint-2.11.1 
Bump pylint from 2.10.2 to 2.11.1
 2021-09-17 11:36:51 +02:00
Markus Heiser 8905607d1c
Merge pull request #326 from searxng/dependabot/pip/master/sphinx-4.2.0 
Bump sphinx from 4.1.2 to 4.2.0
 2021-09-17 08:23:17 +00:00
Markus Heiser 443bf35e09 [pylint] fix global-variable-not-assigned issues 
If there is no write access, there is no need for global.  Remove global
statement if there is no assignment.

global-variable-not-assigned:
  Using global for names but no assignment is done Used when a variable is
  defined through the "global" statement but no assignment to this variable is
  done.

In Pylint 2.11 the global-variable-not-assigned checker now catches global
variables that are never reassigned in a local scope and catches (reassigned)
functions [1][2]

[1] https://pylint.pycqa.org/en/latest/whatsnew/2.11.html
[2] https://github.com/PyCQA/pylint/issues/1375

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-17 10:14:27 +02:00
Alexandre Flament 41f6359d06 [fix] error recorder: avoid RuntimeError on some rare occasion 
httpx.RequestError (subclass of httpx.HTTPError) has a property request.
This property raises a RuntimeError if the attributes _request is None.
To avoid a cascade of errors, this commit reads directly the _request attribute.
 2021-09-17 10:06:24 +02:00
Alexandre Flament b10403d3a1 [mod] searx.network: remove redundant code 
searx.client.new_client: the proxies parameter is a dictonnary,
and the protocol (key of the dictionnary) is already normalized
(see usage of searx.network.network.PROXY_PATTERN_MAPPING)
 2021-09-17 10:06:24 +02:00
Alexandre Flament 8e73438cbe [upd] upgrade httpx 0.19.0 
adjust searx.network module to the new internal API
see https://github.com/encode/httpx/pull/1522
 2021-09-17 10:06:22 +02:00
Markus Heiser fe6470cbe6 [pylint] disable consider-using-f-string in .pylintrc 
Pylint 2.11 added [1][2]

consider-using-f-string:
  Emitted when .format() or '%' is being used to format a string.

We're not ready to enforce f-strings everywhere, so just disable this new
warning.

[1] https://pylint.pycqa.org/en/latest/whatsnew/2.11.html
[2] https://github.com/PyCQA/pylint/issues/3592

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-17 09:22:11 +02:00
dependabot[bot] 4570865ccf
Bump sphinx from 4.1.2 to 4.2.0 
Bumps [sphinx](https://github.com/sphinx-doc/sphinx) from 4.1.2 to 4.2.0.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/4.x/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v4.1.2...v4.2.0)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-09-17 07:05:07 +00:00
dependabot[bot] cfef47f682
Bump pylint from 2.10.2 to 2.11.1 
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.10.2 to 2.11.1.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.10.2...v2.11.1)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-09-17 07:05:02 +00:00
Alexandre Flament 602cbc2c99
Merge pull request #297 from dalf/engine-logger-enh 
debug mode: more readable logging
 2021-09-14 07:06:28 +02:00
Markus Heiser aba3566fbd
Merge pull request #318 from return42/fix-doc-brand 
[brand] docs - normalize project name to SearXNG
 2021-09-13 12:40:47 +00:00
Markus Heiser ecb7e73e03 [brand] docs - normalize project name to SearXNG 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-13 14:36:24 +02:00
Markus Heiser de5a8ee7d7 [fix] settings - displayed name is SearXNG 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-13 14:36:24 +02:00
Alexandre Flament 823a2fc792
Merge pull request #317 from return42/fix-manage-usage 
[fix] manage help(): commands babel.* has been renamed to weblate.*
 2021-09-13 09:09:48 +02:00
Markus Heiser 97acedd9fe
Merge pull request #305 from dalf/fix-engine-logger 
[fix] logger per engine: make .logger is always initialized
 2021-09-13 07:03:37 +00:00
Alexandre Flament f8793fbda0 [fix] logger per engine: make .logger is always initialized 
the openstreetmap engine imports code from the wikidata engine.
before this commit, specific code make sure to copy the logger variable to the wikidata engine.

with this commit searx.engines.load_engine makes sure the .logger is initialized.
The implementation scans sys.modules for module name starting with searx.engines.
 2021-09-13 08:47:59 +02:00
Markus Heiser 3f2c10ef9c [fix] manage help(): commands babel.* has been renamed to weblate.* 
In commit 97355672c the functions named babel.* has been renamed to weblate.*
but it was forgotten to change it also in the help().

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-12 15:46:00 +02:00
Markus Heiser c3473480f4
Merge pull request #314 from MrPaulBlack/engine-stats-link 
Engine stats link
 2021-09-12 09:11:12 +00:00
MrPaulBlack 644ccf16be [theme] make engine stats clickable 2021-09-12 10:52:15 +02:00
MrPaulBlack 48d4296caa [theme] link to engine stats in footer 2021-09-12 10:37:21 +02:00
Markus Heiser ecd6ca86d0
Merge pull request #308 from dalf/plugin_hostname_replace 
[enh] add hostname_replace plugin
 2021-09-12 07:53:09 +00:00
Alexandre Flament 0f43b39eac [enh] add hostname_replace plugin 
* backport of https://github.com/searx/searx/pull/2724
* allow to remove result if the replacement is the boolean value false
 2021-09-11 13:23:06 +02:00
Alexandre Flament 2de95af923
Merge pull request #313 from dalf/fix-pr-257 
[fix] PR #257: use the image_proxy network instead of the default network
 2021-09-11 11:22:29 +02:00
Alexandre Flament 2b53d718e4 [fix] PR #257: use the image_proxy network instead of the default network 2021-09-11 11:15:51 +02:00
Alexandre Flament 6abc37efc7 [mod] production mode: make sure to set the log level to WARNING 
set:
* the root logger level to WARNING
* the werkzeug logger level to WARNING (useful when there is no uwsgi)
 2021-09-11 10:13:16 +02:00
Alexandre Flament 0e42db9da1 [mod] xpath engine: remove logging of the requested URL 2021-09-11 10:13:16 +02:00
Alexandre Flament 91a6d80e82 [mod] debug mode: log HTTP requests with network name 
For example wikipedia requests use the logger name "searx.network.wikipedia"

Log is disable when searx_debug is False
 2021-09-11 10:13:14 +02:00
Alexandre Flament 577998106a [mod] debug mode: use coloredlogs package 
in debug mode, add some padding to make the output more readable
in procution mode, add the timestamp
 2021-09-10 21:49:34 +02:00
Alexandre Flament b513917ef9 [mod] searx.metrics & searx.search: use the engine loggers 
metrics & processors use the engine logger
 2021-09-10 21:49:34 +02:00
Markus Heiser 76e0f6807c
Merge pull request #311 from dalf/fix-pr-302 
[fix] searx/results.py: strip result['content'] only if it exists
 2021-09-10 16:10:33 +00:00
Alexandre Flament d9658a7f91 [fix] searx/results.py: strip result['content'] only if it exists 
fix PR #302
 2021-09-10 17:58:19 +02:00
Markus Heiser 13a4d20e8d
Merge pull request #306 from dalf/docs-brand 
[doc] searxng brand
 2021-09-10 15:42:20 +00:00
Alexandre Flament 75daef8986
Merge pull request #309 from searxng/ci-python-3.10.0-rc.2 
[ci] add Python 3.10.0-rc.2
 2021-09-10 13:20:41 +02:00
Alexandre Flament ca73a37679
[ci] add Python 3.10.0-rc.2 2021-09-10 13:13:49 +02:00
Alexandre Flament 4833d85e2e [doc] update copyright notice and HTML title 2021-09-10 11:49:57 +02:00
Markus Heiser b671e0364f
Merge pull request #302 from dalf/mod_plugin_on_result 
[mod] plugin: call on_result for each result of each engines.
 2021-09-10 09:20:26 +00:00
Alexandre Flament 0b27c8698f [doc] update docs/dev/plugins.rst 2021-09-10 10:58:22 +02:00
Markus Heiser 449ff70898
Merge pull request #307 from dalf/remove-transifex-ref 
[fix] remove references to transifex
 2021-09-10 07:14:07 +00:00
Alexandre Flament 70c9bb6f2c [fix] remove references to transifex 2021-09-09 21:29:55 +02:00
Alexandre Flament b941763e20 [mod] ahmia_filter: use on_result instead of post_search 
see commit 6c9ae7911e9639bc46cd53af215734b4bdb61ba9
 2021-09-09 11:31:46 +02:00
Alexandre Flament 660c180170 [mod] plugin: call on_result after each engine from the ResultContainer 
Currently, searx.search.Search calls on_result once the engine results have been merged
(ResultContainer.order_results).

on_result plugins can rewrite the results: once the URL(s) are modified, even they can be merged,
it won't be the case since ResultContainer.order_results has already be called.

This commit call on_result inside for each result of each engines.
In addition the on_result function can return False to remove the result.

Note: the on_result function now run on the engine thread instead of the Flask thread.
 2021-09-09 11:31:44 +02:00
Alexandre Flament 1973e4ecf6
Merge pull request #303 from return42/fix-README 
[fix] README - fix minor typo
 2021-09-08 09:39:45 +02:00
Markus Heiser dad82cac1a [fix] README - fix minor typo 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-08 09:00:48 +02:00