czaky
c331cf64cf
Merge 6e9f7c276e into cb945276b6
2024-06-13 10:46:50 +02:00
Bnyro
f5eb56b63f
[refactor] hostnames plugin: add fallback for old hostname_replace plugin
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 14:42:52 +02:00
Markus Heiser
845a0b678d
[doc] add 'hostnames' plugin to the online documentation
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 14:42:52 +02:00
Bnyro
aa59bfbf60
[feat] hostname replace plugin: support for external list file
2024-06-07 14:42:52 +02:00
Bnyro
3bec04079c
[feat] hostname replace plugin: possibility to prioritize certain websites
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 14:42:52 +02:00
Bnyro
46c5309888
[feat] mojeek: implement dedicated module
2024-06-07 11:31:05 +02:00
Markus Heiser
32a2175f38
[feat] add engines for discourse forums (python, caddy, pi-hole)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 10:16:09 +02:00
allendema_searxng_pi
ee146dbc07
[enh] Add engine for discourse forums
2024-06-07 10:16:09 +02:00
searxng-bot
91882aedf1
[l10n] update translations from Weblate
...
00cfc653da89cbc458b58008c902c92cadcb2d159a175a9ab96e6e2488cff0922626a0f2
2024-06-07 10:14:03 +02:00
searxng-bot
18fb701be2
[l10n] update translations from Weblate
...
61aa303a4170248b247c2fee8705b4a84c9cdd076ef553d1c529d7c48bd4b50f8cd9e63d211935324e3cdb5196bba8b66d1538af5393e9c4b55aeea54474eaf870f76afb4a320991
2024-05-31 11:16:35 +02:00
Markus Heiser
5fc93b6c34
[fix] comment in settings.yml 'Calculator plugin' --> 'Basic Calculator'
...
Reported by @GitTimeraider in [1]
[1] https://github.com/searxng/searxng/discussions/3529#discussioncomment-9605018
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-30 14:34:25 +02:00
Allen
0fa81fc782
[enh] add re-usable func to filter text
2024-05-29 17:56:17 +02:00
Jeff Alyanak
0fb3f0e4ae
[fix] do not show DDG IP from zero click
...
The zero click result from DuckDuckGo for IP should not be displayed. It will
return the IP of the searxng server, not the user's IP, and looks a bit strange
when the `self_info` plugin is enabled as two different IPs get returned.
2024-05-29 11:23:26 +02:00
Markus Heiser
bb7c5bd44c
[data] update searx.data - update_engine_traits.py
...
$ make data.traits
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-29 07:52:18 +02:00
Markus Heiser
a20dfbbcbd
[fix] engine startpage: fetch_traits() / if lang name unknown by babel
...
Workflow "Update data - update_engine_traits.py" fails last night [1].
This issue has already been reported by @allendema [2].
[1] https://github.com/searxng/searxng/actions/runs/9278028691/job/25528337485#step:6:168
[2] https://github.com/searxng/searxng/pull/3504/files#r1613559565
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-29 07:52:18 +02:00
return42
8713aa6c4b
[data] update searx.data - update_wikidata_units.py
2024-05-29 06:54:24 +02:00
return42
c16a143239
[data] update searx.data - update_currencies.py
2024-05-29 06:53:45 +02:00
return42
8a78d7b64d
[data] update searx.data - update_firefox_version.py
2024-05-29 06:53:14 +02:00
return42
f2763e5efc
[data] update searx.data - update_ahmia_blacklist.py
2024-05-29 06:52:39 +02:00
return42
8250773ace
[data] update searx.data - update_engine_descriptions.py
2024-05-29 06:52:17 +02:00
Austin-Olacsi
9bb75a6644
[feat] engine: implementation of findthatmeme
2024-05-28 18:18:13 +02:00
Markus Heiser
c19bffde4d
[fix] issues reported by pylint-3.2.2
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-28 18:10:04 +02:00
Markus Heiser
056968cc39
[fix] unit converter operating backwards (from_si <-> to_si)
...
The factors for from_si and to_si were reversed.
Closes: https://github.com/searxng/searxng/issues/3497
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-28 11:58:13 +02:00
Daniel Kukula
87165ac532
[mod] engine hex: add sort_criteria & page_size to configuration
2024-05-28 11:55:59 +02:00
Alexandre Flament
75e4b65127
[fix] ResultContainer: use self._lock and self._closed for all properties
...
Close #3474
2024-05-24 15:38:03 +02:00
allendema_searxng_pi
68365c8c1d
[enh] add instant answers from ddg
2024-05-24 10:44:17 +02:00
searxng-bot
6c74bc8908
[l10n] update translations from Weblate
...
775bb0f22ccf70529b4a3b70d104e3be80125fcd0b2333b73c20daa579173a10b91ff3adbc3096ae1
2024-05-24 10:28:48 +02:00
czaky
9441c97a26
cleanup
2024-05-18 00:27:37 +00:00
Daniel Kukula
a49232ee29
[feat] engine: implementation of cargo search (crates.io)
2024-05-17 16:37:39 +02:00
czaky
5fe7e42d1a
Add preference for non 404 responses fix test RC.
...
Fixed race condition with the 404 test.
2024-05-17 12:58:47 +00:00
czaky
5d15f6b313
Merge branch 'searxng:master' into redundant_proxy_requests
2024-05-17 08:09:05 -04:00
searxng-bot
3585d71f99
[l10n] update translations from Weblate
...
0712f8fb79a9d043024c6da9e2ae0b941276bee37a08ad29eca2ba719ed9054b57b75920ecf4ce2dc
2024-05-17 09:16:38 +02:00
czaky
122a9568de
[network]: Add redundant parallel proxy requests.
...
Anecdotally, using SearX over unreliable proxies,
like tor, seems to be quite error prone.
SearX puts quite an effort to measure the
performance and reliability of engines, most
likely owning to those aspects being of
significant concern.
The patch here proposes to mitigate related
problems, by issuing concurrent redundant requests
through the specified proxies at once, returning
the first response that is not an error.
The functionality is enabled using the:
`proxy_request_redundancy` parameter within the
outgoing network settings or the engine settings.
Example:
```yaml
outgoing:
request_timeout: 8.0
proxies:
"all://":
- socks5h://tor:9050
- socks5h://tor1:9050
- socks5h://tor2:9050
- socks5h://tor3:9050
proxy_request_redundancy: 4
```
In this example, each network request will be
send 4 times, once through every proxy. The
first (non-error) response wins.
In my testing environment using several tor proxy
end-points, this approach almost entirely
removes engine errors related to timeouts
and denied requests. The latency of the
network system is also improved.
The implementation, uses a
`AsyncParallelTransport(httpx.AsyncBaseTransport)`
wrapper to wrap multiple sub-trasports,
and `asyncio.wait` to wait on the first completed
request.
The existing implementation of the network
proxy cycling has also been moved into the
`AsyncParallelTransport` class, which should
improve network client memoization and
performance.
TESTED:
- unit tests for the new functions and classes.
- tested on desktop PC with 10+ upstream proxies
and comparable request redundancy.
2024-05-17 02:09:29 +00:00
Markus Heiser
2f2d93b292
[build] /static
2024-05-16 07:30:38 +02:00
Markus Heiser
916739d6b4
[mod] simple theme: drop img_src from default results
...
The use of img_src AND thumbnail in the default results makes no sense (only a
thumbnail is needed). In the current state this is rather confusing, because
img_src is displayed like a thumbnail (small) and thumbnail is displayed like an
image (large).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-16 07:30:38 +02:00
Bnyro
0f2f52f0b5
[fix] google: don't display that keyword is missing in content field
2024-05-15 16:03:35 +02:00
Markus Heiser
949a73103f
[mod] hex engine: normalize (some of) the linked terms
...
The names of the links are rather tags than real names, and they sometimes vary
greatly in their spelling:
- GitHub: github, Github
- Source code: Repository, SCM, Project Source Code
- Documentation: docs, Documentation
It was standardized to terms such as 'Source code' and 'Documentation', as
translations already exist for these terms.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-15 12:50:35 +02:00
Daniel Kukula
cc8b537e34
[mod] package.html template: additional links (a python dict)
...
- Closes: https://github.com/searxng/searxng/issues/3456
2024-05-15 12:50:35 +02:00
Bnyro
645a840d82
[refactor] codeberg: use gitea engine
2024-05-15 07:23:57 +02:00
Bnyro
82b6c0d05f
[feat] engine: implementation of gitea
2024-05-15 07:23:57 +02:00
Bnyro
60a373ad89
[fix] chefkoch: use German words in content field
2024-05-12 18:36:49 +02:00
Markus Heiser
ffb1001f80
[fix] engine wikidata - WIKIDATA_UNITS has been changed in #3378
...
This patch is a leftover from [1] in which the WIKIDATA_UNITS values has become
a dictionary.
[1] https://github.com/searxng/searxng/pull/3378
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-10 16:04:27 +02:00
Markus Heiser
901819359c
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-10 10:00:31 +02:00
searxng-bot
4b6eebd312
[l10n] update translations from Weblate
...
9487de41b20d3b115860cf6e36d0a8e99dff4055cd1c377f2c8d9abeb16006a54b5123e24f372ab44fa9b9aae8
2024-05-10 09:29:22 +02:00
Bnyro
383d873597
[fix] unit converter plugin: can't be disabled in settings
2024-05-09 17:40:37 +02:00
Markus Heiser
fb32425d78
[mod] yacy engine: pick base_url randomly from a list of instances
...
Inspired by post [1] in the disscussion we had, while yacy.searchlab.eu was
broken.
[1] https://github.com/searxng/searxng/issues/3428#issuecomment-2101080101
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-09 17:29:15 +02:00
Bnyro
72be98e12f
[feat] plugins: new calculator plugin
2024-05-09 17:23:38 +02:00
Markus Heiser
742303d030
[mod] improve unit converter plugin
...
- l10n support: parse and format decimal numbers by babel
- ability to add additional units
- improved unit detection (symbols are not unique)
- support for alias units (0,010C to F --> 32,018 °F)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-09 17:16:31 +02:00
Alexandre Flament
ac430a9eaf
Drop pytomlpp dependency for Python >= 3.11
...
Rely on tomllib for Python >= 3.11
2024-05-05 17:35:29 +02:00
Markus Heiser
dbed8da284
[fix] startpage engine: XPath expressions adapted for new HTML layout
...
Startpage has changed its HTML layout, classes like ``w-gl__result__main`` do no
longer exists and the result items have been slightly changed in their
structure.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-04 19:45:52 +02:00
