9b6ffed061
fix fetch_languages for bing
...
Bing has a list of regions that it supports and some of these regions
may have more than one possible language.
In some cases, like Switzerland, these languages are always shown as
options, so there is no issue. But in other cases, like Andorra, Bing
will only show one language at the time, either the region's default or
the request's language if the latter is supported by that region.
For example, if the HTTP request is in French, Andorra will appear as
fr-AD but if the same page is requested in any other language Andorra
will appear as ca-AD.
This is specially a problem when Bing assumes that the request is in
English because it overrides enough language codes to make several major
languages like Arabic dissappear from the languages.py file.
To avoid that issue, I set the Accept-Language header to a language
that's only supported in one region to hopefully avoid these overrides.
2021-02-25 23:51:49 -07:00
728e096764
data-update.yml: on PR per file
2021-02-25 08:41:17 +01:00
bc590cbc47
Merge pull request #2592 from dalf/update-external-bangs
...
[mod] add utils/fetch_external_bangs.py
2021-02-24 20:27:26 +01:00
7c1847d5f2
[mod] add utils/fetch_external_bangs.py
...
Based on duckduckgo bangs
Store bangs on a trie to allow autocomplete (not in this commit)
2021-02-24 18:48:36 +01:00
606aa79e49
Merge pull request #2584 from searx/dependabot/pip/master/sphinx-3.5.1
...
Bump sphinx from 3.4.1 to 3.5.1
2021-02-24 13:52:15 +01:00
048be86aaf
Bump sphinx from 3.4.1 to 3.5.1
...
Bumps [sphinx](https://github.com/sphinx-doc/sphinx ) from 3.4.1 to 3.5.1.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases )
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/3.x/CHANGES )
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v3.4.1...v3.5.1 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-02-23 20:20:21 +00:00
5f4a085fc4
Merge pull request #2595 from dalf/update-wikidata-units
...
[mod] update wikidata_units.json and fetch_wikidata_units.py
2021-02-23 17:22:37 +01:00
94c9320c6f
Merge pull request #2585 from dalf/update-currencies
...
[mod] update currencies.json and fetch_currencies.py
2021-02-23 17:22:05 +01:00
46ca32c3cc
[mod] update currencies.json and fetch_currencies.py
...
use a sparql request on wikidata to get the list of currencies.
currencies.json contains the translation for all supported searx languages.
Supersede #993
2021-02-23 16:42:28 +01:00
93d1da4906
[mod] update wikidata_units.json and fetch_wikidata_units.py
...
The fetch_wikidata_units.py result won't change randomly.
See comments in the script.
2021-02-23 13:10:38 +01:00
1be6ab2a91
Fix paging of Bing Images
2021-02-22 21:19:34 +01:00
9ace31c829
Merge pull request #2588 from datagram1/master
...
Added rumble.com video search engine.
2021-02-21 14:08:02 +01:00
1d0a32a2c5
Added rumble.com video search engine. TODO video embedding.
...
Update rumble.py
some lines too long.
Disable Rumble engine
disabled : True
PEP8 fix
change line spacing
2021-02-20 12:48:56 +00:00
640d6ce778
Update dependabot.yml
2021-02-19 13:08:57 +01:00
c89e59650b
Merge pull request #2579 from searx/dependabot/pip/master/sphinx-tabs-2.0.1
2021-02-17 19:51:38 +00:00
731206d003
Bump sphinx-tabs from 1.3.0 to 2.0.1
...
Bumps [sphinx-tabs](https://github.com/executablebooks/sphinx-tabs ) from 1.3.0 to 2.0.1.
- [Release notes](https://github.com/executablebooks/sphinx-tabs/releases )
- [Changelog](https://github.com/executablebooks/sphinx-tabs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/executablebooks/sphinx-tabs/compare/v1.3.0...v2.0.1 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 18:04:37 +00:00
22c6fac671
Merge pull request #2578 from searx/dependabot/pip/master/pyyaml-5.4.1
2021-02-16 18:03:57 +00:00
5d8e77bf20
Bump pyyaml from 5.3.1 to 5.4.1
...
Bumps [pyyaml](https://github.com/yaml/pyyaml ) from 5.3.1 to 5.4.1.
- [Release notes](https://github.com/yaml/pyyaml/releases )
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES )
- [Commits](https://github.com/yaml/pyyaml/compare/5.3.1...5.4.1 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:59:36 +00:00
7dc6060c9c
Merge pull request #2581 from searx/dependabot/pip/master/pylint-2.6.2
2021-02-16 17:58:57 +00:00
567a28be93
Bump pylint from 2.6.0 to 2.6.2
...
Bumps [pylint](https://github.com/PyCQA/pylint ) from 2.6.0 to 2.6.2.
- [Release notes](https://github.com/PyCQA/pylint/releases )
- [Changelog](https://github.com/PyCQA/pylint/blob/master/ChangeLog )
- [Commits](https://github.com/PyCQA/pylint/compare/pylint-2.6.0...pylint-2.6.2 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:55:24 +00:00
0cdf7761c0
Merge pull request #2577 from searx/dependabot/pip/master/jinja2-2.11.3
2021-02-16 17:54:34 +00:00
acfe2c0d4e
Bump jinja2 from 2.11.2 to 2.11.3
...
Bumps [jinja2](https://github.com/pallets/jinja ) from 2.11.2 to 2.11.3.
- [Release notes](https://github.com/pallets/jinja/releases )
- [Changelog](https://github.com/pallets/jinja/blob/master/CHANGES.rst )
- [Commits](https://github.com/pallets/jinja/compare/2.11.2...2.11.3 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:50:13 +00:00
2b245a4609
Merge pull request #2580 from searx/dependabot/pip/master/nose2-coverage_plugin--0.10.0
2021-02-16 17:49:32 +00:00
b843dcc404
Bump nose2[coverage_plugin] from 0.9.2 to 0.10.0
...
Bumps [nose2[coverage_plugin]](https://github.com/nose-devs/nose2 ) from 0.9.2 to 0.10.0.
- [Release notes](https://github.com/nose-devs/nose2/releases )
- [Changelog](https://github.com/nose-devs/nose2/blob/master/docs/changelog.rst )
- [Commits](https://github.com/nose-devs/nose2/compare/0.9.2...0.10.0 )
Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:43:13 +00:00
fd1b8f661b
Update dependabot.yml
2021-02-16 18:42:44 +01:00
3ee24b685a
Create dependabot.yml
...
Only pip packages and ignore pygments, related to https://github.com/searx/searx/pull/2206
2021-02-16 18:41:34 +01:00
44a6593c13
Merge pull request #2573 from unixfox/yggtorrent
...
update yggtorrent url + add it back
2021-02-16 08:22:07 +01:00
09e28ae779
Merge pull request #2570 from xenrox/improve-peertube
...
Improve peertube searching
2021-02-16 08:17:42 +01:00
4b37e10dd9
fix yggtorrent url + add it back
2021-02-15 13:38:34 +01:00
fbbd4cc21f
Improve peertube searching
...
At the moment videos without a description are not shown - setting
default content to "" fixes this.
Another current bug is that thumbnails are not displayed. This is caused
by a double slash in the url. For this every trailing slash is now
stripped (for backwards compatibility) and the API response is correctly
parsed.
2021-02-13 19:47:33 +01:00
aef1161633
data-update.yml: run on Friday, 16:05 UTC
2021-02-12 17:19:44 +01:00
45027765e3
Merge pull request #2566 from dalf/remove-yandex
...
[remove] yandex engine
2021-02-12 17:12:07 +01:00
50bde93dbb
data-update.yml: run on searx org
2021-02-12 16:56:00 +01:00
f59acf4138
data-update.yml: run on Friday
...
give the weekend to review the PR
2021-02-12 11:15:46 +01:00
ddab00abf4
Merge pull request #2559 from dalf/upd-duckduckgo
...
[fix] duckduckgo engine: "!ddg !g" do not redirect to google
2021-02-12 11:14:09 +01:00
c22d4c764c
[fix] duckduckgo engine: "!ddg !g" do not redirect to google
...
* searx understand "!ddg !g time" as : send "!g time" to DDG
* !g a DDG bang for Google: DDG return a HTTP redirect to Google
This commit adds a the allows_redirect param not to follow HTTP redirect.
The DDG engine returns a empty result as before without HTTP redirect.
2021-02-12 11:10:08 +01:00
d76660463b
Merge pull request #2562 from dalf/mod-json-engine
...
[mod] json_engine: add content_html_to_text and title_html_to_text
2021-02-12 10:58:28 +01:00
7dcf67a47a
Merge pull request #2565 from dalf/upd-wikipedia
...
[upd] wikipedia engine: return an empty result on query with illegal characters
2021-02-12 10:57:05 +01:00
2b60d0d243
Merge pull request #2564 from dalf/fix-seznam
...
[fix] fix seznam engine
2021-02-12 10:56:53 +01:00
7e83818879
Merge pull request #2560 from dalf/fix-duckduckgo
...
Fix duckduckgo
2021-02-12 10:56:40 +01:00
63d6ccfbc2
Merge pull request #2557 from dalf/fix-raise_for_httperror
...
Fix: activate raise_for_error by default
2021-02-12 10:56:25 +01:00
74c8b5606f
Merge pull request #2541 from return42/mediathekviewweb
...
[enh] add engine MediathekViewWeb (API)
2021-02-11 15:11:26 +01:00
5d9db6c2f7
[remove] yandex engine
2021-02-11 14:28:06 +01:00
35dd069402
[fix] fix seznam engine
...
no paging support
2021-02-11 12:53:19 +01:00
7d6e69e2f9
[upd] wikipedia engine: return an empty result on query with illegal characters
...
on some queries (like an IT error message), wikipedia returns an HTTP error 400.
this commit returns an empty result instead of showing an error to the user.
2021-02-11 12:29:21 +01:00
ff84a1af35
[mod] json_engine: add content_html_to_text and title_html_to_text
...
Some JSON API returns HTML in either in the HTML or the content.
This commit adds two new parameters to the json_engine:
content_html_to_text and title_html_to_text, False by default.
If True, then the searx.utils.html_to_text removes the HTML tags.
Update crossref, openairedatasets and openairepublications engines
2021-02-10 16:42:11 +01:00
436d366448
Merge pull request #2544 from mrwormo/congresslibrary
...
[Engine] Add Library of Congress engine
2021-02-10 10:13:46 +01:00
eafd27f42a
Merge pull request #2556 from dalf/fix-apk-mirror
...
[fix] fix apk_mirror engine
2021-02-10 10:12:37 +01:00
c40316d957
Merge pull request #2558 from dalf/remove-google-play-music
...
[upd] remove google_play_music engine
2021-02-10 10:12:21 +01:00
d2dac11392
[mod] duckduckgo engine: better support of the language preference
...
After the main request, send a second to https://duckduckgo.com/t/sl_h
See https://github.com/searx/searx/issues/2259
2021-02-09 14:36:43 +01:00
Marc Abonce Seguin