820b468bfe
Merge pull request #2373 from kvch/display-https-engines
...
Display if an engine does not support HTTPS requests
2020-12-09 22:48:10 +01:00
3a63dfbdd7
display if an engine does not support https
...
Closes #302
2020-12-09 20:49:54 +01:00
1c9e7cef50
[remove] remove searchcode_doc and twitter
...
* twitter: the API has changed. the engine needs to rewritten.
* searchcode_doc: the API about documentation doesn't exist anymore.
2020-12-09 13:14:31 +01:00
fa73f10f11
[mod) genious: return valid results even if contents are empty
2020-12-09 13:01:34 +01:00
42a194898b
Merge pull request #2360 from dalf/update-libgen
...
[mod] libgen: update the URL to http://libgen.rs/
2020-12-08 20:33:53 +01:00
a77d8c8227
Merge pull request #2359 from dalf/update-duden
...
[mod] duden engine
2020-12-08 20:33:38 +01:00
bd4869ecd0
Merge pull request #2366 from dalf/remove-seedpeer
...
[remove] seedpeer engine
2020-12-08 20:33:23 +01:00
35bf568b41
Merge pull request #2362 from return42/use_default_settings
...
[doc] recommend to use 'use_default_settings=True'
2020-12-08 20:33:06 +01:00
a70b9b9f61
[doc] recommend to use 'use_default_settings=True'
...
Since #2291 is merged, it is recommend to use::
use_default_settings=True
1. Add a template file use_default_settings.yml::
SEARX_SETTINGS_TEMPLATE="${REPO_ROOT}/utils/templates/etc/searx/use_default_settings.yml"
2. In Chapter "Configuration" recommend to make use of
'use_default_settings=True' and describe it
3. Rewrite of docs/admin/settings.rst
- move chapter 'settings.yml location' to the top
- update and split chapter 'Global Settings'
4. Add environment SEARX_SETTINGS_TEMPLATE to .config.sh
5. Use environment $SEARX_SETTINGS_TEMPLATE in the utils/searx.sh script
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-08 20:19:10 +01:00
56c64d6b64
[remove] seedpeer engine
...
the website is offline.
2020-12-07 21:02:29 +01:00
c1a9732268
Merge pull request #2364 from dalf/fix-youtube-noapi
...
[fix] youtube_noapi engine
2020-12-07 20:26:00 +01:00
13d3004703
Merge pull request #2365 from dalf/fix-soundcloud
...
[fix] soundclound: accept result without content
2020-12-07 20:25:17 +01:00
62073c0e1d
Merge pull request #2361 from dalf/fix-1x
...
[fix] 1x engine
2020-12-07 20:24:47 +01:00
923bc02c17
Merge pull request #2363 from dalf/fix-wikipedia-minor
...
[fix] wikipedia: minor fix: return no result instead of crash in some very few cases.
2020-12-07 18:33:37 +01:00
deb1bde20d
[fix] soundclound: accept result without content
2020-12-07 17:45:36 +01:00
34df0f7910
[fix] youtube_noapi engine
2020-12-07 17:44:31 +01:00
58d51e082d
[fix] wikipedia: minor fix: return no result instead of crash in some very few cases.
...
In few cases, the JSON results doesn't contains the key 'type'.
2020-12-07 17:42:05 +01:00
4ec810749b
[fix] 1x engine
2020-12-07 15:46:00 +01:00
1e781863fa
[fix] command engine: SearchQuery.query is str not bytes
...
see c225db45c8
2020-12-07 10:43:42 +01:00
9bf594cbcf
[mod] duden engine
...
* add params['soft_max_redirects'] = 1 (when there is spelling suggestion)
* avoid try..except
* use eval_xpath_* functions
2020-12-07 10:31:11 +01:00
b3032cf953
[mod] libgen: update the URL to http://libgen.rs/
...
https://libgen.is actually redirect to http://libgen.rs/
It seems there is no HTTPS version:
* https://www.wikidata.org/wiki/Q22017206
* https://librarygenesis.net/
2020-12-07 10:19:34 +01:00
a458451d20
Merge pull request #2356 from dalf/fix-ddd
...
[fix] duckduckgo_definitions: fix relative image URL
2020-12-07 10:16:53 +01:00
925bb561a2
Merge pull request #2352 from dalf/no_http
...
Remove HTTP connections as much as possible
2020-12-06 10:18:49 +01:00
28cc644f0a
[fix] duckduckgo_definitions: fix relative image URL
...
ddg returns relative URL to https://duckduckgo.com/
2020-12-06 10:14:09 +01:00
cdceec1cbb
Merge pull request #2354 from dalf/fix-wikipedia
...
[fix] wikipedia engine: don't raise an error when the query is not found
2020-12-04 20:42:45 +01:00
f0054d67f1
[fix] wikipedia engine: don't raise an error when the query is not found
...
Add a new parameter "raise_for_status", set by default to True.
When True, any HTTP status code >= 300 raise an exception ( #2332 )
When False, the engine can manage the HTTP status code by itself.
2020-12-04 20:04:39 +01:00
d9494283cc
Merge pull request #2353 from dalf/fix-wikidata
...
[fix] wikidata: fix crash when the item has no description at all and…
2020-12-04 18:07:24 +01:00
bef2f2efa8
[fix] wikidata: fix crash when the item has no description at all and at least one URL.
2020-12-04 17:17:20 +01:00
38d32337e7
[mod] documentations & comments: update http://* URL to https://*.
...
About http://lesscss.org see https://github.com/less/less-docs/issues/520
2020-12-04 16:52:25 +01:00
244e812f37
[fix] remove searx/engines/filecrop.py (dead code)
2020-12-04 16:48:15 +01:00
0226ae69d3
[fix] dbpedia autocomplete (and use HTTPS)
2020-12-04 16:47:43 +01:00
f56e78ee80
Merge pull request #2338 from unixfox/issue-template
...
add new issue template
2020-12-03 19:16:11 +01:00
741c31fa06
add new issue template
2020-12-03 20:02:09 +02:00
cec73b5dcf
Merge pull request #2350 from dalf/mod-engines-report-captcha
...
[mod] stackoverflow & yandex: detect CAPTCHA response
2020-12-03 13:50:12 +01:00
fa909c7c02
[mod] stackoverflow & yandex: detect CAPTCHA response
2020-12-03 13:23:19 +01:00
7905d41487
Merge pull request #2349 from dalf/fix-settings-loader
...
[fix] settings_loader: don't crash when a key exists only in the user settings
2020-12-03 11:47:53 +01:00
d0d7a3e1c2
[fix] settings_loader: don't crash when a key exists only in the user settings
...
typical use case: result_proxy can be defined in the user settings,
but are not defined the default settings.yml
2020-12-03 11:35:12 +01:00
89fbb85d45
Merge pull request #2332 from dalf/metrology-errors
...
[enh] record exception details per engine
2020-12-03 10:31:44 +01:00
64cccae99e
[mod] various engines: use eval_xpath* functions and searx.exceptions.*
...
Engine list: ahmia, duckduckgo_images, elasticsearch, google, google_images, google_videos, youtube_api
2020-12-03 10:22:48 +01:00
ad72803ed9
[mod] xpath, 1337x, acgsou, apkmirror, archlinux, arxiv: use eval_xpath_* functions
2020-12-03 10:22:48 +01:00
de887c6347
[mod] bing_news: use eval_xpath_getindex
...
remove unused function searx.utils.list_get
2020-12-03 10:22:48 +01:00
1d0c368746
[enh] record details exception per engine
...
add an new API /stats/errors
2020-12-03 10:22:48 +01:00
6b5a578822
Merge pull request #2285 from return42/fix-digg
...
bugfix & refactor digg engine
2020-12-03 10:20:40 +01:00
35a76d9116
Merge pull request #2348 from mrwormo/master
...
Disable Invidious engine by default
2020-12-02 23:36:40 +02:00
2b153db74c
Disable Invidious engine by default
2020-12-02 21:56:11 +01:00
bef185723a
[refactor] digg - improve results and clean up source code
...
- strip html tags and superfluous quotation marks from content
- remove not needed cookie from request
- remove superfluous imports
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02 21:54:27 +01:00
6b0a896f01
[mod] digg - pylint searx/engines/digg.py
...
Eliminate redundant file names which are tested by test.pylint and ignored by
test.pep8
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02 20:59:30 +01:00
173b744ef0
[fix] digg - the ISO time stamp of published date has been changed
...
Error pattern::
Engines cannot retrieve results:
digg (unexpected crash time data '2020-10-16T14:09:55Z' does not match format '%Y-%m-%d %H:%M:%S')
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02 20:40:12 +01:00
219af243a2
Merge pull request #2318 from dalf/add-pylint
...
Add pylint
2020-12-01 15:31:10 +01:00
8aa2a7556a
[enh] activate pylint
...
There are 3 invocations:
* one with the default .pylintrc file
* one for searx/engines with some disabled checks and some additional-builtins
* one for the all the code except the engines with some disabled checks
2020-12-01 15:21:19 +01:00
Noémi Ványi