Markus Heiser
4cb8cbc6c3
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4
--> DDG lite
does not like this referer anymore!
- The 'Referer' header is only set on second and follow up pages but not on the
first page
- The vqd value is not needed on the first page, the ddg-lite client sets this
value only on follow up pages / this can help to reduce the vqd requests from
SearXNG.
Related to 'Referer' header & ddg requests:
[1] https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:04:53 +02:00
Bnyro
16ce63b8a2
[mod] yacy: use official instance by default and fix crashes
2023-10-19 18:04:53 +02:00
Hackurei
ce6b7c9f75
[feat] implement hackernews engine - news.ycombinator.com
2023-10-19 18:04:53 +02:00
Aine
fa830b375b
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
2023-10-19 18:04:53 +02:00
Bnyro
34d0d2c9ab
[feat] duckduckgo: support for videos and news
2023-10-19 18:04:53 +02:00
Bnyro
84b4932e21
[fix] kickass: crash when no results
2023-10-19 18:04:53 +02:00
Bnyro
057ae1767b
[mod] piped: always show video length if available
2023-10-19 18:04:53 +02:00
Bnyro
a742cfe2e7
[feat] engine: implementation of mastodon
2023-10-19 18:04:53 +02:00
Markus Heiser
ba5f9bd4ac
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:04:53 +02:00
Bnyro
70f6a84aff
[feat] engine: implementation of radio-browser.info
2023-10-19 18:04:53 +02:00
Jinyuan Huang
993ea9c1ec
[typo] solved a typo in yahoo error message.
2023-10-19 18:04:53 +02:00
Jinyuan Huang
7de4e3b48f
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
2023-10-19 18:04:53 +02:00
Bnyro
f6ee574508
[fix] emojipedia: fix engine
2023-10-19 18:04:52 +02:00
Markus Heiser
f4f2af7db6
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:04:52 +02:00
jazzzooo
ae91b993b1
[fix] engine - bing fix search, pagination, remove safesearch
2023-10-19 18:04:52 +02:00
Bnyro
b732fbfe5b
[feat] engine: implementation of pinterest
2023-10-19 18:04:52 +02:00
Bnyro
32e04f05bf
[fix] matrixrooms.info: pagination not working properly
2023-10-19 18:04:52 +02:00
Markus Heiser
cef109e0e0
[fix] engine - moviepilot instead of thumbnail use img_src
...
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.
Related:
- b4e0d2eedc (r128785388)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:04:52 +02:00
Bnyro
3b51a0bf0f
[mod] tagesschau: add option to only use tagesschau urls
2023-10-19 18:04:52 +02:00
Bnyro
07d932fba0
[feat] engine: implementation of matrixrooms.info
2023-10-19 18:04:52 +02:00
Bnyro
aad75ae867
[mod] add movies category for tmdb, imdb and moviepilot
2023-10-19 18:04:52 +02:00
jazzzooo
c4d280d890
[fix] engine - currency fix and simplify
2023-10-19 18:04:52 +02:00
Jinyuan Huang
3c8ad561ff
[fix] bilibili new api used
2023-10-19 18:04:52 +02:00
jazzzooo
adaf30a5ff
[fix] engine - kickass update url, fix parsing, use multiple mirrors
2023-10-19 18:04:52 +02:00
Markus Heiser
c61c7f3416
[fix] engine brave - fetch traits (modified settings menu)
...
Brave has changed it settings menu fundamental. Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:
https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:04:52 +02:00
Markus Heiser
ddc1735d0f
[fix] engine annas archive - fetch traits (modified xpath selectors)
...
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:04:52 +02:00
Émilien (perso)
f9d2b9f5f1
[mod] remove twitter ( #2843 )
2023-10-19 18:04:37 +02:00
Bnyro
e845c8857b
[feat] engine: implementation of imgur
2023-10-19 18:04:37 +02:00
Bnyro
624bbcf5ed
[fix] internet archive scholar: crash when there's no title
2023-10-19 18:04:37 +02:00
Markus Heiser
deeacad697
Revert "[fix] engine - duckduckgo vqd edge-case"
...
This reverts commit 102502a4f09e78682cd4f030605be394bc33282c.
2023-10-19 18:04:21 +02:00
Bnyro
d493ad30be
[feat] engine: implementation of chefkoch.de
2023-10-19 18:04:21 +02:00
jazzzooo
c6b1a0e6e7
[fix] engine - brave don't show ads
2023-10-19 18:04:21 +02:00
jazzzooo
47f2469bdc
[fix] engine - google images error when no results
2023-10-19 18:04:21 +02:00
Bnyro
fcec4dbc06
[feat] engine: implementation of google icons/material design icons
2023-10-19 18:04:21 +02:00
Bnyro
03123675a0
[feat] engine: implementation of wallhaven
2023-10-19 18:04:21 +02:00
jazzzooo
8bea311d5a
[fix] engine - duckduckgo vqd edge-case
2023-10-19 18:04:21 +02:00
Markus Heiser
30c12a206a
[fix] engine qwant (web-lite) - ignore advertising adds
...
Closes: https://github.com/searxng/searxng/issues/2812
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:03:39 +02:00
Émilien (perso)
b6e3cf6ced
wikipedia wikidata infobox + disable wikisource ( #2806 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:03:21 +02:00
Bnyro
5c402923f8
[feat] engine: implementation of internet archive scholar
2023-10-19 18:02:23 +02:00
jazzzooo
b6316020f7
[fix] spelling
2023-10-19 18:02:05 +02:00
Markus Heiser
ad518f41f6
[fix] engine - qwant delivers only 5 pages maximum
...
all qwant engines (incl qwant-lite) delivers only 5 pages maximum
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:02:05 +02:00
jazzzooo
743515e68a
[fix] engine - qwant wrong error type
2023-10-19 18:02:05 +02:00
Markus Heiser
346e0b1b2e
[fix] qwant: subsequent fix of commit d9dbcedeb
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:02:05 +02:00
Markus Heiser
2e16b43f68
[feat] implementation of qwant lite for web search
...
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-19 18:02:05 +02:00
Bnyro
bc4dac4624
[feat] engine: implemenation of moviepilot (de)
2023-10-19 18:02:05 +02:00
jazzzooo
6c30e0b5cc
[fix] tagesschau videos
2023-10-19 18:02:05 +02:00
jazzzooo
38966b1bbe
[fix] brave.videos
2023-10-19 18:01:36 +02:00
jazzzooo
b11d3b73d6
[fix] brave.news
2023-10-19 18:01:36 +02:00
Justas Zabulionis
805e524d4a
[fix] rumble redirect
2023-10-19 18:01:36 +02:00
Justas Zabulionis
35b7bee5af
[fix] pubmed content being None
2023-10-19 18:01:36 +02:00