zaclys/searxng
1
0
Fork 1
mirror of https://github.com/searxng/searxng synced 2024-01-01 19:24:07 +01:00
Code Issues Projects Releases Packages Wiki Activity
searxng/searx/engines
History
Markus Heiser 9c68980ea1 [fix] startpage engine: language/region & time support & fix CAPTCHA 
One reason for the often seen CAPTCHA of the startpage requests are the
incomplete requests SearXNG sends to startpage.com.  To avoid CAPTCHA we need to
send a well formed HTTP POST request with a cookie, we need to form a request
that is identical to the request build by startpage.com itself:

- in the cookie the **region** is selected
- in the POST arguments the **language** is selected

Based on the *engine_properties* boilerplate, SearXNG's startpage engine now
implements a `_fetch_engine_properties()` function to fetch regions & languages
from startpage.com.

This patch is a complete new implementation of the request() function, reversed
engineered from the startpage.com page.  The new implementation adds

- time-range support
- save-search support

to the startpage engine which has been missed in the past.

Closes: https://github.com/searxng/searxng/issues/1081
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-19 14:40:57 +02:00
..
1337x.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
__init__.py [mod] engines_languages.json: add new type engine_properties 2022-04-19 14:35:02 +02:00
ahmia.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
apkmirror.py [enh] add more categories 2022-01-05 11:00:11 +01:00
archlinux.py [enh] add more categories 2022-01-05 11:00:11 +01:00
artic.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
arxiv.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
bandcamp.py [mod] bandcamp & genius: in result set img_src instead thumbnail 2022-02-21 22:12:07 +01:00
base.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
bing.py bing engine: _fetch_supported_languages: don't use the language code as a country 2022-03-31 20:03:34 +00:00
bing_images.py [enh] add more categories 2022-01-05 11:00:11 +01:00
bing_news.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
bing_videos.py [enh] add more categories 2022-01-05 11:00:11 +01:00
btdigg.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
command.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
core.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
currency_convert.py [pylint] engines/currency_convert.py 2022-02-01 08:02:42 +01:00
dailymotion.py dailymotion: send valid value for the language parameter 2022-04-16 09:27:34 +02:00
deezer.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
demo_offline.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
demo_online.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
deviantart.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
dictzone.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
digbt.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
docker_hub.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
doku.py [fix] issues reported by pylint 2021-12-27 10:16:20 +01:00
duckduckgo.py [enh] add more categories 2022-01-05 11:00:11 +01:00
duckduckgo_definitions.py [fix] issues reported by pylint 2021-12-27 10:16:20 +01:00
duckduckgo_images.py [enh] add more categories 2022-01-05 11:00:11 +01:00
duden.py [enh] move dictionaries, Erowid & IMDb out of general category 2022-01-05 11:03:44 +01:00
dummy-offline.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
dummy.py [enh] engines: add about variable 2021-01-14 20:57:17 +01:00
ebay.py [mod] Pass desired ebay domain in settings 2022-04-16 19:10:35 +02:00
elasticsearch.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
fdroid.py [enh] add more categories 2022-01-05 11:00:11 +01:00
flickr.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
flickr_noapi.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
framalibre.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
freesound.py [mod] result_templates/default.html replace embedded HTML by data_src audio_src 2022-02-13 14:20:47 +01:00
frinkiac.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
genius.py [mod] bandcamp & genius: in result set img_src instead thumbnail 2022-02-21 22:12:07 +01:00
gentoo.py [enh] add more categories 2022-01-05 11:00:11 +01:00
gigablast.py [enh] add more categories 2022-01-05 11:00:11 +01:00
github.py [enh] add more categories 2022-01-05 11:00:11 +01:00
google.py Update the XPath for fetching the Google results 2022-02-09 14:34:14 +01:00
google_images.py [fix] google images engine: Fix 'scrap_img_by_id' function 2022-02-19 14:33:56 +01:00
google_news.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
google_scholar.py [mod] engines_languages.json: add new type engine_properties 2022-04-19 14:35:02 +02:00
google_videos.py [mod] engines_languages.json: add new type engine_properties 2022-04-19 14:35:02 +02:00
imdb.py [enh] move dictionaries, Erowid & IMDb out of general category 2022-01-05 11:03:44 +01:00
ina.py [fix] ina engine 2022-01-28 22:33:41 +01:00
invidious.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
jisho.py jisho : code refactoring 2022-04-09 18:01:57 +02:00
json_engine.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
kickass.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
loc.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
mediathekviewweb.py [fix] engine mediathekviewweb: replace http links by https 2022-03-07 19:49:16 +01:00
mediawiki.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
meilisearch.py [pylint] engines: drop no longer needed 'missing-function-docstring' 2021-09-07 13:26:59 +02:00
mixcloud.py [mod] add artwork to mixcloud & soundcloud engines 2022-02-19 21:59:12 +01:00
mongodb.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
mysql_server.py [mod] engine mysql_server: make port configurable 2022-01-11 23:47:40 +01:00
nyaa.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
opensemantic.py [enh] engines: add about variable 2021-01-14 20:57:17 +01:00
openstreetmap.py [fix] openstreatmap: load thumbnail from uploads.wikimedia.org 2022-02-07 13:05:52 +01:00
openverse.py [fix] ccengine engine - avoid unwanted redirects 2022-01-07 14:14:31 +01:00
pdbe.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
peertube.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
photon.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
piratebay.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
postgresql.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
pubmed.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
qwant.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
recoll.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
reddit.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
redis_server.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
rumble.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
scanr_structures.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
searchcode_code.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
searx_engine.py reference docs.searxng.org 2022-01-02 21:18:29 +01:00
semantic_scholar.py [fix] engine: Semantic Scholar (Science) // rework & fix 2022-03-05 11:53:41 +01:00
sepiasearch.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
seznam.py [enh] add more categories 2022-01-05 11:00:11 +01:00
sjp.py [enh] move dictionaries, Erowid & IMDb out of general category 2022-01-05 11:03:44 +01:00
solidtorrents.py [fix] solidtorrents engine: store random bas_url in param 2022-02-04 14:55:21 +01:00
solr.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
soundcloud.py [mod] add artwork to mixcloud & soundcloud engines 2022-02-19 21:59:12 +01:00
spotify.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
springer.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
sqlite.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
stackexchange.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
startpage.py [fix] startpage engine: language/region & time support & fix CAPTCHA 2022-04-19 14:40:57 +02:00
tineye.py [mod] tineye engine: minor changes 2022-01-30 20:49:22 +01:00
tokyotoshokan.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
torznab.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
translated.py [enh] move dictionaries, Erowid & IMDb out of general category 2022-01-05 11:03:44 +01:00
unsplash.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
vimeo.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
wikidata.py [pylint] searx/engines/wikidata.py (no functional change) 2022-02-07 10:15:32 +01:00
wikipedia.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
wolframalpha_api.py change "Wolfram|Alpha" to "Wolfram Alpha" in search results 2022-04-12 10:37:33 +01:00
wolframalpha_noapi.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
wordnik.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
www1x.py [fix] 1x engine 2022-01-30 19:48:40 +01:00
xpath.py [fix[ Update only cookies/headers 2022-04-17 11:29:23 +02:00
yacy.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
yahoo.py [enh] add more categories 2022-01-05 11:00:11 +01:00
yahoo_news.py [mod] engines_languages.json: add new type engine_properties 2022-04-19 14:35:02 +02:00
youtube_api.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
youtube_noapi.py [mod] engines_languages.json: add new type engine_properties 2022-04-19 14:35:02 +02:00
zlibrary.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00