zaclys/searxng
1
0
Fork 1
mirror of https://github.com/searxng/searxng synced 2024-01-01 19:24:07 +01:00
Code Issues Projects Releases Packages Wiki Activity

[fix] bing engine: query string only support 2 letter language code

Browse source 
The 'language:xx' query string in the request() function does only support the 2
letter language codes from the "Display languages" list.

Examples of items from the "Display languages" not sopported in the query
string:

  pt-BR, pt-BR, mn-Cyrl-MN, chr-cher, zh-Hans, ha-latn, ca-es-valencia

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
This commit is contained in:
Markus Heiser 2022-04-10 15:43:41 +02:00
parent 864aeebc2f
commit d97e1a479f
3 changed files with 64 additions and 83 deletions
Download patch file Download diff file Expand all files Collapse all files

21
searx/engines/bing.py
View file

@ -131,21 +131,24 @@ def _fetch_supported_languages(resp):
lang_tags = set()
dom = html.fromstring(resp.text)
lang_links = eval_xpath(dom, '//div[@id="language-section"]//li')
for _li in lang_links:
# Selector to get items from "Display language"
ui_lang_links = eval_xpath(dom, '//div[@id="language-section"]//li')
for _li in ui_lang_links:
href = eval_xpath(_li, './/@href')[0]
(_scheme, _netloc, _path, _params, query, _fragment) = urlparse(href)
query = parse_qs(query, keep_blank_values=True)
# fmt: off
setlang = query.get('setlang', [None, ])[0]
# example: 'mn-Cyrl-MN' --> '['mn', 'Cyrl-MN']
lang, nation = (setlang.split('-', maxsplit=1) + [None,])[:2] # fmt: skip
# fmt: on
# The 'language:xx' query string in the request function (above) does
# only support the 2 letter language codes from the "Display languages"
# list. Examples of items from the "Display languages" not sopported in
# the query string:
# 'mn-Cyrl-MN', 'chr-cher', 'zh-Hans', ha-latn, 'ca-es-valencia'
tag = lang + '-' + nation if nation else lang
lang_tags.add(tag)
setlang = query.get('setlang', [None, ])[0]
lang = setlang.split('-')[0]
lang_tags.add(lang)
return list(lang_tags)