bcae7ae4e3
add developer info as author
2022-08-24 17:50:38 +07:00
e5c1b64b1d
add the apple app store engine
...
The Apple App Store is the digital app distribution platform for iOS & iPadOS.
2022-08-24 17:27:36 +07:00
040e24f9ad
support playing videos directly
2022-08-24 16:48:31 +07:00
c2db7b2a66
[fix] Internal server error after changing UI language to BG
...
A placeholder has been translated to BG, issue was added 8 month ago, when BG
translation was added [1]
msgid "Compute {functions} of the arguments"
msgstr "Изчислете {функции} на аргументите"
The incorrect translation has been corrected here in the message files and on
weblate.
[1] https://weblate.bubu1.eu/translate/searxng/searxng/bg/?&offset=49#history
Closes: https://github.com/searxng/searxng/issues/1692
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-23 08:11:16 +02:00
79d06509c1
add tags as suggestions
2022-08-23 05:18:35 +07:00
d22f469010
use `invalid-name` instead of `C0103` for pylint
2022-08-22 18:27:35 +07:00
dd9127492f
add 9gag engine
...
9GAG is a social media website where users upload and share user-generated images and videos
2022-08-22 17:35:07 +07:00
e64cca8c3f
don't raise error when nothing was found
2022-08-22 17:04:29 +07:00
faa32d5773
fixed xpath selector for appropriate results
2022-08-21 20:08:00 +01:00
5ed40af3ba
Merge pull request #1661 from liimee/eng-tw
...
Add twitter engine
2022-08-21 15:21:18 +02:00
ee3c5e7752
Merge pull request #1666 from return42/harden-get_engine_locales
...
[fix] typo in get_engine_locale
2022-08-21 08:22:29 +02:00
77a0f33819
[fix] engine duden - don't raise exception on empty result list
...
Duden expects a word in German, so with query "amazing" the site finds nothing
and respons a 404:
httpx.HTTPStatusError: Client error '404 Not Found' for url\
'https://www.duden.de/suchen/dudenonline/amazing '
[1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054
Suggested-by: @allendema [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-20 08:41:03 +02:00
6f28a69f12
Merge pull request #1677 from searxng/dependabot/pip/master/pygments-2.13.0
...
Bump pygments from 2.12.0 to 2.13.0
2022-08-19 10:21:22 +02:00
299635fb8b
[build] /static
2022-08-19 10:01:25 +02:00
b08a779f2e
make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-19 10:00:50 +02:00
3478c0bc8b
[translations] update from Weblate
...
2b94abf3249c92f8a331870c5aca8ddc6e7d76a02a49e5f02d2cafa6adcf97ed
2022-08-19 07:18:58 +00:00
05851978cf
add explanation of token
2022-08-17 19:45:42 +07:00
c8acd4a3b6
add profile image to user results
2022-08-17 14:30:59 +07:00
b6fd7cd571
add thumbnail to results if available
2022-08-17 14:25:22 +07:00
de1e7d12f7
[fix] get_engine_locale: better approximation of 'en' is 'en-US'
...
Compared to `en-EN` the better approximation of 'en' is 'en-US'.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 15:45:07 +02:00
ac7776663b
[fix] typo in get_engine_locale
...
Due to a typo in get_engine_locale, a language selection like `!qw :de siemens`
did not work.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 14:35:09 +02:00
ef81d14ccf
[fix] harden get_engine_locale: handle UnknownLocaleError exceptions
...
When a user selects an unknown or invalid locale by using the search syntax:
!qw siemens :de-TW
Before this patch a UnknownLocaleError exception will be rasied:
```
Traceback (most recent call last):
File "SearXNG/searx/search/processors/online.py", line 154, in search
search_results = self._search_basic(query, params)
File "SearXNG/searx/search/processors/online.py", line 128, in _search_basic
self.engine.request(query, params)
File "SearXNG/searx/engines/qwant.py", line 98, in request
q_locale = get_engine_locale(params['language'], supported_languages, default='en_US')
File "SearXNG/searx/locales.py", line 216, in get_engine_locale
locale = babel.Locale.parse(searxng_locale, sep='-')
File "SearXNG/local/py3/lib/python3.8/site-packages/babel/core.py", line 330, in parse
raise UnknownLocaleError(input_id)
```
This patch implements a simple exception handling, since e.g. `de-TW` does not
exists `de` will be used to get engines locale. On invalid terms like `xy-XY`
the default will be returned.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 13:55:42 +02:00
27385e7898
[mod] qwant - add safesearch option
...
Closes: https://github.com/searxng/searxng/issues/1640
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:36:14 +02:00
6579d6d558
[fix] qwant - API error::locale must be one ..
...
The request function should not request a language (aka locale) that is not
supported by qwant. Select a locale like zh-TW ends in qwant's API error:
ERROR searx.engines.qwant news: exception : \
API error::locale must be one of the following values: \
en_gb, en_ie, en_us, en_ca, en_my, en_au, en_nz, de_de, de_ch, de_at, fr_fr, \
fr_be, fr_ch, fr_ca, fr_ad, fc_ca, co_fr, es_es, es_ar, es_cl, es_co, es_mx, \
es_pe, es_ad, ca_es, ca_ad, ca_fr, eu_es, eu_fr, it_it, it_ch, pt_pt, pt_ad, \
nl_be, nl_nl
The existing searx.utils.match_language function is unsuitable for this purpose,
it is replaced by function searx.locales.get_engine_locale that is based on the
methods from the babel package.
The quant's _fetch_supported_languages function has been revised to filter out
languages 8aka locales) not supported by qwant.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:36:14 +02:00
9ae409a05a
[mod] add locale.get_engine_locale to get predictable results
...
The match_language function sometimes returns incorrect results which is why a
new function get_engine_locale is required.
A bugfix of the match_language is not easily possible, because there is almost
no documentation for it and already the call parameters are undefined. E.g. the
function processes values like the ones from yahoo::
"yahoo": [
"ar",
...
"zh_chs",
"zh_cht"
]
The get_engine_locale has been documented in detail, there is a clear
description of the assumptions as well as the requirements and approximation
rules (read doc-string for more details)::
Argument ``engine_locales`` is a python dict that maps *SearXNG locales* to
corresponding *engine locales*:
<engine>: {
# SearXNG string : engine-string
'ca-ES' : 'ca_ES',
'fr-BE' : 'fr_BE',
'fr-CA' : 'fr_CA',
'fr-CH' : 'fr_CH',
'fr' : 'fr_FR',
...
'pl-PL' : 'pl_PL',
'pt-PT' : 'pt_PT'
}
.. hint::
The *SearXNG locale* string has to be known by babel!
In the following you will find a comparison:
>>> import babel.languages
>>> from searx.utils import match_language
>>> from searx.locales import get_engine_locale
Assume we have an engine that supports the follwoing locales:
>>> lang_list = {
... "zh-CN": "zh_CN",
... "zh-HK": "zh_HK",
... "nl-BE": "nl_BE",
... "fr-CA": "fr_CA",
... }
Assumption:
A. When a user selects a language the results should be optimized according to
the selected language.
B. When user selects a language and a territory the results should be
optimized with first priority on territory and second on language.
----
Example: (Assumption A.)
A user selects region 'zh-TW' which should end in zh_HK
hint:
CN is 'Hans' and HK ('Hant') fits better to TW ('Hant')
>>> get_engine_locale('zh-TW', lang_list)
'zh_HK'
>>> lang_list[match_language('zh-TW', lang_list)]
'zh_CN'
----
Example: (Assumption A.)
A user selects only the language 'zh' which should end in CN
>>> get_engine_locale('zh', lang_list)
'zh_CN'
>>> lang_list[match_language('zh', lang_list)]
'zh_CN'
----
Example: (Assumption B.)
A user selects region 'fr-BE' which should end in nl-BE
hint:
priority should be on the territory the user selected. If the user
prefers 'fr' he will select 'fr' without a region tag.
>>> get_engine_locale('fr-BE', lang_list, default='unknown')
'nl_BE'
>>> match_language('fr-BE', lang_list, fallback='unknown')
'fr-CA'
----
Example: (Assumption A.)
A user selects only the language 'fr' which should end in fr_CA
>>> get_engine_locale('fr', lang_list)
'fr_CA'
>>> lang_list[match_language('fr', lang_list)]
'fr_CA'
----
The difference in priority on the territory is best shown with a engine that
supports the following locales:
>>> lang_list = {
... "fr-FR": "fr_FR",
... "fr-CA": "fr_CA",
... "en-GB": "en_GB",
... "nl-BE": "nl_BE",
... }
----
Example: (Assumption A.)
A user selects only a language
>>> get_engine_locale('en', lang_list)
'en_GB'
>>> match_language('en', lang_list)
'en-GB'
hint: the engine supports fr_FR and fr_CA since no territory is given, fr_FR
takes priority ..
>>> get_engine_locale('fr', lang_list)
'fr_FR'
>>> lang_list[match_language('fr', lang_list)]
'fr_FR'
----
Example: (Assumption B.)
A user selects region 'fr-BE' which should end in nl-BE
>>> get_engine_locale('fr-BE', lang_list)
'nl_BE'
>>> lang_list[match_language('fr-BE', lang_list)]
'fr_FR'
----
If the user selects a language and there are two locales like the following:
>>> lang_list = {
... "fr-BE": "fr_BE",
... "fr-CH": "fr_CH",
... }
>>>
>>> get_engine_locale('fr', lang_list)
'fr_BE'
>>> lang_list[match_language('fr', lang_list)]
'fr_BE'
Looks like both functions return the same value, but match_language depends on the
order of the dictionary (which is not predictable):
>>> lang_list = {
... "fr-CH": "fr_CH",
... "fr-BE": "fr_BE",
... }
>>> get_engine_locale('fr', lang_list)
'fr_BE'
>>> lang_list[match_language('fr', lang_list)]
'fr_CH'
>>>
The get_engine_locale selects the locale by looking at the "population percent"
and this percentage has an higher amount in BE (68.%) compared to CH (21%)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:35:55 +02:00
75bb8c45d0
[mod] decouple qwant's categories from SearXNG's categories
...
By using new property `qwant_categ:` the category of qwant is no longer bound to
the category of SearXNG.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:26:54 +02:00
96ea355a1f
add twitter engine
2022-08-14 08:39:41 +07:00
0043190643
Merge pull request #1655 from return42/fix-opensearch
...
[fix] improve OpenSearch description
2022-08-13 12:36:34 +02:00
b56848e8d0
Merge pull request #1660 from liimee/eng-neeva
...
Add neeva engine
2022-08-13 02:53:27 +02:00
8fa84ee9f4
Fix time range support and add soft_max_redirects
...
Add custom time_range_url and time_range_map
Set soft_max_redirects = 2 to prevent "ErrorContext('searx/search/processors/online.py', 116, 'count_error(', None, '2 redirects, maximum: 0', ('200', 'OK', 'neeva.com')) True"
2022-08-13 07:35:15 +07:00
d6dfada1a9
add neeva web engine
...
Neeva is "the world's first ad-free, private search engine" and uses data from Apple, Bing, Yelp and "others".
They claim to crawl "hundreds of millions" of URLs a day (https://twitter.com/Neeva/status/1536447373903335426 ).
2022-08-13 07:26:36 +07:00
b4fea007f5
[translations] update from Weblate
...
f2997bfaeeca674f7478de6ac4fb9110a5b432e2eb01d415f96eb06ee7c79191f4dbd424
2022-08-12 07:18:14 +00:00
3b0f9c07b2
[fix] improve OpenSearch description
...
Some HTTP-Clients do have issues with the ``opensearch.xml`` from SearXNG
(related [1][2]) while other OpenSearch descriptions[3] (e.g. from qwant) work
flawles.
Inspired by the OpenSearch description from qwant and with informations from the
specification[4] the ``opensearch.xml`` has been *improved*.
- convert `<Url>` methods from lower case to upper case (`POST`|`GET`)
- add `<moz:SearchForm>` and `xmlns:moz="http://www.mozilla.org/2006/browser/search/ "`
- add `<Query role="example" searchTerms="SearXNG" />` [4]
OpenSearch description documents should include at least one Query element of
`role="example"` that is expected to return search results. Search clients may
use this example query to validate that the search engine is working properly.
- modified `<LongName>` to SearXNG
- modified `<Description>` the word 'hackable' scares uninitiated users and was removed
- add the `type="image/png"` to `<Image>`
Test can be done by::
make run
Visit http://127.0.0.1:8888/ and add the search engine to your WEB-Browser /
test with different WEB-Browser from desktop and Smartphones (are there any iOS
user here, please test on Safari and Chrome).
[1] https://app.element.io/#/room/#searxng:matrix.org/$xN_abdKhNqUlgXRBrb_9F3pqOxnSzGQ1TG0s0G9hQVw
[2] https://github.com/searxng/searxng/issues/431
[3] https://developer.mozilla.org/en-US/docs/Web/OpenSearch
[4] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#the-query-element
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-11 19:04:36 +02:00
73ffa0c070
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10 21:48:34 +02:00
e0215e0cc8
add sourcehut engine
2022-08-10 21:48:12 +02:00
43c545910b
Merge pull request #1648 from unixfox/google_mobile_ui_parameter
...
output format protobuf to HTML for google mobile
2022-08-10 20:50:45 +02:00
eb02cc77c5
[fix] google - simplify XPath selectors to fetch more results
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10 18:55:31 +02:00
90bdb23756
add lib.rs engine
2022-08-10 12:17:55 +02:00
b9f16a77db
output format protobuf to HTML for google mobile
2022-08-10 09:36:06 +00:00
d4acbcfe63
[mod] add deepl translation engine
...
This implements the Deepl Translation engine. It works nearly like lingva but
directly to the deepl API. This api only needs a to-lang, from-lang is a fake
by now.
There is a free option to use [1].
[1] https://www.deepl.com/pro-api?cta=header-pro-api for registering a free account.
2022-08-10 09:14:36 +02:00
24210fb10b
Revert PR #1633
...
This reverts the changes made to the Google results XPath in PR #1633 .
2022-08-10 03:41:39 +02:00
94b3656b4a
[fix] google engine: results XPath
...
Seems google rolls out changes first on the `google.com` domain and later on the
"language" domains. By example: yesterday [1] `google.com` did not work but
`google.de` and `google.fr` did work, today they do not work any longer and this
fix is needed on all domains.
Closes: https://github.com/searxng/searxng/issues/1628
[1] https://github.com/searxng/searxng/issues/1628#issuecomment-1208191816
2022-08-09 06:23:59 +02:00
925f3ff487
Merge pull request #1627 from allendema/add-marginalia
...
[enh] Initial Marginalia.nu support (foss)
2022-08-08 06:53:02 +02:00
58f630d312
Merge pull request #1623 from return42/mod-yep.com
...
[mod] engine yep.com: show all 100 results yep.com has
2022-08-08 06:52:15 +02:00
5b815b3966
[enh] initial Marginalia.nu support (foss)
...
Currently it uses a public api_key `/public/` [1]
The 'index' parameter selects the search index, corresponding to the drop down
next to the search field in the main GUI.
0: popular
1: blogs
2: big_sites
3: default
4: experimental
'experimental' is more up to date and does not exclude other sites, which is the
case with 'big sites' or 'blogs'.
[1] https://api.marginalia.nu/
[2] https://git.marginalia.nu/marginalia/marginalia.nu
[3] https://news.ycombinator.com/item?id=31536626
Closes: https://github.com/searxng/searxng/issues/1620
2022-08-08 06:31:04 +02:00
8b58cd1167
[fix] typo in uWSGI cache: searxcache --> searxngcache
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-07 12:31:09 +02:00
8c318562e2
add description and wikidata ID to wttr.in engine
2022-08-07 14:57:10 +07:00
8aa018db95
add wttr.in engine
2022-08-07 13:04:18 +07:00
647e6187d7
[mod] engine yep.com: show all 100 results yep.com has
...
yep.com is still in beta, the api.yep.com does not have paging support. There
is only a 'limit' argument with a maximum of 100 results.
yep.com seems fast; there is nor need for a timeout of 12 sec.
The API returns JSON nevertheless what the HTTP header is, the "show more"
button on yep.com's web site does not set a special HTTP Accept header.
FYI: The index does not support languages, the WEB UI does not offer a language
selection of the results and the entire index seems in English.
Closes: https://github.com/searxng/searxng/issues/1619
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-06 13:21:28 +02:00
0f02fcc836
[translations] update from Weblate
...
acf8bd394ad75b6eee8cbee687c19313cbe0de3245029a176eec3795f8d8f31fb3fb365faaeabbc96c71c501f7b5ba19850e7fa00cb696fc04c3785fb500f2ad0b576b830adeb6e20b025f17
2022-08-05 07:18:24 +00:00
58369e41d6
[wip] brave time range support
2022-08-04 04:47:25 +02:00
8df1f0c47e
[mod] add 'Accept-Language' HTTP header to online processores
...
Most engines that support languages (and regions) use the Accept-Language from
the WEB browser to build a response that fits to the language (and region).
- add new engine option: send_accept_language_header
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 17:01:59 +02:00
a2badb4fe4
[doc] add description of method EngineProcessor.get_params()
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 16:42:33 +02:00
2babf59adc
[fix] pyright repported errors
...
The errors make pyright usage useless since a new error won't be seen [1].
[1] https://github.com/searxng/searxng/pull/1569
```
searx/compat.py:11:27 - error: Expression of type "Type[cached_property[_T@cached_property]]" cannot be assigned to declared type "Type[cached_property]"
"Type[cached_property[_T@cached_property]]" is incompatible with "Type[cached_property]"
Type "Type[cached_property[_T@cached_property]]" cannot be assigned to type "Type[cached_property]" (reportGeneralTypeIssues)
searx/utils.py:69:36 - error: Expression of type "None" cannot be assigned to parameter of type "str"
Type "None" cannot be assigned to type "str" (reportGeneralTypeIssues)
searx/utils.py:573:85 - error: Expression of type "None" cannot be assigned to parameter of type "int"
Type "None" cannot be assigned to type "int" (reportGeneralTypeIssues)
searx/webapp.py:1306:22 - error: Argument of type "str" cannot be assigned to parameter "__a" of type "BytesPath" in function "join"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:68 - error: Argument of type "Literal['themes']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['themes']" cannot be assigned to type "BytesPath"
"Literal['themes']" is incompatible with "bytes"
"Literal['themes']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:78 - error: Argument of type "str | Any | None" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "str | Any | None" cannot be assigned to type "BytesPath"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:85 - error: Argument of type "Literal['img']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['img']" cannot be assigned to type "BytesPath"
"Literal['img']" is incompatible with "bytes"
"Literal['img']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/engines/mongodb.py:8:6 - warning: Import "pymongo" could not be resolved (reportMissingImports)
searx/engines/mysql_server.py:9:8 - warning: Import "mysql.connector" could not be resolved (reportMissingImports)
searx/engines/postgresql.py:9:8 - warning: Import "psycopg2" could not be resolved from source (reportMissingModuleSource)
searx/engines/xpath.py:187:28 - warning: "categories" is not defined (reportUndefinedVariable)
searx/search/__init__.py:184:82 - warning: "flask" is not defined (reportUndefinedVariable)
searx/search/checker/background.py:19:26 - error: Type of "schedule" is partially unknown
Type of "schedule" is "(delay: Any, func: Any, *args: Any) -> Literal[True]" (reportUnknownVariableType)
searx/shared/__init__.py:8:12 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
searx/shared/shared_uwsgi.py:5:8 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
```
2022-07-30 18:04:44 +02:00
782f73540e
[utils/searxng.sh] implement new script to install SearXNG
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-30 13:39:35 +02:00
953aaec6a3
[translations] update from Weblate
...
c0c9107c5b48bce679669e65520e92847cf52ff59d3ebe722d03c097388af012a4bcf09893fd0b728f68b2069007c99caeec96f269084863b48190abb6bbc0a51a503806c960cb938a2bd34b1064cea06742304556c87fda36a64f1c
2022-07-29 07:17:55 +00:00
14085cc0a7
Merge pull request #1580 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-07-29 07:23:02 +02:00
7602c23d71
Merge pull request #1579 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-07-29 07:22:12 +02:00
0bad4fb931
Merge pull request #1578 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-07-29 07:21:06 +02:00
7dd75ae080
Merge pull request #1576 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-07-29 07:20:28 +02:00
2bdb367e8c
Update searx.data - update_engine_descriptions.py
2022-07-29 02:13:07 +00:00
fc019fb296
Update searx.data - update_currencies.py
2022-07-29 02:01:30 +00:00
c2662ec3c8
Update searx.data - update_firefox_version.py
2022-07-29 02:01:08 +00:00
385542e6c5
Update searx.data - update_ahmia_blacklist.py
2022-07-29 02:01:04 +00:00
90068b3d0b
Update searx.data - update_languages.py
2022-07-29 02:00:53 +00:00
c72d70d45c
Revert "Quick fix for google engine for EU countries"
...
This reverts commit 747cf1a246
2022-07-26 06:39:44 +02:00
950f036c03
[fix] google engine: results XPath
2022-07-26 00:24:15 +02:00
747cf1a246
Quick fix for google engine for EU countries
...
This revert part of the commit of 5fb2071cb2
2022-07-25 20:48:50 +00:00
0be0e63117
[fix] demo_online.py - fixed typo
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-25 20:04:00 +02:00
5fb2071cb2
[fix] google & youtube - set EU consent cookie
...
This change the previous bypass method for Google consent using
``ucbcb=1`` (6face215b8https://www.google.com/search?q=time&tbm=isch " \
-A "Mozilla/5.0 (X11; Linux i686; rv:102.0) Gecko/20100101 Firefox/102.0" \
| grep -i consent
...
location: https://consent.google.com/m?continue=https://www.google.com/search?q%3Dtime%26tbm%3Disch&gl=DE&m=0&pc=irp&uxe=eomtm&hl=en-US&src=1
set-cookie: CONSENT=PENDING+936; expires=Wed, 24-Jul-2024 11:26:20 GMT; path=/; domain=.google.com; Secure
...
PENDING & YES [2]:
Google change the way for consent about YouTube cookies agreement in EU
countries. Instead of showing a popup in the website, YouTube redirects the
user to a new webpage at consent.youtube.com domain ... Fix for this is to
put a cookie CONSENT with YES+ value for every YouTube request
[1] https://github.com/iv-org/invidious/pull/2207
[2] https://github.com/TeamNewPipe/NewPipeExtractor/issues/592
Closes: https://github.com/searxng/searxng/issues/1432
2022-07-25 13:27:06 +02:00
4231a5770b
[fix] sjp engine - convert enginename to a latin1 compliance name
...
The engine name is not only a *name* its also a identifier that is used in
logs, HTTP headers and more. Unicode characters in the name of an engine could
cause various issues.
Closes: https://github.com/searxng/searxng/issues/1544
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-24 21:10:55 +02:00
2516e21c58
[fix] emojipedia - update XPath to be relative
2022-07-24 19:14:26 +02:00
1540891561
[fix] engine tineye: handle 422 response of not supported img format
...
Closes: https://github.com/searxng/searxng/issues/1449
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-23 16:00:58 +02:00
561433b12b
[translations] update from Weblate
...
cf6e9482918c1bfe4e65ecf6a54be8fecad6cb2fa6bd11709d0e8754
2022-07-22 07:20:00 +00:00
6d646129c3
[mod] add tor_check plugin - convenient tor checking trough searxng
2022-07-19 07:34:54 +02:00
d339e97727
[fix] preferences: missing option value
...
Fix missing option value "0".
2022-07-17 19:51:12 +02:00
7bf4e8d12d
Merge pull request #1512 from searxng/translations_update
...
Update translations
2022-07-15 09:45:03 +02:00
4e05197444
Merge pull request #1475 from return42/Emojipedia
...
[mod] Add engine for Emojipedia
2022-07-15 09:30:40 +02:00
445cba7c02
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-15 09:26:44 +02:00
10edcbe3c2
[mod] Add engine for Emojipedia
...
Emojipedia is an emoji reference website which documents the meaning and
common usage of emoji characters in the Unicode Standard. It is owned by Zedge
since 2021. Emojipedia is a voting member of The Unicode Consortium.[1]
Cherry picked from @james-still [2[3] and slightly modified to fit SearXNG's
quality gates.
[1] https://en.wikipedia.org/wiki/Emojipedia
[2] 2fc01eb20fhttps://github.com/searx/searx/pull/3278
2022-07-15 09:26:44 +02:00
f84e9f8154
[translations] update from Weblate
...
e78584e1eb3f21409160b6d118d569b8c9137f9e14d8b61fc11e318d4d53b3bb613117bfe5e383052bea37fa5ab1588132794ad3830b01f9b4d431e5c6d9841e686926568cba6d36fe45788695e7d403f02673b17d49be29fbe6e4da
2022-07-15 07:19:07 +00:00
8e509941b9
[mod] allow brand.issue_url to overwrite the step1 url
2022-07-10 18:43:53 +02:00
44f2eb50a5
Merge pull request #1219 from dalf/follow_bing_redirect
...
bing.py: remove redirection links
2022-07-10 18:06:22 +02:00
6face215b8
bypass google consent with ucbcb=1
2022-07-09 21:33:24 +00:00
84e2a3bd3f
Add infinite scroll as a setting in settings.yml
2022-07-09 17:33:25 +00:00
a1e8af0796
bing.py: resolve bing.com/ck/a redirections
...
add a new function searx.network.multi_requests to send multiple HTTP requests at once
2022-07-08 22:02:21 +02:00
7e695c6644
Merge pull request #1478 from dalf/submit_bug_workflow
...
Engine error log: Submit a new issue button: ask the user to check if there are some existing issues.
2022-07-08 20:24:00 +02:00
f90aed7ef9
locales.py: add support for Papiamento
2022-07-08 10:00:20 +02:00
cb3a31c04d
[translations] update from Weblate
...
b1809ae3cf09e8b25a854ba3e35864339465ae781e1799d056429ebbe1e040b1d04f51ef1a09e45afab4f6de782eac5c73f6dde9eb3bf7a45c3376168511391a816ec36424adf82f25e13dcff2008c3679b9b12a1f2f61c8e7a1cd6efc02ccbf3d1afa8895c871d2f8825dd1a781c97c7290ce9c0a1286c5baa49eef3d3fbc15a1eb8798a08b01a6356344468d1fe456805da3b0c6f02ceecd8246136a4b41ee53eb448a7012f64351ea1d58744d130ce92d37cd4576e883da7a9b10f20a317fcab15b1512d6021cc86a37389c6d05e22b6ca75155e9663c49fac625
2022-07-08 07:18:05 +00:00
be3ecf6e31
[build] /static
2022-07-08 09:04:57 +02:00
eb489c45ea
Submit GH bug: ask the user to do some checks before submitting a new issue
2022-07-08 09:04:57 +02:00
81e8c7370f
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 17:16:41 +02:00
c63fab6928
Merge pull request #1443 from return42/fix-online_dictionary
...
[fix] online_dictionary: regular expression
2022-07-07 16:25:10 +02:00
480476fdf3
[fix] online_dictionary: regular expression
...
The query term of a engine-type `online_dictionary` can consist of more than one
word.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 15:58:29 +02:00
df837d8b1b
Merge pull request #1428 from return42/fix-center_aligment
...
fix typo and document preference 'center_alignment' in the 'ui' section
2022-07-07 09:43:12 +02:00
c5ec8db6b3
Merge pull request #1457 from return42/fix-1435
...
[fix] engine z-zlibrary https URL
2022-07-06 13:44:08 +02:00
be2f782c9e
Merge pull request #1460 from unixfox/patch-1
...
Better explanation for the use of use_mobile_ui
2022-07-06 00:16:26 +02:00
63a995b8c1
Better explanation for the use of use_mobile_ui
2022-07-06 00:10:09 +02:00
38385e48cf
fix: return body on limiter block so there is not just a blank page
2022-07-05 22:57:26 +02:00
970a69012b
[fix] engine z-zlibrary https URL
...
before this patch:
DEBUG searx.engines.z-library : using base_url: https:https://de1lib.org
with this patch URL is fixed to:
DEBUG searx.engines.z-library : using base_url: https://de1lib.org
Closes: https://github.com/searxng/searxng/issues/1435
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-05 22:27:55 +02:00
8de0b62005
[build] /static
2022-07-04 19:06:45 +02:00
f8222eb2cd
[fix] style.less: move <dl> from infobox.attributes to .attributes class
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-04 19:06:45 +02:00
14756a2674
[mod] Adds Lingva translate engine
...
Add the lingva engine (which grabs data from google translate). Results from
Lingva are added to the infobox results.
2022-07-04 19:06:45 +02:00
61ee370e18
[mod] link to public-instances can be set to hidden
...
Some administrators may want to hide the link to public_instances: If you run a
private instance for a company that wants there employees to use the private
instance instead of any of the public instances.
2022-07-04 13:26:01 +02:00
241bde5ae3
[fix] typo: add missing 'n' in center_aligment --> center_alignment
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-03 17:35:54 +02:00
4ef6263725
Merge pull request #1404 from dalf/donation_use_external_link
...
Donation link: default value to searxng.org, can be hidden or custom
2022-07-02 17:18:05 +02:00
5831c15b49
[fix] engines/openstreetmap.py typo: user_langage --> user_language
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 16:51:25 +02:00
6716c6b0c3
openstreetmap engine: return the localized named.
...
For example: display "Tokyo" instead of "東京都" when the language is English.
2022-07-02 16:51:25 +02:00
7f30ac37e9
map.html: display the intended text for the links instead of the URL
...
For example display "Tokyo (en)" instead of https://en.wikipedia.org/wiki/Tokyo
2022-07-02 16:51:25 +02:00
69a6d994e1
Merge pull request #1382 from dalf/fix_searxng_extra_update
...
fix searxng_extra/update/update*.py scripts
2022-07-02 12:33:07 +02:00
1416559f22
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 12:16:00 +02:00
2bf800a4b1
Update searx.data - update_currencies.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_currencies.py
Closes: https://github.com/searxng/searxng/pull/1375
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 12:16:00 +02:00
f8f239fe1f
Donation link: default value to searxng.org, can be hidden or custom
...
Add a new setting: general.donation_url
By default the value is https://docs.searxng.org/donate.html
When the value is false, the link is hidden
When the value is true, the link goes to the infopage donation,
the administrator can create a custom page.
2022-07-02 11:29:21 +02:00
8376833d7d
[translations] update from Weblate
2022-07-02 09:17:14 +00:00
bcded7686e
[build] /static
2022-07-02 10:05:43 +02:00
e3e5d2bd22
Theme: all top right icons have labels including "Preferences"
2022-07-02 10:04:35 +02:00
4272ef3117
[translations] update from Weblate
...
c6c13e8c284f86fed659c9f23d76fb71874e15dc10f3978d66556a496c5a28a79bb7dc8e38bd6b551aecb8f89a74838e3f139d79d3449b5f
2022-07-01 07:18:53 +00:00
1617ef1e41
Update searx/infopage/en/donate.md
...
Co-authored-by: Émilien Devos <contact@emiliendevos.be>
2022-06-29 21:03:01 +02:00
0e503c990a
Move donation page to docs.searxng.org and link to it from instances
...
Close #1378
2022-06-29 17:26:19 +00:00
ecccf02a02
infopage: a .md file can be remove without crash
...
An administrator might decide to remove some of the .md files.
This commit make sure to not crash the application.
2022-06-29 17:25:07 +00:00
eb3123e164
Merge pull request #1379 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-06-29 15:40:51 +02:00
a89fca9d08
Update searx.data - update_ahmia_blacklist.py
2022-06-29 07:21:09 +00:00
3a75d3c1cc
Merge pull request #1376 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-06-29 08:45:29 +02:00
11def5155e
Update searx.data - update_wikidata_units.py
2022-06-29 01:52:03 +00:00
21ab024469
Update searx.data - update_firefox_version.py
2022-06-29 01:51:46 +00:00
0801f9a24e
Add donate.md
2022-06-28 10:59:36 +02:00
86f14fd066
[build] /static
2022-06-25 20:32:04 +02:00
6e2b5f3d5a
Theme: add Help and Donate links in all pages
...
Close https://github.com/searxng/searxng/issues/931
2022-06-25 20:31:40 +02:00
4bedd7465c
Merge pull request #1346 from dalf/theme-dependencies-upgrade
...
Theme: dependencies upgrade
2022-06-25 19:27:42 +02:00
bfebaa15ad
[translations] update from Weblate
...
d745649a80c8f41f
2022-06-25 15:49:33 +00:00
0f3e98ace4
Theme: upgrade dependencies & minor update of the grunt scripts
...
Remove webfont grunt script
Update clean grunt script
2022-06-25 13:59:37 +02:00
dd2577e21d
[translations] update from Weblate
...
b4ef9941a4ad5c56e9640746063e2d09da0952744d632f14136edb6725533b02030b5310
2022-06-24 07:18:15 +00:00
ed1ff4b8bc
Merge pull request #1357 from liimee/eng-3
...
Add curlie.org engine
2022-06-22 18:29:36 +02:00
7c457fcf7a
add curlie engine
2022-06-22 11:46:33 +07:00
88f62cf0df
[fix] clean up templates / remove import of result_footer_rtl macro
...
A macro named 'result_footer_rtl' does not exists.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-20 19:00:10 +02:00
8883aed132
[fix] google play apps engine: implement engines/google_play_apps.py
2022-06-18 16:02:39 +02:00
189df7db4e
Merge pull request #1287 from dalf/style-center-2nd
...
Theme: add a preference to center the results (Oscar) (2nd edition)
2022-06-18 12:34:57 +02:00
0539e38309
Workaround: index.html: remove image preload
...
Related to https://github.com/searxng/searxng/issues/1326
URL for the logo is referenced twice:
* in index.html for preloading: it contains the hash for cache busting (when static_use_hash: true)
* in searxng.min.css: to actually display the image. The URL doesn't contain the hash.
So the image preload actually loads twice the same image.
This commit removed the image preloading.
This is workaround: the real fix is to be able to use the URL with the hash in the CSS.
2022-06-18 09:04:13 +02:00
e6c3000909
[build] /static
2022-06-18 08:58:06 +02:00
8a85d1b0c7
Theme: add a preference to center the results (Oscar) (2nd edition)
...
related to
* #1169
* #1281
* #1286
2022-06-18 08:54:24 +02:00
5bcbec9b06
Fix: use sys.modules.copy() to avoid RuntimeError
...
use sys.modules.copy() to avoid "RuntimeError: dictionary changed size during iteration"
see https://github.com/python/cpython/issues/89516
and https://docs.python.org/3.10/library/sys.html#sys.modules
close https://github.com/searxng/searxng/issues/1342
2022-06-18 07:39:46 +02:00
a7b0b2ecbf
Merge pull request #1329 from samsaptidev/feature/privacypolicy_url
...
Add privacypolicy_url option
2022-06-18 07:26:40 +02:00
6bdc66b70e
[fix] mojeek engine: XPath
...
Update the XPath of the Mojeek engine.
2022-06-17 09:32:53 +02:00
8e107a9ad6
[translations] update from Weblate
...
7d7f982361912312895d116e2f55d1a3507db1e11a7079d1aa30ed02
2022-06-17 07:17:59 +00:00
31005595c9
Add privacypolicy_url option
2022-06-16 11:56:24 +02:00
e9cc6ab0e7
add pub.dev engine
2022-06-15 12:55:37 +02:00
d7a76f3772
Merge pull request #1322 from return42/fix-794
...
[fix] keyboard.js - highlightResult: don't steal focus on click event
2022-06-14 19:07:09 +02:00
ef4239c68a
[doc] fix some leftovers from ad964562c
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-14 16:31:41 +02:00
1a361e6635
[build] /static
2022-06-14 15:14:33 +02:00
882282d0e9
[fix] keyboard.js - highlightResult: don't steal focus on click event
...
For keyboard navigation the highlightResult() function in keyboard.js steals the
focus. On a mouse click event (non keyboard action) the focus should resist
where it is, otherwise a marked region gets lost. This is the reason why text
can't be selected when using simple theme with JS enabled.
Closes: https://github.com/searxng/searxng/issues/794
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-14 15:14:19 +02:00
3ade7ffc26
[build] /static
2022-06-13 21:38:07 +02:00
fe1683c9c6
UX fix: when the user clicks on the search input, don't move the cursor at the end
...
Related to https://github.com/searxng/searxng/pull/1153#issuecomment-1154247988
2022-06-13 21:35:14 +02:00
9b0b6a2c90
Merge pull request #1313 from unixfox/help-rate-limit-google
...
add "warn" message to notify the admin that use_mobile_ui parameter exist
2022-06-12 17:07:13 +02:00
ee3f230d93
Autocomplete: don't suggest the current query.
...
Example of minor issue before this commit:
the autocompletion can suggest "Test" if the query is "Test".
2022-06-12 11:21:24 +02:00
2455f1d06a
Merge pull request #1308 from allendema/add-yep-com-json
...
[enh] Add yep.com via json_engine
2022-06-12 11:09:04 +02:00
916f5f8b90
Merge pull request #1306 from return42/fix-1303
...
[fix] move locale code from webapp.py to locales.py and fix #1303
2022-06-12 10:56:59 +02:00
ad964562ce
[fix] move locale code from webapp.py to locales.py and fix #1303
...
To improve modularization this patch:
- moves *locale* related implementation from the webapp.py application to the
locale.py module.
- The initialization of the locales is now done in the application (webapp) and
is no longer done while importing searx.locales.
In the searx.locales module a new dictionary named `LOCALE_BEST_MATCH` has been
added. In this dictionary we can map languages without a translation to
languages we have a translation for.
To fix #1303 zh-HK has been mapped to zh-Hant-TW (we do not need additional
translations of traditional Chinese)
Closes: https://github.com/searxng/searxng/issues/1303
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-12 10:52:26 +02:00
0d4c066119
notify the user that use_mobile_ui parameter exist
2022-06-11 17:20:56 +02:00
fd9a13a3e5
[enh] Initial no paging support for Yep.com
...
Upstream example query:
https://yep.com/web?q=test
https://yep.com/about
2022-06-11 14:17:44 +02:00
cd2dd5dd55
Wikidata engine: ignore dummy entities
...
Close #641
2022-06-11 11:09:21 +02:00
d068b67a71
Wikidata engine: minor change of the SPARQL request
...
The engine can be slow especially when the query won't return any answer.
See https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual/MWAPI#Find_articles_in_Wikipedia_speaking_about_cheese_and_see_which_Wikibase_items_they_correspond_to
Related to #1290
2022-06-11 10:50:11 +02:00
1e82dedcf3
[translations] update from Weblate
...
25debdad4ea83323034a61d212598dee9ebd1a60
2022-06-10 07:19:19 +00:00
98c4156f12
Fixed typo in settings.yml
2022-06-09 17:08:14 +02:00
ea0cddba0b
Merge pull request #1047 from return42/redis-lib
...
Add a redis library to generalize DB functions we need in SearXNG.
2022-06-06 10:59:11 +02:00
06217ef184
[build] /static
2022-06-05 23:06:19 +02:00
9723cef99a
Revert "Theme: add a preference to center the results (Oscar)"
...
This reverts commit 4237f5fd50
2022-06-05 23:03:26 +02:00
f8f6b95d8f
Merge pull request #1281 from dalf/style-center
...
Theme: add a preference to center the results
2022-06-05 21:39:58 +02:00
2c62360e6e
[build] /static
2022-06-05 20:00:11 +02:00
4237f5fd50
Theme: add a preference to center the results (Oscar)
...
related to #1169
2022-06-05 19:59:49 +02:00
0c489a25ac
[fix] version.py: git format '%cs' is not downward compatible
...
Committer date, short format YYYY-MM-DD ('%cs') [1] is not supported by older git
versions. Instead use '%cd' committer date (format respects --date= option) [2].
[1] https://www.git-scm.com/docs/git-show#Documentation/git-show.txt-emcsem
[2] https://www.git-scm.com/docs/git-show#Documentation/git-show.txt-emcdem
Suggested-by: @ravermeister https://github.com/searxng/searxng/issues/1251#issuecomment-1146282429
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-04 09:15:26 +02:00
2de007138c
[fix] prepare for pylint 2.14.0
...
Remove issue reported by Pylint 2.14.0:
- no-self-use: has been moved to optional extension [1]
- The refactoring checker now also raises 'consider-using-generator' messages
for max(), min() and sum(). [2]
.pylintrc:
- <option name>-hint has been removed since long, Pylint 2.14.0 raises an
error on invalid options
- bad-continuation and bad-whitespace have been removed [3]
[1] https://pylint.pycqa.org/en/latest/whatsnew/2/2.14/summary.html#removed-checkers
[2] https://pylint.pycqa.org/en/latest/whatsnew/2/2.14/full.html#what-s-new-in-pylint-2-14-0
[2] https://pylint.pycqa.org/en/latest/whatsnew/2/2.6/summary.html#summary-release-highlights
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-03 15:41:52 +02:00
bc8cd9cb8c
[translations] update from Weblate
...
1f71567c67ff4da057bf9bd75f63090b4b6756669fcfccffb28ac961ec7b3c14622896c153d0f115e16d889a2c5337a5
2022-06-03 07:18:49 +00:00
7e8a60fb27
[build] /static
2022-06-02 20:35:49 +00:00
fbad93e808
Theme: enable autofocus of #q only on the index page and when the width > 50em
...
Related to #1270
2022-06-02 20:33:31 +00:00
96dc4369d5
Merge pull request #1259 from allendema/petal-images
...
[enh] Add Petalsearch Images engine
2022-06-02 14:59:24 +02:00
7e95d6bb79
[mod] image proxy: allow binary/octet-stream mime type
...
The Petal Search Images engine sends the thumbnails with the binary/octet-stream mime type.
2022-06-02 14:32:37 +02:00
43dc9eb7d6
[enh] Initial Petalsearch Images support
...
Upstream example query:
https://petalsearch.com/search?query=test&channel=image&ps=50&pn=1®ion=de-de&ss_mode=off&ss_type=normal
Depending on locale it will internally use some/all results from other
engines. See:
https://seirdy.one/posts/2021/03/10/search-engines-with-own-indexes/#general-indexing-search-engines
2022-06-02 14:32:37 +02:00
e568da2314
Merge pull request #1266 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-06-01 13:49:48 +02:00
84a5e48a90
Merge pull request #1265 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-06-01 11:29:41 +02:00
78968843a8
Merge pull request #1267 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-06-01 11:24:35 +02:00
a9251cfeb4
Merge pull request #1268 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-06-01 11:24:00 +02:00
61ee915064
Merge pull request #1264 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-06-01 10:34:19 +02:00
fda176144e
Update searx.data - update_engine_descriptions.py
2022-06-01 06:40:37 +00:00
f37b9978cb
Update searx.data - update_currencies.py
2022-06-01 06:32:10 +00:00
a93170725f
Update searx.data - update_firefox_version.py
2022-06-01 06:31:57 +00:00
8d6d32bf6e
Update searx.data - update_ahmia_blacklist.py
2022-06-01 06:31:54 +00:00
012d7fcaa0
Update searx.data - update_languages.py
2022-06-01 06:31:54 +00:00
ab9616c2cc
Update searx.data - update_wikidata_units.py
2022-06-01 06:31:52 +00:00
1a8ff10e30
[mod] redislib - optimize LUA script registration.
...
Instead of register the LUA script on each call, the LUA script is registered
once and the `Script` object is cached in global storage.
[1] https://github.com/searxng/searxng/pull/1047#discussion_r884143305
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-30 11:21:09 +02:00
4b185f0e11
[mod] plugins/limiter.py - use searx.redislib.incr_sliding_window
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-30 11:10:30 +02:00
08876df7c2
[mod] collection of redis functions and lua scripts (initial)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-30 11:10:30 +02:00
167f635924
[engine] petal search news
...
Add Petal Search News to SearXNG via XPath
2022-05-29 22:49:41 +02:00
f09e8abd76
[engine] petal search
...
Add Petal Search to SearXNG via XPath
2022-05-29 22:23:30 +02:00
7c8903c809
[fix] mojeek engine: xpath
2022-05-28 18:09:25 +02:00
e93385e6de
Merge pull request #1249 from Linerly/english-infopage
...
Capitalize website names in search-syntax.md, in the English infopage
2022-05-28 16:50:55 +02:00
c2f7b1136e
Capitalize website names
2022-05-28 14:41:53 +00:00
979c42f044
Replace link
2022-05-28 14:38:14 +00:00
2871900651
Capitalize website names
2022-05-28 14:34:58 +00:00
db26b9b13b
Replace English links to Indonesian links
2022-05-28 14:33:10 +00:00
22d8971bc9
[translation] add DE translation of about.md and search-syntax.md
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-28 14:28:51 +02:00
7686739f56
Merge pull request #1242 from Linerly/indonesian-infopage
...
Add Indonesian translations of about.md and search-syntax.md
2022-05-28 12:06:00 +02:00
69886253d6
[translations] update from Weblate
...
00f6ec8e76553d1e897c7b0abed737a19a0227e5f8598b81a181f9e31c0c69415b707d4d
2022-05-27 07:19:13 +00:00
f3134e0869
Add Indonesian translations of about.md and search-syntax.md
2022-05-27 10:06:44 +07:00
13f4dcafc1
[fix] [new] Brave - Update xpath
...
Last merge request was messed up with git.
2022-05-26 18:44:11 +02:00
c24864a9ad
Enable duckduckgo by default
...
see https://github.com/searxng/searxng/pull/1219#discussion_r879543174
2022-05-24 23:33:12 +02:00
cea7b71d14
Disable the bing engine
...
see
* https://github.com/searxng/searxng/discussions/1209
* https://github.com/searxng/searxng/issues/941
* https://github.com/searxng/searxng/pull/1219
2022-05-24 23:33:08 +02:00
d694b339c5
Merge pull request #1214 from dalf/update_template_image
...
Template images.html: always use JS to lazy load the full size images
2022-05-24 23:14:47 +02:00
1911d63186
[translations] update from Weblate
...
fffd40d4ae4b92e4946e5e9cc758b17b0a73f5ad36c8c1a242fec22c43d1f4ed
2022-05-20 07:19:10 +00:00
0063427309
Template images.html: lazy by JS the full size image
...
Remove lazy loading by browser / width / height:
JS is required to display this HTML fragment anyway.
Simplify the HTML template.
2022-05-18 07:29:31 +00:00
f814ac703b
Merge pull request #1202 from julianfairfax/master
...
Preferences URL in preferences
2022-05-15 20:42:37 +02:00
7d443dfea3
Preferences URL in preferences
...
Revert translation changes
Auto-save preferences from URL
Preferences URL in preferences
Fix that
Preferences URL in preferences
2022-05-15 20:34:04 +02:00
6ef24ffd94
[enh] Add alexandria.org engine
...
engine: json_engine
official_api_documentation: https://github.com/alexandria-org/alexandria-api/raw/master/README.md
2022-05-15 11:10:15 +02:00
6b29cddadb
[translations] update from Weblate
...
2842aa38c8fd2dee6336104f2419fe866ed911ebb6afcecaa250f3493506357bdbf772e9ee7c50368411acd2
2022-05-13 07:20:35 +00:00
bc89bb4790
[build] /static
2022-05-11 00:03:42 +02:00
392c9c4243
[simple theme] add products.html template
2022-05-11 00:03:21 +02:00
035a4eaa09
Merge pull request #1194 from mrpaulblack/fix-leaflet-src
...
[fix] loading of external resources in JS client toolkit
2022-05-10 23:24:24 +02:00
58d4086ce1
[build] /static
2022-05-10 23:06:44 +02:00
b47e44a008
Merge pull request #1196 from unixfox/patch-2
...
Fix typo for the limiter plugin docs
2022-05-10 22:51:03 +02:00
66b77c46c7
Fix typo
2022-05-10 20:45:59 +00:00
06cb15cbf7
Reflect the real world parameter from settings.yml
2022-05-10 20:44:35 +00:00
33c0a9e410
[fix] loading of external resources in JS client toolkit
2022-05-10 22:40:46 +02:00
c69c61838b
[fix] autocomplete and infinite scroll persistence in preferences
...
* fixes a regression from https://github.com/searxng/searxng/pull/1186
2022-05-10 22:25:42 +02:00
6b124e5120
[build] /static
2022-05-10 21:58:22 +02:00
2115f6565e
[mod] simple theme: colors, autocomplete, border
...
* change colors, autocomplete, delete border in some places
2022-05-10 21:56:43 +02:00
18b8bbc017
[fix] PR 1186: GET method
...
PR https://github.com/searxng/searxng/pull/1186 prevented the GET method from being selected.
2022-05-10 17:47:53 +02:00
1e45dbbae9
[build] /static
2022-05-07 19:43:20 +02:00
9b3efa6d8a
theme: remove __common__
2022-05-07 19:40:48 +02:00
4326009d00
[format.python] based on bugfix in 9ed626130
2022-05-07 18:23:10 +02:00
8175290867
[build] /static
2022-05-07 17:58:53 +02:00
444b1e70db
[mod] add setting: search.autocomplete_min
...
Minimun characters to type before autocompleter starts.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-07 17:58:30 +02:00
ed2a4c8087
[mod] client_settings: pass settings from server to JS client
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-07 17:58:30 +02:00
3f18761adb
Revert "[build] /static"
2022-05-07 17:56:30 +02:00
0f18bfc8a5
[build] /static
2022-05-07 17:36:58 +02:00
550f70b1aa
Add support for the Silesian language
2022-05-06 09:40:45 +00:00
12a584c5dd
[translations] update from Weblate
...
7d941719c3fa27740c5271783540a89fc517f467f9b9f6662b3dfa75bacd0922
2022-05-06 07:18:36 +00:00
31521f3a46
Merge pull request #1153 from return42/drop-oscar
...
[theme] peel out oscar from SearXNG development
2022-05-03 18:47:35 +02:00
8a79eb4d7b
Merge pull request #1158 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-05-01 09:51:56 +02:00
6bd6e09e14
Merge pull request #1159 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-05-01 09:51:21 +02:00
9c7e9bf1d9
Merge pull request #1157 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-05-01 09:50:28 +02:00
9e6000407a
Merge pull request #1156 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-05-01 09:49:55 +02:00
6f0a717dce
Update searx.data - update_engine_descriptions.py
2022-05-01 06:33:42 +00:00
bdfbc0ec02
Update searx.data - update_currencies.py
2022-05-01 06:26:53 +00:00
6cb08a568a
Update searx.data - update_wikidata_units.py
2022-05-01 06:26:44 +00:00
10023344a5
Update searx.data - update_ahmia_blacklist.py
2022-05-01 06:26:33 +00:00
e36d7067a9
Update searx.data - update_firefox_version.py
2022-05-01 06:26:31 +00:00
c3bb6c7059
[upd] searx/translations/messages.pot
...
generated by::
./manage pyenv.cmd pybabel extract \
-F babel.cfg \
-o "searx/translations/messages.pot"\
"searx/"
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 13:20:27 +02:00
ad1aca6823
[theme] delete static/themes/oscar and templates/oscar
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
templates/oscar# gelöscht: searx/static/themes/oscar/fonts/glyphicons-halflings-regular.ttf
2022-04-30 13:20:27 +02:00
e8541b6006
[theme] peel out oscar from SearXNG development
...
This is the first step of removing oscar theme
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 13:20:27 +02:00
fa681580bf
Merge pull request #1150 from searxng/dependabot/pip/master/pygments-2.12.0
...
Bump pygments from 2.11.2 to 2.12.0
After each update of the pygments version, we (or github action) should [1]
1. update less files:
./manage pyenv.cmd searxng_extra/update/update_pygments.py
update: static/themes/oscar/src/generated/pygments-logicodev.less
update: static/themes/oscar/src/generated/pygments-pointhi.less
update: static/themes/simple/src/generated/pygments.less
2. rebuild the static files of each themes:
make static.build.commit
[1] https://github.com/searxng/searxng/pull/2#issuecomment-826958666
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 07:25:35 +02:00
0275f0f5ad
[upd] ./manage pyenv.cmd searxng_extra/update/update_pygments.py
...
After each update of the pygments version, we (or github action) should [1]
1. update less files:
./manage pyenv.cmd searxng_extra/update/update_pygments.py
update: static/themes/oscar/src/generated/pygments-logicodev.less
update: static/themes/oscar/src/generated/pygments-pointhi.less
update: static/themes/simple/src/generated/pygments.less
2. rebuild the static files of each themes:
make static.build.commit
[1] https://github.com/searxng/searxng/pull/2#issuecomment-826958666
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 07:12:39 +02:00
fcc177b6ed
Merge pull request #1151 from searxng/translations_update
...
Update translations
2022-04-30 07:03:22 +02:00
4b77fc6acf
[translations] update from Weblate
...
07ad7224
2022-04-29 08:09:27 +00:00
02026bcc76
[fix] library genesis engine: xpath and url
...
Changed the xpath to use the official download mirror.
Changed the URL to libgen.fun as this is the official instance. (https://en.wikipedia.org/wiki/Library_Genesis )
2022-04-27 13:11:34 +02:00
624b58764a
[enh] Add pagination to Brave
...
Also added ```&spellcheck=1``` because now it is disabled by default, not returning any ```suggestion_xpath```.
2022-04-23 14:06:53 +02:00
8c7e6cc983
[fix] FutureWarning from lxml
...
Just in case if content is None, the original code will skip extract_text(), and
just append the None value to 'content'. So just add allow_none=True, and this
will return None without raising a ValueError in extract_text().
2022-04-22 16:09:36 +02:00
62982c8812
[fix] add back missing languages & regions (followup of PR #1071 )
...
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.
As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].
This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.
[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)
2022-04-22 12:09:42 +02:00
1974a85461
Bump grunt-contrib-uglify in /searx/static/themes/simple
...
Bumps [grunt-contrib-uglify](https://github.com/gruntjs/grunt-contrib-uglify ) from 5.1.0 to 5.2.1.
- [Release notes](https://github.com/gruntjs/grunt-contrib-uglify/releases )
- [Changelog](https://github.com/gruntjs/grunt-contrib-uglify/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt-contrib-uglify/compare/v5.1.0...v5.2.1 )
---
updated-dependencies:
- dependency-name: grunt-contrib-uglify
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 09:28:01 +00:00
50bac93363
Merge pull request #1094 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-1.5.2
...
Bump grunt from 1.4.1 to 1.5.2 in /searx/static/themes/simple
2022-04-22 11:25:12 +02:00
cf644b413e
[test.pyright] suppress unneeded error & warning messages
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 11:16:41 +02:00
9fd5d3b2ac
[translations] update from Weblate
...
9398019a2768987ddc9e7f98b223bd62715e7dac5c53a0ec5906fd34691702edcc8bb018ebfab76aa8ce22fae9b6e3c66266ea2e1729fbd80d0f52931b022583f2a71d933020678210f54679
2022-04-22 07:18:46 +00:00
4ab189315b
[build] /static
2022-04-19 09:37:58 +02:00
2bcd610eeb
[fix] add missing result.length and result.author to simple theme
...
Closes: https://github.com/searxng/searxng/issues/1027
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-19 09:37:41 +02:00
e22dc2ba36
Merge pull request #1099 from dalf/update_engine_descriptions
...
Update engine descriptions
2022-04-17 11:37:36 +02:00
bbf13a4657
Merge pull request #1101 from allendema/pass-cookies-from-settings
...
[enh] Allow passing headers/cookies from settings.yml
2022-04-17 11:37:07 +02:00
dae8a08089
[fix[ Update only cookies/headers
2022-04-17 11:29:23 +02:00
67fb6fba84
[lint] Remove whitespace
...
From GH GUI
2022-04-17 10:42:25 +02:00
f039873e1a
[mod] Make a default domain for ebay
...
Which can be changed.
2022-04-17 10:37:12 +02:00
15862ebc35
[mod] Pass desired ebay domain in settings
...
https://www.ebay.de
https://www.ebay.com
htttps://www.ebay.es
etc
2022-04-16 19:10:35 +02:00
155333f625
[enh] Allow passing headers/cookies from settings.yml
...
Example:
- engine: xpath
- search_url: example.org
- headers: {'example_header': 'example_header'}
- cookies: {'safesearch': 'off'}
2022-04-16 17:42:04 +02:00
7bf9e12db9
Update searx.data - update_engine_descriptions.py
2022-04-16 13:17:39 +02:00
c474616642
Merge pull request #1071 from return42/fix-lang-dailymotion
...
[fix] dailymotion engine: filter by language & country
2022-04-16 11:54:49 +02:00
4224607c62
searx.utils.html_to_text: replace <br/> by a space
2022-04-16 09:45:57 +02:00
1a82e79b50
dailymotion: send valid value for the language parameter
2022-04-16 09:27:34 +02:00
3bb62823ec
[fix] dailymotion engine: filter by language & country
...
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.
This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.
[1] https://developers.dailymotion.com/tools/
Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-16 09:27:34 +02:00
ccd8305465
Merge branch 'searxng:master' into master
2022-04-15 16:10:49 +02:00
9109ad706d
[translations] update from Weblate
...
10e2e02d723fc2b48c3ef0ce19b08ebf5838445aa9541b968f9c7cee54ea2973
2022-04-15 07:18:31 +00:00
e314cfe667
Bump grunt from 1.4.1 to 1.5.2 in /searx/static/themes/simple
...
Bumps [grunt](https://github.com/gruntjs/grunt ) from 1.4.1 to 1.5.2.
- [Release notes](https://github.com/gruntjs/grunt/releases )
- [Changelog](https://github.com/gruntjs/grunt/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt/compare/v1.4.1...v1.5.2 )
---
updated-dependencies:
- dependency-name: grunt
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-04-15 07:11:47 +00:00
de4af2fefd
[enh] add seznam autocomplete
2022-04-14 03:02:05 +02:00
9eb1b04f48
change "Wolfram|Alpha" to "Wolfram Alpha" in search results
2022-04-12 10:37:33 +01:00
27f8fa6fe0
Merge pull request #1048 from Linerly/patch-1
...
Improve the about page
2022-04-09 20:30:49 +02:00
592cea0e5e
Merge pull request #1030 from austinhuang0131/master
...
(feat) add jisho.org
2022-04-09 18:57:20 +02:00
74c7aee9ec
jisho : code refactoring
2022-04-09 18:01:57 +02:00
e764427153
Merge branch 'master' into switch-md-parser
2022-04-09 15:24:11 +02:00
5e7f469911
Merge pull request #1051 from return42/fix-region-name
...
[fix] add missing territory (country) name
2022-04-09 14:54:43 +02:00
02d64772f7
Merge pull request #1066 from unixfox/fix-icons-oscar
...
Revert "[fix] return correct favicon path"
2022-04-08 10:25:40 +02:00
604d177551
Merge pull request #1064 from capric98/pretty-url
...
fix: %2F in path will be converted to " › " in searx/webapp.py
2022-04-08 10:08:51 +02:00
01bbd1d0bd
[translations] update from Weblate
...
45fc8afeb187bba29d380d6603029129be15e57271fb0c50
2022-04-08 07:19:02 +00:00
cad3d93fa2
Revert "[fix] return correct favicon path"
...
This fixes https://github.com/searxng/searxng/issues/1057
This reverts commit f99d109ceb
2022-04-07 17:56:28 +00:00
c7de5c043c
fix: %2F in path will be converted to " › "
2022-04-07 23:15:58 +08:00
9215281232
[mod] replace Markdown parser mistletoe by markdown-it-py
...
There are several reasons why we should prefer markdown-it-py over mistletoe:
- Get identical rendering results in SearXNG's `/info` pages and the SearXNG's
project documentation which is build by Sphinx-doc.
In the Sphinx-doc we use the MyST parser to render Markdown and the MyST
parser itself is built on top of the markdown-it-py package.
- markdown-it-py has a typographer that supports *replacements*
and *smartquotes* (e.g. em-dash, copyright, ellipsis, ...) [1]
- markdown-it-py is much more flexible compared to mistletoe [2]
- markdown-it-py is the fastest CommonMark compliant parser in python [3]
[1] https://markdown-it-py.readthedocs.io/en/latest/using.html#typographic-components
[2] https://markdown-it-py.readthedocs.io/en/latest/plugins.html
[3] https://markdown-it-py.readthedocs.io/en/latest/other.html#performance
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-06 15:49:50 +02:00
170f0081c9
[build] /static
2022-04-06 15:07:42 +02:00
169f8d9988
[simple theme] add netloc to image result articles
2022-04-06 15:07:05 +02:00
22309f398b
Fix spelling and punctuation
2022-04-06 12:36:17 +00:00
19ebd0e1ac
[mod] review of the "Search Syntax" page (en)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-06 14:13:22 +02:00
655db9b003
[mod] review of the "About SearXNG" page (en)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-06 13:05:20 +02:00
effcde3d0e
[fix] add missing territory (country) name
...
Related-to: https://github.com/searxng/searxng/pull/1029#issuecomment-1086824911
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-05 16:48:25 +02:00
57a3252ff1
Unquote path on result page.
2022-04-05 02:37:18 +08:00
036b46493b
Improve the about page
2022-04-02 20:51:11 +00:00
765504ceca
Merge pull request #1031 from dalf/fix-bing-_fetch_supported_languages
...
Fix bing fetch supported languages
2022-04-02 08:23:58 +02:00
19fa0095a0
(fix) satisfy the linter, and btw reduce timeout
2022-04-01 09:23:24 -04:00
ta