24210fb10b
Revert PR #1633
...
This reverts the changes made to the Google results XPath in PR #1633 .
2022-08-10 03:41:39 +02:00
94b3656b4a
[fix] google engine: results XPath
...
Seems google rolls out changes first on the `google.com` domain and later on the
"language" domains. By example: yesterday [1] `google.com` did not work but
`google.de` and `google.fr` did work, today they do not work any longer and this
fix is needed on all domains.
Closes: https://github.com/searxng/searxng/issues/1628
[1] https://github.com/searxng/searxng/issues/1628#issuecomment-1208191816
2022-08-09 06:23:59 +02:00
925f3ff487
Merge pull request #1627 from allendema/add-marginalia
...
[enh] Initial Marginalia.nu support (foss)
2022-08-08 06:53:02 +02:00
58f630d312
Merge pull request #1623 from return42/mod-yep.com
...
[mod] engine yep.com: show all 100 results yep.com has
2022-08-08 06:52:15 +02:00
5b815b3966
[enh] initial Marginalia.nu support (foss)
...
Currently it uses a public api_key `/public/` [1]
The 'index' parameter selects the search index, corresponding to the drop down
next to the search field in the main GUI.
0: popular
1: blogs
2: big_sites
3: default
4: experimental
'experimental' is more up to date and does not exclude other sites, which is the
case with 'big sites' or 'blogs'.
[1] https://api.marginalia.nu/
[2] https://git.marginalia.nu/marginalia/marginalia.nu
[3] https://news.ycombinator.com/item?id=31536626
Closes: https://github.com/searxng/searxng/issues/1620
2022-08-08 06:31:04 +02:00
8b58cd1167
[fix] typo in uWSGI cache: searxcache --> searxngcache
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-07 12:31:09 +02:00
647e6187d7
[mod] engine yep.com: show all 100 results yep.com has
...
yep.com is still in beta, the api.yep.com does not have paging support. There
is only a 'limit' argument with a maximum of 100 results.
yep.com seems fast; there is nor need for a timeout of 12 sec.
The API returns JSON nevertheless what the HTTP header is, the "show more"
button on yep.com's web site does not set a special HTTP Accept header.
FYI: The index does not support languages, the WEB UI does not offer a language
selection of the results and the entire index seems in English.
Closes: https://github.com/searxng/searxng/issues/1619
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-06 13:21:28 +02:00
0f02fcc836
[translations] update from Weblate
...
acf8bd394ad75b6eee8cbee687c19313cbe0de3245029a176eec3795f8d8f31fb3fb365faaeabbc96c71c501f7b5ba19850e7fa00cb696fc04c3785fb500f2ad0b576b830adeb6e20b025f17
2022-08-05 07:18:24 +00:00
58369e41d6
[wip] brave time range support
2022-08-04 04:47:25 +02:00
8df1f0c47e
[mod] add 'Accept-Language' HTTP header to online processores
...
Most engines that support languages (and regions) use the Accept-Language from
the WEB browser to build a response that fits to the language (and region).
- add new engine option: send_accept_language_header
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 17:01:59 +02:00
a2badb4fe4
[doc] add description of method EngineProcessor.get_params()
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 16:42:33 +02:00
2babf59adc
[fix] pyright repported errors
...
The errors make pyright usage useless since a new error won't be seen [1].
[1] https://github.com/searxng/searxng/pull/1569
```
searx/compat.py:11:27 - error: Expression of type "Type[cached_property[_T@cached_property]]" cannot be assigned to declared type "Type[cached_property]"
"Type[cached_property[_T@cached_property]]" is incompatible with "Type[cached_property]"
Type "Type[cached_property[_T@cached_property]]" cannot be assigned to type "Type[cached_property]" (reportGeneralTypeIssues)
searx/utils.py:69:36 - error: Expression of type "None" cannot be assigned to parameter of type "str"
Type "None" cannot be assigned to type "str" (reportGeneralTypeIssues)
searx/utils.py:573:85 - error: Expression of type "None" cannot be assigned to parameter of type "int"
Type "None" cannot be assigned to type "int" (reportGeneralTypeIssues)
searx/webapp.py:1306:22 - error: Argument of type "str" cannot be assigned to parameter "__a" of type "BytesPath" in function "join"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:68 - error: Argument of type "Literal['themes']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['themes']" cannot be assigned to type "BytesPath"
"Literal['themes']" is incompatible with "bytes"
"Literal['themes']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:78 - error: Argument of type "str | Any | None" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "str | Any | None" cannot be assigned to type "BytesPath"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:85 - error: Argument of type "Literal['img']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['img']" cannot be assigned to type "BytesPath"
"Literal['img']" is incompatible with "bytes"
"Literal['img']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/engines/mongodb.py:8:6 - warning: Import "pymongo" could not be resolved (reportMissingImports)
searx/engines/mysql_server.py:9:8 - warning: Import "mysql.connector" could not be resolved (reportMissingImports)
searx/engines/postgresql.py:9:8 - warning: Import "psycopg2" could not be resolved from source (reportMissingModuleSource)
searx/engines/xpath.py:187:28 - warning: "categories" is not defined (reportUndefinedVariable)
searx/search/__init__.py:184:82 - warning: "flask" is not defined (reportUndefinedVariable)
searx/search/checker/background.py:19:26 - error: Type of "schedule" is partially unknown
Type of "schedule" is "(delay: Any, func: Any, *args: Any) -> Literal[True]" (reportUnknownVariableType)
searx/shared/__init__.py:8:12 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
searx/shared/shared_uwsgi.py:5:8 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
```
2022-07-30 18:04:44 +02:00
782f73540e
[utils/searxng.sh] implement new script to install SearXNG
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-30 13:39:35 +02:00
953aaec6a3
[translations] update from Weblate
...
c0c9107c5b48bce679669e65520e92847cf52ff59d3ebe722d03c097388af012a4bcf09893fd0b728f68b2069007c99caeec96f269084863b48190abb6bbc0a51a503806c960cb938a2bd34b1064cea06742304556c87fda36a64f1c
2022-07-29 07:17:55 +00:00
14085cc0a7
Merge pull request #1580 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-07-29 07:23:02 +02:00
7602c23d71
Merge pull request #1579 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-07-29 07:22:12 +02:00
0bad4fb931
Merge pull request #1578 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-07-29 07:21:06 +02:00
7dd75ae080
Merge pull request #1576 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-07-29 07:20:28 +02:00
2bdb367e8c
Update searx.data - update_engine_descriptions.py
2022-07-29 02:13:07 +00:00
fc019fb296
Update searx.data - update_currencies.py
2022-07-29 02:01:30 +00:00
c2662ec3c8
Update searx.data - update_firefox_version.py
2022-07-29 02:01:08 +00:00
385542e6c5
Update searx.data - update_ahmia_blacklist.py
2022-07-29 02:01:04 +00:00
90068b3d0b
Update searx.data - update_languages.py
2022-07-29 02:00:53 +00:00
c72d70d45c
Revert "Quick fix for google engine for EU countries"
...
This reverts commit 747cf1a246
2022-07-26 06:39:44 +02:00
950f036c03
[fix] google engine: results XPath
2022-07-26 00:24:15 +02:00
747cf1a246
Quick fix for google engine for EU countries
...
This revert part of the commit of 5fb2071cb2
2022-07-25 20:48:50 +00:00
0be0e63117
[fix] demo_online.py - fixed typo
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-25 20:04:00 +02:00
5fb2071cb2
[fix] google & youtube - set EU consent cookie
...
This change the previous bypass method for Google consent using
``ucbcb=1`` (6face215b8https://www.google.com/search?q=time&tbm=isch " \
-A "Mozilla/5.0 (X11; Linux i686; rv:102.0) Gecko/20100101 Firefox/102.0" \
| grep -i consent
...
location: https://consent.google.com/m?continue=https://www.google.com/search?q%3Dtime%26tbm%3Disch&gl=DE&m=0&pc=irp&uxe=eomtm&hl=en-US&src=1
set-cookie: CONSENT=PENDING+936; expires=Wed, 24-Jul-2024 11:26:20 GMT; path=/; domain=.google.com; Secure
...
PENDING & YES [2]:
Google change the way for consent about YouTube cookies agreement in EU
countries. Instead of showing a popup in the website, YouTube redirects the
user to a new webpage at consent.youtube.com domain ... Fix for this is to
put a cookie CONSENT with YES+ value for every YouTube request
[1] https://github.com/iv-org/invidious/pull/2207
[2] https://github.com/TeamNewPipe/NewPipeExtractor/issues/592
Closes: https://github.com/searxng/searxng/issues/1432
2022-07-25 13:27:06 +02:00
4231a5770b
[fix] sjp engine - convert enginename to a latin1 compliance name
...
The engine name is not only a *name* its also a identifier that is used in
logs, HTTP headers and more. Unicode characters in the name of an engine could
cause various issues.
Closes: https://github.com/searxng/searxng/issues/1544
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-24 21:10:55 +02:00
2516e21c58
[fix] emojipedia - update XPath to be relative
2022-07-24 19:14:26 +02:00
1540891561
[fix] engine tineye: handle 422 response of not supported img format
...
Closes: https://github.com/searxng/searxng/issues/1449
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-23 16:00:58 +02:00
561433b12b
[translations] update from Weblate
...
cf6e9482918c1bfe4e65ecf6a54be8fecad6cb2fa6bd11709d0e8754
2022-07-22 07:20:00 +00:00
6d646129c3
[mod] add tor_check plugin - convenient tor checking trough searxng
2022-07-19 07:34:54 +02:00
d339e97727
[fix] preferences: missing option value
...
Fix missing option value "0".
2022-07-17 19:51:12 +02:00
7bf4e8d12d
Merge pull request #1512 from searxng/translations_update
...
Update translations
2022-07-15 09:45:03 +02:00
4e05197444
Merge pull request #1475 from return42/Emojipedia
...
[mod] Add engine for Emojipedia
2022-07-15 09:30:40 +02:00
445cba7c02
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-15 09:26:44 +02:00
10edcbe3c2
[mod] Add engine for Emojipedia
...
Emojipedia is an emoji reference website which documents the meaning and
common usage of emoji characters in the Unicode Standard. It is owned by Zedge
since 2021. Emojipedia is a voting member of The Unicode Consortium.[1]
Cherry picked from @james-still [2[3] and slightly modified to fit SearXNG's
quality gates.
[1] https://en.wikipedia.org/wiki/Emojipedia
[2] 2fc01eb20fhttps://github.com/searx/searx/pull/3278
2022-07-15 09:26:44 +02:00
f84e9f8154
[translations] update from Weblate
...
e78584e1eb3f21409160b6d118d569b8c9137f9e14d8b61fc11e318d4d53b3bb613117bfe5e383052bea37fa5ab1588132794ad3830b01f9b4d431e5c6d9841e686926568cba6d36fe45788695e7d403f02673b17d49be29fbe6e4da
2022-07-15 07:19:07 +00:00
8e509941b9
[mod] allow brand.issue_url to overwrite the step1 url
2022-07-10 18:43:53 +02:00
44f2eb50a5
Merge pull request #1219 from dalf/follow_bing_redirect
...
bing.py: remove redirection links
2022-07-10 18:06:22 +02:00
6face215b8
bypass google consent with ucbcb=1
2022-07-09 21:33:24 +00:00
84e2a3bd3f
Add infinite scroll as a setting in settings.yml
2022-07-09 17:33:25 +00:00
a1e8af0796
bing.py: resolve bing.com/ck/a redirections
...
add a new function searx.network.multi_requests to send multiple HTTP requests at once
2022-07-08 22:02:21 +02:00
7e695c6644
Merge pull request #1478 from dalf/submit_bug_workflow
...
Engine error log: Submit a new issue button: ask the user to check if there are some existing issues.
2022-07-08 20:24:00 +02:00
f90aed7ef9
locales.py: add support for Papiamento
2022-07-08 10:00:20 +02:00
cb3a31c04d
[translations] update from Weblate
...
b1809ae3cf09e8b25a854ba3e35864339465ae781e1799d056429ebbe1e040b1d04f51ef1a09e45afab4f6de782eac5c73f6dde9eb3bf7a45c3376168511391a816ec36424adf82f25e13dcff2008c3679b9b12a1f2f61c8e7a1cd6efc02ccbf3d1afa8895c871d2f8825dd1a781c97c7290ce9c0a1286c5baa49eef3d3fbc15a1eb8798a08b01a6356344468d1fe456805da3b0c6f02ceecd8246136a4b41ee53eb448a7012f64351ea1d58744d130ce92d37cd4576e883da7a9b10f20a317fcab15b1512d6021cc86a37389c6d05e22b6ca75155e9663c49fac625
2022-07-08 07:18:05 +00:00
be3ecf6e31
[build] /static
2022-07-08 09:04:57 +02:00
eb489c45ea
Submit GH bug: ask the user to do some checks before submitting a new issue
2022-07-08 09:04:57 +02:00
81e8c7370f
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 17:16:41 +02:00
c63fab6928
Merge pull request #1443 from return42/fix-online_dictionary
...
[fix] online_dictionary: regular expression
2022-07-07 16:25:10 +02:00
480476fdf3
[fix] online_dictionary: regular expression
...
The query term of a engine-type `online_dictionary` can consist of more than one
word.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 15:58:29 +02:00
df837d8b1b
Merge pull request #1428 from return42/fix-center_aligment
...
fix typo and document preference 'center_alignment' in the 'ui' section
2022-07-07 09:43:12 +02:00
c5ec8db6b3
Merge pull request #1457 from return42/fix-1435
...
[fix] engine z-zlibrary https URL
2022-07-06 13:44:08 +02:00
be2f782c9e
Merge pull request #1460 from unixfox/patch-1
...
Better explanation for the use of use_mobile_ui
2022-07-06 00:16:26 +02:00
63a995b8c1
Better explanation for the use of use_mobile_ui
2022-07-06 00:10:09 +02:00
38385e48cf
fix: return body on limiter block so there is not just a blank page
2022-07-05 22:57:26 +02:00
970a69012b
[fix] engine z-zlibrary https URL
...
before this patch:
DEBUG searx.engines.z-library : using base_url: https:https://de1lib.org
with this patch URL is fixed to:
DEBUG searx.engines.z-library : using base_url: https://de1lib.org
Closes: https://github.com/searxng/searxng/issues/1435
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-05 22:27:55 +02:00
8de0b62005
[build] /static
2022-07-04 19:06:45 +02:00
f8222eb2cd
[fix] style.less: move <dl> from infobox.attributes to .attributes class
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-04 19:06:45 +02:00
14756a2674
[mod] Adds Lingva translate engine
...
Add the lingva engine (which grabs data from google translate). Results from
Lingva are added to the infobox results.
2022-07-04 19:06:45 +02:00
61ee370e18
[mod] link to public-instances can be set to hidden
...
Some administrators may want to hide the link to public_instances: If you run a
private instance for a company that wants there employees to use the private
instance instead of any of the public instances.
2022-07-04 13:26:01 +02:00
241bde5ae3
[fix] typo: add missing 'n' in center_aligment --> center_alignment
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-03 17:35:54 +02:00
4ef6263725
Merge pull request #1404 from dalf/donation_use_external_link
...
Donation link: default value to searxng.org, can be hidden or custom
2022-07-02 17:18:05 +02:00
5831c15b49
[fix] engines/openstreetmap.py typo: user_langage --> user_language
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 16:51:25 +02:00
6716c6b0c3
openstreetmap engine: return the localized named.
...
For example: display "Tokyo" instead of "東京都" when the language is English.
2022-07-02 16:51:25 +02:00
7f30ac37e9
map.html: display the intended text for the links instead of the URL
...
For example display "Tokyo (en)" instead of https://en.wikipedia.org/wiki/Tokyo
2022-07-02 16:51:25 +02:00
69a6d994e1
Merge pull request #1382 from dalf/fix_searxng_extra_update
...
fix searxng_extra/update/update*.py scripts
2022-07-02 12:33:07 +02:00
1416559f22
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 12:16:00 +02:00
2bf800a4b1
Update searx.data - update_currencies.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_currencies.py
Closes: https://github.com/searxng/searxng/pull/1375
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 12:16:00 +02:00
f8f239fe1f
Donation link: default value to searxng.org, can be hidden or custom
...
Add a new setting: general.donation_url
By default the value is https://docs.searxng.org/donate.html
When the value is false, the link is hidden
When the value is true, the link goes to the infopage donation,
the administrator can create a custom page.
2022-07-02 11:29:21 +02:00
8376833d7d
[translations] update from Weblate
2022-07-02 09:17:14 +00:00
bcded7686e
[build] /static
2022-07-02 10:05:43 +02:00
e3e5d2bd22
Theme: all top right icons have labels including "Preferences"
2022-07-02 10:04:35 +02:00
4272ef3117
[translations] update from Weblate
...
c6c13e8c284f86fed659c9f23d76fb71874e15dc10f3978d66556a496c5a28a79bb7dc8e38bd6b551aecb8f89a74838e3f139d79d3449b5f
2022-07-01 07:18:53 +00:00
1617ef1e41
Update searx/infopage/en/donate.md
...
Co-authored-by: Émilien Devos <contact@emiliendevos.be>
2022-06-29 21:03:01 +02:00
0e503c990a
Move donation page to docs.searxng.org and link to it from instances
...
Close #1378
2022-06-29 17:26:19 +00:00
ecccf02a02
infopage: a .md file can be remove without crash
...
An administrator might decide to remove some of the .md files.
This commit make sure to not crash the application.
2022-06-29 17:25:07 +00:00
eb3123e164
Merge pull request #1379 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-06-29 15:40:51 +02:00
a89fca9d08
Update searx.data - update_ahmia_blacklist.py
2022-06-29 07:21:09 +00:00
3a75d3c1cc
Merge pull request #1376 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-06-29 08:45:29 +02:00
11def5155e
Update searx.data - update_wikidata_units.py
2022-06-29 01:52:03 +00:00
21ab024469
Update searx.data - update_firefox_version.py
2022-06-29 01:51:46 +00:00
0801f9a24e
Add donate.md
2022-06-28 10:59:36 +02:00
86f14fd066
[build] /static
2022-06-25 20:32:04 +02:00
6e2b5f3d5a
Theme: add Help and Donate links in all pages
...
Close https://github.com/searxng/searxng/issues/931
2022-06-25 20:31:40 +02:00
4bedd7465c
Merge pull request #1346 from dalf/theme-dependencies-upgrade
...
Theme: dependencies upgrade
2022-06-25 19:27:42 +02:00
bfebaa15ad
[translations] update from Weblate
...
d745649a80c8f41f
2022-06-25 15:49:33 +00:00
0f3e98ace4
Theme: upgrade dependencies & minor update of the grunt scripts
...
Remove webfont grunt script
Update clean grunt script
2022-06-25 13:59:37 +02:00
dd2577e21d
[translations] update from Weblate
...
b4ef9941a4ad5c56e9640746063e2d09da0952744d632f14136edb6725533b02030b5310
2022-06-24 07:18:15 +00:00
ed1ff4b8bc
Merge pull request #1357 from liimee/eng-3
...
Add curlie.org engine
2022-06-22 18:29:36 +02:00
7c457fcf7a
add curlie engine
2022-06-22 11:46:33 +07:00
88f62cf0df
[fix] clean up templates / remove import of result_footer_rtl macro
...
A macro named 'result_footer_rtl' does not exists.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-20 19:00:10 +02:00
8883aed132
[fix] google play apps engine: implement engines/google_play_apps.py
2022-06-18 16:02:39 +02:00
189df7db4e
Merge pull request #1287 from dalf/style-center-2nd
...
Theme: add a preference to center the results (Oscar) (2nd edition)
2022-06-18 12:34:57 +02:00
0539e38309
Workaround: index.html: remove image preload
...
Related to https://github.com/searxng/searxng/issues/1326
URL for the logo is referenced twice:
* in index.html for preloading: it contains the hash for cache busting (when static_use_hash: true)
* in searxng.min.css: to actually display the image. The URL doesn't contain the hash.
So the image preload actually loads twice the same image.
This commit removed the image preloading.
This is workaround: the real fix is to be able to use the URL with the hash in the CSS.
2022-06-18 09:04:13 +02:00
e6c3000909
[build] /static
2022-06-18 08:58:06 +02:00
8a85d1b0c7
Theme: add a preference to center the results (Oscar) (2nd edition)
...
related to
* #1169
* #1281
* #1286
2022-06-18 08:54:24 +02:00
5bcbec9b06
Fix: use sys.modules.copy() to avoid RuntimeError
...
use sys.modules.copy() to avoid "RuntimeError: dictionary changed size during iteration"
see https://github.com/python/cpython/issues/89516
and https://docs.python.org/3.10/library/sys.html#sys.modules
close https://github.com/searxng/searxng/issues/1342
2022-06-18 07:39:46 +02:00
a7b0b2ecbf
Merge pull request #1329 from samsaptidev/feature/privacypolicy_url
...
Add privacypolicy_url option
2022-06-18 07:26:40 +02:00
Brock Vojković