07936060d1
preferences: Set autocomplete=off for form
...
Otherwise you can change the value of a select,
refresh the page and the preferences stay changed,
leaving the wrong impression that they were saved.
2022-02-04 21:11:29 +01:00
b35ef9789b
[pylint] engines/invidious.py
...
Fix remarks from pylint and remove usless comments
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 15:42:06 +01:00
e2ec6b4211
[fix] invidious engine: store random base_url in param
...
Two different threads ( = two different user queries) can call the request
function in a row and then the response function. The namespace will be same
since this is the same engine.
To keep exactly the same value ``base_url`` must be stored in params and then
retrieve using ``resp.search_params["base_url"]``.
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#discussion_r799324861
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 15:42:06 +01:00
ae804ddf40
Merge pull request #862 from return42/fix-858
...
[fix] solidtorrents engine - JSON API no longer exists
2022-02-04 14:38:36 +00:00
ddc2102a07
[fix] solidtorrents engine: store random bas_url in param
...
Two different threads ( = two different user queries) can call the request
function in a row and then the response function. The namespace will be same
since this is the same engine.
To keep exactly the same value ``base_url`` must be stored in params and then
retrieve using ``resp.search_params["base_url"]``.
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#discussion_r799324861
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:55:21 +01:00
d6061b7c8a
[mod] solidtorrents engine: add metadata & torrentfile
...
BTW: define min_len in eval_xpath_list of 'stats' list
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#pullrequestreview-872910744
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:53:42 +01:00
f9c4868142
[fix] solidtorrents engine: use get_torrent_size from searx.utils
...
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#pullrequestreview-872858489
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:53:42 +01:00
d92b3d96fd
[fix] solidtorrents engine: JSON API no longer exists
...
The API endpoint, we where using does not exist anymore. This patch is a
rewrite that parses the HTML page.
Related: https://github.com/paulgoio/searxng/issues/17
Closes: https://github.com/searxng/searxng/issues/858
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:53:37 +01:00
de32d543bc
Merge pull request #863 from searxng/dependabot/pip/master/black-22.1.0
...
Bump black from 21.12b0 to 22.1.0
2022-02-04 08:52:22 +00:00
2e5d562da3
Merge pull request #865 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/sharp-0.30.0
...
Bump sharp from 0.29.3 to 0.30.0 in /searx/static/themes/simple
2022-02-04 08:52:04 +00:00
964902e779
[fix] issue reported by pylint 22.1.0
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 09:45:35 +01:00
cc99386523
[translations] update from Weblate
...
bf218121ba9e50fd258505badacbf882968e7f6b
2022-02-04 07:14:12 +00:00
6eee2d8771
Bump sharp from 0.29.3 to 0.30.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.29.3 to 0.30.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.29.3...v0.30.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-02-04 07:10:14 +00:00
9fae80facb
Merge pull request #618 from dalf/limiter
...
[enh] limiter plugin
2022-02-02 09:24:34 +01:00
f79b0fce06
[enh] limiter plugin
...
can replace filtron:
* rate limite the number of request per IP and per (IP, User-Agent)
* block some bots
use Redis
data stored in Redis never contains the IP addresses, only HMAC using the secret_key
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-02 09:15:59 +01:00
07f7289e23
Merge pull request #849 from return42/fix-787
...
[fix] engines description - currency_convert.py
2022-02-01 07:19:05 +00:00
50a56532c4
[pylint] engines/currency_convert.py
...
Fix remarks from pylint
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-01 08:02:42 +01:00
314ea2dc61
Merge pull request #852 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-02-01 06:52:57 +00:00
4d0bd47ff0
Merge pull request #853 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-02-01 06:52:19 +00:00
20cbabff96
Merge pull request #851 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-02-01 06:48:54 +00:00
f4f90aa3a4
Update searx.data - update_firefox_version.py
2022-02-01 06:23:16 +00:00
7b402e1aa0
Update searx.data - update_ahmia_blacklist.py
2022-02-01 06:23:01 +00:00
1c47f4b6e0
Update searx.data - update_currencies.py
2022-02-01 06:23:00 +00:00
e78dc45d1e
Update searx.data - update_wikidata_units.py
2022-02-01 06:22:58 +00:00
14338e2c3b
[enh] generate navigation for help pages
2022-02-01 06:29:22 +01:00
c53c295573
[enh] make searx.user_help use an explicit TOC
...
When we have multiple help pages we want them
to be displayed in a specific order.
2022-02-01 06:29:22 +01:00
0f7bcd17b2
[build] /static
2022-02-01 06:29:19 +01:00
5012d06e72
[simple] allow .tabs to be used for help pages
2022-02-01 06:28:26 +01:00
fb9eedbf40
[enh] introduce /help route
...
Translation will be implemented in the future.
For now the "en" in /help/en/<pagename> is hardcoded.
2022-02-01 06:28:26 +01:00
b93711b45d
[help] remove link from about.md title
...
Now that about.html extends page_with_header.html
it already has a link to the start page and removing
the link makes it easier to extract the page title
from the Markdown for the following commit.
2022-02-01 06:28:26 +01:00
08bb3a5f3a
[pyright:basic] searx.user_help
2022-02-01 06:28:26 +01:00
e931590312
[build] /static
2022-02-01 06:22:44 +01:00
b6200563ba
[simple] improve margin of #linkto_preferences
...
Co-authored-by: Paul Braeuning <paul@paulgo.io>
2022-02-01 06:22:29 +01:00
15320b5eec
[fix] engines description - currency_convert.py
...
Currency engine has DuckDuckGo metadata
In the engine selector of the preferences window, the currency search engine has
the same metadata and wikidata url as duckduckgo, I'd assume there should be a
difference of some sort there clarifying what source the currency uses or, if
it's a duckduckgo service, at least clarifying that it's a currency service by
duck duck go.
Closes: https://github.com/searxng/searxng/issues/787
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-31 23:17:28 +01:00
743353dd09
[simple] add aria-label to preferences link
2022-01-31 12:00:11 +01:00
e7c0f4e877
[simple] link preferences on /about and /stats
...
We want to link the preferences from every page
(except of course the preferences page).
2022-01-31 11:57:24 +01:00
c82b9c68d2
Merge pull request #843 from not-my-profile/simple-page-with-header
2022-01-31 11:14:48 +01:00
60e7fee47a
Merge pull request #475 from return42/tineye
...
[enh] engine - add Tineye reverse image search
2022-01-31 08:51:35 +01:00
2d5929cc59
[mod] searx.utils: more typing
2022-01-30 22:14:12 +01:00
ebd3013a1a
[mod] tineye engine: minor changes
...
* remove "disable: false" in settings.yml
* use the json() method from httpx.Response (faster character encoding detection)
2022-01-30 20:49:22 +01:00
a6673a1a94
[fix] 1x engine
...
1x changed the XML result layout.
2022-01-30 19:48:40 +01:00
79dbbd4d99
[build] /static
2022-01-30 17:29:21 +01:00
6f0ec7e58f
[simple] introduce page_with_header.html template
...
Previously the preferences & stats templates contained the markup:
<a href="{{ url_for('index') }}"><h1><span>SearXNG</span></h1></a>
There are many things wrong with this:
1. the markup was duplicated
2. the CSS needed to be changed whenever a new page wanted to use this
header (since the CSS used page-specific selectors)
3. h1 should be reserved for the actual page title
(e.g. Preferences or Engine stats)
4. the image was set via CSS which also set:
span { visibility: hidden; }
which however removes the alternative text from the accessibility
tree (meaning screen readers will ignore it).
This commit fixes all these problems.
2022-01-30 17:29:21 +01:00
a6b879f19c
[mod] tineye engine: set engine_type to 'online_url_search'
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-30 16:30:52 +01:00
e92d40c854
[enh] implement a OnlineUrlSearchProcessor
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-30 16:05:08 +01:00
0eacc46ee3
[mod] add documentation about searx.utils
...
This module is a toolbox for the engines.
Is should be documented.
In addition, searx/utils.py is checked by pylint.
2022-01-29 22:49:42 +01:00
068155df88
[build] /static
2022-01-29 14:44:05 +01:00
dc4caa5a39
[fix] simple theme: /preferences: cookies table is LTR
...
close #827
2022-01-29 14:42:12 +01:00
6a366c9807
Merge pull request #838 from dalf/remove_deprecated_code
...
[mod] remove deprecate code
2022-01-29 10:13:56 +01:00
f3f61df6a0
[mod] remove deprecate code
...
remove code to support Python 3.5 and Python 3.6
2022-01-29 08:54:12 +01:00
116802852d
[fix] ina engine
...
based on a45408e8e2
2022-01-28 22:33:41 +01:00
b7f74fbe42
[mod] tineye - add some documentation
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-28 09:06:44 +01:00
880555e263
[enh] engine - add Tineye reverse image search
...
Other optional parameter ..
`&sort=crawl_date`
can be appended to search_string to sort results by date.
`&domain=example.org`
can be implemented to search_string to get results from just one domain.
Public instances could get relatively fast timed-out for 3600s.
--
Merged from @allendema's commit [1] and slightly modfied / see [2].
Related-to: [1] 455b2b4460https://github.com/searx/searx/pull/3040
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-28 09:06:44 +01:00
43a262497b
[translations] update from Weblate
...
80b990723235457738737f21f1658c803172618b5063d26169df6ff651bd2e18f6dea2a9d62301424d07658ce3798ef7bc99fe052811901d
2022-01-28 07:16:43 +00:00
4f82ab36a9
Merge pull request #817 from not-my-profile/pyright-01
...
Pyright 01
2022-01-27 23:18:41 +01:00
0cbf73a1f4
Allow 'using_tor_proxy' to be set for each engine individually
...
Check 'using_tor_proxy' for each engine individually instead of checking globally
[fix] searx.network: update _rdns test to the last httpx version
Co-authored-by: Alexandre Flament <alex@al-f.net>
2022-01-27 22:37:02 +01:00
506169f312
[pyright] remove no longer needed assertion
...
The pyright bug[1] for which the assertion was added has been fixed.
[1]: https://github.com/microsoft/pyright/issues/2930
2022-01-27 22:17:16 +01:00
b767752d0c
[pyright:basic] searx.webapp
2022-01-27 22:17:16 +01:00
640c404844
[pyright:strict] searx.search.checker.background
2022-01-27 22:07:12 +01:00
7f89adc5f3
[pyright:strict] searx.shared.shared_abstract
2022-01-27 22:07:12 +01:00
2c6bd2adf6
Merge pull request #825 from MontyQI/ui-changes
...
Simple theme uppercase buttons
2022-01-26 18:09:11 +01:00
f59afc8dd2
Uppercase buttons
2022-01-26 16:54:15 +01:00
ccffab3a43
Merge pull request #813 from MarcAbonce/change-wolfram-category
...
Move WolframAlpha away from Science category
2022-01-26 14:10:19 +01:00
e5f266065c
Merge pull request #824 from dalf/fix-simple-pref-checker
...
[fix] simple theme: don't crash when the checker is enabled
2022-01-25 23:01:31 +01:00
dfb9ca527d
[fix] simple theme: don't crash when the checker is enabled
...
The macro "checkbox" in macros.html uses the macro "icon_small"
from icons.html
The commit imports icon_small in macros.html to fix the issue.
It works because the macros in macros.html are imported with the Jinja2 context.
See https://jinja.palletsprojects.com/en/3.0.x/templates/#import-visibility
close #819
2022-01-25 22:03:21 +01:00
10c9b9775d
[mod] improve setup of invidious engine
...
- My experience is, that a timeout of 5 sec is not need, I got fast response
less than a second.
- https://invidious.tube/ redirects to http://ww25.invidious.tube/
- in SearXNG defaults the http protocol is unsafe and raise an error
- https://ww25.invidious.tube has SSL_ERROR_UNSAFE_NEGOTIATION
Related-to: https://github.com/searxng/searxng/issues/821
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-25 19:02:11 +01:00
81453a0eba
Merge pull request #811 from return42/enh-788
...
[mod] configuration to overwrite engine description
2022-01-25 06:55:12 +01:00
576eab04d2
Merge pull request #802 from MontyQI/Icon-update
...
Changed preferences icon to settings icon in gruntfile
2022-01-24 22:05:55 +01:00
1311745f24
move WolframAlpha away from Science category
2022-01-23 23:24:02 -06:00
e0b284e427
[mod] configuration to overwrite engine description
...
Engine description can be configured, this is needed e.g. by custom search
engines. Here is an example of a command engine with a description in the about
section::
- name: locate
engine: command
command: ['locate', '{{QUERY}}']
disabled: true
categories: files
about:
description: local files
website: 'https://www.man7.org/linux/man-pages/man1/locate.1.html '
delimiter:
chars: ' '
keys: ['line']
Closes: https://github.com/searxng/searxng/issues/788
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-23 20:55:14 +01:00
61853aa0fb
Merge pull request #799 from return42/brave-complete
...
Add autocompleter from Brave
2022-01-23 19:23:06 +01:00
e9588b70a6
[fix] brave autocompleter: charset_normalizer issues
...
Use httpx.Response.json() to avoid charset_normalizer issues:
DEBUG charset_normalizer : override steps (5) and chunk_size (512) as content does not fit (153 byte(s) given) parameters.
INFO charset_normalizer : ascii passed initial chaos probing. Mean measured chaos is 0.000000 %
DEBUG charset_normalizer : ascii should target any language(s) of ['Latin Based']
INFO charset_normalizer : ascii is most likely the one. Stopping the process.
[1] https://www.python-httpx.org/api/#response
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-23 17:22:13 +01:00
9c5bac4c43
[pylint] searx/autocomplete.py
...
Fix remarks from pylint, BTW set SPDX-License-Identifier.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-23 09:12:03 +01:00
105c5a6a98
[help] stop rendering documentation with Jinja2
...
To facilitate translation of the user documentation we move
the templating logic outside of the user documentation.
2022-01-23 08:01:55 +01:00
284ac8bfd8
[help] convert about.html to Markdown
...
To facilitate translation the new user documentation shall be written in
Markdown (which is more human-friendly than HTML and reStructuredText).
2022-01-23 08:01:55 +01:00
05149db4c1
[help] render user documentation once on startup
...
Currently we have two kinds of user documentation:
* the about page[1] which is written in HTML and part of the web
application and can therefore link instance-specific pages
(like e.g. the preferences) via Jinja variables
* the Sphinx documentation[2] which is written in reStructuredText
and cannot link instance-specific pages since it doesn't know
which instance the user is using
The plan is to integrate the user documentation currently in Sphinx
into the application, so that it can also link instance specific pages.
We also want to enable the user documentation to be translated.
This commit implements the first step in this endeavor (see #722 ).
[1]: searx/templates/__common__/about.html
[2]: docs/user/ (currently served at https://docs.searxng.org/user/ )
2022-01-23 08:01:55 +01:00
382f4f8fb0
Merge pull request #801 from dalf/fix-checker
...
[fix] checker: fix image fetch
2022-01-22 19:29:29 +01:00
80530befdc
[build] /static
2022-01-22 17:23:43 +01:00
91ca5d1613
Changed preferences icon to settings icon in gruntfile
2022-01-22 17:14:19 +01:00
5439dd5fb1
[fix] checker: fix image fetch
...
Since https://github.com/searxng/searxng/pull/354
the searx.network.stream(...) returns a tuple
This commits update the checker code according to
this function signature change.
2022-01-22 16:11:42 +01:00
f01ddd1932
Merge pull request #775 from return42/redis-4.1.1
...
Revert "[hotfix] interim fix to get docker-build of CI without issues"
2022-01-22 15:56:15 +01:00
b8c98c4c0d
[enh] Add autocompleter from Brave
...
Raw response example: https://search.brave.com/api/suggest?q=how%20to:%20with%20j
Headers are needed in order to get a 200 response, thus Searx user-agent is used.
Other URL param could be '&rich=false' or '&rich=true'.
Cherry-pick: 71786bf9cb
2022-01-21 14:39:10 +01:00
9b3122a84e
[translations] update from Weblate
...
f3f70b7dc66d23fbc2b9f7f7159ec4168184a23bc4b476d4eaf18ed5e7fec15699368a91a8b23af97af1ba210af5a3eea448183bea4f95cf2f3e7ac9c28ae5a8b664bd3b
2022-01-21 07:16:40 +00:00
96a1f79c6d
Merge pull request #773 from not-my-profile/typing
...
More typing
2022-01-18 16:28:32 +01:00
1a0760c10a
[fix] googel engine - "some results are invalids: invalid content"
...
Fix google issues listet in the `/stats?engine=google` and message::
some results are invalids: invalid content
The log is::
DEBUG searx : result: invalid content: {'url': 'https://de.wikipedia.org/wiki/Foo ', 'title': 'Foo - Wikipedia', 'content': None, 'engine': 'google'}
WARNING searx.engines.google : ErrorContext('searx/search/processors/abstract.py', 111, 'result_container.extend(self.engine_name, search_results)', None, 'some results are invalids: invalid content', ()) True
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-18 13:23:35 +01:00
f0102a95c9
[fix] google engine: remove adds and fix mobile_ui selector
...
1. Fix issue reported in comment [1]
2. Fix XPath selector for the response of google's mobile UI, reported in
comment [2]
[1] https://github.com/searxng/searxng/pull/777#issuecomment-1015121322
[2] https://github.com/searxng/searxng/pull/777#issuecomment-1015236238
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-18 11:05:45 +01:00
b972df255a
Merge pull request #776 from mrpaulblack/simple-ltr-vars
...
[simple theme] dont hardcode border radius
2022-01-18 07:56:03 +01:00
6670063e0d
Update XPath for Google engine
2022-01-17 21:49:57 +00:00
6c1a64d4b3
[build] /static
2022-01-17 22:35:22 +01:00
7a0f5e6b19
[simple theme] dynamic border radius in CSS
2022-01-17 22:35:02 +01:00
e85744c254
Revert "[hotfix] interim fix to get docker-build of CI without issues"
...
This reverts interim fix from commit 50c4b58dbhttps://github.com/redis/redis-py/issues/1869
[2] https://github.com/redis/redis-py/commit/1fc1233f
[3] https://github.com/redis/redis-py/pull/1854
[4] https://github.com/redis/redis-py/issues/1880
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-17 18:03:29 +01:00
96655cbd4e
[typing] add type hints to webapp.py
2022-01-17 11:42:48 +01:00
193b0efd12
[typing] add results.UnresponsiveEngine
2022-01-17 11:42:48 +01:00
0c6a09cae3
[refactor] remove never used parameter
2022-01-17 11:42:48 +01:00
def62c3a47
[typing] add type hints for dictionaries
2022-01-17 11:42:48 +01:00
6d43cf7952
[typing] add optional attrs to Plugin
2022-01-17 11:42:48 +01:00
fdf562bc32
[typing] add results.Timing
2022-01-17 11:42:48 +01:00
1ed618222f
[typing] add ExtendedRequest
...
webapp.py monkey-patches the Flask request global.
This commit adds a type cast so that e.g. Pyright[1]
doesn't show "Cannot access member" errors everywhere.
[1]: https://github.com/microsoft/pyright
2022-01-17 11:18:17 +01:00
0c036ae294
Merge pull request #750 from dalf/simple-rtl
...
Simple theme: implement RTL
2022-01-16 20:29:34 +01:00
e07417848f
Merge pull request #695 from return42/fix-sp
...
[fix] startpage engine / modified API
2022-01-16 20:27:36 +01:00
Martin Fischer