eaa694fb7d
[enh] replace requests by httpx
2021-04-10 15:38:33 +02:00
111180705b
[fix] test: avoid HTTP requests
...
patch engine initialization to skip HTTP request
(engine_init function in searx.engines.initialize_engines)
2021-04-10 15:38:27 +02:00
44f4a9d49a
[enh] add ability to send engine data to subsequent requests
2021-03-06 12:12:35 +01:00
aaae9a209e
Merge pull request #2600 from dalf/searx-extra
...
Add searx_extra package
2021-03-05 09:43:39 +01:00
b8cd326464
Add searx_extra package
...
Split the utils directory into:
* searx_extra contains update scripts, standalone_searx.py
* utils contains the files to build and setup searx.
2021-03-04 11:59:14 +01:00
63f17d2e4c
[enh] autocomplete refactoring, autocomplete on external bangs
2021-03-01 19:12:32 +01:00
7c1847d5f2
[mod] add utils/fetch_external_bangs.py
...
Based on duckduckgo bangs
Store bangs on a trie to allow autocomplete (not in this commit)
2021-02-24 18:48:36 +01:00
138f32471c
Updated webutils.highlight_content to ignore double-quotes when highlighting query parts
2021-02-08 23:58:54 -05:00
c937a9e85f
[fix] get correct locale with country from browser
...
Some of our interface locales include uppercase country codes,
which are separated by `_` instead of the more common `-`.
Also, a browser's `Accept-Language` header could be in lowercase.
This commit attempts to normalize those cases so a browser's
language+country codes can better match with our locales.
This solution assumes that our UI locales have nothing more than
language and optionally country. If we ever add a script specific
locale like `zh-Hant-TW` this would have to change to accomodate
that, but the idea would be pretty much the same as this fix.
2021-02-04 19:53:59 -07:00
571ce9ff07
fix empty colon in query from selecting Chinese
2021-01-09 22:11:41 -07:00
eda8934f15
[mod] searx.search.EngineRef: remove from_bang parameter
...
from_bang is True when the user query contains a bang.
In this case the category is also set to 'none'.
from_bang only usage was in searx.webadapter.parse_specific :
if from_bang is True, then the EngineRef category is ignored and force to 'none'.
This commit also removes the searx.webadapter.parse_sepecific function.
2020-12-18 12:29:48 +01:00
995ba2f406
[mod] searx.search.SearchQuery: remove categories parameter
...
The categories parameter is useless in the constructor:
it is always the categories from the EngineRef.
The categories becomes a property.
2020-12-18 12:29:48 +01:00
7ec8bc3ea7
[mod] split searx.search into different processors
...
see searx.search.processors.abstract.EngineProcessor
First the method searx call the get_params method.
If the return value is not None, then the searx call the method search.
2020-12-17 11:39:36 +01:00
9bc1856e2b
[mod] themes: remove legacy, courgette and pix-art themes
2020-12-17 11:33:28 +01:00
d0d7a3e1c2
[fix] settings_loader: don't crash when a key exists only in the user settings
...
typical use case: result_proxy can be defined in the user settings,
but are not defined the default settings.yml
2020-12-03 11:35:12 +01:00
1d0c368746
[enh] record details exception per engine
...
add an new API /stats/errors
2020-12-03 10:22:48 +01:00
b00d108673
[mod] pylint: numerous minor code fixes
2020-12-01 15:21:19 +01:00
b7f1a8424a
[fix] tests: fix duplicate method name
2020-12-01 15:07:09 +01:00
a302ac5629
[mod] remove dead code
2020-12-01 15:07:09 +01:00
b4b81a5e1a
[enh] settings.yml: add use_default_settings option (2nd version)
2020-11-27 19:40:04 +01:00
3786920df9
[enh] Add multiple outgoing proxies
...
credits go to @bauruine see https://github.com/searx/searx/pull/1958
2020-11-20 15:29:21 +01:00
9c25cd99c4
[mod] use github actions instead of travis
...
fix https://github.com/searx/searx/issues/2279
2020-11-17 15:09:06 +01:00
230a5ecd04
[fix] fix a test_standalone_searx test case
...
If test_engines_init.py runs before test_standalone_searx.py, the engine list is not empty.
It makes test_get_search_query flaky.
This commit initializes the engline list in test_standalone_searx.py
2020-11-17 10:39:44 +01:00
3038052c79
[mod] remove unused import
...
use
from searx.engines.duckduckgo import _fetch_supported_languages, supported_languages_url # NOQA
so it is possible to easily remove all unused import using autoflake:
autoflake --in-place --recursive --remove-all-unused-imports searx tests
2020-11-14 14:11:02 +01:00
e1bd617669
Merge pull request #2296 from rachmadaniHaryono/feature/suppress-output
...
suppress test output
2020-11-14 13:45:32 +01:00
46b454277f
Merge pull request #2309 from dalf/mod_search_repr
...
[mod] searx.search: EngineRef, SearchQuery: add __repr__ and __eq__ methods
2020-11-14 13:23:44 +01:00
8fc74d0d7b
[mod] searx.search: EngineRef, SearchQuery: add __repr__ and __eq__ methods
2020-11-10 10:45:40 +01:00
b3a3ccf2db
[fix] fix of / and /search
...
* URL / : the index page displayed the selected or the default category.
* URL / : when the q parameter is set using the URL, the redirect includes the URL query.
* URL /search : an empty query doesn't raise an exception.
2020-11-06 12:11:52 +01:00
4d4b6750bc
chg: test: suppress output
2020-11-05 07:15:29 +08:00
c03e4c86bc
Feature/standalone searx update ( #1591 )
...
* chg: dev: update standalone_searx
parent d8a5df721b33dd8a7cc9e21dba4060f21d629f69
author rachmadaniHaryono <foreturiga@gmail.com> 1603896594 +0800
committer rachmadaniHaryono <foreturiga@gmail.com> 1603896619 +0800
chg: dev: debug engine_shortcuts
chg: dev: only initilize if engine is given
chg: dev: split main
chg: dev: standalone_searx
chg: dev: update standalone_searx
chg: doc: remove unnecessary log
chg: test: differentiate travis
chg: test: disable shortcut
chg: test: use default engine settings
fix: dev: category choices
fix: dev: duplicate engine shortcut
fix: dev: travis python3
fix: test: use empty string as shortcut
fix: test: apkm
fix: test: engine shortcut
fix: test: mypy
fix: test: parameter
fix: test: pep8
fix: test: py2 compatibilities
fix: test: searx settings
fix: test: travis engines
new: dev: deduplicate engine
new: dev: main receive engines parameter
new: dev: parse_argument accept engines parameter
new: dev: split search query from get_result func
new: test: basic result case
Suggestions: use RawTextQuery to make the suggestions URLs. Update all themes accordingly.
* new: doc: searx import and init
* chg: dev: parse_argument
- doc
- run on __main__
- simple parse_args
* chg: doc: module
* chg: dev: import section
- remove unused python path modification
- new required package
* chg: dev: script run
- parse_argument func return directly parsed results
- main func return dict instead json text
- dump directly on sys.stdout.write
* chg: dev: get_search_query and get_search_query func
* chg: dev: main func
- move inner function outside
- return dict instead of json text
* new: dev: add utils to doc sys path
* new: doc: standalone_searx
* fix: doc: run script
* chg: dev: mypy type hint
* chg: dev: SearchQuery don't have attr engines
* chg: dev: reset engines __init__
* chg: test: unit test update
* chg: dev: pylint and flake8
* new: test: standalone_searx
* chg: dev: main func and doc
* chg: dev: import and type hint
* new: dev: main func
- remove get_result func
- single func which just translate dict
* chg: test: put mypy on dev requirement
* chg: doc: update
* new: doc: add standalone_searx module member
* chg: doc: shell command line
* chg: dev: remove mypy
* chg: doc: module docstring
2020-11-04 12:38:54 +00:00
8d71420b45
[mod] separate index and search routes
...
This makes it easier to separately handle search and index requests
from a web server or from a reverse proxy.
If a request to index contains a query, a permanent redirect HTTP response
is returned. This should give some level of backwards compatibility
for users that have set a searx instance in their browser's search bar.
2020-11-02 20:04:03 -07:00
db703a0283
Merge pull request #565 from MarcAbonce/onions
...
New category: Onions
2020-10-26 14:20:58 +01:00
2aef38c3b9
[fix] resolve query_parts regression
2020-10-26 14:15:59 +01:00
c3daa08537
[enh] Add onions category with Ahmia, Not Evil and Torch
...
Xpath engine and results template changed to account for the fact that
archive.org doesn't cache .onions, though some onion engines migth have
their own cache.
Disabled by default. Can be enabled by setting the SOCKS proxies to
wherever Tor is listening and setting using_tor_proxy as True.
Requires Tor and updating packages.
To avoid manually adding the timeout on each engine, you can set
extra_proxy_timeout to account for Tor's (or whatever proxy used) extra
time.
2020-10-25 17:59:05 -07:00
33e139cae6
Let admins lock user preferences
2020-10-25 18:06:18 +01:00
6beb84efb8
[fix] adjust query unit tests
2020-10-25 18:03:28 +01:00
35577051e2
[fix] hash plugin test
2020-10-24 10:25:33 +02:00
69e5a58058
[fix] code style
2020-10-23 21:26:42 +02:00
c9593c8ffd
[enh] add plugin converting strings into hash digests
2020-10-23 21:25:10 +02:00
116f7a6daa
Force admins to set secret_key if debug mode is disabled
...
This commit also enables debug mode for unit tests.
2020-10-09 18:31:42 +02:00
2006eb4680
[mod] move extract_text, extract_url to searx.utils
2020-10-02 18:13:56 +02:00
485a502b88
[mod] add typing and __slots__
2020-09-22 19:05:05 +02:00
691d12726b
[mod] check the engine tokens in searx/webadapter.py instead of searx/search.py
2020-09-22 18:59:51 +02:00
2929495112
[mod] add searx.search.EngineRef
...
was previously a Dict with two or three keys: name, category, from_bang
make clear that this is a engine reference (see tests/unit/test_search.py for example)
all variables using this class are renamed accordingly.
2020-09-22 18:59:51 +02:00
2dbc0de0cd
[mod] add searx/webadapter.py
...
* move searx.search.get_search_query_from_webapp to searx.webadapter
* move searx.query.SearchQuery to searx.search
2020-09-22 18:59:51 +02:00
ad0758e52a
[mod] add searx/webutils.py
...
contains utility functions and classes used only by webapp.py
2020-09-22 11:57:06 +02:00
6deb85072a
[fix] searx.utils.HTMLTextExtractor: invalid HTML don't raise an Exception
...
Close #2188
2020-09-13 10:28:11 +02:00
df12ed6e55
[mod] searx.RawTextQuery: the constructor call parse_query
2020-09-12 15:25:58 +02:00
c225db45c8
Drop Python 2 (4/n): SearchQuery.query is a str instead of bytes
2020-09-10 10:49:42 +02:00
7888377743
Drop Python 2 (3/n): objects
2020-09-10 10:39:04 +02:00
Alexandre Flament