8f914a28fa
[mod] searx.utils.normalize_url: remove Yahoo hack
...
* The hack for Yahoo URLs is not necessary anymore. (see searx.engines.yahoo.parse_url)
* move the URL normalization in extract_url to normalize_url
2020-10-03 10:02:50 +02:00
c1d10bde02
[mod] searx/utils.py: add docstring
2020-10-02 18:17:01 +02:00
2006eb4680
[mod] move extract_text, extract_url to searx.utils
2020-10-02 18:13:56 +02:00
ecb9f28869
Merge pull request #2236 from return42/fix-2234
...
[fix] google engine - div classes has been renamed in HTML result
2020-10-01 10:11:19 +02:00
8162d7aff4
[fix] google engine - div classes has been renamed in HTML reult
...
Since 1. October 2020 google has changed the 'class' attribute of the HTML
result page.
Fix the xpath expressions and ignore <div class="g" ../> sections which do not
match to title's xpath expression.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-10-01 09:44:29 +02:00
fd5fe36984
Merge pull request #2232 from dalf/fix-sphinx-build2
...
[fix] Sphinx 3.2.1 build: call searx.engines.initialize_engines
2020-09-30 10:29:28 +02:00
9a856083df
[fix] Sphinx 3.2.1 build: call searx.engines.initialize_engines
...
Fix admin/engines.html
Fix #2230
2020-09-30 10:20:12 +02:00
6c6985aaf8
Merge pull request #2230 from dalf/fix-sphinx-build
...
[fix] Sphinx 3.2.1 build: add missing "engines" variable in the jinja context
2020-09-30 09:29:09 +02:00
9740618227
Merge pull request #2226 from dalf/fix-searx-migration
...
[fix] migration from github.com/asciimoo/searx to github.com/searx/searx : fix URLs
2020-09-29 12:35:11 +02:00
6d56c754a7
[fix] Sphinx 3.2.1 build: add missing "engines" variable in the jinja context
...
Fix the admin/engines.html page
2020-09-29 12:30:10 +02:00
246b8cd1a4
[fix] about.html: fix small inconsistencies in about page ( #2219 )
2020-09-28 16:56:25 +02:00
f204e4903d
[fix] migration from github.com/asciimoo/searx to github.com/searx/searx : fix URLs
2020-09-28 16:44:14 +02:00
8d47142f35
Merge pull request #2189 from dalf/architecture-clean-up
...
Architecture clean up
2020-09-28 14:56:23 +02:00
c2a6f14516
[fix] Update Sphinx package versions
...
* Update call to sphinx-autobuild (remove --poll -B options, add --open-browser)
* Upgrade the Sphinx and sphinx-tabs versions.
* utils/makefile.sphinx: remove the SPHINXVERS variable.
* utils/makefile.sphinx: remove the sphinx-doc and sphinx-live targets, Sphinx is already installed by the pyenvinstall target.
2020-09-28 13:27:50 +02:00
9d60ae1ce6
[fix] missing 'alias' typo in docs/admin/installation-nginx.rst
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-09-28 11:40:45 +02:00
93f7f7eee2
[mod] upgrade requests to version 2.24.0. use ssl instead of pyopenssl.
...
requests 2.24.0 uses the ssl module except if it doesn't support SNI, in this case searx fallbacks to pyopenssl.
searx logs a critical message and exit if the ssl modules doesn't support SNI and pyOpenSSL is not installed.
searx logs a critical message and exit if the ssl version is older than 1.0.2.
in requirements.txt, pyopenssl is still required to install searx as a fallback.
2020-09-26 19:30:27 +02:00
f2f3300bde
[mod] more typing
2020-09-24 16:26:00 +02:00
485a502b88
[mod] add typing and __slots__
2020-09-22 19:05:05 +02:00
678699beaf
[mod] searx/webadapter.py: add get_selected_categories share common code with get_search_query_from_webapp
...
Update searx/webapp.py to use get_selected_categories
Close #2142
2020-09-22 18:59:51 +02:00
d5b5e48f04
[mod] searx/webadapter.py: each web parameter has a dedicated function (parse_pageno, page_lang,....).
2020-09-22 18:59:51 +02:00
691d12726b
[mod] check the engine tokens in searx/webadapter.py instead of searx/search.py
2020-09-22 18:59:51 +02:00
eecfff2689
[mod] check time_range parameter in searx/webadapter.py
2020-09-22 18:59:51 +02:00
2929495112
[mod] add searx.search.EngineRef
...
was previously a Dict with two or three keys: name, category, from_bang
make clear that this is a engine reference (see tests/unit/test_search.py for example)
all variables using this class are renamed accordingly.
2020-09-22 18:59:51 +02:00
2dbc0de0cd
[mod] add searx/webadapter.py
...
* move searx.search.get_search_query_from_webapp to searx.webadapter
* move searx.query.SearchQuery to searx.search
2020-09-22 18:59:51 +02:00
21dbc7e852
"Egde" → "Edge"
2020-09-22 17:44:32 +02:00
e8df5d3f7f
[mod] searx.search: change function declaration: online then offline then utility functions.
2020-09-22 12:36:26 +02:00
50e717c452
[mod] searx.search: remove unused global variable number_of_searches
2020-09-22 12:36:26 +02:00
edd8dccd07
[mod] searx.query.RawTextQuery: getSearchQuery and changeSearchQuery rename to getQuery and changeQuery
...
getSearchQuery is confusing, the method returns a str not a SearchQuery object
2020-09-22 12:36:26 +02:00
c4067a9d02
[mod] searx.search.Search: split the search method into different methods
2020-09-22 12:14:46 +02:00
ad0758e52a
[mod] add searx/webutils.py
...
contains utility functions and classes used only by webapp.py
2020-09-22 11:57:06 +02:00
f9664037a6
[mod] refactor searx.webapp.get_locale
...
* Log each call to get_locale: display the URL, the locale and the source (browser, preferences, form).
* Rename _get_browser_language to _get_browser_or_settings_language to match the actual code.
2020-09-22 11:49:15 +02:00
2fd582d457
[fix] /autocompleter: return HTTP 400 when q is empty as intent.
...
Fix commit c225db45c8
2020-09-22 11:38:37 +02:00
ecf5899153
fetch google's search langs rather than ui langs
2020-09-22 11:37:44 +02:00
c86504b47a
fix utils/fetch_languages to work with new languages
2020-09-22 11:37:44 +02:00
41800835f9
fetch supported languages for startpage engine
2020-09-22 11:37:44 +02:00
ea9d979cc3
add language names in qwant's fetch languages function
2020-09-22 11:37:44 +02:00
e0142d380e
Merge pull request #2211 from return42/fix-centos-7
...
Bugfix of: ERROR: centos-: uWSGI not yet implemented
2020-09-21 09:06:20 +02:00
69a61ce333
[fix] remove doc-build for centos-7 from './utils/searx.sh doc'
...
Since there is no centos-7 documentation 'searx.sh doc' produce an error
message::
ERROR: centos-: uWSGI not yet implemented
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-09-20 11:11:14 +02:00
4cc8644ec9
Merge pull request #1865 from dalf/uwsgi_static
...
[enh] Docker image: uwsgi serves the static files directly.
2020-09-19 16:04:07 +02:00
375cbd12b3
Merge pull request #2205 from dalf/fix-simple-theme-autocomplete
...
[fix] simple theme: fix autocomplete
2020-09-19 16:02:01 +02:00
530fc4bda7
Merge pull request #2190 from dalf/fix-htmltextextractor
...
[fix] searx.utils.HTMLTextExtractor: invalid HTML don't raise an Exception
2020-09-19 15:59:03 +02:00
c23401e9fa
[fix] simple theme: fix autocomplete
...
AJAX requests send the X-Requested-With HTTP header,
so searx.webapp.autocompleter returns the results with the expected data format.
Related to #2127
Close #2203
2020-09-19 10:13:05 +02:00
6deb85072a
[fix] searx.utils.HTMLTextExtractor: invalid HTML don't raise an Exception
...
Close #2188
2020-09-13 10:28:11 +02:00
ae07f4a211
Merge pull request #2185 from dalf/rawtextquery-auto-parse
...
[mod] searx.RawTextQuery: the constructor call parse_query
2020-09-12 15:33:03 +02:00
df12ed6e55
[mod] searx.RawTextQuery: the constructor call parse_query
2020-09-12 15:25:58 +02:00
2370234d09
Merge pull request #2137 from dalf/drop-python-2
...
Drop Python 2
2020-09-12 14:51:35 +02:00
bdac99d4f0
Drop Python 2 (5/n): searx.utils.is_valid_lang, input parameter is a str instead of bytes
...
Fix bug in translated.py and dictzone.py
2020-09-10 10:49:42 +02:00
c225db45c8
Drop Python 2 (4/n): SearchQuery.query is a str instead of bytes
2020-09-10 10:49:42 +02:00
7888377743
Drop Python 2 (3/n): objects
2020-09-10 10:39:04 +02:00
78df10fb55
Drop Python 2 (2/n): templates
2020-09-10 10:39:04 +02:00
Alexandre Flament