searxng

Commit Graph

Author	SHA1	Message	Date
Alexandre Flament	51494849fc	Merge pull request #23 from searxng/metrics-stats-engines Metrics stats engines	2021-04-25 14:31:52 +02:00
Alexandre Flament	df41b77121	[mod] /stats : detail per engine allow to submit a github issue including the technical details (exceptions, errors, warning, checker result)	2021-04-25 14:28:06 +02:00
Markus Heiser	28b25185c5	[brand] searxng -- fix links to issue tracker & WEB-GUI Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-25 14:25:08 +02:00
Markus Heiser	c6a5cc019a	[brand] searxng is a fork from searx Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-25 11:42:42 +02:00
Markus Heiser	6d41255eb1	[fix] Springer-Nature & core.ac need API key to work It is the whole engine definition that should be comment out : without the api_key nothing works. Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-04-24 09:00:53 +02:00
Markus Heiser	8efabd3ab7	[mod] core.ac.uk engine - add to list of pylint scripts - add debug log messages - move API key int `settings.yml` - improved readability - add some metadata to results Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-04-24 09:00:53 +02:00
spongebob33	7528e38c8a	add core.ac.uk engine	2021-04-24 08:55:45 +02:00
Alexandre Flament	525bfe7830	Fix PEP8	2021-04-24 07:19:44 +02:00
Alexandre Flament	7032f7521c	[mod] /stats: simple theme implementation	2021-04-24 06:58:49 +02:00
Alexandre Flament	09e7ecdce2	[mod] /stats : add reliability column and sort by column links	2021-04-24 06:58:49 +02:00
Markus Heiser	c54bf42cb9	[mod] metrics: add to pylint and justify indentations Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-24 06:58:49 +02:00
Alexandre Flament	65c29081cc	[mod] update /stats	2021-04-24 06:58:22 +02:00
Alexandre Flament	3755cf2eba	More branding	2021-04-22 21:10:22 +02:00
Alexandre Flament	04b34c70b8	More branding	2021-04-22 20:14:16 +02:00
Alexandre Flament	9d84025e4f	searxng brand	2021-04-22 19:57:02 +02:00
Alexandre Flament	d01741c9a2	Merge pull request #15 from return42/add-springer Add a search engine for Springer Nature	2021-04-22 13:23:31 +02:00
Markus Heiser	213041adc7	[enh] themes - add result.metadata to result sub header Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-04-22 12:37:18 +02:00
Pierre Chevalier	a80bf1ba97	[enh] Add Springer Nature engine Springer Nature is a global publisher dedicated to providing service to research community [1] with official API [2]. To test this PR, first get your API key following this page: https://dev.springernature.com/signup In searx/engines/springer.py at line 24, add this API key. I left my own key, commented out in the line aboce. Feel free to use it, if needed. [1] https://www.springernature.com/ [2] https://dev.springernature.com/	2021-04-22 12:35:25 +02:00
habsinn	41a2e3785e	[enh] add engine using API from "The Art Institute of Chicago"	2021-04-22 12:25:43 +02:00
Alexandre Flament	981cdb7acf	Merge pull request #10 from return42/fix-youtube [fix] youtube - send CONSENT Cookie to not be redirected	2021-04-22 12:21:31 +02:00
Markus Heiser	9a05ad4c73	[enh] add DOI resolver from sci-hub / replace default DOI The new sci-hub URLs are comming from @aurora-vasiliev [1]. [1] https://github.com/searx/searx/pull/2706 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-22 12:13:01 +02:00
Markus Heiser	e9a6ab4015	[fix] youtube - send CONSENT Cookie to not be redirected In the EU there exists a "General Data Protection Regulation" [1] aka GDPR (BTW: very user friendly!) which requires consent to tracking. To get the consent from the user, youtube requests are redirected to confirm and get a CONSENT Cookie from https://consent.youtube.com This patch adds a CONSENT Cookie to the youtube request to avoid redirection. [1] https://en.wikipedia.org/wiki/General_Data_Protection_Regulation Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> Reported-by: https://github.com/searx/searx/issues/2774	2021-04-22 12:09:09 +02:00
Markus Heiser	247c46c6b0	[drop] plugin HTTPS rewrite - rule base is to old (update is to big) The usefulness of the _HTTPS rewrite_ plugin is questionable: - the 36 rule files have not been updated since 2015 [1] - actual there are 23760 rule files in the https-everywhere repo [2] For the first, we can remove this plugin. For a complete new implementation, it might be good to know that there is a project "https-everywhere : Privacy for Pythons" [3] related: https://github.com/return42/searx-next/issues/8 [1] https://github.com/return42/searx-next/tree/d187a1d/searx/plugins/https_rules [2] https://github.com/EFForg/https-everywhere/tree/master/src/chrome/content/rules [3] https://github.com/jayvdb/https-everywhere-py Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-22 11:47:16 +02:00
Alexandre Flament	c6d5605d27	Merge pull request #7 from searxng/metrics Metrics	2021-04-22 08:34:17 +02:00
Alexandre Flament	baff1cbbab	fix issues from review	2021-04-21 18:49:13 +02:00
Alexandre Flament	b7848e3422	[fix] searxng fix: sjp engine	2021-04-21 16:31:29 +02:00
Alexandre Flament	7cfd8d900a	[mod] oscar: /preferences , engines tab: report engine times * display the median time instead of the average. * add a "Reliability" column (sum up the metrics and the checker results). * the "selected language", "SafeSearch", "Time range" values are displayed as "broken" when the checker tests fail.	2021-04-21 16:24:46 +02:00
Alexandre Flament	c27fef1cde	[mod] metrics: add secondary parameter Some error won't stop the engine: * additional HTTP redirects for example * some invalid results secondary=True allows to flag these errors as not important.	2021-04-21 16:24:46 +02:00
Alexandre Flament	7acd7ffc02	[enh] rewrite and enhance metrics	2021-04-21 16:24:46 +02:00
Alexandre Flament	aae7830d14	[mod] refactoring: processors Report to the user suspended engines. searx.search.processor.abstract: * manages suspend time (per network). * reports suspended time to the ResultContainer (method extend_container_if_suspended) * adds the results to the ResultContainer (method extend_container) * handles exceptions (method handle_exception)	2021-04-21 16:24:46 +02:00
Alexandre Flament	ae5954f2da	Merge remote-tracking branch 'return42/fix-preference-save'	2021-04-21 16:24:22 +02:00
Alexandre Flament	624d3ec6db	Merge remote-tracking branch 'return42/fix-url-bar-suggestion'	2021-04-21 16:23:52 +02:00
Alexandre Flament	92db0227b1	Merge remote-tracking branch 'dalf/oscar-images'	2021-04-19 09:36:54 +02:00
Alexandre Flament	48720e20a8	Merge remote-tracking branch 'searx/master'	2021-04-19 09:35:12 +02:00
Noémi Ványi	8362257b9a	Merge pull request #2736 from plague-doctor/sjp Add new engine: SJP - Słownik języka polskiego	2021-04-16 17:30:14 +02:00
Noémi Ványi	e56323d3c8	Merge pull request #2759 from ypid/fix/typo Fix grammar mistake in debug log output	2021-04-16 17:26:45 +02:00
Plague Doctor	d275d7a35e	Code refactoring.	2021-04-16 12:23:27 +10:00
Markus Heiser	f637bfc635	[mod] oscar's "default" template should make use of result.thumbnail Some engine do have set result.img_src, other return a result.thumbnail. If result.img_src is unset and a result.thumbnail is given, show it to the UI. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-15 08:52:11 +02:00
Markus Heiser	062d589f86	[fix] xpath expressions to grap all items from bandcamp's response I also found some items missing a thumbnail and I used text_extract for content and title, to remove unneeded whitespaces. BTW: added bandcamp's favicon Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-15 08:52:11 +02:00
Kyle Anthony Williams	4d3c399ee9	[feat] add bandcamp engine	2021-04-15 08:52:11 +02:00
Alexandre Flament	d14994dc73	[httpx] replace searx.poolrequests by searx.network settings.yml: * outgoing.networks: * can contains network definition * propertiers: enable_http, verify, http2, max_connections, max_keepalive_connections, keepalive_expiry, local_addresses, support_ipv4, support_ipv6, proxies, max_redirects, retries * retries: 0 by default, number of times searx retries to send the HTTP request (using different IP & proxy each time) * local_addresses can be "192.168.0.1/24" (it supports IPv6) * support_ipv4 & support_ipv6: both True by default see https://github.com/searx/searx/pull/1034 * each engine can define a "network" section: * either a full network description * either reference an existing network * all HTTP requests of engine use the same HTTP configuration (it was not the case before, see proxy configuration in master)	2021-04-12 17:25:56 +02:00
Markus Heiser	c4793afadc	[fix] https-scheme missing in preferences-page This patch is an addition to PR #2656 which removed all usage of `base_url` from the templates, except one was forgotten in the cookie URL of the preferences. closes: 2740 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-12 16:02:16 +02:00
Markus Heiser	2bf297b19f	[fix] redirect when saving preferences Erroneously commit `87e4c4762` droped the 302 redirect. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-12 15:29:08 +02:00
Robin Schneider	dfc66ff0f0	Fix grammar mistake in debug log output	2021-04-11 22:12:53 +02:00
Alexandre Flament	eaa694fb7d	[enh] replace requests by httpx	2021-04-10 15:38:33 +02:00
Plague Doctor	599ff39ddf	Fix conflicts	2021-04-09 06:54:03 +10:00
Noémi Ványi	cc359345a8	Merge pull request #2735 from plague-doctor/wordnik Add new engine: Wordnik.com	2021-04-08 19:48:13 +02:00
Plague Doctor	6631f11305	Add new engine: SJP	2021-04-08 10:21:54 +10:00
Plague Doctor	7035bed4ee	Add new engine: Wordnik.com	2021-04-08 09:58:00 +10:00
Alexandre Flament	c09ff4faf2	[fix] fix PR 2656 SCRIPT_NAME remove trailing slash to avoid infinite redirect	2021-04-07 13:05:55 +02:00
Noémi Ványi	07f5edce3d	Add Meilisearch engine Website: https://www.meilisearch.com/	2021-04-06 21:57:05 +02:00
Noémi Ványi	a477a3a687	Merge pull request #2728 from return42/fix-loader [fix] settings_loader.py - use update_dict only for mapping types	2021-04-05 21:32:41 +02:00
3nprob	2ca0aa4f29	Remove hubsbpot tracking URL params More information here: https://knowledge.hubspot.com/settings/how-do-i-create-a-tracking-url https://knowledge.hubspot.com/ads/ad-tracking-in-hubspot https://knowledge.hubspot.com/ctas/calls-to-action-frequently-asked-questions https://meta.stackexchange.com/questions/263392/what-are-these-very-long-parameters-in-so-careers-feedback-always-welcome-url	2021-04-06 02:11:09 +09:00
Markus Heiser	9c10b15096	[fix] settings_loader.py - use update_dict only for mapping types I can't set `default_doi_resolver` in `settings.yml` if I'm using `use_default_settings`. Searx seems to try to interpret all settings at root level in `settings.yml` as dict, which is correct except for `default_doi_resolver` which is at root level and a string:: File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 125, in load_settings update_settings(default_settings, user_settings) File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 61, in update_settings update_dict(default_settings[k], v) File "/usr/lib/python3.9/site-packages/searx/settings_loader.py", line 48, in update_dict for k, v in user_dict.items(): AttributeError: 'str' object has no attribute 'items' Signed-off-by: Markus Heiser <markus@darmarit.de> Suggested-by: @0xhtml https://github.com/searx/searx/issues/2722#issuecomment-813391659	2021-04-05 16:33:48 +02:00
Alexandre Flament	7089526723	Merge pull request #2656 from return42/fix-url_for [fix] url_for(..., _external=True) in templates	2021-04-05 14:50:39 +02:00
Markus Heiser	87e4c47621	[fix] url_for(..., _external=True) in templates The `url_for` function in the template context is not the one from Flask, it is the one from `webapp`. The `webapp.url_for_theme` is different from its namesake of Flask and has it quirks, when called with argument `_external=True`. The `webapp.url_for_theme` can't handle absolute URLs since it pokes a leading '/', here is the snippet of the old code:: url = url_for(endpoint, *values) if settings['server']['base_url']: if url.startswith('/'): url = url[1:] url = urljoin(settings['server']['base_url'], url) Next drawback of (Flask's) `_external=True` is, that it will not return the HTTP scheme when searx (the Flask app) listens on http and is proxied by a https server. To get the right scheme `HTTP_X_SCHEME` is needed by Flask (werkzeug). Since this is not provided in every environment (e.g. behind Apache mod_wsgi or the HTTP header is not fully set for some other reasons) it is recommended to get script_name, server* and scheme from the configured `base_url`. If `base_url` is specified, then these values from are given preference over any Flask's generics. BTW this patch normalize to use `url_for` in the `opensearch.xml` and drop the need of `host` and `urljoin` in template's context. Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-04-05 14:34:45 +02:00
Alexandre Flament	7a0fbdecc4	[enh] oscar: image thumbnail layout Adjust thumbnail sizes to fill the container width	2021-04-05 11:29:17 +02:00
Noémi Ványi	ba90c5a2e0	Merge pull request #2718 from return42/fix-publishedDate [fix] publishedDate: don't try to get date from empty string or None	2021-04-04 23:00:22 +02:00
Markus Heiser	ebfd0eb2b7	[fix] default_doi_resolver in preferences Instead of a hard-coded `oadoi.org` default, use the default value from `settings.yml`. Fix an issue in the themes: The replacement 'current_doi_resolver' contains the doi_resolver_url, not the name of the DOI resolver. Compare return value of:: searx.plugins.oa_doi_rewrite.get_doi_resolver(...) Fix a typo in `get_doi_resolver(..)`: suggested by @kvch: L32 should set doi_resolver not doi_resolvers Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-04 13:36:33 +02:00
Markus Heiser	c12826c6d5	[fix] publishedDate: don't try to get date from empty string or None Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-04-04 13:16:38 +02:00
Noémi Ványi	7612e5d9fd	Merge pull request #2712 from searx/update_data_update_firefox_version.py Update searx.data - update_firefox_version.py	2021-04-03 23:15:43 +02:00
Noémi Ványi	985e8b28fe	Merge pull request #2710 from searx/update_data_update_ahmia_blacklist.py Update searx.data - update_ahmia_blacklist.py	2021-04-03 23:02:44 +02:00
Noémi Ványi	feb2d81874	Merge pull request #2709 from searx/update_data_update_currencies.py Update searx.data - update_currencies.py	2021-04-03 23:02:26 +02:00
Noémi Ványi	9a962c5369	Merge pull request #2711 from searx/update_data_update_wikidata_units.py Update searx.data - update_wikidata_units.py	2021-04-03 23:01:43 +02:00
Noémi Ványi	5ca34ac571	Merge pull request #2713 from searx/update_data_update_languages.py Update searx.data - update_languages.py	2021-04-03 23:01:00 +02:00
Markus Heiser	169438137f	[fix] url bar autocomplete (opensearch suggestions) Since #2593 is merged the OpenSearch-Format is buggy. The loop in [1] will change raw_text_query object and this will change also the value of `raw_text_query.query` on every `raw_text_query.changeQuery(result)`. This patch fixes this issue by storing the initial query value in `sug_prefix`. [1] `ac0fdc3b96/searx/webapp.py (L804-L806)` OpenSearch-Format:: [ "<query>", [ "<term 1>", "<term 2>", ... "<term n>" ], [ "<content 1>", "<content 2>", ..., "<content n>" ], [ "<url 1>", "<url 2>", ..., "<url n>" ] ] - https://www.google.com/support/enterprise/static/gsa/docs/admin/current/gsa_doc_set/xml_reference/query_suggestion.html#1080002 - https://developer.mozilla.org/en-US/docs/Archive/Add-ons/Supporting_search_suggestions_in_search_plugins#implementing_search_suggestion_support_on_the_server Legacy-Format:: [ "<term 1>", "<term 2>", ..., "<term n>" ] - https://www.google.com/support/enterprise/static/gsa/docs/admin/current/gsa_doc_set/xml_reference/query_suggestion.html#1081079 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-04-03 18:18:50 +02:00
dalf	c0668d248e	Update searx.data - update_languages.py	2021-04-01 07:00:46 +00:00
dalf	ad74c42aa1	Update searx.data - update_firefox_version.py	2021-04-01 07:00:39 +00:00
dalf	23dc7ef6d1	Update searx.data - update_wikidata_units.py	2021-04-01 07:00:37 +00:00
dalf	eb5cd7a543	Update searx.data - update_ahmia_blacklist.py	2021-04-01 07:00:33 +00:00
dalf	f804f54ca3	Update searx.data - update_currencies.py	2021-04-01 07:00:29 +00:00
Marc Abonce Seguin	419b907a0b	fix dark "expand" button from infobox	2021-03-28 21:54:37 -07:00
Adam Tauber	ae122ea943	[enh] release v1.0.0	2021-03-27 20:30:08 +01:00
Adam Tauber	15f2385a7b	[enh] update translations from transifex	2021-03-27 19:10:54 +01:00
Alexandre Flament	bb316d2698	Merge pull request #2682 from dalf/fix-checker [fix] checker: various bug fixes	2021-03-27 17:44:29 +01:00
Alexandre Flament	725a69616b	Merge pull request #2681 from dalf/fix-wikipedia-title [fix] wikipedia: remove HTML from the title	2021-03-27 17:43:36 +01:00
Noémi Ványi	9bb312c505	Remove duplicated key from dict in Semantic Scholar	2021-03-27 16:58:32 +01:00
Noémi Ványi	f596f5767b	fix Semantic Scholar engine	2021-03-27 16:54:01 +01:00
Adam Tauber	28286cf3f2	[fix] update seznam engine to be compatible with the new website	2021-03-27 15:29:04 +01:00
Alexandre Flament	0b45afd4d7	[fix] checker: various bug fixes * initialize engine_data (youtube engine) * don't crash if an engine don't set result['url']	2021-03-25 09:37:37 +01:00
Alexandre Flament	fcfcf662ff	[fix] wikipedia: remove HTML from the title fr.wikipedia.org (and it seems not other wikipedia websites), adds HTML to api_result['displayTitle']. (Search for '!wp :fr Braid' for example) The commit uses api_result['title']	2021-03-25 08:31:39 +01:00
Adam Tauber	06b754ad67	[mod] increase lobste.rs engine timeout to avoid timeouts most of the time	2021-03-25 01:22:36 +01:00
Adam Tauber	0ba71c3644	[fix] make ina engine compatible with the new response json	2021-03-25 01:20:41 +01:00
Adam Tauber	6255b33c9d	[fix] rewrite hoogle to use html/xpath instead of json the json response has been changed and it contains html chunks which is not compatible with our json engine, so we have to switch to html/xpath parsing	2021-03-25 01:13:24 +01:00
Adam Tauber	45f0e1a859	[fix] update geektimes.ru url - it redirects to habr.com	2021-03-25 01:02:19 +01:00
Adam Tauber	50ba2b9e87	[fix] update google play movies xpath	2021-03-25 00:55:53 +01:00
Adam Tauber	88657fe9c2	[fix] update google play apps xpath	2021-03-25 00:55:43 +01:00
Adam Tauber	5f450fda74	[enh] add year filter to duckduckgo	2021-03-25 00:25:36 +01:00
Adam Tauber	fd737dc9d8	[fix] remove debug code	2021-03-24 23:54:39 +01:00
Alexandre Flament	d648001688	[mod] preferences: a tooltip is shown when the mouse is over the engine names	2021-03-22 08:22:59 +01:00
Alexandre Flament	6bd01bf81f	[mod] oscar: fix the sourcemap URL in .min.css Close https://github.com/searx/searx/issues/2670 Note: clean-css contains a bug: a multiline comment or URL adds "$stdin" to the sourcemap (see src/less/logicodev/search.less) * in this case when the user opens the devtools, the browser fails to load this "https://.../$stdin" URL * it is not a problem and the error appears only when the user actively tries to debug the CSS. * seems related to https://github.com/jakubpawlowicz/clean-css/issues/593	2021-03-21 18:03:40 +01:00
Alexandre Flament	a48ec0b4bd	Merge pull request #2671 from searx/update-soundcloud [mod] soundcloud: faster initialization	2021-03-21 15:10:39 +01:00
Alexandre Flament	30c950a2c7	Merge pull request #2660 from dalf/upd-translations [mod] replace /translations.js with an embedded JSON	2021-03-21 12:39:26 +01:00
Alexandre Flament	38c210d746	[mod] soundcloud: faster initialization The get_cliend_id() function: * fetches https://soundcloud.com * then fetches each referenced javascript URL to get the client id. This commit fetches the javascript URLs in the reverse order: the client id is in the last javascript URL.	2021-03-21 09:29:53 +01:00
James Higginbotham	ce6eb81a71	Update settings.yml to enable HTTP for yacy Added a line to the yacy entry to enable HTTP if the local yacy instance isn't using HTTPS. Otherwise, an error will be thrown in the logs: "No connection adapters were found for 'http://localhost:8090/yacysearch.json...'". This is likely related to ticket #2641 that forces HTTPS by default.	2021-03-19 15:06:25 -06:00
Alexandre Flament	2b0dd96bd3	[mod] oscar: remove space * reduce by 15% the uncompressed output (on average) * dos2unix searx/templates/oscar/result_templates/files.html	2021-03-17 09:22:05 +01:00
Dr. Rolf Jansen	7a9dc63d74	Merge branch 'master' into conditional-sigusr1	2021-03-16 08:45:57 -03:00
Alexandre Flament	6553c79029	[mod] replace /translations.js by embedded JSON In webapp.py, there is a new function "get_translations" lists available translations Close #2064	2021-03-16 11:22:21 +01:00
Alexandre Flament	32cd0d31b3	[mod] upgrade pygments add searx_extra/update/update_pygments.py to update the css style of the oscar and simple themes.	2021-03-16 09:07:08 +01:00
Dr. Rolf Jansen	2a6dbeb6a5	Merge branch 'master' into conditional-sigusr1	2021-03-15 19:31:44 -03:00
Adam Tauber	4c631ac6d0	[fix] remove debug code	2021-03-15 21:47:27 +01:00
Dr. Rolf Jansen	4a27dabcf7	Merge branch 'master' into conditional-sigusr1	2021-03-15 17:03:36 -03:00
Noémi Ványi	8158d8654a	fix Microsoft Academic engine	2021-03-15 20:21:28 +01:00
Adam Tauber	f97b4ff7b6	[fix] update youtube_noapi paging	2021-03-15 17:22:31 +01:00
Adam Tauber	dd34ac396c	Merge pull request #2652 from kvch/solr-engine Add Apache Solr engine	2021-03-15 15:39:39 +01:00
Alexandre Flament	1664258061	Merge pull request #2655 from return42/fix-imports [fix] remove unused import from yahoo-news engine	2021-03-15 08:38:34 +01:00
Alexandre Flament	5b176b3496	Merge pull request #2659 from MarcAbonce/onions-http-fix Fix HTTP error in onion engines	2021-03-15 08:33:38 +01:00
Marc Abonce Seguin	f4a0a4d756	fix HTTP error in onion engines regression from https://github.com/searx/searx/pull/2641 most onion websites only serve HTTP, so it must be enabled	2021-03-14 20:23:07 -07:00
Rolf	80025c3244	Windows does not support SIGUSR1, so don't use it unconditionally.	2021-03-14 19:04:36 -03:00
Markus Heiser	6e1f1085ef	[fix] remove unused import from yahoo-news engine Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-03-14 15:13:57 +01:00
Markus Heiser	3703ebb22a	[drop] Acgsou engine - www.acgsou.com no longer exists - https://www.acgsou.com/ acgsou.com is redirected to 36dm.club - @rinpatch do not plan on maintaining the engine [1] [1] https://github.com/searx/searx/pull/1283#issuecomment-798783585 Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-03-14 11:49:18 +01:00
Noémi Ványi	ff527e2681	Add Solr engine	2021-03-13 21:18:09 +01:00
Alexandre Flament	9292571304	Merge pull request #2346 from dalf/upgrade-oscar [mod] oscar: upgrade dependencies	2021-03-13 09:29:13 +01:00
Alexandre Flament	92dd5e245e	Merge pull request #2626 from mikeri/solidtorrents Add Solid Torrents engine	2021-03-12 19:45:22 +01:00
Alexandre Flament	a1a492baed	Merge pull request #2641 from dalf/disable_http_by_default [mod] by default allow only HTTPS, not HTTP	2021-03-12 19:21:46 +01:00
Alexandre Flament	cb04d42806	[mod] oscar: update README.rst	2021-03-11 09:33:04 +01:00
Alexandre Flament	86912e2272	[mod] oscar: get bootstrap and typeahead from NPM	2021-03-11 09:33:01 +01:00
Alexandre Flament	44407353ef	[mod] oscar: get leaflet and jquery from NPM easy to upgrade (package.json)	2021-03-11 09:32:22 +01:00
Alexandre Flament	c7133efb12	[mod] oscar: move compiled files to the src directory	2021-03-10 19:28:51 +01:00
Alexandre Flament	eda3b513ac	[mod] oscar: remove polyfills for Internet Explorer	2021-03-10 19:01:16 +01:00
Alexandre Flament	1268910274	[mod] oscar: remove unused images	2021-03-10 19:01:16 +01:00
Alexandre Flament	bdb41bea7b	[mod] theme: remove require-2.1.15.min.js See https://github.com/requirejs/requirejs/issues/1816 requirejs loads one file: leaflet. This commit: * removes requirejs * load leaflet using <script src...> HTML tag in searx/templates/oscar/base.html	2021-03-10 19:01:15 +01:00
Alexandre Flament	2f3d5ec2af	[mod] oscar: upgrade npm dependencies	2021-03-10 19:01:14 +01:00
Markus Heiser	96422e5c9f	[fix] APKMirror engine - update xpath selectors and fix img_src BTW: make the code slightly more readable Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-03-09 08:34:57 +01:00
Markus Heiser	d2faea423a	[fix] rewrite Yahoo-News engine Many things have been changed since last review of this engine. This patch fix xpath selectors, implements suggestion and is a complete review / rewrite of the engine. Signed-off-by: Markus Heiser <markus@darmarit.de>	2021-03-08 11:43:34 +01:00
Alexandre Flament	99e0651cea	[mod] by default allow only HTTPS, not HTTP Related to https://github.com/searx/searx/pull/2373	2021-03-08 11:35:08 +01:00
Michael Ilsaas	5549d58de3	Add Solid Torrents engine	2021-03-07 18:14:30 +01:00
Adam Tauber	44f4a9d49a	[enh] add ability to send engine data to subsequent requests	2021-03-06 12:12:35 +01:00
Alexandre Flament	87f4cc4a9e	Merge pull request #2631 from searx/update_data_update_languages.py Update searx.data - update_languages.py	2021-03-06 10:03:00 +01:00
Markus Heiser	4845183128	[mod] don't dump traceback of SearxEngineResponseException on init When initing engines a "SearxEngineResponseException" is logged very verbose, including full traceback information: ERROR:searx.engines:yggtorrent engine: Fail to initialize Traceback (most recent call last): File "share/searx/searx/engines/__init__.py", line 293, in engine_init init_fn(get_engine_from_settings(engine_name)) File "share/searx/searx/engines/yggtorrent.py", line 42, in init resp = http_get(url, allow_redirects=False) File "share/searx/searx/poolrequests.py", line 197, in get return request('get', url, *kwargs) File "share/searx/searx/poolrequests.py", line 190, in request raise_for_httperror(response) File "share/searx/searx/raise_for_httperror.py", line 60, in raise_for_httperror raise_for_captcha(resp) File "share/searx/searx/raise_for_httperror.py", line 43, in raise_for_captcha raise_for_cloudflare_captcha(resp) File "share/searx/searx/raise_for_httperror.py", line 30, in raise_for_cloudflare_captcha raise SearxEngineCaptchaException(message='Cloudflare CAPTCHA', suspended_time=3600 24 * 15) searx.exceptions.SearxEngineCaptchaException: Cloudflare CAPTCHA, suspended_time=1296000 For SearxEngineResponseException this is not needed. Those types of exceptions can be a normal use case. E.g. for CAPTCHA errors like shown in the example above. It should be enough to log a warning for such issues: WARNING:searx.engines:yggtorrent engine: Fail to initialize // Cloudflare CAPTCHA, suspended_time=1296000 closes: #2612 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-03-05 17:26:22 +01:00
Alexandre Flament	0165e14a7f	Merge pull request #2632 from searx/update_data_update_wikidata_units.py Update searx.data - update_wikidata_units.py	2021-03-05 11:59:44 +01:00
Alexandre Flament	152f6fc1da	Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.py Update searx.data - update_ahmia_blacklist.py	2021-03-05 11:59:20 +01:00
dalf	1e8b846954	Update searx.data - update_currencies.py	2021-03-05 10:56:57 +00:00
dalf	2f8a708481	Update searx.data - update_wikidata_units.py	2021-03-05 10:56:49 +00:00
dalf	d9dc3376d0	Update searx.data - update_languages.py	2021-03-05 10:56:46 +00:00
dalf	2857473553	Update searx.data - update_ahmia_blacklist.py	2021-03-05 10:56:33 +00:00
Alexandre Flament	aac37f288f	Merge pull request #2593 from dalf/update-autocomplete Update autocomplete	2021-03-04 10:51:09 +01:00
Alexandre Flament	63f17d2e4c	[enh] autocomplete refactoring, autocomplete on external bangs	2021-03-01 19:12:32 +01:00
Markus Heiser	d48e2e7b0b	[enh] google scholar - python implementation of the engine The old xpath configuration for google scholar did not work and is replaced by a python implementation. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-03-01 15:16:37 +01:00
Alexandre Flament	4fa1290c11	[fix] answers: don't crash when the query is an empty string	2021-03-01 10:52:39 +01:00
Alexandre Flament	e2fb500892	Merge pull request #2608 from return42/unittest2 [py2to3] use unittest from py3, remove unittest2 from py2	2021-03-01 10:05:38 +01:00
Alexandre Flament	0c663e25fc	Merge pull request #2604 from searx/update_data_firefox_version Update searx.data - firefox_version	2021-03-01 10:03:39 +01:00
Alexandre Flament	f77983e174	Merge pull request #2602 from MarcAbonce/fix-bing-fetch-languages Fix fetch_languages for Bing	2021-03-01 09:06:37 +01:00
GazoilKerozen	5f6ac3afa2	Add Freesound engine (#2596 ) Add freesound engine with player. Co-authored-by: Gazoil <maildeguzel@gmail.com>	2021-03-01 08:52:36 +01:00
Markus Heiser	3bae35940a	[py2to3] use unittest from py3, remove unittest2 from py2 - unittest2 is a backport of the new features added to the unittest testing framework in Python 2.7 - unittest2 was only needed in py2 and can be dropped now Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-02-28 11:37:06 +01:00
Alexandre Flament	b05f4d0664	Merge pull request #2605 from searx/update_data_currencies Update searx.data - currencies	2021-02-26 12:56:32 +01:00
Alexandre Flament	aec5188b51	Merge pull request #2606 from searx/update_data_wikidata_units Update searx.data - wikidata_units	2021-02-26 12:55:51 +01:00
dalf	893b6e4901	Update searx.data - ahmia_blacklist	2021-02-26 08:31:15 +00:00
dalf	7b9005df31	Update searx.data - wikidata_units	2021-02-26 08:31:01 +00:00
dalf	4c8ae5b7ed	Update searx.data - firefox_version	2021-02-26 08:30:45 +00:00
dalf	d2778b5efe	Update searx.data - currencies	2021-02-26 08:30:45 +00:00
Marc Abonce Seguin	d6681fd33b	remove articles number from engines_languages.json	2021-02-25 23:54:21 -07:00
Marc Abonce Seguin	9b6ffed061	fix fetch_languages for bing Bing has a list of regions that it supports and some of these regions may have more than one possible language. In some cases, like Switzerland, these languages are always shown as options, so there is no issue. But in other cases, like Andorra, Bing will only show one language at the time, either the region's default or the request's language if the latter is supported by that region. For example, if the HTTP request is in French, Andorra will appear as fr-AD but if the same page is requested in any other language Andorra will appear as ca-AD. This is specially a problem when Bing assumes that the request is in English because it overrides enough language codes to make several major languages like Arabic dissappear from the languages.py file. To avoid that issue, I set the Accept-Language header to a language that's only supported in one region to hopefully avoid these overrides.	2021-02-25 23:51:49 -07:00
Alexandre Flament	7c1847d5f2	[mod] add utils/fetch_external_bangs.py Based on duckduckgo bangs Store bangs on a trie to allow autocomplete (not in this commit)	2021-02-24 18:48:36 +01:00
Alexandre Flament	5f4a085fc4	Merge pull request #2595 from dalf/update-wikidata-units [mod] update wikidata_units.json and fetch_wikidata_units.py	2021-02-23 17:22:37 +01:00
Alexandre Flament	46ca32c3cc	[mod] update currencies.json and fetch_currencies.py use a sparql request on wikidata to get the list of currencies. currencies.json contains the translation for all supported searx languages. Supersede #993	2021-02-23 16:42:28 +01:00
Alexandre Flament	93d1da4906	[mod] update wikidata_units.json and fetch_wikidata_units.py The fetch_wikidata_units.py result won't change randomly. See comments in the script.	2021-02-23 13:10:38 +01:00
Noémi Ványi	1be6ab2a91	Fix paging of Bing Images	2021-02-22 21:19:34 +01:00
datagram1	1d0a32a2c5	Added rumble.com video search engine. TODO video embedding. Update rumble.py some lines too long. Disable Rumble engine disabled : True PEP8 fix change line spacing	2021-02-20 12:48:56 +00:00
Alexandre Flament	44a6593c13	Merge pull request #2573 from unixfox/yggtorrent update yggtorrent url + add it back	2021-02-16 08:22:07 +01:00
Emilien Devos	4b37e10dd9	fix yggtorrent url + add it back	2021-02-15 13:38:34 +01:00
Thorben Günther	fbbd4cc21f	Improve peertube searching At the moment videos without a description are not shown - setting default content to "" fixes this. Another current bug is that thumbnails are not displayed. This is caused by a double slash in the url. For this every trailing slash is now stripped (for backwards compatibility) and the API response is correctly parsed.	2021-02-13 19:47:33 +01:00
Alexandre Flament	45027765e3	Merge pull request #2566 from dalf/remove-yandex [remove] yandex engine	2021-02-12 17:12:07 +01:00
Alexandre Flament	c22d4c764c	[fix] duckduckgo engine: "!ddg !g" do not redirect to google * searx understand "!ddg !g time" as : send "!g time" to DDG * !g a DDG bang for Google: DDG return a HTTP redirect to Google This commit adds a the allows_redirect param not to follow HTTP redirect. The DDG engine returns a empty result as before without HTTP redirect.	2021-02-12 11:10:08 +01:00
Alexandre Flament	d76660463b	Merge pull request #2562 from dalf/mod-json-engine [mod] json_engine: add content_html_to_text and title_html_to_text	2021-02-12 10:58:28 +01:00
Alexandre Flament	7dcf67a47a	Merge pull request #2565 from dalf/upd-wikipedia [upd] wikipedia engine: return an empty result on query with illegal characters	2021-02-12 10:57:05 +01:00
Alexandre Flament	2b60d0d243	Merge pull request #2564 from dalf/fix-seznam [fix] fix seznam engine	2021-02-12 10:56:53 +01:00
Alexandre Flament	7e83818879	Merge pull request #2560 from dalf/fix-duckduckgo Fix duckduckgo	2021-02-12 10:56:40 +01:00
Alexandre Flament	63d6ccfbc2	Merge pull request #2557 from dalf/fix-raise_for_httperror Fix: activate raise_for_error by default	2021-02-12 10:56:25 +01:00
Alexandre Flament	74c8b5606f	Merge pull request #2541 from return42/mediathekviewweb [enh] add engine MediathekViewWeb (API)	2021-02-11 15:11:26 +01:00
Alexandre Flament	5d9db6c2f7	[remove] yandex engine	2021-02-11 14:28:06 +01:00
Alexandre Flament	35dd069402	[fix] fix seznam engine no paging support	2021-02-11 12:53:19 +01:00
Alexandre Flament	7d6e69e2f9	[upd] wikipedia engine: return an empty result on query with illegal characters on some queries (like an IT error message), wikipedia returns an HTTP error 400. this commit returns an empty result instead of showing an error to the user.	2021-02-11 12:29:21 +01:00
Alexandre Flament	ff84a1af35	[mod] json_engine: add content_html_to_text and title_html_to_text Some JSON API returns HTML in either in the HTML or the content. This commit adds two new parameters to the json_engine: content_html_to_text and title_html_to_text, False by default. If True, then the searx.utils.html_to_text removes the HTML tags. Update crossref, openairedatasets and openairepublications engines	2021-02-10 16:42:11 +01:00
Alexandre Flament	436d366448	Merge pull request #2544 from mrwormo/congresslibrary [Engine] Add Library of Congress engine	2021-02-10 10:13:46 +01:00
Alexandre Flament	eafd27f42a	Merge pull request #2556 from dalf/fix-apk-mirror [fix] fix apk_mirror engine	2021-02-10 10:12:37 +01:00
Alexandre Flament	d2dac11392	[mod] duckduckgo engine: better support of the language preference After the main request, send a second to https://duckduckgo.com/t/sl_h See https://github.com/searx/searx/issues/2259	2021-02-09 14:36:43 +01:00
Alexandre Flament	74d56f6cfb	[mod] poolrequests: for one (user request, engine) always use the same HTTPAdapter The duckduckgo engine requires an additional request after the results have been sent. This commit makes sure that the second request uses the same HTTPAdapter = the same IP address, and the same proxy.	2021-02-09 14:33:36 +01:00
Markus Heiser	bc1be3f0e9	[enh] add engine MediathekViewWeb (API) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-02-09 13:08:01 +01:00
mrwormo	051da88328	Add Library of Congress engine	2021-02-09 12:45:39 +01:00
Alexandre Flament	9211cdfe9b	[upd] remove google_play_music engine Google Play Music has been replaced by Youtube music.	2021-02-09 11:38:50 +01:00
Alexandre Flament	aedf03c0f7	Fix: activate raise_for_error by default Fix commit `d703119d3a` : Some engines need to parse the HTTP error but raise_for_error is always set to False in the "request" function.	2021-02-09 11:27:41 +01:00
Alexandre Flament	5e055b069b	[fix) fix apk_mirror engine	2021-02-09 11:02:12 +01:00
Alexandre Flament	e4cc7f13a3	Merge pull request #2542 from kvch/fix-naver-engine Fix XPATHs in Naver engine	2021-02-09 08:52:38 +01:00
Alexandre Flament	bec9e30fe7	Merge pull request #2554 from MarcAbonce/zh-variants-in-wikipedia Add support for Chinese variants in Wikipedia	2021-02-09 08:49:59 +01:00
Daniel Hones	138f32471c	Updated webutils.highlight_content to ignore double-quotes when highlighting query parts	2021-02-08 23:58:54 -05:00
Marc Abonce Seguin	64e81794fe	add support for Chinese variants in Wikipedia	2021-02-08 21:56:45 -07:00
Noémi Ványi	ac309f5b8d	Fix naver engine Closes #2540	2021-02-07 18:58:13 +01:00
Markus Heiser	41c03cf011	[drop] metager - xpath engine won't work anymore The new version of MetaGer needs to reload the reults (into a iframe) with a unique tag (see HTML response below). Implementing a dedicated metager-engine for searx makes no sense to me. The great days of MetaGer seems to be ended. I remember the good old days this project started in the 90's of the last century. But in the last few years it becomes more and more crap. As the name suggested, MetaGer was made for germans in the first place. They have added a english and spain translation but the i18n is very poor compared to what searx offers. It's a pity, lets drop MetaGer. This is the first response, the id (b82679980656899ba5a17ffd02a56846) is unique for each query: $ curl "https://metager.org/meta/meta.ger3?eingabe=foo&submit-query=&focus=web" <!DOCTYPE html> <html lang="en"> <head> <meta charset="UTF-8"> <link rel="stylesheet" href="/index.css?id=b82679980656899ba5a17ffd02a56846"> <script src="/index.js?id=b82679980656899ba5a17ffd02a56846"></script> <title>foo - MetaGer</title> <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" /> </head> <body> <iframe id="mg-framed" src="https://metager.org/meta/meta.ger3?eingabe=foo&submit-query=&focus=web&mgv=b82679980656899ba5a17ffd02a56846" autofocus="true" onload="this.contentWindow.focus();"></iframe> </body> Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-02-07 14:55:21 +01:00
Hermógenes Oliveira	514faa9162	[feat] recoll: paged json support	2021-02-07 10:05:35 -03:00
Marc Abonce Seguin	c937a9e85f	[fix] get correct locale with country from browser Some of our interface locales include uppercase country codes, which are separated by `_` instead of the more common `-`. Also, a browser's `Accept-Language` header could be in lowercase. This commit attempts to normalize those cases so a browser's language+country codes can better match with our locales. This solution assumes that our UI locales have nothing more than language and optionally country. If we ever add a script specific locale like `zh-Hant-TW` this would have to change to accomodate that, but the idea would be pretty much the same as this fix.	2021-02-04 19:53:59 -07:00
mrwormo	c4c1636b18	Add Creative Commons search engine	2021-02-04 11:31:35 +01:00
Alexandre Flament	ca93a01844	[mod] dynamically set language_support variable The language_support variable is set to True by default, and set to False in only 5 engines. Except the documentation and the /config URL, this variable is not used. This commit remove the variable definition in the engines, and set value according to supported_languages length: False when the length is 0, True otherwise. Close #2485	2021-02-01 17:10:37 +01:00
Markus Heiser	7f505bdc6f	[fix] google: avoid unnecessary SearxEngineXPathException errors Avoid SearxEngineXPathException errors when parsing non valid results:: .//div[@class="yuRUbf"]//a/@href index 0 not found Traceback (most recent call last): File "./searx/engines/google.py", line 274, in response url = eval_xpath_getindex(result, href_xpath, 0) File "./searx/searx/utils.py", line 608, in eval_xpath_getindex raise SearxEngineXPathException(xpath_spec, 'index ' + str(index) + ' not found') searx.exceptions.SearxEngineXPathException: .//div[@class="yuRUbf"]//a/@href index 0 not found Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-28 10:08:50 +01:00
Markus Heiser	e436287385	[mod] checker: add some additional tests BTW: fix indentation by 2 spaces The additional tests has been commented out in the google engines to not release any CAPTCHA issues. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-28 10:08:50 +01:00
Markus Heiser	b1fefec40d	[fix] normalize the language & region aspects of all google engines BTW: make the engines ready for search.checker: - replace eval_xpath by eval_xpath_getindex and eval_xpath_list - google_images: remove outer try/except block Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-28 10:08:46 +01:00
Markus Heiser	ff6804e545	[data] make engines.languages Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-24 09:52:32 +01:00
Markus Heiser	8cdad5d85d	[fix] google-videos: parse values for 'length' & 'author' The 'video.html' template from the 'oscar' design supports replacement for author and length. Google-videos does not have an author, alternatively the publisher info from is used for the author. Hint: these replacements are not supported by the 'simple' design. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-24 09:51:24 +01:00
Markus Heiser	89b3050b5c	[fix] revise of the google-Video engine This revise is based on the methods developed in the revise of the google engine (see commit `410c2f9`). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-24 09:39:30 +01:00
Alexandre Flament	8c46b767d0	[fix] google_news: avoid one HTTP redirect except for the English results also add params['soft_max_redirects'] = 1 to avoid false error reporting in /stats/errors	2021-01-24 08:53:35 +01:00
Markus Heiser	5f92dfcdbe	[fix] google-news: query uses locale without country tag Wthout country-region tag google will redirect to correct the contry tag [1]: SEARX_DEBUG=1 searx-checker -v "google news" ... https://news.google.com:443 "GET /search?q=computer&hl=en... HTTP/1.1" 302 0 https://news.google.com:443 "GET /search?q=computer&hl=en-US&.... HTTP/1.1" 200 None ... [1] https://github.com/searx/searx/pull/2483#issuecomment-765600849 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-23 11:37:14 +01:00
Markus Heiser	baec54c492	[fix] revise of the google-news engine This revise is based on the methods developed in the revise of the google engine (see commit `410c2f9`). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-22 18:49:45 +01:00
Alexandre Flament	73c86f9bf2	[mod] checker: disable by default	2021-01-19 21:44:48 +01:00
Alexandre Flament	3b7b852aa8	[fix] checker: minor fix about language detection	2021-01-19 21:29:31 +01:00
Alexandre Flament	aa887eb375	[mod] checker : replace pycld3 by langdetect pycld3 requires the native library cld3 langdetect is a pure python package	2021-01-19 21:26:04 +01:00
Alexandre Flament	67a1aab0d5	[fix] /stats/checker : remove the timestamp field when the checker is disabled	2021-01-18 08:19:53 +01:00
Alexandre Flament	d473407ec9	[fix] checker: fix engine statistics Without this commit, the URL /stats/errors shows percentage above 100% after the checker has run.	2021-01-18 08:19:44 +01:00
Alexandre Flament	ca76f3119a	[fix] error_recorder: record code and lineno about the engine since the PR #2225 , code and lineno were sometimes meaningless see /stats/errors	2021-01-17 16:25:11 +01:00
Alexandre Flament	80d7411f2c	Merge pull request #2452 from kvch/add-wilby-engine Add wiby.me engine	2021-01-16 22:36:31 +01:00
Alexandre Flament	b405646749	Merge pull request #2451 from mrwormo/invidious-engine [Fix] Invidious Engine	2021-01-16 19:25:45 +01:00
Alexandre Flament	a4dcfa025c	[enh] engines: add about variable move meta information from comment to the about variable so the preferences, the documentation can show these information	2021-01-14 20:57:17 +01:00
mrwormo	2dff3887f0	[fix] Invidious engine by enabling requests by randomly picking amongst working instances	2021-01-14 12:12:56 +01:00
Alexandre Flament	912c7e975c	[fix] checker: don't run the checker when uwsgi is not properly configured Before this commit, even with the scheduler disabled, the checker was running at least once for each uwsgi worker.	2021-01-13 14:07:39 +01:00
Alexandre Flament	7f0c508598	[fix] checker: fix typo unknown instead of unknow	2021-01-12 11:47:17 +01:00
Alexandre Flament	a0c8b413a6	[mod] searx.shared: minor tweaks searx.shared.shared_abstract.SharedDict inherit from abc.ABC searx.shared.shared_uwsgi.schedule can schedule multiple functions without issue	2021-01-12 11:47:17 +01:00
Alexandre Flament	87bafbc32b	[mod] checker: add status and timestamp to the result for each engine: replace status by success	2021-01-12 11:47:17 +01:00
Alexandre Flament	f3e1bd308f	[mod] checker: minor adjustements on the default tests the query "time" is convinient because most of the search engine will return some results, but some engines in the general category will return documentation about the HTML tags <time> or <input type="time">	2021-01-12 11:47:17 +01:00
Alexandre Flament	45bfab77d0	\|mod] checker: improve searx-checker command line * output is unbuffered * verbose mode describe more precisly the errrors	2021-01-12 11:47:17 +01:00
Alexandre Flament	3a9f513521	[enh] checker: background check See settings.yml for the options SIGUSR1 signal starts the checker. The result is available at /stats/checker	2021-01-12 11:47:17 +01:00
Alexandre Flament	6e2872f436	[enh] add searx.shared shared dictionary between the workers (UWSGI or werkzeug) scheduler: run a task once every x seconds (UWSGI or werkzeug)	2021-01-12 11:47:17 +01:00
Markus Heiser	9c581466e1	[fix] do not colorize output on dumb terminals Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-12 11:47:17 +01:00
Alexandre Flament	ca0889d488	[enh] checker: wikidata & ddd: add specific tests	2021-01-12 11:47:17 +01:00
Alexandre Flament	16a889dd8f	[enh] checker: add rosebud test	2021-01-12 11:47:17 +01:00
Alexandre Flament	8cbc9f2d58	[enh] add checker	2021-01-12 11:47:17 +01:00
Alexandre Flament	f7e11fd722	Merge pull request #2459 from dalf/update-python Update python	2021-01-12 11:02:58 +01:00
Alexandre Flament	9c55d772e9	Merge pull request #2408 from return42/rm-brand-make [mod] move brand options from Makefile to settings.yml	2021-01-12 10:52:42 +01:00
Alexandre Flament	f5c3cb7afa	[mod] drop Python 3.5 support	2021-01-12 09:45:16 +01:00
Alexandre Flament	8d0312d014	Merge pull request #2458 from MarcAbonce/hide-links-mobile2 Hide links panel in mobile screens	2021-01-12 08:27:24 +01:00
Marc Abonce Seguin	635c6516a4	hide links panel in mobile screens	2021-01-11 20:40:21 -07:00
Alexandre Flament	424e6abc7e	[mod] settings.yml: move brand settings to a dedicated section	2021-01-11 22:59:52 +01:00
Markus Heiser	d0338cb504	[fix] add missing brand.CONTACT_URL to /config API endpoint Suggested-by: @dalf / https://github.com/searx/searx-stats2/issues/59#issuecomment-747961582 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-11 22:12:38 +01:00
Markus Heiser	9e53470b4c	[mod] get rid of searx/brand.py Removes module searx/brand.py and creates a namespace at searx.brand. This patch is a first 'proof of concept'. Later we can decide to remove the brand namespace entirely or not. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-11 22:12:38 +01:00
Markus Heiser	9485179064	[mod] move brand options from Makefile to settings.yml Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-11 22:12:38 +01:00
Alexandre Flament	c2646df496	Merge pull request #2454 from MarcAbonce/fix-empty-lang-bang Fix empty colon in query from selecting Chinese	2021-01-10 11:01:32 +01:00
Marc Abonce Seguin	571ce9ff07	fix empty colon in query from selecting Chinese	2021-01-09 22:11:41 -07:00
Noémi Ványi	a6dd1de4a8	Add wiby.me engine Closes #2339	2021-01-08 23:11:18 +01:00
Markus Heiser	b0bb0a3a0f	[fix] Library Genesis links shifted by 1 #1998 Fixes: #1998 Suggested-by: @linuxmue Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2021-01-07 14:47:34 +01:00
Émilien Devos	fc6cfc3b58	Remove voat due to its shutdown Voat shutted down on December 25th, 2020 at 12 noon PST: https://voat.co/host/voat/static/inactive.min.html?ReturnUrl=/	2021-01-06 10:45:02 +00:00
Alexandre Flament	54e69d0367	[upd] update dependencies minor change in the oscar theme becase the last version of jinja2 respect more carefully the spaces in the templates	2020-12-28 09:04:39 +01:00
Alexandre Flament	568b9465e9	[mod] check secret_key when searx.webapp is imported Without this commit the module searx checks the secret_key value. With this commit, make docs, utils/standalone_searx.py, utils/fetch_firefox_version.py works without SEARX_DEBUG=1 For reference see https://github.com/searx/searx/pull/2386	2020-12-27 10:30:20 +01:00
Alexandre Flament	1956ab4b50	Merge pull request #2412 from dalf/update-buildenv [fix] update buildenv	2020-12-27 08:31:23 +01:00
Markus Heiser	4de276e364	[upd] make SEARX_DEBUG=1 useragents.update Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-12-22 14:23:58 +01:00
Alexandre Flament	db5b060455	[fix] update buildenv CONTACT_URL is unset in Makefile, but searx/brand.py and utils/brand.env are not updated. This commit fixes this issue.	2020-12-21 10:55:28 +01:00
Alexandre Flament	3f8ebf70b1	[fix] pylint: use "raise ... from ..."	2020-12-20 09:46:53 +01:00
Alexandre Flament	eb33ae6893	[fix] Python 3.9: use html.unescape instead of HTMLParser.unescape	2020-12-20 09:46:53 +01:00
Alexandre Flament	04447f8c1a	Merge pull request #2398 from dalf/mod-search-query Mod search query	2020-12-20 09:32:54 +01:00
Alexandre Flament	f4983e7415	[mod] remove emojis from source code	2020-12-20 08:58:57 +01:00
Alexandre Flament	eda8934f15	[mod] searx.search.EngineRef: remove from_bang parameter from_bang is True when the user query contains a bang. In this case the category is also set to 'none'. from_bang only usage was in searx.webadapter.parse_specific : if from_bang is True, then the EngineRef category is ignored and force to 'none'. This commit also removes the searx.webadapter.parse_sepecific function.	2020-12-18 12:29:48 +01:00
Alexandre Flament	995ba2f406	[mod] searx.search.SearchQuery: remove categories parameter The categories parameter is useless in the constructor: it is always the categories from the EngineRef. The categories becomes a property.	2020-12-18 12:29:48 +01:00
Alexandre Flament	14c7cc0e11	[mod] Makefile: make CONTACT_URL optional	2020-12-18 09:54:03 +01:00
BBaoVanC	19fce74443	Add link to contact instance maintainer to footer of each page (#2391 )	2020-12-18 09:53:28 +01:00
Alexandre Flament	5c6a5407a0	[fix] fix of PR #2225	2020-12-17 16:49:48 +01:00
Alexandre Flament	02fc4147ce	[mod] dictzone, translated, currency_convert: use engine_type online_curency and online_dictionnary	2020-12-17 11:39:36 +01:00
Alexandre Flament	7ec8bc3ea7	[mod] split searx.search into different processors see searx.search.processors.abstract.EngineProcessor First the method searx call the get_params method. If the return value is not None, then the searx call the method search.	2020-12-17 11:39:36 +01:00
Alexandre Flament	c0cc01e936	[mod] searx.search: search_multiple_requests is a method of Search class	2020-12-17 11:39:36 +01:00
Alexandre Flament	3b87efb3db	[mod] move seax/search.py to searx/search/__init__.py	2020-12-17 11:39:36 +01:00
Alexandre Flament	9bc1856e2b	[mod] themes: remove legacy, courgette and pix-art themes	2020-12-17 11:33:28 +01:00
Alexandre Flament	88660fde90	Merge pull request #2396 from lucky13820/patch-1 Fix the StartPage result title is showing the url	2020-12-17 08:23:34 +01:00
lucky13820	fea8958e99	Fix the StartPage result title is showing the url Fix the issue 2395 where StartPage result title is showing the url. https://github.com/searx/searx/issues/2395	2020-12-16 13:54:14 -08:00
Markus Heiser	9db7d6357b	[themes] add hyperlink to searx instances list in error message closes: #2383 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-12-16 20:24:42 +01:00
Alexandre Flament	39ac81478c	prepare release 0.18.0	2020-12-14 19:03:09 +01:00
Alexandre Flament	292b73a3fc	Merge pull request #2385 from joshu9h/patch-1 [Fix] Startpage	2020-12-14 17:56:48 +01:00
Alexandre Flament	36600118fb	Merge pull request #2372 from dalf/remove-broken-engines [remove] remove searchcode_doc and twitter	2020-12-13 17:11:05 +01:00
joshu9h	8260435c8b	[Fix] Startpage	2020-12-13 15:43:50 +01:00
Alexandre Flament	3c4a9c1188	Merge pull request #2358 from dalf/fix-command [fix] command engine: SearchQuery.query is str not bytes	2020-12-11 14:53:24 +01:00
Alexandre Flament	d703119d3a	[enh] add raise_for_httperror check HTTP response: * detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time. * otherwise raise HTTPError as before the check is done in poolrequests.py (was before in search.py). update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status	2020-12-11 14:37:08 +01:00
Alexandre Flament	033f39bff7	Merge pull request #2376 from dalf/fix-mojeek Fix mojeek	2020-12-11 13:14:54 +01:00
Alexandre Flament	6bc6d5e9fd	Merge pull request #2371 from dalf/mod-genius [mod) genious: return valid results even if contents are empty	2020-12-11 13:14:03 +01:00
Alexandre Flament	0ba74cd812	[mod] results: don't crash when an engine don't have a category According to `820b468bfe/searx/engines/__init__.py (L87-L88)` an engine can have no category at all. Without this commit, searx raise an exception in searx/results.py Note: in this case, the engine is not shown in the preferences.	2020-12-10 10:57:07 +01:00
Alexandre Flament	d41cafd5f3	[fix] xpath, mojeek: fix commit `58d72f2692` before commit `58d72f2`, category was not set in xpath.py, so searx/engines/__init__py was setting the category to ['general'] the commit `58d72f2` set the category to [] which is not replaced by searx/engines/__init__.py consequence: the mojeek engine is hidden in the preferences. this commit revert the xpath.py change. close #2368	2020-12-10 10:52:06 +01:00
Noémi Ványi	3a63dfbdd7	display if an engine does not support https Closes #302	2020-12-09 20:49:54 +01:00
Alexandre Flament	1c9e7cef50	[remove] remove searchcode_doc and twitter * twitter: the API has changed. the engine needs to rewritten. * searchcode_doc: the API about documentation doesn't exist anymore.	2020-12-09 13:14:31 +01:00
Alexandre Flament	fa73f10f11	[mod) genious: return valid results even if contents are empty	2020-12-09 13:01:34 +01:00
Alexandre Flament	42a194898b	Merge pull request #2360 from dalf/update-libgen [mod] libgen: update the URL to http://libgen.rs/	2020-12-08 20:33:53 +01:00
Alexandre Flament	a77d8c8227	Merge pull request #2359 from dalf/update-duden [mod] duden engine	2020-12-08 20:33:38 +01:00
Alexandre Flament	bd4869ecd0	Merge pull request #2366 from dalf/remove-seedpeer [remove] seedpeer engine	2020-12-08 20:33:23 +01:00
Alexandre Flament	56c64d6b64	[remove] seedpeer engine the website is offline.	2020-12-07 21:02:29 +01:00
Alexandre Flament	c1a9732268	Merge pull request #2364 from dalf/fix-youtube-noapi [fix] youtube_noapi engine	2020-12-07 20:26:00 +01:00
Alexandre Flament	13d3004703	Merge pull request #2365 from dalf/fix-soundcloud [fix] soundclound: accept result without content	2020-12-07 20:25:17 +01:00
Alexandre Flament	62073c0e1d	Merge pull request #2361 from dalf/fix-1x [fix] 1x engine	2020-12-07 20:24:47 +01:00
Alexandre Flament	923bc02c17	Merge pull request #2363 from dalf/fix-wikipedia-minor [fix] wikipedia: minor fix: return no result instead of crash in some very few cases.	2020-12-07 18:33:37 +01:00
Alexandre Flament	deb1bde20d	[fix] soundclound: accept result without content	2020-12-07 17:45:36 +01:00
Alexandre Flament	34df0f7910	[fix] youtube_noapi engine	2020-12-07 17:44:31 +01:00
Alexandre Flament	58d51e082d	[fix] wikipedia: minor fix: return no result instead of crash in some very few cases. In few cases, the JSON results doesn't contains the key 'type'.	2020-12-07 17:42:05 +01:00
Alexandre Flament	4ec810749b	[fix] 1x engine	2020-12-07 15:46:00 +01:00
Alexandre Flament	1e781863fa	[fix] command engine: SearchQuery.query is str not bytes see `c225db45c8`	2020-12-07 10:43:42 +01:00
Alexandre Flament	9bf594cbcf	[mod] duden engine * add params['soft_max_redirects'] = 1 (when there is spelling suggestion) * avoid try..except * use eval_xpath_* functions	2020-12-07 10:31:11 +01:00
Alexandre Flament	b3032cf953	[mod] libgen: update the URL to http://libgen.rs/ https://libgen.is actually redirect to http://libgen.rs/ It seems there is no HTTPS version: * https://www.wikidata.org/wiki/Q22017206 * https://librarygenesis.net/	2020-12-07 10:19:34 +01:00
Alexandre Flament	a458451d20	Merge pull request #2356 from dalf/fix-ddd [fix] duckduckgo_definitions: fix relative image URL	2020-12-07 10:16:53 +01:00
Alexandre Flament	925bb561a2	Merge pull request #2352 from dalf/no_http Remove HTTP connections as much as possible	2020-12-06 10:18:49 +01:00
Alexandre Flament	28cc644f0a	[fix] duckduckgo_definitions: fix relative image URL ddg returns relative URL to https://duckduckgo.com/	2020-12-06 10:14:09 +01:00
Alexandre Flament	cdceec1cbb	Merge pull request #2354 from dalf/fix-wikipedia [fix] wikipedia engine: don't raise an error when the query is not found	2020-12-04 20:42:45 +01:00
Alexandre Flament	f0054d67f1	[fix] wikipedia engine: don't raise an error when the query is not found Add a new parameter "raise_for_status", set by default to True. When True, any HTTP status code >= 300 raise an exception ( #2332 ) When False, the engine can manage the HTTP status code by itself.	2020-12-04 20:04:39 +01:00
Alexandre Flament	bef2f2efa8	[fix] wikidata: fix crash when the item has no description at all and at least one URL.	2020-12-04 17:17:20 +01:00
Alexandre Flament	244e812f37	[fix] remove searx/engines/filecrop.py (dead code)	2020-12-04 16:48:15 +01:00
Alexandre Flament	0226ae69d3	[fix] dbpedia autocomplete (and use HTTPS)	2020-12-04 16:47:43 +01:00
Alexandre Flament	fa909c7c02	[mod] stackoverflow & yandex: detect CAPTCHA response	2020-12-03 13:23:19 +01:00
Alexandre Flament	d0d7a3e1c2	[fix] settings_loader: don't crash when a key exists only in the user settings typical use case: result_proxy can be defined in the user settings, but are not defined the default settings.yml	2020-12-03 11:35:12 +01:00
Alexandre Flament	64cccae99e	[mod] various engines: use eval_xpath* functions and searx.exceptions.* Engine list: ahmia, duckduckgo_images, elasticsearch, google, google_images, google_videos, youtube_api	2020-12-03 10:22:48 +01:00
Alexandre Flament	ad72803ed9	[mod] xpath, 1337x, acgsou, apkmirror, archlinux, arxiv: use eval_xpath_* functions	2020-12-03 10:22:48 +01:00
Alexandre Flament	de887c6347	[mod] bing_news: use eval_xpath_getindex remove unused function searx.utils.list_get	2020-12-03 10:22:48 +01:00
Alexandre Flament	1d0c368746	[enh] record details exception per engine add an new API /stats/errors	2020-12-03 10:22:48 +01:00
Alexandre Flament	6b5a578822	Merge pull request #2285 from return42/fix-digg bugfix & refactor digg engine	2020-12-03 10:20:40 +01:00
mrwormo	2b153db74c	Disable Invidious engine by default	2020-12-02 21:56:11 +01:00
Markus Heiser	bef185723a	[refactor] digg - improve results and clean up source code - strip html tags and superfluous quotation marks from content - remove not needed cookie from request - remove superfluous imports Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-12-02 21:54:27 +01:00
Markus Heiser	6b0a896f01	[mod] digg - pylint searx/engines/digg.py Eliminate redundant file names which are tested by test.pylint and ignored by test.pep8 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-12-02 20:59:30 +01:00
Markus Heiser	173b744ef0	[fix] digg - the ISO time stamp of published date has been changed Error pattern:: Engines cannot retrieve results: digg (unexpected crash time data '2020-10-16T14:09:55Z' does not match format '%Y-%m-%d %H:%M:%S') Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-12-02 20:40:12 +01:00
Alexandre Flament	b00d108673	[mod] pylint: numerous minor code fixes	2020-12-01 15:21:19 +01:00
Alexandre Flament	9ed3ee2beb	[mod] wikidata: WDGeoAttribute class: doesn't change the method signature of get_str	2020-12-01 15:21:17 +01:00
Alexandre Flament	3cfef61123	[fix] /stats: report error percentage instead of error count This bug exists since the PR https://github.com/searx/searx/pull/751	2020-12-01 15:07:09 +01:00
Alexandre Flament	a1e6bc4cee	Merge pull request #2291 from dalf/settings2 [enh] user settings can relied on the default settings	2020-12-01 14:57:12 +01:00
Alexandre Flament	f1e016e9ea	[mod] oscar theme: added option into gruntfile.js for generate sourceMap Credits go to @mrwormo (see PR #2308 )	2020-12-01 10:07:01 +01:00
GazoilKerozen	1b700738eb	[fix] fix the reset button in the oscar theme (#2306 ) Rely on javascript instead of type="clear" Close #2009	2020-11-30 16:30:21 +01:00
Noémi Ványi	4a36a3044d	Add recoll engine (#2325 ) recoll is a local search engine based on Xapian: http://www.lesbonscomptes.com/recoll/ By itself recoll does not offer web or API access, this can be achieved using recoll-webui: https://framagit.org/medoc92/recollwebui.git This engine uses a custom 'files' result template set `base_url` to the location where recoll-webui can be reached set `dl_prefix` to a location where the file hierarchy as indexed by recoll can be reached set `search_dir` to the part of the indexed file hierarchy to be searched, use an empty string to search the entire search domain	2020-11-30 08:35:15 +01:00
Alexandre Flament	b4b81a5e1a	[enh] settings.yml: add use_default_settings option (2nd version)	2020-11-27 19:40:04 +01:00
M. Efe Çetin	d1f527c3af	Photon API Link Update Via https://photon.komoot.io/	2020-11-27 10:22:28 +03:00
Alexandre Flament	1cfe7f2a75	[enh] settings.yml: add use_default_settings option This change is backward compatible with the existing configurations. If a settings.yml loaded from an user defined location (SEARX_SETTINGS_PATH or /etc/searx/settings.yml), then this settings can relied on the default settings.yml with this option: user_default_settings:True	2020-11-26 18:27:27 +01:00
Alexandre Flament	6ada5bac60	Merge pull request #2327 from renyhp/master Add preference for displaying advanced settings	2020-11-26 17:37:43 +01:00
renyhp	0323606691	Remove unused lines	2020-11-26 17:26:19 +01:00
renyhp	844ae0b310	Fix syntax error	2020-11-26 16:27:46 +01:00
renyhp	4979b4f9d9	Another patch	2020-11-26 15:34:53 +01:00
renyhp	22489c4b5f	Patch advanced search preferences	2020-11-23 19:13:29 +01:00
renyhp	b00f77059c	Add preference for displaying advanced settings	2020-11-22 18:16:43 +01:00
Alexandre Flament	3786920df9	[enh] Add multiple outgoing proxies credits go to @bauruine see https://github.com/searx/searx/pull/1958	2020-11-20 15:29:21 +01:00
Noémi Ványi	80a8bc5ad9	Fix type of unresponsive_engines Previously __get_translated_errors returned a list. But unresponsive_engines is a set. Closes #2305	2020-11-17 23:22:45 +01:00
Markus Heiser	c71d214b0c	[refactor] deviantart - improve results and clean up source code Devian's request and response forms has been changed. - fixed title - fixed time_range_dict to 'popular--**' - use image from <noscript> if exists - drop obsolete "http to https, remove domain sharding" - use query URL https://www.deviantart.com/search/deviations?page=5&q=foo - add searx/engines/deviantart.py to pylint check (test.pylint) Error pattern:: There DEBUG:searx:result: invalid title: {'url': 'https://www.deviantart.com/ ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-11-14 17:09:56 +01:00
Alexandre Flament	3038052c79	[mod] remove unused import use from searx.engines.duckduckgo import _fetch_supported_languages, supported_languages_url # NOQA so it is possible to easily remove all unused import using autoflake: autoflake --in-place --recursive --remove-all-unused-imports searx tests	2020-11-14 14:11:02 +01:00
Alexandre Flament	c3d9b17c2a	Merge pull request #2292 from kvch/elasticsearch-engine New engine: Elasticsearch	2020-11-14 13:25:08 +01:00
Alexandre Flament	102c08838b	Merge pull request #2289 from dalf/pylint [mod] pylint: add extension-pkg-whitelist=lxml.etree	2020-11-14 13:24:31 +01:00
Alexandre Flament	46b454277f	Merge pull request #2309 from dalf/mod_search_repr [mod] searx.search: EngineRef, SearchQuery: add __repr__ and __eq__ methods	2020-11-14 13:23:44 +01:00
Alexandre Flament	ebed1461bc	Merge pull request #2300 from dalf/fix-webapp-index [fix] fix of / and /search	2020-11-14 13:23:03 +01:00
Noémi Ványi	43e697681e	New engine: Elasticsearch	2020-11-10 19:53:38 +01:00
Alexandre Flament	8fc74d0d7b	[mod] searx.search: EngineRef, SearchQuery: add __repr__ and __eq__ methods	2020-11-10 10:45:40 +01:00
Alexandre Flament	b3a3ccf2db	[fix] fix of / and /search * URL / : the index page displayed the selected or the default category. * URL / : when the q parameter is set using the URL, the redirect includes the URL query. * URL /search : an empty query doesn't raise an exception.	2020-11-06 12:11:52 +01:00
Adam Tauber	063260d090	[enh] add default http headers - closes #715	2020-11-05 16:14:23 +01:00
Adam Tauber	1b42d42695	Merge pull request #2290 from dalf/fix-misc Various bug fixes	2020-11-03 15:12:25 +01:00
Alexandre Flament	58d72f2692	[mod] pylint: minor code change to allow pylint globally This commit is only a step, it doesn't fix all the issues reported by pylint	2020-11-03 11:35:53 +01:00
Alexandre Flament	e28b56e262	[fix] webadapter: fix locked categories	2020-11-03 10:55:49 +01:00
Alexandre Flament	eed43783f9	[fix] comamnd engine: fix import	2020-11-03 10:55:08 +01:00
Alexandre Flament	a08df82574	[fix] scanr_structure engine: fix import	2020-11-03 10:54:02 +01:00
Marc Abonce Seguin	8d71420b45	[mod] separate index and search routes This makes it easier to separately handle search and index requests from a web server or from a reverse proxy. If a request to index contains a query, a permanent redirect HTTP response is returned. This should give some level of backwards compatibility for users that have set a searx instance in their browser's search bar.	2020-11-02 20:04:03 -07:00
Alexandre Flament	95bd6033fa	[mod] wikidata engine: use one SPARQL request instead of 2 HTTP requests.	2020-10-28 08:09:25 +01:00
Alexandre Flament	ca593728af	[mod] duckduckgo_definitions: display only user friendly attributes / URL various bug fixes	2020-10-28 08:09:25 +01:00
Alexandre Flament	382fded665	[mod] result.py: merge infobox URL and attributes when the same label or the same entity entity are wikidata entity (like "Q42" for "Douglas Adams", see https://www.wikidata.org/wiki/Q42 )	2020-10-28 08:09:25 +01:00
Alexandre Flament	23f4203dfb	[fix] simple theme: infobox: remove useless entity information	2020-10-28 08:09:25 +01:00
Alexandre Flament	ed6696e6bf	[mod] add external_urls.json and wikidata_units.json	2020-10-28 08:09:25 +01:00
Alexandre Flament	5e7060053c	[mod] ahmia_filter.py: minor changes - use result['parsed_url'] - load ahmia_blacklist.txt in searx.datae	2020-10-27 20:00:04 +01:00
Adam Tauber	db703a0283	Merge pull request #565 from MarcAbonce/onions New category: Onions	2020-10-26 14:20:58 +01:00
Adam Tauber	2aef38c3b9	[fix] resolve query_parts regression	2020-10-26 14:15:59 +01:00
Marc Abonce Seguin	32957cdf49	add Ahmia filter plugin for onion results	2020-10-25 17:59:43 -07:00
a01200356	c3daa08537	[enh] Add onions category with Ahmia, Not Evil and Torch Xpath engine and results template changed to account for the fact that archive.org doesn't cache .onions, though some onion engines migth have their own cache. Disabled by default. Can be enabled by setting the SOCKS proxies to wherever Tor is listening and setting using_tor_proxy as True. Requires Tor and updating packages. To avoid manually adding the timeout on each engine, you can set extra_proxy_timeout to account for Tor's (or whatever proxy used) extra time.	2020-10-25 17:59:05 -07:00
Noémi Ványi	33e139cae6	Let admins lock user preferences	2020-10-25 18:06:18 +01:00
Nicholas Kegler	8e15d3e4c1	Open Semantic Search Engine	2020-10-25 17:50:00 +01:00
Adam Tauber	aa3c18dda9	[enh] allow searx query parts anywhere in the query - closes #831	2020-10-25 17:40:36 +01:00
Venca24	2b93e70a26	[fix] code style	2020-10-24 09:20:55 +02:00
Venca24	1cbcf2ccb6	[mod] adapt hash plugin to current version of searx	2020-10-23 21:35:13 +02:00
Venca24	40c552c11e	[fix] hash plugin	2020-10-23 21:26:42 +02:00
Venca24	69e5a58058	[fix] code style	2020-10-23 21:26:42 +02:00
Venca24	1ea9438f5d	[fix] hash plugin	2020-10-23 21:25:10 +02:00
Venca24	c9593c8ffd	[enh] add plugin converting strings into hash digests	2020-10-23 21:25:10 +02:00
Noémi Ványi	116f7a6daa	Force admins to set secret_key if debug mode is disabled This commit also enables debug mode for unit tests.	2020-10-09 18:31:42 +02:00
Noémi Ványi	e158eeee4b	Propagate error messages from YouTube API	2020-10-09 17:34:26 +02:00
Adam Tauber	835d16cbb1	Merge pull request #2255 from kvch/yacy-improvements Add yacy improvements: HTTP digest auth, category checking	2020-10-09 16:34:42 +02:00
Alexandre Flament	cfd21bc475	[fix] fix duckduckgo engine - remove paging support: a "vqd" parameter is required between each request. This parameter is uniq for each request - update the URL (no redirect), use the POST method - language support: works if there is no more than request per minute, otherwise it is ignored !	2020-10-09 16:00:42 +02:00
Noémi Ványi	72c7fd25fe	Add yacy improvements: HTTP digest auth, category checking	2020-10-09 15:06:05 +02:00
Adam Tauber	a05c660e30	[enh] add ability to set enabled plugins from settings - closes #1613 #778	2020-10-09 14:12:31 +02:00
Noémi Ványi	ce000a9fef	Fix XPATH of lobste.rs engine && add timeout	2020-10-09 12:56:37 +02:00
Adam Tauber	da8b227044	[fix] use base_url everywhere if it is defined in settings.yml	2020-10-08 14:19:09 +02:00
Noémi Ványi	f0278d41fc	add ebay enginte to shopping category	2020-10-08 13:20:55 +02:00
Alexandre Flament	a9dc54bebc	[mod] Add searx.data module Instead of loading the data/*.json in different location, load these files in the new searx.data module.	2020-10-07 10:29:34 +02:00
Alexandre Flament	e30dc2f0ba	Merge pull request #2247 from dalf/fix-opensearch [fix] opensearch.xml URL contains method and autocomplete parameters	2020-10-07 10:14:57 +02:00
Alexandre Flament	474d56c77f	Merge pull request #2248 from dalf/fix-webadapter [fix] various fixes of searx.webadapter	2020-10-07 10:12:10 +02:00
Alexandre Flament	d5950079cf	[fix] fix searx.webadapter * Fix "?q=test&engines=wikipedia": fix exception * Fix "?q=test&engines=wikipedia&categories=images": now the engines from images category are included. * Fix parse_timeout: make sure a value is always returned * Various typing fixes (searx.webadapter, searx.search.SearchQuery)	2020-10-06 15:23:19 +02:00
Alexandre Flament	8659212f5a	[fix] drop Python 2: use collections.abc.Iterable instead of collections.Iterable	2020-10-06 09:43:24 +02:00
Alexandre Flament	15013e64d8	[fix] drop Python 2: use importlib instead of imp.load_source imp.load_source is not documented in Python 3 see documentation : https://docs.python.org/3/library/importlib.html#importing-a-source-file-directly partial fix of https://github.com/searx/searx/issues/1674	2020-10-06 09:42:11 +02:00
Alexandre Flament	bfdad7bc0f	[fix] opensearch.xml URL contains method and autocomplete parameters When the user add searx as a search engine, the browser loads the /opensearch.xml URL without the cookies. Without the query parameters, the user preferences are ignored (method and autocomplete). In addition, opensearch.xml is modified to support automatic updates, see https://developer.mozilla.org/en-US/docs/Web/OpenSearch	2020-10-06 00:54:37 +02:00
Alexandre Flament	584760cf54	Merge pull request #2237 from dalf/mod-engines-init Mod engines init	2020-10-05 11:20:46 +02:00
Alexandre Flament	6c39917c4d	[mod] webapp.py: update engines initialization condition Always call initialize engines except on the first run of werkzeug with the reload feature. the reload feature is activated when: * searx_debug is True (SEARX_DEBUG environment variable or settings.yml) * FLASK_APP=searx/webapp.py FLASK_ENV=development flask run (see https://flask.palletsprojects.com/en/1.1.x/cli/ ) Fix SEARX_DEBUG=0 make docs docs/admin/engines.rst : engines are initialized See https://github.com/searx/searx/issues/2204#issuecomment-701373438	2020-10-05 11:13:32 +02:00
Alexandre Flament	b728cb610b	Merge pull request #2241 from dalf/move-extract-text-and-url Move the extract_text and extract_url functions to searx.utils	2020-10-04 09:06:20 +02:00
Alexandre Flament	e2cd9b65bb	Merge pull request #2239 from dalf/mod-preferences [mod] preferences.py: check language setting with a regex instead of match_language	2020-10-04 09:05:14 +02:00
Finn	53c8d945b4	[enh] Add SepiaSearch engine (#2227 ) supported_languages values: see https://framagit.org/framasoft/peertube/search-index/-/blob/master/client/src/views/Search.vue#L618-641	2020-10-03 13:00:10 +02:00
Alexandre Flament	8f914a28fa	[mod] searx.utils.normalize_url: remove Yahoo hack * The hack for Yahoo URLs is not necessary anymore. (see searx.engines.yahoo.parse_url) * move the URL normalization in extract_url to normalize_url	2020-10-03 10:02:50 +02:00
Alexandre Flament	c1d10bde02	[mod] searx/utils.py: add docstring	2020-10-02 18:17:01 +02:00
Alexandre Flament	2006eb4680	[mod] move extract_text, extract_url to searx.utils	2020-10-02 18:13:56 +02:00
Alexandre Flament	507896c115	[mod] preferences.py: check language setting with a regex instead of match_language	2020-10-01 11:29:31 +02:00
Markus Heiser	8162d7aff4	[fix] google engine - div classes has been renamed in HTML reult Since 1. October 2020 google has changed the 'class' attribute of the HTML result page. Fix the xpath expressions and ignore <div class="g" ../> sections which do not match to title's xpath expression. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-10-01 09:44:29 +02:00
Alexandre Flament	9740618227	Merge pull request #2226 from dalf/fix-searx-migration [fix] migration from github.com/asciimoo/searx to github.com/searx/searx : fix URLs	2020-09-29 12:35:11 +02:00
Qt Resynth	246b8cd1a4	[fix] about.html: fix small inconsistencies in about page (#2219 )	2020-09-28 16:56:25 +02:00
Alexandre Flament	f204e4903d	[fix] migration from github.com/asciimoo/searx to github.com/searx/searx : fix URLs	2020-09-28 16:44:14 +02:00
Adam Tauber	8d47142f35	Merge pull request #2189 from dalf/architecture-clean-up Architecture clean up	2020-09-28 14:56:23 +02:00
Alexandre Flament	93f7f7eee2	[mod] upgrade requests to version 2.24.0. use ssl instead of pyopenssl. requests 2.24.0 uses the ssl module except if it doesn't support SNI, in this case searx fallbacks to pyopenssl. searx logs a critical message and exit if the ssl modules doesn't support SNI and pyOpenSSL is not installed. searx logs a critical message and exit if the ssl version is older than 1.0.2. in requirements.txt, pyopenssl is still required to install searx as a fallback.	2020-09-26 19:30:27 +02:00
Alexandre Flament	f2f3300bde	[mod] more typing	2020-09-24 16:26:00 +02:00
Alexandre Flament	485a502b88	[mod] add typing and __slots__	2020-09-22 19:05:05 +02:00
Alexandre Flament	678699beaf	[mod] searx/webadapter.py: add get_selected_categories share common code with get_search_query_from_webapp Update searx/webapp.py to use get_selected_categories Close #2142	2020-09-22 18:59:51 +02:00
Alexandre Flament	d5b5e48f04	[mod] searx/webadapter.py: each web parameter has a dedicated function (parse_pageno, page_lang,....).	2020-09-22 18:59:51 +02:00
Alexandre Flament	691d12726b	[mod] check the engine tokens in searx/webadapter.py instead of searx/search.py	2020-09-22 18:59:51 +02:00
Alexandre Flament	eecfff2689	[mod] check time_range parameter in searx/webadapter.py	2020-09-22 18:59:51 +02:00
Alexandre Flament	2929495112	[mod] add searx.search.EngineRef was previously a Dict with two or three keys: name, category, from_bang make clear that this is a engine reference (see tests/unit/test_search.py for example) all variables using this class are renamed accordingly.	2020-09-22 18:59:51 +02:00
Alexandre Flament	2dbc0de0cd	[mod] add searx/webadapter.py * move searx.search.get_search_query_from_webapp to searx.webadapter * move searx.query.SearchQuery to searx.search	2020-09-22 18:59:51 +02:00
Qt Resynth	21dbc7e852	"Egde" → "Edge"	2020-09-22 17:44:32 +02:00
Alexandre Flament	e8df5d3f7f	[mod] searx.search: change function declaration: online then offline then utility functions.	2020-09-22 12:36:26 +02:00
Alexandre Flament	50e717c452	[mod] searx.search: remove unused global variable number_of_searches	2020-09-22 12:36:26 +02:00
Alexandre Flament	edd8dccd07	[mod] searx.query.RawTextQuery: getSearchQuery and changeSearchQuery rename to getQuery and changeQuery getSearchQuery is confusing, the method returns a str not a SearchQuery object	2020-09-22 12:36:26 +02:00
Alexandre Flament	c4067a9d02	[mod] searx.search.Search: split the search method into different methods	2020-09-22 12:14:46 +02:00
Alexandre Flament	ad0758e52a	[mod] add searx/webutils.py contains utility functions and classes used only by webapp.py	2020-09-22 11:57:06 +02:00
Alexandre Flament	f9664037a6	[mod] refactor searx.webapp.get_locale * Log each call to get_locale: display the URL, the locale and the source (browser, preferences, form). * Rename _get_browser_language to _get_browser_or_settings_language to match the actual code.	2020-09-22 11:49:15 +02:00
Alexandre Flament	2fd582d457	[fix] /autocompleter: return HTTP 400 when q is empty as intent. Fix commit `c225db45c8`	2020-09-22 11:38:37 +02:00
Marc Abonce Seguin	ecf5899153	fetch google's search langs rather than ui langs	2020-09-22 11:37:44 +02:00
Marc Abonce Seguin	c86504b47a	fix utils/fetch_languages to work with new languages	2020-09-22 11:37:44 +02:00
Marc Abonce Seguin	41800835f9	fetch supported languages for startpage engine	2020-09-22 11:37:44 +02:00
Marc Abonce Seguin	ea9d979cc3	add language names in qwant's fetch languages function	2020-09-22 11:37:44 +02:00
Alexandre Flament	375cbd12b3	Merge pull request #2205 from dalf/fix-simple-theme-autocomplete [fix] simple theme: fix autocomplete	2020-09-19 16:02:01 +02:00
Alexandre Flament	c23401e9fa	[fix] simple theme: fix autocomplete AJAX requests send the X-Requested-With HTTP header, so searx.webapp.autocompleter returns the results with the expected data format. Related to #2127 Close #2203	2020-09-19 10:13:05 +02:00
Alexandre Flament	6deb85072a	[fix] searx.utils.HTMLTextExtractor: invalid HTML don't raise an Exception Close #2188	2020-09-13 10:28:11 +02:00
Alexandre Flament	df12ed6e55	[mod] searx.RawTextQuery: the constructor call parse_query	2020-09-12 15:25:58 +02:00
Alexandre Flament	bdac99d4f0	Drop Python 2 (5/n): searx.utils.is_valid_lang, input parameter is a str instead of bytes Fix bug in translated.py and dictzone.py	2020-09-10 10:49:42 +02:00
Dalf	c225db45c8	Drop Python 2 (4/n): SearchQuery.query is a str instead of bytes	2020-09-10 10:49:42 +02:00
Dalf	7888377743	Drop Python 2 (3/n): objects	2020-09-10 10:39:04 +02:00
Dalf	78df10fb55	Drop Python 2 (2/n): templates	2020-09-10 10:39:04 +02:00
Dalf	1022228d95	Drop Python 2 (1/n): remove unicode string and url_utils	2020-09-10 10:39:04 +02:00
Marc Abonce Seguin	7e82817925	wait for img to load before hiding infobox toggle	2020-09-10 09:54:30 +02:00
Marc Abonce Seguin	ab20ca182c	use Wikipedia's REST v1 API	2020-09-10 09:54:30 +02:00
Alexandre Flament	d0f9778c2a	[mod] results.py: code clean up (#2140 )	2020-09-08 10:09:11 +02:00
Noémi Ványi	f0ca1c3483	[enh] Add command line engines: git grep, find, etc. (#2128 ) A new "base" engine called command is introduced. It is the foundation for all command line engines for now. You can use this engine to create your own command line engine. Add some engines (commented out to make sure no one enables anything accidentally): * git grep: This engine lets you grep in the searx repo. * locate: If locate is installed and initialized, you can search on the FS. * find: You can find files with a specific name from where you started searx. * pattern search in files: This engine utilizes the command fgrep. * regex search in files: This engine runs `grep` to find a file based on its contents.	2020-09-08 09:51:53 +02:00
Alexandre Flament	3397382754	[enh] stop searx when an engine raise an SyntaxError exception (#2177 ) and some other exceptions: * KeyboardInterrupt * SystemExit * RuntimeError * SystemError * ImportError: an engine with an unmet dependency will stop everything.	2020-09-07 15:39:26 +02:00
Scott Wallace	8bcba31e31	Add key to settings.yml for opening result links in a new tab Closes #1552 Closes #444	2020-09-01 18:10:24 +01:00
Adam Tauber	4a913247b2	[enh] add option to configure proxies per engine - closes #1827	2020-09-01 15:59:22 +02:00
Alexandre Flament	b329058c1a	Revert "[enh] test: load each engine to check for syntax errors" This reverts commit `4fb3ed2c63`.	2020-08-31 19:00:06 +02:00
Singustromo	315cdfee09	Added metager-search (#2139 ) * Added metager-search	2020-08-31 18:42:51 +02:00
Adam Tauber	6f9aa0e258	Merge pull request #2160 from dalf/test_load_engine [enh] test: load each engine to check for syntax errors	2020-08-31 14:29:52 +02:00
Adam Tauber	6ded6e7a9a	[fix] skip uncomplete image results - closes #1496	2020-08-31 14:07:45 +02:00
Dalf	4fb3ed2c63	[enh] test: load each engine to check for syntax errors	2020-08-28 12:12:32 +02:00
Marc Abonce Seguin	a2430154b9	fix selects in preferences so they look consistent (#2150 )	2020-08-27 21:55:47 +02:00
Marc Abonce Seguin	0d8970c8f2	only return one url per "type" in Wikidata (#2151 ) i.e. only one official website, one Twitter, etc.	2020-08-27 21:44:48 +02:00
Adam Tauber	079783e993	[fix] pylint	2020-08-27 14:38:39 +02:00
Adam Tauber	30d16e7ee6	[fix] use base_url for prefix of sharing 'currenly saved preferences' - fixes #1249 by @matejc	2020-08-27 14:29:38 +02:00
Adam Tauber	6278538890	[fix] add search language and time range filter to suggestions - fixes #1314	2020-08-27 14:26:38 +02:00
Émilien Devos	a5e6423c39	[fix] opensearch on chromium for android (#2132 )	2020-08-18 18:29:58 +02:00
Émilien Devos	27d74826f1	[enh] add yggtorrent engine (#2135 )	2020-08-18 18:02:41 +02:00
Emilien Devos	c15a91a534	[fix] piratebay engine date and pep8 indentation	2020-08-10 23:44:53 +02:00
Emilien Devos	52d78d8418	[fix] piratebay engine	2020-08-10 20:26:59 +02:00
Adam Tauber	77103c7874	Merge pull request #2116 from mikeri/invidiousres Include author and video length in Invidious results	2020-08-10 12:49:17 +02:00
Adam Tauber	e6d002a730	Merge pull request #2130 from msafadieh/master Make default query submission method configurable	2020-08-10 12:15:45 +02:00
Marc Abonce Seguin	0601f2bb48	add toggle to resize infobox	2020-08-10 00:12:45 -07:00
Marc Abonce Seguin	57bad502a6	add visually-hidden css class to pointhi style	2020-08-09 20:44:26 -07:00
Marc Abonce Seguin	74270a3fc2	add class for infobox's official url	2020-08-09 20:44:26 -07:00
Marc Abonce Seguin	001eb047cd	set max-height on infobox's images	2020-08-09 20:44:26 -07:00
Marc Abonce Seguin	c9c39b3e79	add engine's name in infobox's header	2020-08-09 15:42:55 -07:00
Marc Abonce Seguin	574e99c4de	reduce space between title and url in infobox header	2020-08-09 15:42:55 -07:00
Mohamad Safadieh	8dff74dd1b	Make default query submission method configurable Sending queries through POST, while better for privacy, breaks functionality with certain extensions (e.g. Firefox containers). Since Firefox does not send cookies when requesting `/opensearch.xml`, users cannot easily switch to GET on the client side unless they make a custom search engine. This commit allows admins to modify the default method on their side so they can set it to GET if needed.	2020-08-09 17:04:47 -04:00
Mohamad Safadieh	1ea35605d1	Use query params for browser autocomplete Sending query params over GET seems to be the only way to be able to enable autocomplete in the browser. This commit adds the necessary URL formatting to opensearch.xml. In order to identify queries coming from the URL bar (rather than an AJAX request), which requires a different JSON format and MIME type, the request headers are checked for "X-Requested-With: XMLHttpRequest" which is added by jQuery request.	2020-08-09 07:59:49 -04:00
Vlad	f678388dbc	Fix google images 'get image' button bug from issue #2103 (#2115 ) Closes #2103	2020-08-08 19:35:22 +02:00
Michael Ilsaas	a1ce141c99	add peertube engine (#2109 )	2020-08-08 19:22:53 +02:00
Vlad	c3af520c33	Fix search error with query 'random sha256'	2020-08-04 15:47:41 +03:00
Michael Ilsaas	2ed8ad7691	include length in invidious results	2020-08-02 13:31:04 +02:00
Michael Ilsaas	0305fe0dd5	include author in invidious results	2020-08-02 13:30:38 +02:00
Noémi Ványi	935321226b	Merge branch 'master' into patch-1	2020-08-01 21:52:19 +02:00
Vlad	d83ee1e413	Add clearfix to fix issue 2110	2020-07-31 20:08:45 +03:00
asht	3b8bd0770b	Change isAlive() to is_alive() as isAlive() is unsupported in newer Python versions	2020-07-31 00:28:54 +03:00
Adam Tauber	d75f98c764	Merge pull request #2106 from kvch/revert-open-result-on-new-tab-plugin Revert "[enh] new plugin to open results on new browser tabs"	2020-07-30 21:25:42 +02:00
Lynda Lopez	b06fc31942	DOI improvements: enable HTTPS, update URL of doai.io (#1718 ) - enabling HTTPS for sci-hub.tw by default - making sci-hub the default DOI resolver as it has the largest collection of scientific articles. - replaced doai.io with dissem.in, as it redirects to this new domain. Co-authored-by: Aurora of Earth <auroraofearth@ya.ru>	2020-07-29 22:31:48 +02:00
Noémi Ványi	74013c212a	Revert "[enh] new plugin to open results on new browser tabs" This reverts commit `ab6a7601cb`. Closes #2037	2020-07-29 22:10:16 +02:00
Noémi Ványi	157fa1adb3	add Gitea engine Closes #1448 Closes #1447	2020-07-28 22:37:37 +02:00
TheEvilSkeleton	925be22d8f	Replaced dash with em in searx description (#1973 ) Very small change, but it looks better	2020-07-28 21:54:35 +02:00
Venca24	d3bc171a15	[add] naver engine It adds new search engine for users from the South Korea (and therefore it is disabled by default). Closes #1553	2020-07-28 21:42:48 +02:00
Adam Tauber	93ac4db312	[enh] copy atime_ns and mtime_ns of external plugin resources	2020-07-28 13:57:57 +02:00
Adam Tauber	164e4725f3	[mod] add dedicated directory to external plugins with gitignore file	2020-07-28 13:10:40 +02:00
Adam Tauber	3f60bb470a	[fix] correct imported modules	2020-07-28 13:10:40 +02:00
Adam Tauber	dff879d07d	[fix] resolve minor review issues	2020-07-28 13:10:40 +02:00
Adam Tauber	e45a269ecb	[mod] create static directory for each external plugin	2020-07-28 13:10:40 +02:00
Adam Tauber	81e9c75534	[fix] pep8	2020-07-28 13:10:40 +02:00
Adam Tauber	7b93d11d84	[fix] add plugin sha sum check to be able to copy updated resources	2020-07-28 13:10:40 +02:00
Adam Tauber	1f2dc6c647	[enh] add external plugin support	2020-07-28 13:10:40 +02:00
Marc Abonce Seguin	77b9faa8df	fix Wikipedia's paragraph extraction	2020-07-26 23:53:40 -07:00
Michael Ilsaas	98cb6b6701	Update torrentz2 URL from .eu to .is	2020-07-26 15:56:54 +02:00
xywei	1d4657b714	Fix relative urls that do not start with '/'	2020-07-23 11:12:19 -05:00
Lukáš Kucharczyk	74e4e5e507	Allow localization of "Self Informations" Allows the string "Self Informations" in the plugin of the same name to be localized by wrapping it with gettext().	2020-07-16 15:26:01 +02:00
Dalf	b339b8b6d6	[mod] bangs.json: remove the favicons fix #2076	2020-07-15 09:15:26 +02:00
Gaspard d'Hautefeuille	4e346e741a	fix python 3 support	2020-07-12 23:43:24 +01:00
Dalf	718715180d	[mod] external_bang.py: always read bangs.json with a UTF-8 file.	2020-07-11 12:23:08 +02:00
Adam Tauber	8199ab50f9	[enh] release v0.17.0	2020-07-09 17:31:28 +02:00
Adam Tauber	b7d2597f2e	[enh] update translations	2020-07-09 15:15:52 +02:00
Adam Tauber	e693bccaf4	[mod] drop py2 support	2020-07-09 15:04:00 +02:00
Adam Tauber	52eba0c721	[fix] pep8	2020-07-08 00:46:03 +02:00
Markus Heiser	16f8ec894a	[fix] revise google images engine this commit is picked from #1985	2020-07-07 21:59:15 +02:00
Markus Heiser	410c2f903d	[fix] revise google engine this commit is picked from #1985	2020-07-07 21:50:59 +02:00
Adam Tauber	3227695b0b	[fix] indicate visually active tab programmatically on the page Preferences - #350	2020-07-06 13:07:45 +02:00
Lukas van den Berk	4829a76aae	Created new plugin type custom_results. Added new plugin bang_redirect (#2027 ) * Made first attempt at the bangs redirects plugin. * It redirects. But in a messy way via javascript. * First version with custom plugin * Added a help page and a operator to see all the bangs available. * Changed to .format because of support * Changed to .format because of support * Removed : in params * Fixed path to json file and changed bang operator * Changed bang operator back to & * Made first attempt at the bangs redirects plugin. * It redirects. But in a messy way via javascript. * First version with custom plugin * Added a help page and a operator to see all the bangs available. * Changed to .format because of support * Changed to .format because of support * Removed : in params * Fixed path to json file and changed bang operator * Changed bang operator back to & * Refactored getting search query. Also changed bang operator to ! and is now working. * Removed prints * Removed temporary bangs_redirect.js file. Updated plugin documentation * Added unit test for the bangs plugin * Fixed a unit test and added 2 more for bangs plugin * Changed back to default settings.yml * Added myself to AUTHORS.rst * Refacored working of custom plugin. * Refactored _get_bangs_data from list to dict to improve search speed. * Decoupled bangs plugin from webserver with redirect_url * Refactored bangs unit tests * Fixed unit test bangs. Removed dubbel parsing in bangs.py * Removed a dumb print statement * Refactored bangs plugin to core engine. * Removed bangs plugin. * Refactored external bangs unit tests from plugin to core. * Removed custom_results/bangs documentation from plugins.rst * Added newline in settings.yml so the PR stays clean. * Changed searx/plugins/__init__.py back to the old file * Removed newline search.py * Refactored get_external_bang_operator from utils to external_bang.py * Removed unnecessary import form test_plugins.py * Removed _parseExternalBang and _isExternalBang from query.py * Removed get_external_bang_operator since it was not necessary * Simplified external_bang.py * Simplified external_bang.py * Moved external_bangs unit tests to test_webapp.py. Fixed return in search with external_bang * Refactored query parsing to unicode to support python2 * Refactored query parsing to unicode to support python2 * Refactored bangs plugin to core engine. * Refactored search parameter to search_query in external_bang.py	2020-07-03 13:25:04 +00:00
Noémi Ványi	223114c575	[fix] refine contrast ratios of texts and borders - #350	2020-07-02 16:24:58 +02:00
Markus Heiser	f14a7add31	Merge branch 'master' of https://github.com/asciimoo/searx into csp-oscar-theme	2020-06-30 15:37:39 +02:00
Markus Heiser	8d318ee142	Merge branch 'master' into gigablast	2020-06-29 16:09:59 +00:00
Sophie Tauchert	71db7b1238	Fix YaCy text results returned as images	2020-06-29 14:48:56 +02:00
Markus Heiser	02017bc624	Merge branch 'master' into duckduckgo_correction	2020-06-29 06:47:06 +00:00
Adam Tauber	c7b75fc818	[fix] rewrite overflow:none as none is an invalid property - $350	2020-06-28 20:44:33 +02:00
Adam Tauber	b51d4ec041	[fix] add aria labels to result links - #350	2020-06-28 20:41:42 +02:00
Noémi Ványi	93cbd85b8a	Merge branch 'master' into duckduckgo_correction	2020-06-28 20:28:12 +02:00
Noémi Ványi	02c6710564	Make Oscar theme scalable	2020-06-27 16:41:26 +02:00
Markus Heiser	5f201dea7d	Merge branch 'master' into about-opensearch	2020-06-26 08:33:37 +00:00
Markus Heiser	5fac6cffa2	Merge branch 'master' into gigablast	2020-06-26 08:09:33 +00:00
Markus Heiser	5293e58032	[fix] yahoo engine - changed content_xpath Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-06-25 21:45:42 +02:00
Adam Tauber	969b4340fd	[fix] add label/info to Time range search and Language - #350	2020-06-25 19:50:26 +02:00
Adam Tauber	cc164abdfc	[fix] make "Advanced settings" openable and usable with keyboard - #350	2020-06-25 19:50:26 +02:00
Adam Tauber	ec48447361	[fix] change lang attribute of the html to match the current locale - #350	2020-06-25 19:50:26 +02:00
Adam Tauber	6ab569f558	[fix] connect selects and inputs programmatically on the preferences page - #350	2020-06-25 19:50:26 +02:00
Adam Tauber	fce2d49651	[fix] use scope attribute to describe properties in the engine preferences table	2020-06-25 19:50:26 +02:00
Adam Tauber	5ca5286912	[fix] indicate too high max time by e.g. icon not only by colour	2020-06-25 19:50:26 +02:00
Adam Tauber	d418b593bb	[fix] do not use h1 element for the logo	2020-06-25 19:50:26 +02:00
Adam Tauber	01ee3a6edd	[fix] remove redundant alt texts from images in Videos, Social Media and Music results - #350	2020-06-25 19:50:26 +02:00
Markus Heiser	fc370faa5b	Merge branch 'master' into gigablast	2020-06-25 05:42:28 +00:00
Markus Heiser	a059c59cea	Merge branch 'master' into about-opensearch	2020-06-25 05:42:11 +00:00
Markus Heiser	34264f0b0a	Merge branch 'master' into proxify-dataurl	2020-06-24 17:07:05 +00:00
Adam Tauber	a984afd6a3	[enh] make checkboxes in preferences accessible using keyboard - #350	2020-06-23 21:45:57 +02:00
Adam Tauber	2ff6214a4d	[fix] remove alt text which doesnt add extra info - #350	2020-06-23 21:45:57 +02:00
Adam Tauber	cc84566e0a	[enh] add visually hidden but accessible css class - #350	2020-06-23 21:45:57 +02:00
Dalf	4c7b787004	[mod] don't try to proxify data URL. Previously only image/jpeg was not proxied. This commit don't proxify all MIME types starting with "image/". This is a quick fix for the PR #1985 : the google_image engine can returns some data URL.	2020-06-22 13:57:33 +02:00
Markus Heiser	4eab5cf854	Merge branch 'master' into gigablast	2020-06-19 04:51:48 +00:00
Markus Heiser	1db37a0cc3	Merge branch 'master' into about-opensearch	2020-06-19 04:51:29 +00:00
Markus Heiser	ca1c3bd15d	Merge branch 'master' into csp-oscar-theme	2020-06-19 04:51:02 +00:00
Noémi Ványi	4ec2fab583	Consider HTTP request when running search categories on select is enabled Closes #1138	2020-06-18 23:06:09 +02:00
Adam Tauber	08c13daf85	[enh] update opensearch.xml to match major search engines opensearch.xml	2020-06-18 19:38:13 +02:00
Markus Heiser	cc721b5d86	Merge branch 'master' of https://github.com/asciimoo/searx into csp-oscar-theme	2020-06-16 10:17:03 +02:00
Markus Heiser	59739a44db	Merge branch 'master' into about-opensearch	2020-06-16 07:37:06 +00:00
Markus Heiser	223430ff30	Merge branch 'master' into gigablast	2020-06-16 07:36:44 +00:00
Markus Heiser	dda4a46f8e	Merge branch 'master' into filtron	2020-06-16 05:56:12 +00:00
Adam Tauber	0dc5bdb6ef	[fix] add missing template file	2020-06-15 20:11:12 +02:00
Adam Tauber	32f7877235	[fix] resolve flickr_noapi encoding issues	2020-06-15 19:15:24 +02:00
Adam Tauber	4ca0d8cb0f	[enh] add translatable strings to javascript - closes #461	2020-06-15 18:31:14 +02:00
Gordon Quad	385e9b5c9e	add correction support for duckduckgo	2020-06-13 22:43:10 +01:00
Markus Heiser	e088b95e74	Merge branch 'master' of https://github.com/asciimoo/searx into csp-oscar-theme	2020-06-10 07:25:44 +02:00
Markus Heiser	4496ad1218	Merge branch 'master' into filtron	2020-06-10 04:55:41 +00:00
Markus Heiser	cc82303b62	Merge branch 'master' into about-opensearch	2020-06-10 04:55:04 +00:00
Markus Heiser	ee0da61cbb	Merge branch 'master' into gigablast	2020-06-10 04:54:57 +00:00
Adam Tauber	aa7c043ff4	[fix] resolve pep8 errors	2020-06-10 00:34:57 +02:00
Adam Tauber	43f7b84a59	[fix] do not stretch images - fixes #1262	2020-06-10 00:30:39 +02:00
Adam Tauber	29960aa1d9	[enh] add official site link to the top of the infobox - closes #1644	2020-06-09 23:49:13 +02:00
Adam Tauber	6c06286251	[enh] add length and author details to youtube videos closes #775	2020-06-09 20:31:51 +02:00
Adam Tauber	2c6531b233	[enh] add routing directions to osm search - closes #254	2020-06-09 17:18:44 +02:00
Markus Heiser	2b1f73ad49	Merge branch 'master' into about-opensearch	2020-06-09 08:29:48 +00:00
Markus Heiser	d065b9e4fb	Merge branch 'master' into csp-oscar-theme	2020-06-09 08:28:53 +00:00
Markus Heiser	3d6a7302a2	Merge branch 'master' of https://github.com/asciimoo/searx into gigablast	2020-06-09 10:27:10 +02:00
Markus Heiser	28181ba34f	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-06-09 10:20:20 +02:00
Adam Tauber	785f0938fd	[fix] add link to wikidata entities in infobox - fixes #1097	2020-06-09 01:31:57 +02:00
Adam Tauber	d5e146251f	[enh] add subscribe link to rss results - closes #468	2020-06-09 01:05:15 +02:00
Adam Tauber	f0819e8826	[enh] add engine names to results as classes - closes #670	2020-06-09 00:31:52 +02:00
Adam Tauber	c6ca468df2	[fix] wrap long lines in infoboxes - fixes #1652	2020-06-04 23:22:44 +02:00
Markus Heiser	d9c1d5192d	Merge branch 'master' into gigablast	2020-06-04 21:20:30 +00:00
Markus Heiser	434e452d54	Merge branch 'master' of https://github.com/asciimoo/searx into csp-oscar-theme	2020-06-04 23:18:22 +02:00
Markus Heiser	1fc0e9ddc5	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-06-04 21:22:53 +02:00
Adam Tauber	de1b08a941	[enh] add unique class for each endpoint - closes #1133	2020-06-04 19:21:15 +02:00
Noémi Ványi	640da73a9e	make category order configurable using ui.categories_order	2020-06-03 21:33:14 +02:00
Markus Heiser	2b2a882df0	Merge branch 'master' into filtron	2020-06-03 16:33:06 +00:00
Adam Tauber	08fdfc73fb	[fix] do not autocomplete for pressing enter when mouse is on the completion list - fixes #340	2020-06-03 15:36:22 +02:00
Adam Tauber	47cddcab8b	[mod] reduce the gap between results	2020-06-03 15:04:01 +02:00
Adam Tauber	c54a0e81ff	[enh] add shortcut column to search engines table in preferences - fixes #230	2020-06-03 13:49:20 +02:00
Adam Tauber	bab5efeac9	[enh] update npm dependency versions	2020-06-03 13:44:55 +02:00
Adam Tauber	f47e6fc0f8	[enh] build css after less file changes	2020-06-03 13:44:40 +02:00
Adam Tauber	ceedab6aed	Merge pull request #983 from ahangarha/patch-1 Update results.less	2020-06-03 13:35:21 +02:00
Markus Heiser	b85d845636	Merge branch 'master' of https://github.com/asciimoo/searx into about-opensearch	2020-06-01 09:43:19 +02:00
Markus Heiser	6fc26775e4	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-06-01 09:25:30 +02:00
Markus Heiser	a3431d59d3	Merge branch 'master' of https://github.com/asciimoo/searx into csp-oscar-theme	2020-06-01 09:18:51 +02:00
Markus Heiser	74135007eb	Merge branch 'master' into gigablast	2020-06-01 06:23:45 +00:00
Adam Tauber	19e32dc686	Merge pull request #1978 from kvch/fix-rtl-in-oscar Fix Farsi language in Oscar && adjust tables with RTL	2020-05-31 23:45:14 +02:00
Noémi Ványi	a3e15a3df6	Fix Farsi language in Oscar && adjust tables with RTL	2020-05-31 23:44:34 +02:00
Adam Tauber	da02e0b8d8	Merge pull request #1979 from kvch/feature-toggle-all-buttons Add "Allow all" and "Disable all" to engines tab of Oscar preferences	2020-05-31 23:40:49 +02:00
Noémi Ványi	d7d89369cb	add disable all and allow all engines button to Oscar preferences	2020-05-31 23:39:21 +02:00
Noémi Ványi	e3282748d0	add display_error_messages option to engine settings A new option is added to engines to hide error messages from users. It is called `display_error_messages` and by default it is set to `True`. If it is set to `False` error messages do not show up on the UI. Keep in mind that engines are still suspended if needed regardless of this setting. Closes #1828	2020-05-31 19:17:48 +02:00
Markus Heiser	ee5d2b319b	[fix] gigablast requires a random extra parameter Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-29 12:48:58 +02:00
Markus Heiser	a18760b322	[fix] revise of the gigablast engine (WIP) The gigablast API has changed and seems to have some quirks, this is the first revise. More work (hacks) are needed. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-28 19:24:03 +02:00
Markus Heiser	57c7b90edd	[fix] gigablast does no longer support supported_languages_url Since there are zero results, we can remove it: $ make engines.languages fetch languages .. ... fetched 0 languages from engine gigablast Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-28 15:21:01 +02:00
Markus Heiser	de179ecc5b	[fix] remove debug print from commit `e5305f8` Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-28 15:17:59 +02:00
Markus Heiser	d44b034817	Merge branch 'master' into master	2020-05-28 11:09:15 +00:00
resynth1943	e84cdb66ae	Add autofocus to all search inputs	2020-05-27 13:49:00 +01:00
Markus Heiser	fcc5af66d8	[fix] disable debug in settings.yml by default debug was accidentally enabled in commit `cbc08fd` Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-21 15:16:49 +02:00
Sion Kazama	74e6f5d724	Revise outdated URLs	2020-05-19 20:47:35 +08:00
Markus Heiser	c9f9e7da52	[build] rebuild of the oscar theme, build from `ad208378` the CSS files has been build by: $ make themes.oscar Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-15 10:23:21 +02:00
Markus Heiser	ad208378bb	[fix] oscar theme, remove inline style attributes (CSP compliants) Inline styles are blocked by default with Content Security Policy (CSP). Move the rest of inline styles to CSS and correct the HTML template of the oscar preference page. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-15 10:16:49 +02:00
Markus Heiser	e7788980ad	[fix] about page- 'How to set as the default search engine?' Searx supports OpenSearch, remove the inline JS from the about page. close: https://github.com/asciimoo/searx/issues/1949 close: https://github.com/asciimoo/searx/issues/1616 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-05-12 14:17:47 +02:00
Markus Heiser	1fdd8cd3c0	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-04-22 14:24:59 +02:00
Émilien Devos	7a50522a82	Update default user agents	2020-04-21 20:50:16 +00:00
Markus Heiser	9302d1fc17	Merge branch 'master' into master	2020-04-20 12:44:50 +00:00
Markus Heiser	4b4e95f2c3	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-04-19 12:03:14 +02:00
Noémi Ványi	bce3830b8d	[fix] translate engine errors to Occitan when configured	2020-04-17 23:39:48 +02:00
Noémi Ványi	ba7c8d7b96	[fix] remove usage of request context where not available	2020-04-17 23:39:48 +02:00
Noémi Ványi	fcb44c6542	Merge branch 'master' into fix_startpage_ValueError_on_spanish_datetime	2020-04-15 23:33:16 +02:00
HLFH	3a26093c46	Remove discontinued faroo engine	2020-04-15 16:46:15 +01:00
Markus Heiser	f2ca12b54f	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-04-13 13:01:07 +02:00
Noémi Ványi	7878176bb0	Merge branch 'master' into wikimedia-projects	2020-04-12 21:35:37 +02:00
Splinter Suidman	83fa88cbec	fix: Change Wikiversity and Wikivoyage shortcuts to wv and wy. Suggested by @Venca24 <https://github.com/asciimoo/searx/pull/1914#issuecomment-610194209>.	2020-04-07 11:05:35 +02:00
Splinter Suidman	87fba9c12d	fix: Remove unnecessary query parameter for Wikimedia projects.	2020-04-06 15:59:00 +02:00
Splinter Suidman	c37544e6be	fix: Spelling of Wiktionary.	2020-04-06 12:31:32 +02:00
Splinter Suidman	2b453cb226	fix: Change Wikinews category to news.	2020-04-06 12:31:00 +02:00
Splinter Suidman	536eb2b8dd	Add Wikimedia projects. A list of the added projects: - Wikibooks - Wikinews - Wikiquote - Wikisource - Wiktionary - Wikiversity - Wikivoyage	2020-04-05 19:27:44 +02:00
Venca24	5cb9d9e56a	[add] rubygems engine	2020-04-03 17:31:59 +02:00
Markus Heiser	81b9848eb9	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-03-31 18:29:00 +02:00
Dalf	4bb35e7ef5	[fix] template: fix typo in about.html	2020-03-31 16:52:52 +02:00
Markus Heiser	0742c2504d	build environment: add GIT_BRANCH variable Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-29 16:28:17 +02:00
Markus Heiser	65b22be1f4	Merge PR #1900 of https://github.com/asciimoo/searx into filtron Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-29 13:03:27 +02:00
Markus Heiser	6846402d73	.gitignore: make package-lock.json visible Even if we do not versioning them right now. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-26 15:35:32 +01:00
Markus Heiser	9717521981	Minor improvements of the HTML about page Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-26 13:45:37 +01:00
Markus Heiser	809e6f7933	make project: re-build generic files of the searx project Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-26 13:35:17 +01:00
Markus Heiser	5d087ee466	Rewrite of the HTL about page The about page should only address higher-level issues that are important to each user. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-26 13:09:29 +01:00
Markus Heiser	3486613a19	brands: hardcode ISSUE_URL and some links on the about-page A brand of searx is a fork which might have its own design and some special functions which might bee reasonable in a special context. In this sense, the fork might have its own documentation but not its own issue tracker. The upstream of a brand is always https://github.com/asciimoo from where the brand-fork pulls the master branch regularly. A fork which has its own issue tracker is a spin-off and out of the scope of the searx project itself. The conclusion is: - hard code ISSUE_URL (in the Makefile) - always refer to DOCS_URL - links in the about page refer to the upstream (searx project) except DOCS_URL - "fork me on github" ribbons refer to the upstream Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-26 10:58:25 +01:00
Markus Heiser	3381471933	brands: add ISSUE_URL Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-25 17:48:34 +01:00
Markus Heiser	4d64828237	webapp.py: expose the brand variable in the /config URL. E.g. helpful for searx-stats2 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-25 17:28:32 +01:00
Markus Heiser	ace7d30aed	webapp.py: partial code review (no functional change) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-25 17:12:02 +01:00
Markus Heiser	d471ec86dd	Makefile: add target node.env - download & install npm dependencies Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-25 16:38:52 +01:00
Markus Heiser	757ebb5d9f	[fix] brands: add variables from build env to grunt process We have some variables in the build environment which are also needed in the grunt process when building themes. Theses variables are relavant if one creates a fork with its own branding. We treat these variables under the term 'brands'. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-25 14:09:47 +01:00
Markus Heiser	aaf22baad2	make project: re-build generic files of the searx project Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-25 12:14:21 +01:00
Markus Heiser	04c687403e	[fix] brands: add variables from build env to jinja templating We have some variables in the build environment which are also needed in the templating process. Theses variables are relavant if one creates a fork with its own branding. We treat these variables under the term 'brands'. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-25 11:49:33 +01:00
Markus Heiser	95bed4910a	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-03-23 14:46:25 +01:00
Adam Tauber	9a2f26d915	[enh] submit search on suggestion select - closes #807	2020-03-23 14:01:33 +01:00
Adam Tauber	65cae85735	[fix] load new page with infinite scroll if there is no scrollbar - fixes #759	2020-03-23 13:05:19 +01:00
Adam Tauber	2621c24cc7	[enh] add clear search button to oscar theme - fixes #454	2020-03-23 12:41:02 +01:00
Markus Heiser	baddb8d3eb	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-03-21 18:46:26 +01:00
Adam Tauber	822aee94a2	[fix] remove debug print	2020-03-16 00:22:38 +01:00
Adam Tauber	baca55c94e	[fix] handle weights in accept language parsing - fixes w3ms en;q=1.0	2020-03-16 00:22:15 +01:00
Markus Heiser	26b85659c0	Merge branch 'master' of https://github.com/asciimoo/searx into filtron	2020-03-15 09:19:26 +01:00
Adam Tauber	58a630308a	[fix] convert query to string to produce valid filename for csv output	2020-03-13 00:57:01 +01:00
Adam Tauber	018b681841	[fix] add answers, suggestions, corrections to csv output fixes #1888	2020-03-13 00:50:19 +01:00
Adam Tauber	9bc24080bf	[fix] add answers, suggestions, corrections to rss output fixes #1888	2020-03-13 00:43:05 +01:00
Spühler Stefan	4f90fb6a92	[Fix] Startpage ValueError on Spanish date format datetime.parser.parse() does not know the Spanish date format which leads to a ValueError. Fixes #1870 Traceback (most recent call last): File "/usr/local/searx/searx/search.py", line 160, in search_one_http_request_safe search_results = search_one_http_request(engine, query, request_params) File "/usr/local/searx/searx/search.py", line 97, in search_one_http_request return engine.response(response) File "/usr/local/searx/searx/engines/startpage.py", line 102, in response published_date = parser.parse(date_string, dayfirst=True) File "/usr/local/searx/searx-ve/lib/python3.6/site-packages/dateutil/parser/_parser.py", line 1358, in parse return DEFAULTPARSER.parse(timestr, **kwargs) File "/usr/local/searx/searx-ve/lib/python3.6/site-packages/dateutil/parser/_parser.py", line 649, in parse raise ValueError("Unknown string format:", timestr) ValueError: ('Unknown string format:', '24 Ene 2013')	2020-03-09 09:31:20 +01:00
Markus Heiser	cbc08fdc26	docs: describe uwsgi setup of all suported distributions Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-04 19:56:40 +01:00
Markus Heiser	ad7a6e6e10	bugfix(!biv) : bing-video do not like "older" User-Agents When selecting other languages than 'en', bing-video did not handle the language correct and gave very bad results. Since User-Agent is normaly rotated in searx, the behavior of a !biv search was unpredictable and paging was broken. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-01 17:28:59 +01:00
Markus Heiser	1c853f9573	bing_news: parital rollback of `c89c05bc` The bing_news bug (discussed in #1838) was caused by wrong language tags, which was fixed `e0c99d9d` / no need to change the bing_news search string. closes: https://github.com/asciimoo/searx/issues/1838 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-01 11:07:59 +01:00
Markus Heiser	79412828cd	update languages: engines_languages.json languages.py build by Makefile target: make project Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-01 08:06:51 +01:00
Markus Heiser	e0c99d9dcb	bugfix: fetch_supported_languages bing, -news, -videos, -images Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-01 08:01:36 +01:00
Markus Heiser	40843fe95a	searx/data/engines_languages.json: sort json file (no content change) To get meaningfull diffs, the json file has to be sorted. Before applying any further content patch, the json file needs a inital sort (without changing any content). Sorted by:: import sys, json with open('engines_languages.json') as f: j = json.load(f) with open('engines_languages.json', 'w') as f: json.dump(j, f, indent=2, sort_keys=True) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-03-01 07:56:46 +01:00
Markus Heiser	c89c05bceb	bugfix: google-news and bing-news has changed the language parameter closes: https://github.com/asciimoo/searx/issues/1838 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-25 18:44:28 +01:00
Markus Heiser	8685d1b7d8	Merge branch 'master' into fix-prefs	2020-02-24 08:16:42 +01:00
Markus Heiser	aa95a0d70b	searx/testing.py: fixed pep8 error Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-24 07:55:14 +01:00
Marc Abonce Seguin	51e78211de	monkey patch babel get_translations to support Occitan	2020-02-23 21:46:26 -07:00
Markus Heiser	81f106e5de	searx/testing.py: bugfix process model (do not use Flask's debug mode) Don't enable Flask's debug mode, the debugger from Flask will cause a wired process model, where the server never dies. Further read: - debug mode: https://flask.palletsprojects.com/quickstart/#debug-mode - Flask.run(..): https://flask.palletsprojects.com/api/#flask.Flask.run closes: https://github.com/asciimoo/searx/issues/1862 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-23 23:03:05 +01:00
Markus Heiser	4a94b4cca6	searx/testing.py: pylint & SPDX tag (no functional change) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-23 22:51:07 +01:00
Markus Heiser	1cae4fa88d	preferences.py: implement defaults if unset Implemnts defaults for: - search.default_lang, search.autocomplete, search.safe_search, - ui.default_theme, ui.default_locale - server.image_proxy This fixes also: https://github.com/asciimoo/searx/pull/1860#issuecomment-590082955 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-23 20:56:05 +01:00
Markus Heiser	179be12732	preferences.py: pylint, SPDX tag & docstrings (no functional change) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-23 20:52:00 +01:00
Markus Heiser	b7105da2af	Add missing autocomplete backends to settings.yml comment Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-23 15:41:08 +01:00
Markus Heiser	78c5216d76	Merge branch 'master' into autocomplete_swisscows	2020-02-23 14:24:42 +00:00
Markus Heiser	98322ac15c	Merge branch 'master' into engine-etools	2020-02-23 11:47:49 +00:00
Marc Abonce Seguin	c0006cadf7	fix default locale and language issues	2020-02-23 02:03:42 -07:00
Adam Tauber	6df4172887	[fix] allow settin custom locale from settins.yml	2020-02-18 00:56:27 +01:00
piplongrun	b136480546	Add Swisscows autocomplete option	2020-02-14 19:19:24 +01:00
Dalf	88f9ac58f4	[mod] move public instance list to https://searx.space	2020-02-14 13:48:44 +01:00
piplongrun	e1b60106b7	Add etools engine to the list	2020-02-12 23:59:18 +01:00
piplongrun	f0684a5bb5	Add eTools engine	2020-02-12 23:58:50 +01:00
Markus Heiser	7c79eb9b1b	Merge commit 'refs/pull/1621/head' of https://github.com/asciimoo/searx Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2020-02-08 15:08:33 +01:00
Noémi Ványi	99435381a8	[enh] introduce private engines This PR adds a new setting to engines named `tokens`. It expects a list of tokens which lets searx validate if the request should be accepted or not.	2020-02-08 11:47:39 +01:00
Nicolas Gelot	b8b13372c8	Fix deprecated werkzeug import Close: #1830 Signed-off-by: Nicolas Gelot <nicolas.gelot@e.email>	2020-02-06 22:49:35 +01:00
Adam Tauber	6060ab85f8	[enh] version v0.16.0	2020-01-30 13:39:06 +01:00
Adam Tauber	b6a2aff94a	[enh] update translations	2020-01-30 11:16:15 +01:00
Adam Tauber	8e3bd3fcbd	[mod] add py2 deprecation warning to webapp	2020-01-28 15:52:50 +01:00
Markus Heiser	e64ff38217	Merge branch 'master' into fix-infinite-scroll	2020-01-28 10:59:03 +00:00
frankdelange	db9d7d47bd	Fix double-encode error (fixes #1799 )	2020-01-07 21:41:43 +01:00
Markus Heiser	1d86d0054f	Merge branch 'master' into bug/oscar-theme	2020-01-06 08:05:29 +00:00
Adam Tauber	17b6faa4c3	[fix] pep8	2020-01-02 22:38:12 +01:00
Adam Tauber	ad5bb994b1	[fix] add py3 compatibility	2020-01-02 22:30:18 +01:00
Adam Tauber	1e6253ce16	[fix] handle empty response	2020-01-02 22:29:55 +01:00
Adam Tauber	86a378bd01	[fix] handle missing thumbnail	2020-01-02 22:29:28 +01:00
Adam Tauber	2dc2e1e8f9	[fix] skip invalid encoded attributes	2020-01-02 22:29:10 +01:00
Adam Tauber	2292e6e130	[fix] handle missing result size	2020-01-02 22:28:47 +01:00
Adam Tauber	a1b85571a2	[fix] tmp suspend insecure engines	2020-01-02 22:28:18 +01:00
Markus Heiser	36e72a4619	Merge branch 'master' into fix-engine-spotify	2019-12-29 09:47:06 +01:00
Markus Heiser	38dad2e8e3	Merge branch 'master' into ne/fix-infinite_scroll-with-vim_bindings	2019-12-24 15:42:05 +01:00
Markus Heiser	fb668e2075	Merge branch 'master' into libgen	2019-12-24 13:33:07 +01:00
Vipul	8bea927bb0	[Fix] oscar: no HTML escaping prior to output When results are fetched from any programming related documentation site (like git-scm.com, docs.python.org etc), content in Info box is shown as raw HTML code. This change addresses the issue by using "safe" filter feature provided by Django. See, - https://docs.djangoproject.com/en/3.0/ref/templates/builtins/#safe - Searx issue tracker (issue #1649), for more information. Resolves: #1649	2019-12-24 15:11:48 +05:30
Markus Heiser	70f7142824	Merge branch 'master' into bug/oscar-theme	2019-12-23 18:47:23 +01:00
Vipul	f407dd8ef4	Switch to https for some domains	2019-12-22 13:39:00 +00:00
Vipul	ee6781d777	[Fix] Libgen engine Libgen has switched to new domain (i.e https://libgen.is) with TLS support and older domain (i.e. http://libgen.io) is no longer accessible. See, https://en.wikipedia.org/wiki/Library_Genesis, for more information. Resolves: #1693	2019-12-22 13:04:46 +00:00
Marc Abonce Seguin	495ae59b31	hide suggestions box if empty This bug happens only in python3 because map returns an iterator.	2019-12-21 22:47:08 -06:00
Marc Abonce Seguin	5706c12fba	remove empty parenthesis in wikipedia's summary They're usually IPA pronunciations which are removed by the API.	2019-12-21 22:47:08 -06:00
Marc Abonce Seguin	c18048e045	exclude disambiguation pages from wikipedia infobox	2019-12-21 22:47:08 -06:00
Vipul	6a5aae6530	[Fix] oscar: no HTML escaping prior to output When results are fetched from any programming related documentation site (like git-scm.com, docs.python.org etc), content in Info box is shown as raw HTML code. This change addresses the issue by using "safe" filter feature provided by Django. See, - https://docs.djangoproject.com/en/3.0/ref/templates/builtins/#safe - Searx issue tracker (issue #1649), for more information. Resolves: #1649	2019-12-22 02:27:45 +00:00
Vipul	36ca2dcc56	[Fix] oscar: move info box at top of the page In low width devices like mobile, tablet etc, info box is present at bottom of the page. This change addresses the issue by rearranging column grids for low width devices and move side bar at top of the page. See - https://getbootstrap.com/docs/3.3/css/#grid-column-ordering. - and Searx issue tracker (issue#1777), for more information. Effect: Along with Info, Suggestion and Link boxes also move to top of the page. Resolves: #1777	2019-12-22 02:27:42 +00:00
Adam Tauber	34ad3d6b34	[enh] display error message if gigablast extra param expired	2019-12-21 21:25:50 +01:00
Adam Tauber	fc457569f7	[fix] pep8	2019-12-21 21:13:43 +01:00
Adam Tauber	00512e36c1	[fix] handle empty response from wikipedia engine - closes #1114	2019-12-21 21:01:08 +01:00
Adam Tauber	f8713512be	[fix] convert byte query to string in osm engine - fixes #1220	2019-12-21 20:56:38 +01:00
Adam Tauber	e5305f886c	[fix] fetch extra search param of gigablast - fixes #1293	2019-12-21 20:51:30 +01:00
Adam Tauber	8850036ded	[fix] add explicit useragent header to requests - closes #1459	2019-12-21 20:25:39 +01:00
Nick Espig	0ae86cd168	Fix not jumping to results loaded by infinite scroll Infinite scroll adds a `hr` tag to split up the sections loaded by it. The vim bindings `j` and `k`, which jump to the next and previous result respectively, search for a direct sibling with the class `result`. With the `hr` between results a direct sibling cannot be found. To fix this we remove the restriction of it having to be a direct sibling.	2019-12-16 19:31:29 +01:00
Adam Tauber	3f93fe04d8	Merge pull request #1752 from MarcAbonce/user-agents-update User agents update	2019-12-11 15:45:02 +00:00
Dalf	0e7b6c9a03	[mod] infinite scroll: XHR requests are sent with the header "Accept: text/html". Fix https://github.com/searx/searx-docker/issues/16	2019-12-11 14:34:25 +01:00
Markus Heiser	a3b5f3230c	theme: oscar - remove dust (comes from PR #1671 implementation) was inadvertently included in the commit [1] [1] `f34ac58752 (diff-0243d1c24e9981002156cc87cc10bd53R103)` Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-12-10 18:33:36 +01:00
Markus Heiser	f373169c84	theme: oscar - add accesskey to input tags l - language field s - search field t - time range field The way to activate the accesskey depends on the browser and its platform [1] [1] https://developer.mozilla.org/en-US/docs/Web/HTML/Global_attributes/accesskey Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-12-10 18:20:51 +01:00
Markus Heiser	57c6fa6e63	theme: oscar - fix auto-submit on language seletion Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-12-10 18:16:45 +01:00
Markus Heiser	2a5c39e33c	theme: oscar - tidy up trailing whitespaces and tab usage Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-12-10 18:10:33 +01:00
Markus Heiser	9988cdcbc5	Merge branch 'master' of https://github.com/asciimoo/searx into dos2unix Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-12-10 17:35:23 +01:00
Dalf	f34ac58752	[mod] tidy oscar HTML output	2019-12-10 10:58:30 +01:00
Markus Heiser	56b7e05721	themes: remove CR from newlines Adding a CR in some files and in others not, is a good starting point for a DOS+Unix mess we all have already seen in many projects. Patch fixes all files matching (even those comming from grunt's build):: find ./searx -exec file {} \; \| grep CR BTW: Same with mixing TAB and SPACE indent styles in one and the same file. So if sources are tuched here in this patch, its also fixed. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-12-08 15:33:46 +01:00
Marc Abonce Seguin	ccaf6ca02c	[fix] update xpaths for new google results page	2019-12-07 16:37:24 -07:00
Adam Tauber	731e34299d	Merge pull request #1744 from dalf/optimizations [mod] speed optimization	2019-12-02 13:39:58 +00:00
Adam Tauber	574cb25a16	Merge pull request #1758 from return42/ddd-fix [fix] duckduckgo_definitions	2019-12-02 13:38:54 +00:00
Markus Heiser	30ad0c666d	duckduckgo_definitions: remove the debug message Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-12-02 14:26:11 +01:00
Adam Tauber	20da8f2cbf	Merge pull request #1754 from MarcAbonce/seedpeer Add Seedpeer again	2019-12-02 13:09:09 +00:00
Markus Heiser	b6d9f5aa71	[fix] duckduckgo_definition issues reported by 'manage.sh test' Fix this error while travis build:: /home/travis/build/asciimoo/searx/searx/engines/duckduckgo_definitions.py:21:44: E225 missing whitespace around operator Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-11-29 19:59:35 +01:00
Markus Heiser	4998e9ec85	[fix] duckduckgo_definitions - where 'AnswerType' is 'calc' Do not try to get text when 'AnswerType' is 'calc'. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-11-29 19:20:14 +01:00
Markus Heiser	2aa95c16e3	[fix] soundcloud: URLs of JS sources has been moved The client_id is found under (new) URL: https://a-v2.sndcdn.com/assets/49-a0c01933-3.js Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>	2019-11-29 15:05:36 +01:00
Adam Tauber	8721be2f7d	Merge pull request #1682 from Venca24/devel_mojeek [fix] mojeek engine	2019-11-28 19:33:08 +00:00
Adam Tauber	789d71350d	Merge pull request #1745 from lorddavidiii/python3.8-fix Fix python 3.8 compatibility	2019-11-28 19:31:59 +00:00
Adam Tauber	05033ea8d8	Merge pull request #1689 from MarcAbonce/images_fixes [fix] Google Images	2019-11-26 13:20:19 +00:00
Marc Abonce Seguin	9299355570	add seedpeer again	2019-11-24 22:01:44 -07:00
Marc Abonce Seguin	d0d91fa331	update user agents	2019-11-23 19:27:49 -07:00
Marc Abonce Seguin	94ca30de1b	add a shortcut for utils/fetch_firefox_version.py in manage.sh	2019-11-23 19:26:48 -07:00
Emilien Devos	8f51430f5c	[fix] Force Google old UI with a new user agent	2019-11-22 23:01:41 +01:00
lorddavidiii	5e5ff0cbf8	webapp.py: use html.escape if cgi.escape is not available - cgi.escape was removed in python 3.8 - also use html.escape in framalibre.py	2019-11-16 21:58:25 +01:00
Dalf	85b3723345	[mod] speed optimization compile XPath only once avoid redundant call to urlparse get_locale(webapp.py): avoid useless call to request.accept_languages.best_match	2019-11-15 09:33:15 +01:00
Mathieu Brunot	e9d90d06a9	Merge branch 'master' into feature/accessibility	2019-10-29 23:53:08 +01:00
Noémi Ványi	bf24b39fce	Merge branch 'master' into corrections_fix	2019-10-24 10:39:26 +02:00
Marc Abonce Seguin	dede46a2d5	fix out of range error in tracker remover plugin	2019-10-22 23:17:00 -07:00
Marc Abonce Seguin	b0f89ed477	[fix] preserve bangs in corrections	2019-10-22 21:41:50 -07:00
Mathieu Brunot	a51b2b6c20	Merge branch 'master' into feature/accessibility	2019-10-16 19:30:02 +02:00
Noémi Ványi	5796dc60c9	fix pep 8 check	2019-10-16 15:52:48 +02:00
Noémi Ványi	a6f20caf32	add initial support for offline engines && command engine	2019-10-16 15:52:48 +02:00
Adam Tauber	3c34e0c3a7	[mod] remove cloudflare protected digbt from engines list	2019-10-16 15:35:12 +02:00
Adam Tauber	7d8fd4b95e	[fix] pep8	2019-10-16 15:32:03 +02:00
Adam Tauber	bbe4442a86	[fix] update gigablast engine	2019-10-16 15:27:37 +02:00
Adam Tauber	1057e42cfd	[fix] update digg engine	2019-10-16 15:11:42 +02:00
Adam Tauber	72459b246b	[fix] convert bytes type to string in language detection (fixes dictzone)	2019-10-16 14:52:57 +02:00
Adam Tauber	7177c9e12f	[fix] update devianart engine	2019-10-16 14:42:31 +02:00
Adam Tauber	6ca1622378	[fix] update 1x engine	2019-10-16 13:27:05 +02:00
Adam Tauber	c98a2df36d	[fix] enable paging support for arxiv engine	2019-10-16 13:12:17 +02:00
Adam Tauber	ed1c1bdb04	[fix] pep8	2019-10-14 15:09:39 +02:00
Adam Tauber	27ed31c7a2	[fix] add message to SearxParameterException - fixes #1722	2019-10-14 15:06:25 +02:00
Adam Tauber	28c75c187f	[fix] update query params sanitization - closes #722	2019-10-14 14:58:20 +02:00
Adam Tauber	07a0a50e0d	[fix] update voat xpaths - closes #1581	2019-10-14 14:25:49 +02:00
Adam Tauber	77a70fe541	[fix] update startpage engine - closes #1601	2019-10-14 14:18:41 +02:00
Adam Tauber	3d0c22c58d	[fix] normalize time range parameter	2019-10-14 14:18:02 +02:00
Adam Tauber	94ea9d6622	[fix] duckduckgo paging - closes #1677	2019-10-14 13:52:15 +02:00
mathieu.brunot	4d17d453bf	♿ Add aria labels for oscar buttons Signed-off-by: mathieu.brunot <mathieu.brunot@monogramm.io>	2019-10-14 01:36:11 +02:00
Marc Abonce Seguin	bb4d223770	[fix] google images	2019-08-26 21:54:01 -07:00
Venca24	07d0250241	[fix] mojeek engine	2019-08-20 16:10:25 +02:00
Dalf	6fbba63c83	oscar and simple themes: no inline script (allow A+ Content-Security-Policy)	2019-08-06 12:14:11 +02:00
Frank de Lange	e4e8e6da4c	Add image format and source information to display (#1567 ) Add image format and source information to display - needs changes to engines to actually display something. Displays result.source (website from which the image was taken) and result.img_format (image type and size). Result is styled with result-format and result-source classes. See PR #1566 for an example of an engine which has the necessary changes. Strip <span class="highlight">...</span> in the oscar image template.	2019-08-06 09:31:24 +02:00
Léo Bourrel	88261e111c	Fix bing engine results count (#1387 ) This PR fixes the result count from bing which was throwing an (hidden) error and add a validation to avoid reading more results than avalaible. For example : If there is 100 results from some search and we try to get results from 120 to 130, Bing will send back the results from 0 to 10 and no error. If we compare results count with the first parameter of the request we can avoid this "invalid" results.	2019-08-05 16:15:40 +02:00
Dalf	1cee2c1796	[fix] bing engine before this commit, sometimes there are no results use a generic user-agent instead of one with the OS "Windows NT 6.3; WOW64"	2019-08-05 15:46:40 +02:00
Dalf	9a378ca8c6	[fix] etymonline, voat engines	2019-08-05 15:44:22 +02:00
Dalf	fcc9587ee9	[fix] fdroid engine	2019-08-05 15:44:02 +02:00
Dalf	fbf6b689dd	[fix] dictzone engine	2019-08-05 15:43:21 +02:00
Dalf	9ff5001816	[fix] arxiv engine	2019-08-05 15:43:01 +02:00
Alexandre Flament	333e54943d	[fix] fix monkey patch in test_webapp.py (#1667 ) at the end of test_webapp.py, the monkey patch of searx.search.Search was not revert which lead to side effects on other tests close #1663	2019-08-03 13:23:36 +02:00
Dalf	ba80a0ba38	[fix] fix paging for the oscar theme after PR #1640	2019-08-02 20:04:37 +02:00
Alexandre Flament	72029d27de	[enh] Add timeout limit per request (#1640 ) The new url parameter "timeout_limit" set timeout limit defined in second. Example "timeout_limit=1.5" means the timeout limit is 1.5 seconds. In addition, the query can start with <[number] to set the timeout limit. For number between 0 and 99, the unit is the second : Example: "<30 searx" means the timeout limit is 3 seconds For number above 100, the unit is the millisecond: Example: "<850 searx" means the timeout is 850 milliseconds. In addition, there is a new optional setting: outgoing.max_request_timeout. If not set, the user timeout can't go above searx configuration (as before: the max timeout of selected engine for a query). If the value is set, the user can set a timeout between 0 and max_request_timeout using <[number] or timeout_limit query parameter. Related to #1077 Updated version of PR #1413 from @isj-privacore	2019-08-02 13:50:51 +02:00
Alexandre Flament	2179079a91	[fix] fix flickr_noapi decoding (#1655 ) Characters that were not ASCII were incorrectly decoded. Add an helper function: searx.utils.ecma_unescape (Python implementation of unescape Javascript function).	2019-08-02 13:37:13 +02:00
cy8aer	4dc792e1e2	[enh] add invidious engine. (#1657 ) closes #1372	2019-08-02 13:25:25 +02:00
0xhtml	b2e1ee8d35	Fix some more errors with none/wrong credentials	2019-07-31 21:09:02 +02:00
0xhtml	275b37cc7c	Fix error if the user hasn't set api credentials	2019-07-31 21:01:24 +02:00
0xhtml	ae3eeedb14	Require Spotify API credentials in settings	2019-07-31 20:51:01 +02:00
0xhtml	c329ea135e	Fix spotify engine	2019-07-31 20:44:41 +02:00
Dalf	0c032c8429	[fix] youtube_noapi engine: fix the title	2019-07-31 08:39:40 +02:00
Dalf	8b7ac56669	[fix] google_videos engine: some results don't a thumbnail	2019-07-31 08:38:45 +02:00
Dalf	d44677e226	[fix] dailymotion engine: remove HTML tags from the description	2019-07-31 08:37:51 +02:00
Dalf	6e0285b2db	[fix] wikidata engine: faster processing, remove one HTTP redirection. * Search URL is https://www.wikidata.org/w/index.php?{query}&ns0=1 (with ns0=1 at the end to avoid an HTTP redirection) * url_detail: remove the disabletidy=1 deprecated parameter * Add eval_xpath function: compile once for all xpath. * Add get_id_cache: retrieve all HTML with an id, avoid the slow to procress dynamic xpath '//div[@id="{propertyid}"]'.replace('{propertyid}') * Create an etree.HTMLParser() instead of using the global one (see #1575)	2019-07-29 07:39:39 +02:00
Frank de Lange	cbc5e13275	[enh] flickr_noapi: use complete JSON data block, add 'content', 'img_format', 'source', etc. (#1571 ) Fetch complete JSON data block, use legend to extract images. Unquote urlencoded strings. Add image description as 'content'. Add 'img_format' and 'source' data (needs PR #1567 to enable this data to be displayed). Show images which lack ownerid instead of discarding them.	2019-07-28 10:42:00 +02:00
Marc Abonce Seguin	59b1370824	[fix] small fixes in preferences view's text	2019-07-27 22:53:46 -07:00
Frank de Lange	204a2cbbf0	[fix] bing_videos (#1579 ) use JSON where possible, compose 'content' using all available data, use correct 'url' (direct to source instead of redirect through bing)	2019-07-27 17:49:30 +02:00
Dalf	70a01e5f02	[fix] don't merge image results if the img_src is different	2019-07-27 08:52:30 +02:00
Dalf	23611897ec	[fix] make sure then engine name is lower case Minor fix: "%s engine initialized" display the right engine name	2019-07-27 08:52:30 +02:00
Dalf	8645ef717e	[fix] settings.yml: make sure all engine names are lower case	2019-07-27 08:52:30 +02:00
Dalf	7d8000d965	[fix] "!wp !wp test" send only one request to wikipedia. Note that "!general !wp test" is not fixed because the category for "!wp" is "none".	2019-07-27 08:52:30 +02:00
Dalf	2fab23ab9a	[fix] fix the debug message "starting webserver on ip:port" was "port:ip"	2019-07-27 08:52:30 +02:00
Marc Abonce Seguin	e1bb0e33f2	[fix] escape perecent signs in translation file (#1528 )	2019-07-27 09:01:02 +02:00
Frank de Lange	11fc9913e9	[enh] bing_images: use data from embedded JSON to improve results (e.g. real page title) (#1568 ) use data from embedded JSON to improve results (e.g. real page title), add image format and source info (see PR #1567), improve paging logic (it now works)	2019-07-27 08:22:02 +02:00
Alexandre Flament	f34b5cedb1	[fix] fixes google play engines (#1651 ) update commit `87baa74a86`	2019-07-25 09:31:47 +02:00
Jonas Zohren	cac8e7c6b8	[enh] add npm search engine (#1510 )	2019-07-25 08:54:26 +02:00
volth	eb182df132	[mod] restore btdigg engine as btdig.com (#1515 )	2019-07-25 08:40:48 +02:00
rachmadani haryono	3b1122c5fa	[fix] fix duden engine (#1594 )	2019-07-25 08:17:45 +02:00
Venca24	87baa74a86	[fix] fixes google play engines and adds thumbnails to their results (#1612 ) fix google play apps, google play apps, google play music engines xpath engine: thumbnail_xpath can define an optional thumbnail	2019-07-25 07:46:41 +02:00
Dalf	da0ce5880f	[fix] fix soundcloud engine, speed up searx start time	2019-07-19 08:59:11 +02:00
Dalf	7e201cbf65	[mod] use cache in _match_language function to speed up searx start time significantly	2019-07-19 08:58:08 +02:00
Alexandre Flament	554a21e1d0	[enh] Add Server-Timing header (#1637 ) Server Timing specification: https://www.w3.org/TR/server-timing/ In the browser Dev Tools, focus on the main request, there are the responses per engine in the Timing tab.	2019-07-17 10:38:45 +02:00
Alexandre Flament	cfcbc3a5c3	[mod] settings.yml: update comments about the morty key. (#1639 ) Fix #1310 Since commit af77ec35d9bd28facdab645a3d57ae340d2b501c Morty accepts base64 encoded key.	2019-07-17 10:29:28 +02:00
rachmadani haryono	ec88fb8a0f	[fix] secret_key can be bytes instead of a string (#1602 ) Fix #1600 In settings.yml, the secret_key can be written as string or as base64 encoded data using !!binary notation.	2019-07-17 10:09:09 +02:00
rachmadani haryono	8f44014627	[fix] preference query parameter decoding (#1599 ) Fix issue #1598	2019-07-17 09:42:40 +02:00
Dalf	c7220b40ea	Suggestions: use RawTextQuery to make the suggestions URLs. Update all themes accordingly.	2019-07-17 09:05:29 +02:00
Alexandre Flament	4d38b8bef7	Merge branch 'master' into bang_fixes	2019-07-16 11:03:52 +02:00
Marc Abonce Seguin	a3368c07a7	[enh] Add Interlingua locale (requires requirements update)	2019-07-15 13:38:51 -05:00
Dalf	45702b77ca	embedded iframe (youtube, dailymotion, vimeo): use https	2019-07-13 15:49:59 +02:00
Dalf	609ac5795a	.travis.yml: robot tests: remove the xvfb dependency	2019-07-13 15:49:59 +02:00
Alexandre Flament	3b8b862d8c	Merge branch 'master' into bang_fixes	2019-07-06 18:48:03 +02:00
Alexandre Flament	3faaf34e25	Fix ./manage.sh robot_tests (#1633 ) doi_resolvers / default_doi_resolver were missing in the settings_robots.yml file, so the test server was not able to start (crash). Since the output wasn't displayed, it was not obvious why the Selenium couldn't connect to searx.	2019-07-06 18:47:35 +02:00
Marc Abonce Seguin	6626f01365	[fix] preserve bangs in suggestions and corrections	2019-07-01 19:52:34 -05:00
Marc Abonce Seguin	40272b0044	[fix] never pass bangs to autocomplete suggestions	2019-07-01 17:16:02 -05:00
Noémi Ványi	6c75052874	Merge branch 'master' into ne/improve-infinite-scroll	2019-06-30 13:45:09 +02:00
Noémi Ványi	1e30f19800	Merge branch 'master' into feature/fix-config	2019-06-24 23:10:22 +02:00
Nicolas Gelot	373a66be30	Fix locale and search language Locale and search language was always defined with english value. This patch inits the locale on `pre_request` in order to define the default value of locale and language preferences. Plus the `best_match` function provided by flask babel library did not work as expected. So the function `match_language` provided by searx is used to detect that the language from Accepted-Language header can be used in searx project.	2019-06-17 23:19:15 +02:00
Nicolas Gelot	a818d3241d	Remove get local from request.args args parameters are merged in form in pre_request, so this patch removes that useless operation.	2019-06-17 23:13:04 +02:00
Nicolas Gelot	db1dfa4a28	Add addr setup via SEARX_BIND_ADDRESS	2019-06-17 22:42:56 +02:00
Nick Espig	06979fa082	Load next page shortly before hitting the bottom This improves the user experience by loading in the next entries shortly before him getting to the bottom. It makes the scrolling more smooth without a break in between. It also fixes an error on my browser that scrolling never hits the defined number. When I debugged it I hit `.scrolltop` of 1092.5 and the `doc.height - win.height` of 1093, so the condition was never true.	2019-06-04 18:22:02 +02:00
rachmadani haryono	45eb2688d0	Merge branch 'master' into feature/fix-config	2019-05-29 19:17:28 +08:00
Emilien Devos	cbd1ebdce8	[fix] Force Google old UI (#1597 )	2019-05-29 10:05:57 +09:00
rachmadani haryono	ac357b12e3	Merge branch 'master' into feature/fix-config	2019-05-28 19:16:58 +08:00
Frank de Lange	4b7332286a	Use string formatter to create source and img_format labels (#1566 ) google_images : use JSON embedded in HTML (engine expected pure JSON)	2019-05-28 12:33:31 +09:00
Dalf	ffe0972f91	Remove some engines : subtitleseeker, seedpeer, swisscows http://www.subtitleseeker.com and http://www.seedpeer.eu don't exist anymore. https://swisscows.ch/ has change : the engine needs to be updated	2019-05-28 04:06:35 +02:00
rachmadani haryono	7a127b4547	Merge branch 'master' into feature/fix-config	2019-05-28 06:55:20 +08:00
Venca24	c66a019478	[fix] seznam engine	2019-05-21 14:27:30 +02:00
rachmadaniHaryono	535fff109f	fix: dev: python3 dict keys jsonify	2019-05-18 00:03:49 +08:00
Alexandre Flament	9012ad498c	Merge branch 'master' into patch-1	2019-04-19 09:59:04 +02:00
Alexandre Flament	df2b9a76f7	Merge branch 'master' into ne/fix-google-image-search	2019-04-14 13:55:00 +02:00
Nick Espig	1c6ab79b9f	Fix google image search - Because there is not full image url in the dom, we replace "image_url" with the same url as the "url" (url of source). See example HTML https://gist.github.com/Nachtalb/2dea8a4d2c723c49226ad9645838121f - Remove unused import - Fix google image search title - Keep google image safe value up to date	2019-04-14 12:03:25 +02:00
Marc Abonce Seguin	3e1c2153f7	[fix] duckduckgo images requests	2019-04-13 00:38:37 -05:00
b_b	4ca7e68841	use instance_name for page title related to #1025	2019-04-09 21:15:02 +02:00
Alexandre Flament	3e9ce2638a	Merge branch 'master' into patch-1	2019-04-09 03:32:39 +02:00
Alexandre Flament	e868650df7	Merge branch 'master' into youtube_fix	2019-04-09 03:21:37 +02:00
Elias Ojala	cef77f0d51	Merge branch 'master' into patch-1	2019-03-29 14:41:12 +00:00
Marc Abonce Seguin	aaa0524cec	[fix] stop engine from sending duplicated requests	2019-03-28 19:25:20 -06:00
Marc Abonce Seguin	f2d49a6971	[fix] get youtube results from js object Results are not appearing in the html document anymore, instead they are found inside an object embedded in a script.	2019-03-26 21:09:15 -06:00
Elias Ojala	8039a577a8	Use HTTPS for crossref	2019-03-12 12:30:47 +00:00
Noémi Ványi	2478c5395d	update pyyaml	2019-02-23 18:52:36 +01:00
Noémi Ványi	6cadbf9269	Merge branch 'master' into devel_google_scholar	2019-02-22 21:05:07 +01:00
Jonas Zohren	f7bdd827c4	[enh] adds apkmirror search engine	2019-02-13 00:37:29 +01:00
Venca24	05a73019b1	[fix] google scholar suggestions	2019-02-04 16:31:17 +01:00
Noémi Ványi	83342a2878	Merge branch 'master' into fix-engine-suspend-time	2019-01-29 11:03:35 +01:00
Léo Bourrel	bf4a38ad66	Remove asksteem	2019-01-28 11:02:43 +01:00
Noémi Ványi	36790168a1	add again accidentally removed import to search.py	2019-01-25 20:54:23 +01:00
Noémi Ványi	fdf3994364	Merge branch 'master' into devel_image_proxy	2019-01-25 20:48:55 +01:00
Venca24	e8734b37c9	[FIX] image_proxify	2019-01-18 09:04:40 +01:00
d-tux	f1814079f0	Merge branch 'master' into engines/unsplash	2019-01-14 13:40:57 +01:00
Marc Abonce Seguin	626a8e9ac9	[fix] unicode error with WolframAlpha API engine	2019-01-08 21:02:23 -06:00
d-tux	329172f66e	Merge branch 'master' into engines/unsplash	2019-01-08 09:24:45 +01:00
Noémi Ványi	97351a2c72	fix after rebase	2019-01-07 21:28:58 +01:00
Noémi Ványi	b63d645a52	Revert "remove 'all' option from search languages" This reverts commit `4d1770398a`.	2019-01-07 21:19:00 +01:00
Noémi Ványi	1a850cf171	Merge branch 'master' into language_aliases_fix	2019-01-07 20:33:31 +01:00
Étienne Deparis	89deb4fbcc	[fix] Remove markup errors in simple template preferences file	2019-01-07 10:48:25 +01:00
Étienne Deparis	21beb64a72	Remove forgotten white spaces in templates/simple/preferences.html	2019-01-07 10:48:20 +01:00
Étienne Deparis	0d4d58f794	[enh] Add preference section to two upstream plugins for simple theme integration	2019-01-07 10:48:14 +01:00
Marc Abonce Seguin	0169b63e84	[fix] fetch google's supported languages	2019-01-06 21:31:45 -06:00
Marc Abonce Seguin	51111c2594	[fix] always set langauge_aliases even if it's empty	2019-01-06 20:49:56 -06:00
Marc Abonce Seguin	5568f24d6c	[fix] check language aliases when setting search language	2019-01-06 20:31:57 -06:00
Noémi Ványi	29d146dde6	update changelog and version.py	2019-01-06 21:59:59 +01:00
Noémi Ványi	62690f623d	pull translations from Transifex	2019-01-06 21:49:42 +01:00
Venca24	8567cc7433	[add] mojeek engine	2019-01-06 10:47:09 +01:00
Venca24	2456b8f571	[mod] google videos	2019-01-05 12:12:09 +01:00
Noémi Ványi	1ea56576dc	Merge branch 'master' into devel_google_videos	2019-01-04 22:27:05 +01:00
Noémi Ványi	aeb6dab187	Merge branch 'master' into master	2019-01-04 22:14:40 +01:00
Noémi Ványi	5b81f7c2cc	Merge branch 'master' into bugfix_startpage	2019-01-04 22:03:00 +01:00
Venca24	cf26aba93b	[FIX] google videos thumbnails	2019-01-04 15:48:22 +01:00
Léo Bourrel	73ec2ba74e	Update bing image engine with new image json format	2018-12-19 11:12:25 +01:00
Michael Pfitzner	44ce51f0c5	restore startpage search results	2018-12-14 21:38:48 +01:00
d-tux	4a127b19de	Merge branch 'master' into engines/unsplash	2018-12-14 07:06:19 +01:00
dimqua	0d86ed9c7e	update startpage.py	2018-12-11 21:45:47 +03:00
dimqua	0823b13ae1	remove Ixquick engine	2018-12-11 20:25:52 +03:00
dimqua	442772a6c5	remove findx engine (#1452 )	2018-12-02 22:39:04 +01:00
Ivan Skytte Jørgensen	0b7f0bde62	Use a more human-friendly format in searx/data/engines_languages.json (#1399 ) Instead of a single line with 500000 characters use nicely formatted JSON. Sort the lists in engine_languages.py so when updating it is possible to more easily see the differences (search engines do change the order their languages are listed in)	2018-11-29 16:31:05 +01:00
Venca24	0bdf090ed7	[fix] google videos engine	2018-11-22 13:00:34 +01:00
Venca24	64df38da56	[add] seznam engine	2018-11-20 13:55:29 +01:00
Denis Wernert	b9ada93b3a	Removes what looks like tracking parameters	2018-10-08 14:56:20 +02:00
Denis Wernert	72d063d27d	Uses the raw url for the image result, rather than the full size result.	2018-10-08 14:01:35 +02:00
Denis Wernert	cd7849ffc8	Adds the Unsplash image engine	2018-10-08 09:18:42 +02:00
dalf	965eebd12b	simple theme : remove unused files	2018-08-26 10:34:41 +02:00
Adam Tauber	052a71d05a	Merge pull request #1368 from aliceinwire/gentoo_engine Add Gentoo wiki search engine	2018-08-21 16:24:34 +02:00
Alice Ferrazzi	d24c58cf4e	Fix pep8 errors	2018-08-21 22:55:51 +09:00
Alice Ferrazzi	ff2eac9f6b	Fix choosing languges function Searching for english is now giving all pages results. Instead searching for a specific language different from english is correctly returning only translated pages for the selected language.	2018-08-21 22:55:39 +09:00
Adam Tauber	c5c812899f	[fix] pep8	2018-08-19 15:32:32 +02:00
Adam Tauber	f7bb45e891	[enh] admin configurable suspend time of errored engines - closes #1266	2018-08-19 15:30:12 +02:00
Adam Tauber	69d1dd3f86	[enh] configurable default oscar style	2018-08-19 15:28:43 +02:00
Adam Tauber	baacfac32b	[fix] remove publicly unavailable 500px engine - #1338	2018-08-19 15:06:59 +02:00
Adam Tauber	ac848b5093	Merge pull request #1323 from cy8aer/dsgvo Create an include for __common__/aboutextend.html for imprint purposes.	2018-08-19 13:50:12 +02:00
Adam Tauber	3126660be5	Merge pull request #1374 from dadosch/master [WIP] [engine] Duden.de (German dictionary)	2018-08-19 13:29:06 +02:00
Adam Tauber	379feb61f9	Merge pull request #1250 from matejc/add-random-answers feat(answers): add sha256 and uuid v4 to random answers	2018-08-19 13:26:08 +02:00
Adam Tauber	666982bd35	Merge pull request #1244 from Venca24/master [UI] new youtube icon for oscar theme	2018-08-19 13:20:54 +02:00
Adam Tauber	19f18a2638	Merge pull request #1360 from Popolon/master get_doi_resolver return doi resolver url instead of doi resolver name	2018-08-19 13:14:53 +02:00
dadosch	b575f898c0	duden.de engine	2018-08-18 19:24:02 +02:00
LiquidLemon	425c4d9a16	Merge branch 'master' into master	2018-08-18 17:43:29 +02:00
Alex	3ba0d0516e	simple theme update - npm package update - apply #1226 - implement vim help dialog - display cookies and search URL with preferences - allow to enable / disable Open Access DOI rewrite - add a clear text button on the left of the search button - implement #1011 : the HTML title page is not set when using POST - remove searx/static/themes/simple/img/loader.gif - use full width when only there are only images as result	2018-08-14 17:21:30 +02:00
Popolon	c2c7394718	Merge branch 'master' into master	2018-08-13 22:07:30 +02:00
Adam Tauber	845ba79e75	[fix] update qwant search url thx to @dalf for the fix (#1365)	2018-08-13 12:38:19 +02:00
LiquidLemon	2190e2f35d	Change the local name of the Polish language	2018-08-12 19:01:58 +02:00
Alice Ferrazzi	5f0888b8f4	added languages to Gentoo engine	2018-08-12 23:00:57 +09:00
Alice Ferrazzi	b7886bb15c	gentoo engine test	2018-08-12 23:00:57 +09:00
Popolon	8b7783e703	Merge branch 'master' into master	2018-08-11 22:23:09 +02:00
Noémi Ványi	5eeb3f2f01	follow up changes in etymonline XPATH engine	2018-08-10 19:03:46 +02:00
cy8aer	d9bf508f31	Merge branch 'master' into dsgvo	2018-08-09 15:17:43 +02:00
Popolon	00b8aa113f	remove double spaces	2018-08-07 17:57:33 +02:00
Popolon	ef4820105f	Merge branch 'master' into master	2018-08-07 17:54:43 +02:00
Popolon	34af9a0141	add http://sci-hub.tw/ as doi resolvers #1216	2018-08-06 01:03:40 +02:00
Popolon	3a160d3aed	return doi resolver url instead of doi resolver name	2018-08-06 00:53:55 +02:00
Alex	50c836864a	fetch_firefox_version.py : compatible with Python 3 and minor fixes.	2018-08-05 10:55:42 +02:00
Alexandre Flament	066bd916bf	[mod] fetch firefox versions in a standalone script	2018-08-05 10:10:15 +02:00
cy8aer	78be030500	Merge branch 'master' into dsgvo	2018-07-09 15:34:43 +02:00
Adam Tauber	d51732c0e5	Merge pull request #1303 from MarcAbonce/bing Fix bing "garbage" results	2018-07-09 11:00:37 +02:00
Léo Bourrel	7a474db61b	Fix formatting	2018-07-06 10:31:01 +02:00
Léo Bourrel	acaef6600e	Update path to wikidata image	2018-07-05 10:11:45 +02:00
Marc Abonce Seguin	c7000cd1df	[fix] update user agent versions this fixes duckduckgo error response	2018-06-23 16:24:06 -05:00
Thomas Renard	b786ac9a63	Create an include for __common__/aboutextend.html for imprint purposes.	2018-06-18 07:53:06 +02:00
Adam Tauber	f82ead3e30	[fix] add py3 compatibility to base engine - closes #1319	2018-06-14 11:50:03 +02:00
Adam Tauber	aef2b07969	[fix] add basestring for py3	2018-06-14 11:48:31 +02:00
Adam Tauber	57e7e9da98	[fix] use html result page in google images (previous endpoint stopped working)	2018-06-14 11:40:39 +02:00
Venca24	4f4df6273b	[fix] google scholar engine	2018-05-31 19:45:00 +02:00
Author Name	7635ebb126	Min width 50 px to oscar theme category. #1158	2018-05-29 22:18:00 -04:00
Noémi Ványi	16915116e0	fix piratebay url Closes #1229	2018-05-21 16:58:39 +02:00
Marc Abonce Seguin	75b276f408	fix bing "garbage" results (issue #1275 )	2018-05-20 18:13:32 -05:00
Noémi Ványi	b843c1351a	add missing parameter to gigablast search url Closes #1293	2018-05-16 22:26:32 +02:00
rinpatch	059c2ccb95	Fix acgsou encoding error on python2 and add unicode characters to unit testt	2018-05-05 23:41:13 +03:00
rinpatch	3b89ce9bfa	Switch acgsou to http	2018-05-03 08:34:21 +03:00
Adam Tauber	1a1f9852f1	Merge pull request #1283 from rinpatch/acgsou-engine [Feature] Acgsou as a searchable engine	2018-04-28 22:42:35 +02:00
rinpatch	c669c30e78	Merge branch 'master' into nyaa-https-fix	2018-04-27 17:58:12 +03:00
rinpatch	f6695cea59	Fix nyaa to use https	2018-04-27 17:55:42 +03:00
rinpatch	f17e54a396	Forgot to remove print command used for debugging	2018-04-27 15:40:42 +03:00
rinpatch	dcc9fdb47f	Added unit test	2018-04-27 15:36:15 +03:00
rinpatch	e3bd2670d7	Traling whitespace	2018-04-27 08:36:11 +03:00
rinpatch	86f47689fe	Hopefully fix code style errors(again)(again)	2018-04-27 08:32:43 +03:00
rinpatch	b8b23d8006	Hopefully fix code style errors(again)	2018-04-27 08:29:17 +03:00
rinpatch	fb364ffae7	Hopefully fix code style errors	2018-04-27 08:23:58 +03:00
rinpatch	3ec35a06f7	Added Engine	2018-04-26 22:42:31 +03:00
rinpatch	7a036579b2	Hide buttons when infinite scrolling is enabled	2018-04-25 18:54:43 +03:00
rinpatch	cd1374d2f2	added whitespaces	2018-04-22 14:12:32 +03:00
rinpatch	a305dae9d8	switched currency convert to duckduckgo and added Bitcoin to currency list	2018-04-22 13:46:13 +03:00
Noémi Ványi	25b48143ea	fix findx engine	2018-04-21 20:02:52 +02:00
Marc Abonce Seguin	f7f9c50393	[fix] force English results in Google when using en-US	2018-04-18 23:29:48 -05:00
Marc Abonce Seguin	b12857a70d	[fix] make search requests on wikidata more accurate	2018-04-08 21:17:00 -05:00
Marc Abonce Seguin	835d1edd58	[fix] google news xpath	2018-04-08 20:56:05 -05:00
Marc Abonce Seguin	343e555ee9	[fix] append http if no scheme is provided in xpath's extact_url This solves a bug with Yahoo where some results don't specify a protocol.	2018-04-08 20:35:34 -05:00
Adam Tauber	283f6c9053	Merge pull request #1252 from MarcAbonce/search-languages [mod] Refactor engine's search language handling	2018-04-05 17:27:07 +02:00
Adam Tauber	fb2dba4762	[fix] assign the correct variable in query.py - fixes #1253	2018-03-28 10:07:28 +02:00
Marc Abonce Seguin	772c048d01	refactor engine's search language handling Add match_language function in utils to match any user given language code with a list of engine's supported languages. Also add language_aliases dict on each engine to translate standard language codes into the custom codes used by the engine.	2018-03-27 00:08:03 -06:00
Matej Cotman	bf9e6737de	feat(answers): add sha256 and uuid v4 to random answers	2018-03-24 22:22:41 +01:00
Noémi Ványi	8cc529e9a3	forward category to engine without highlighting on the ui	2018-03-22 11:02:24 +01:00
Noémi Ványi	d04e471ce5	add findx engine for general, images and videos	2018-03-22 10:02:37 +01:00
Marc Abonce Seguin	d1eae9359f	fix fetch_langauges to be more accurate Add languages supported by either all default general engines or 10 engines.	2018-03-20 17:58:20 -06:00
Adam Tauber	b9d4c0523e	[fix] get doi_rewriters from settings - fixes #1245	2018-03-17 09:38:36 +01:00
Venca24	3867b9fba2	[UI] new youtube icon for oscar theme	2018-03-16 15:56:40 +01:00
Adam Tauber	b8543bcf3a	[enh] update translations ++ add polish - closes #1239	2018-03-16 00:21:11 +01:00
Marc Abonce Seguin	216716db70	[fix] change duckduckgo url to avoid error response	2018-03-14 23:18:42 -06:00
Adam Tauber	b918b29f90	Merge pull request #1226 from rndevfx/fix-vim-mode-on-firefox Fix Vim mode on Firefox	2018-03-07 10:46:24 +01:00
pofilo	348fab25ba	[UI] fix custom-select in oscar	2018-03-05 18:51:44 +01:00
Richard Nespithal	0314349b08	Fix Vim mode on Firefox Firefox automatically opens a built-in quick search when user starts typing without selected input and the Vim shortcuts are not triggered	2018-03-05 13:41:37 +01:00
Adam Tauber	3ac578c0a8	[enh] version 0.14.0	2018-02-19 00:22:56 +01:00
Adam Tauber	b70ce84eb6	[enh] update translations - add taiwanese and filipino	2018-02-19 00:22:39 +01:00
Adam Tauber	03d7a8f065	[fix] pep8	2018-02-18 23:24:59 +01:00
Adam Tauber	b4c657d227	[enh] add asksteem engine - closes #1163	2018-02-18 22:42:32 +01:00
Noémi Ványi	988cf38196	fix Microsoft Academic engine	2018-02-17 21:39:49 +01:00
Adam Tauber	2f69eaeb2f	[fix] fix engine initialization	2018-02-17 14:30:06 +01:00
Noémi Ványi	c645915171	fix bing videos engine	2018-02-10 19:44:07 +01:00
Adam Tauber	0fe6042cc9	[mod] add bottom margin to results - closes #1176	2018-02-07 22:17:31 +01:00
Adam Tauber	480a85340f	[enh] update translations	2018-02-01 23:27:37 +01:00
Adam Tauber	a173c5b4e2	[enh] build oscar css	2018-01-31 18:13:59 +01:00
Matthew Olmsted	c61e1a8165	Preserve image aspect ratio in results Noticed that images are often distorted in the results due to a hard minimum height. This keeps the 4-per-row image results consistent in row height without distorting wider images.	2018-01-24 10:40:42 -08:00
Marc Abonce Seguin	829032f306	[fix] read utf-8 files (settings, languages, currency) with python3.5 Related to discussion in #1124 The io.open import is necessary for python2	2018-01-16 23:26:10 -06:00
Adam Tauber	8511e64f35	Merge pull request #1124 from JosephKiranBabu/python3-unicode-support Make Python 3 able to read settings files with Unicode characters	2018-01-12 10:58:23 +01:00
Noémi Ványi	f3aa5ea47d	fix yacy result url Closes #1064	2018-01-06 14:52:14 +01:00
Adam Tauber	e303339370	[enh] overwrite secret_key from env with the SEARX_SECRET env var if exists - closes #845	2017-12-29 09:13:50 +01:00
Joseph Nuthalapati	bdc803e185	Make Python 3 able to read settings files with Unicode characters SearX currently doesn't start up when run with Python 3 as it tries to parse the settings.yml file with ASCII codecs. There are similar problems with engines_languages.json and currencies.json Python 3 requires that files with Unicode characters be read with a 'b' flag. This also works with Python 2 and hence can be integrated into the main source code. Tested with the latest Python 3.6.4rc1 on Debian unstable. Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>	2017-12-21 17:33:19 +05:30
Noémi Ványi	0cb8a849da	dark background for answers && no background for highlight	2017-12-20 17:10:52 +01:00
Noémi Ványi	2d5eed9b59	send constant cookie with query to Google	2017-12-18 21:38:52 +01:00
Noémi Ványi	e31409daf7	revert changin about to searx docs	2017-12-12 22:02:23 +01:00
Noémi Ványi	4f4dcdf38f	add links to footers of oscar and simple themes Links: * Source code * Issue tracker * List of public instances Closes #1071	2017-12-12 22:02:23 +01:00
Adam Tauber	2dc02f50c2	[fix] do not save engine/plugin cookies as unknown settings options - fixes #1110	2017-12-11 00:20:28 +01:00
Adam Tauber	7752b0a807	[fix] gigablast url parameter change - fixes #1107	2017-12-09 21:00:08 +01:00
Adam Tauber	7061eb91af	[fix] use proper encoding with both py2/3 - closes #1094	2017-12-08 21:39:59 +01:00
Adam Tauber	49b845051f	Merge pull request #973 from MarcAbonce/languages Remove 'all' option from search languages	2017-12-06 14:34:26 +01:00
Adam Tauber	df0b8ee527	Merge pull request #1109 from dalf/simple_magnet_svg simple theme : magnet.svg is replaced by a home made version	2017-12-06 14:28:03 +01:00
marc	4d1770398a	remove 'all' option from search languages	2017-12-06 01:20:15 -06:00
Adam Tauber	e060aedc16	[enh] make custom oscar option configurable from url	2017-12-05 22:30:20 +01:00
Adam Tauber	46fb0d860e	[enh] add dark version of oscar/logicodev	2017-12-05 22:05:19 +01:00
Alexandre Flament	cc69b1cd87	simple theme : replace magnet.svg with a home made version	2017-12-05 21:58:17 +01:00
Adam Tauber	1613c6319e	[fix] handle /sorry redirects	2017-12-05 20:38:34 +01:00
Adam Tauber	1435ae7e96	[enh] display engine error messages	2017-12-05 20:38:32 +01:00
Adam Tauber	1088c2a75d	[fix] do not crash if publication date is missing in pubmed engine	2017-12-01 20:54:12 +01:00
Adam Tauber	801b5a56ad	[fix] multiple fixes in pdbe engine	2017-12-01 20:54:12 +01:00
Adam Tauber	0969e50c5b	[fix] convert json engine result attributes to string - closes #1006	2017-12-01 20:54:12 +01:00
Adam Tauber	a065fcdcc9	[fix] skip non-string result url/title/content	2017-12-01 20:54:12 +01:00
Noémi Ványi	31005f3121	use `change` function just like in case of language selection The previous version did not work in Chrome browser. Closes #1102	2017-11-30 22:33:54 +01:00
Dalf	9babe06a0e	[mod] simple theme: add the license to different files.	2017-11-26 14:33:11 +01:00
Zeph	02cb5602b4	[fix] autocompleter py3 compatibility - fixes #1088	2017-11-23 22:04:00 +01:00
Adam Tauber	7828a1833b	[enh] version 0.13.1	2017-11-23 17:59:06 +01:00
Adam Tauber	f65f90bf3c	[fix] autocompleter py3 compatibility - fixes #1088	2017-11-23 17:42:52 +01:00
Adam Tauber	fe6e87a5a4	[fix] replace obsolete string.join function	2017-11-23 17:40:26 +01:00
Adam Tauber	27e95846ea	[fix] measure request duration only if total_time attribute is set - fixes autocompleter	2017-11-23 01:52:54 +01:00
Adam Tauber	6eb9503896	[fix] use english in google engine if no language was set - this prevents guessing the language by the IP of the instance	2017-11-22 22:56:47 +01:00
Adam Tauber	6fdb6640d9	[fix] revert language changes to prevent CAPTCHAs	2017-11-22 22:50:48 +01:00
Alexandre Flament	c1cfe97851	[enh] timeout and total HTTP time are managed by searx.poolrequests	2017-11-22 18:33:35 +01:00
Adam Tauber	e766939440	[enh] version 0.13.0	2017-11-21 19:29:35 +01:00
Adam Tauber	14a22b1993	[enh] update translations	2017-11-21 17:04:25 +01:00
Adam Tauber	b5071fea6a	[fix] remove trailing 0x00 from csv output	2017-11-21 16:58:51 +01:00
Adam Tauber	3d6c67951a	[fix] resurrect csv output in py2	2017-11-21 16:51:45 +01:00
Adam Tauber	9ab8536479	[fix] fix language support of google	2017-11-21 16:28:53 +01:00
Adam Tauber	128eb76604	[fix] allow none as category in preferences - #1086	2017-11-21 15:27:16 +01:00
yujunqiang	ed1c78d923	fix bug: TypeError: set(['bing', 'google']) is not JSON serializable, when curl 'http://127.0.0.1:8888/?q=xxxxxxxx&categories=general&format=json '	2017-11-15 21:31:27 +08:00
Adam Tauber	400e77b7fe	[enh] update translations	2017-11-13 21:16:36 +01:00
pyrrh0n1c	4340c0b16c	Fixed typos.	2017-11-07 14:14:20 +00:00
pyrrh0n1c	2231b02add	Fixed the currency_convert engine.	2017-11-07 13:29:17 +00:00
Adam Tauber	00a7041daa	Merge pull request #1068 from Apply55gx/genius Continuation of PR #1004 (seems abandoned)	2017-11-03 20:21:25 +01:00
Noémi Ványi	59c02e8e5f	results: make engines of results set Previously, if a same result was returned from the same engine, the name of the engine would be added more than once. To eliminate engine name duplication engine list was changed to set.	2017-11-03 19:52:47 +01:00
Adam Tauber	7a9b18e9e9	[mod] add more error handling to json engine II.	2017-11-02 01:08:15 +01:00
Adam Tauber	181f1c6305	[mod] add more error handling to json engine	2017-11-02 00:43:29 +01:00
jibe-b	b7eb80122e	[fix] update openairepublications	2017-11-02 00:10:08 +01:00
jibe-b	3e9cc1474f	[add] OpenAIRE publication engine and modifies OpenAIRE datasets engine	2017-11-01 22:26:33 +01:00
NoÃ©mi VÃ¡nyi	5954a8e16a	minor fix of BASE engine	2017-11-01 17:02:38 +01:00
Noémi Ványi	d20bba6dc7	minor fixes of pubmed engine Closes #1045	2017-11-01 17:02:38 +01:00
jibe-b	df0d915806	[add] pubmed engine	2017-11-01 17:02:38 +01:00
Noémi Ványi	1b10abfc92	minor fixes of doi resolver Closes #1047	2017-11-01 17:02:38 +01:00
jibe-b	575159b194	[enh] oa_doi_rewrite plugin broadens doai_rewrite	2017-11-01 14:22:26 +01:00
Noémi Ványi	7de8b43eb2	add OpenAIRE engine as a json engine This is the continuation of #1048 created by @jibe-b. Closes #1048	2017-11-01 14:22:22 +01:00
Noémi Ványi	9c2b7a82f0	minor fixes of arxiv Closes #1050	2017-11-01 14:22:22 +01:00
jibe-b	e391b2d970	[fix] remove .encode for python3 compatibility	2017-11-01 11:54:55 +01:00
jibe-b	5278fa666c	[enh] use format to concatenate strings	2017-11-01 11:54:38 +01:00
jibe-b	3e3672e079	[add] arxiv engine	2017-11-01 11:54:16 +01:00
Adam Tauber	6d28e9d694	[enh] update translations	2017-11-01 11:03:22 +01:00
Adam Tauber	8901b7bddb	[fix] pep8	2017-10-26 00:10:57 +02:00
Adam Tauber	5f758b2d39	[mod] compress saved preferences in url	2017-10-26 00:06:03 +02:00
Apply55gx	d800e3fcfa	Merge pull request #1 from asciimoo/master -	2017-10-25 10:44:28 +02:00
Apply55gx	18a4e7035f	removed unused indicies array	2017-10-25 10:42:37 +02:00
Hypolite Petovan	d506d87f60	Remove / in url_for parameter for simple theme Same change as with the oscar theme.	2017-10-18 23:45:30 -04:00
Hypolite Petovan	904a8e7e3f	Remove extra / in url_for parameter for oscar theme The `filename` parameter of the `url_for` function doesn't need a leading `/`, or else the resulting URL features a double-slash `//` that throws off searx 0.12.0 with Apache 2.4.25 on Debian, resulting in missing favicons.	2017-10-18 23:44:11 -04:00
marc	44085e31d0	update engines_languages.json and languages.py Also, fix fetch_languages.py so it can run on python3.	2017-10-10 16:53:28 -05:00
marc	a524dbb823	[fix] language support for bing images and videos	2017-10-10 16:49:49 -05:00
Adam Tauber	1adc8d6e26	Merge pull request #1059 from kvch/preferences-support-intuitive preferences: make supported/not supported labels	2017-10-07 19:14:16 +02:00
Noémi Ványi	47ee15f5ce	preferences: make supported/not supported labels Also, Time range support display was missing from RTL locales. Now it is fixed. Closes #558	2017-10-06 22:08:24 +02:00
Adam Tauber	e2afc1cdba	[mod] disable yahoo by default closes #869 closes #1055	2017-10-06 20:16:03 +02:00
Adam Tauber	eddc162f2c	[fix] remove duplicated german translation - closes #937	2017-09-27 00:20:16 +02:00
Adam Tauber	bd48df289f	Merge pull request #1035 from misnyo/voat [fix] voat.co search xpath and url fixed	2017-09-26 23:25:01 +02:00
Noémi Ványi	e73cb14889	fix hmac python3 compatibility	2017-09-08 21:33:11 +02:00
misnyo	ae99f9070c	[fix] static path fixed in templates and webapp, line endings fixed	2017-09-08 20:33:14 +02:00
misnyo	043143c898	[fix] voat.co search xpath and url fixed	2017-09-04 20:36:27 +02:00
misnyo	33fd938016	[mod] int_or_zero refactored to searx_utils	2017-09-04 20:05:04 +02:00
misnyo	c3232b0e1a	Merge branch 'master' into nyaa	2017-09-04 17:48:25 +02:00
Adam Tauber	688801076d	Merge pull request #1017 from misnyo/geektimes [fix] geektimes.ru xpath fix	2017-09-03 23:10:05 +02:00
Adam Tauber	234366b900	Merge pull request #1018 from misnyo/generalfile [mod]generalfile engine removed	2017-09-03 23:09:49 +02:00
Adam Tauber	c505c3c1ca	Merge pull request #1019 from misnyo/gigablast [fix] gigablast api fix	2017-09-03 23:09:33 +02:00
Adam Tauber	2040aac936	Merge pull request #1020 from misnyo/gitlab [fix] gitlab search fixed for proper api usage	2017-09-03 23:08:55 +02:00
misnyo	9b6307a365	[fix] gitlab search fixed for proper api usage	2017-08-31 21:59:41 +02:00
misnyo	b91772eff1	[fix] gigablast pep8 fix	2017-08-31 21:49:19 +02:00
misnyo	01330f71cd	[fix] nyaa.si fixed	2017-08-31 21:32:30 +02:00
misnyo	1e2b60f380	[mod] tokyotoshokan dependecy to other engine removed	2017-08-31 21:31:40 +02:00
misnyo	bf1ca2ccd3	[fix] habrahabr.ru xpath fix	2017-08-31 18:26:46 +02:00
misnyo	3182ba7069	[fix] google news dom xpath fix	2017-08-31 17:48:07 +02:00
misnyo	8849606e5f	[fix] gigablast api fix	2017-08-31 16:57:57 +02:00
misnyo	2d66df0548	[mod]generalfile engine removed	2017-08-31 15:51:16 +02:00
misnyo	9711795876	[fix] geektimes.ru xpath fix	2017-08-31 15:41:08 +02:00
Adam Tauber	e74aaa781e	Merge pull request #1016 from misnyo/blekko [mod]blekko images removed	2017-08-30 21:48:36 +02:00
Adam Tauber	610117d054	Merge pull request #1015 from misnyo/digg [fix] digg now requires cookie for search	2017-08-30 21:35:12 +02:00
misnyo	6e92fb383a	[fix] digg cookie characters created in module import	2017-08-30 21:14:12 +02:00
misnyo	20d2d4dab1	[fix] pep8 fix for faroo engine	2017-08-30 21:09:03 +02:00
misnyo	0607b167f8	[fix] faroo json api and image layout fixed	2017-08-30 21:09:03 +02:00
misnyo	a49cc18f9c	[fix] digg now requires cookie for search	2017-08-30 19:51:33 +02:00
misnyo	f139f9cfdb	[mod]blekko images removed	2017-08-30 16:47:56 +02:00
misnyo	d14e2781b2	[fix]torrentz search engine fixed for new version	2017-08-25 00:52:35 +02:00
woorst	2434c29dc5	New engine: Genius (lyrics)	2017-08-19 19:05:17 -05:00
Alexandre Flament	57dc6b625f	[fix] travis build : various fix about grunt builds	2017-08-13 13:41:59 +02:00
Alexandre Flament	14a8dd28c2	[fix] fix no_results.html template of the simple theme	2017-08-12 21:15:31 +02:00
Adam Tauber	6254d360a3	[fix] add missing no_results.html template to simple theme	2017-08-08 20:07:48 +02:00
Adam Tauber	ac59f5e168	Merge branch 'master' into simple	2017-08-08 15:55:47 +02:00
Alexandre Flament	10a24bdc2c	[enh] add simple theme (WIP)	2017-08-06 16:04:21 +02:00
marc	3ca9cad927	add bing videos engine	2017-08-05 20:35:57 -05:00
Mostafa Ahangarha	b142e88391	Update results.less More gap between search results increase the readability. Currently, the result page is just filled with text.	2017-07-31 04:41:53 +04:30
marc	5f36e85b37	ensure all parameters are merged in results	2017-07-26 15:49:16 +02:00
marc	856dfc3018	add google videos	2017-07-26 15:49:16 +02:00
Adam Tauber	077d8efed8	[fix] use poolrequests in ddg engines	2017-07-21 16:23:20 +02:00
Adam Tauber	0f6612bb40	[mod] separate engine load and initialization	2017-07-21 14:27:25 +02:00
Adam Tauber	f2b13a7de0	[enh] allow default empty values for normal and result proxies	2017-07-20 13:32:20 +02:00
Adam Tauber	1794f6a4d3	[enh] add "inactive" attribute to engines This modification allows us to deactivate engines in settings.yml without commenting them out	2017-07-20 13:32:20 +02:00
Noémi Ványi	80331cc8e6	add timeout errors in search_multiple_requests	2017-07-20 13:30:56 +02:00
Noémi Ványi	2242000bd4	change unresponsive_engines to a set to eliminate duplication of errors	2017-07-20 13:30:56 +02:00
Noémi Ványi	bdd9528c6b	show engine errors when no result is returned at all	2017-07-15 17:59:50 +02:00
Noémi Ványi	243d3e4298	show engine errors in infobox && add new error alert	2017-07-12 16:29:11 +02:00
Luke Bonham	3bd5ce6595	Italian localisation: corrected and fixed typos	2017-07-10 18:51:24 +02:00
marc	405e5c8f24	[fix] duckduckgo images doesn't fail with countryless language	2017-07-10 18:41:50 +02:00
Adam Tauber	38d6ba4066	[enh] generate search url of saved preferences	2017-07-10 12:50:13 +02:00
Adam Tauber	36af8f9d67	[fix] use py2/3 compatibility layer	2017-07-10 11:42:44 +02:00
marc	80460be8f6	[fix] wrap suggestions inside suggestion box long suggestions now wrap around the box instead of going overboard.	2017-06-25 22:20:35 +02:00
potato	9b82cb1908	[fix] is_valid_lang fixed for new languages.py + dictzone engine encoding	2017-06-25 18:29:19 +02:00
vache asatryan	5835ebf955	fix github url	2017-06-18 21:53:10 +04:00
Noémi Ványi	c361811cb5	[fix] fix xpath of google images	2017-06-13 19:47:56 +02:00
Adam Tauber	6d76d9b202	[fix] load engines if debug mode is enabled using uwsgi	2017-06-12 12:47:42 +02:00
Adam Tauber	343ac7197d	[fix] pep8	2017-06-06 23:37:42 +02:00
Adam Tauber	78365ffb8a	[enh] add init function to engines which loads parallel	2017-06-06 22:20:20 +02:00
Adam Tauber	f82646f386	[enh] version 0.12.0	2017-06-04 13:19:15 +02:00
marc	3b950929b1	[fix] fix duckduckgo's offset First page now starts with 0 offset, rather than starting on the 30th result. DuckDuckGo returns 30 results on each page.	2017-05-27 21:12:39 -05:00
marc	c65a409f0d	add duckduckgo images engine	2017-05-23 20:07:09 +02:00
Adam Tauber	e60e98156f	[enh] update translations - closes #930	2017-05-23 13:49:45 +02:00
Alexandre Flament	7ebe3a6f41	[mod] add category to each results, and change group criterias (template and existing image)	2017-05-22 22:20:35 +02:00
Alexandre Flament	87f673336f	[fix] rss feed : the jinja template was not found when the rss feed returns an valid feed including an error.	2017-05-22 22:20:35 +02:00
Adam Tauber	1972a044a3	[fix] produce valid urls if scheme is missing	2017-05-22 15:48:37 +02:00
Adam Tauber	8db527c1d2	[fix] use raw response with etree.parsefromstring - Unicode strings with encoding declaration are not supported	2017-05-22 15:36:52 +02:00
Noémi Ványi	b685e9753b	[enh] update existing translations	2017-05-19 23:19:18 +02:00
Adam Tauber	a4f7046b8f	[fix] pep8	2017-05-18 22:19:44 +02:00
Noémi Ványi	2a9339f4b7	[fix] add more description on possible search tpyes	2017-05-18 22:04:31 +02:00
Noémi Ványi	87f117d50e	[enh] add free software directory engine	2017-05-18 21:39:32 +02:00
Noémi Ványi	2db807368c	[enh] make search type of mediawiki configurable	2017-05-18 21:34:54 +02:00
marc	9ee8e552da	[fix] bing images	2017-05-17 15:45:55 +02:00
Alexandre Flament	9c91ab33f8	[mod] settings.yml can be /etc/searx/settings.yml The exact order is * first from SEARX_SETTINGS_PATH, * if not found then from searx code base, * if not found then from /etc/searx/settings.yml * if not found an exception stops searx loading	2017-05-15 22:19:42 +02:00
Alexandre Flament	ee080feaed	[mod] the static and templates directories can be defined in the settings.yml	2017-05-15 21:23:13 +02:00
Dalf	c233bf0df9	[fix] framalibre : remove result['thumbnail'] (not used)	2017-05-15 17:28:21 +02:00
Alexandre Flament	f5128c7cb9	[mod] add/modify image fetching for bing_news, qwant and twitter engines	2017-05-15 17:28:21 +02:00
Adam Tauber	52e615dede	[enh] py3 compatibility	2017-05-15 12:02:30 +02:00
Adam Tauber	46a2c63f8e	[fix] yahoo news date parsing	2017-04-08 19:45:04 +02:00
Alexandre Flament	12d91c1d67	[mod] searx doesn't crash at startup when an engine can't be loaded (see #884 )	2017-04-08 17:38:46 +02:00
Adam Tauber	92ca80ba5a	[fix] build french translation to be identical with the .po source	2017-03-24 11:58:49 +01:00
Alexandre Flament	181c12ae04	[mod] upgrade requirements.txt	2017-03-23 21:26:51 +01:00
François Revol	45d15bd6f0	Add framalibre engine framalibre.org is a catalogue of Free Software, edited by Framasoft. For now we pass the thumbnail as img_src as it doesn't seem to be used for IT...	2017-03-22 00:18:23 +01:00
Noémi Ványi	4a4975d7fc	[enh] update translation files New languages: German (Germany), Finnish, Slovak, Ukrainian Updated: Bulgarian, German, Esperanto, Italian, Japanese, Dutch, Portuguese (Brazil), Russian, Swedish	2017-03-18 23:49:00 +01:00
marc	fd65c12921	make search language handling less strict languages.py can change, so users may query on a language that is not on the list anymore, even if it is still recognized by a few engines. also made no and nb the same because they seem to return the same, though most engines will only support one or the other.	2017-03-18 23:44:21 +01:00
marc	805fb02ed1	add language support for qwant closes issue #863	2017-03-18 23:44:21 +01:00
Alexandre Flament	e4d46d21c7	[mod] oscar theme: use tinypng.com to reduce logos and favicon	2017-03-08 16:09:13 +01:00
Alexandre Flament	e9785a69c7	[mod] reduce png and gif image sizes using optipng and gifsicle tools.	2017-03-08 16:09:13 +01:00
Noémi Ványi	247534be76	[fix] pageno param of search reqs in form	2017-02-10 19:43:27 +01:00
Adam Tauber	0e7ac3797d	Merge pull request #848 from maxigas/master add library genesis engine	2017-02-05 16:55:06 +01:00
maxigas	4ebde2b2af	add library genesis engine	2017-02-05 16:32:28 +01:00
Noémi Ványi	742e4dfdcc	[fix] fix paging of duckduckgo	2017-02-01 20:54:13 +01:00
Alexandre Flament	e67dfaaac7	Merge branch 'master' into flask_perimeter	2017-01-27 13:47:59 +00:00
Adam Tauber	ee1d44caf9	[mod] darker green url in logicodev	2017-01-27 13:55:52 +01:00
Adam Tauber	4906ac5192	[fix] add padding to pointhi theme's navbar - closes #841	2017-01-27 13:47:19 +01:00
Noémi Ványi	d88950c25f	[fix] darker green for result urls	2017-01-27 01:21:48 +01:00
Adam Tauber	b3974fc880	[fix] do not show glyph icons if noscript is enabled - #838	2017-01-27 01:19:49 +01:00
Adam Tauber	52d1087202	[enh] add result number parsing to google engine	2017-01-27 00:18:46 +01:00
NoÃ©mi VÃ¡nyi	d635b5fd4d	[enh] make navbar smaller	2017-01-26 23:52:00 +01:00
Noémi Ványi	508d0f063e	[enh] make number of results less prominent	2017-01-26 23:44:21 +01:00
Noémi Ványi	8354bd0c60	[enh] make result url green	2017-01-26 23:33:12 +01:00
Adam Tauber	04306bad89	[fix] whitespace	2017-01-26 21:18:10 +01:00
Adam Tauber	30695265c2	[enh] search input design mods according to #226	2017-01-26 21:12:41 +01:00
Adam Tauber	e7aa98902f	[fix] correct search parameter check	2017-01-21 20:21:32 +01:00
Adam Tauber	2522254fb2	[fix] search time range value check	2017-01-21 20:13:55 +01:00
Adam Tauber	fa26afafd8	[fix] handle missing mapsettings	2017-01-21 20:08:08 +01:00
Alexandre Flament	15eef0ebdb	[enh] validate input and raise an exception inside search.py. The exception message is output in json and rss format.	2017-01-20 18:52:47 +01:00
Alexandre Flament	7fdfeca3a4	[mod] add a __common__ template that can't be selected but that provides a common place for shared templates. What has been moved into this template : * opensearch.xml is always the same whatever the themes. the text inside */about.html	2017-01-20 15:40:38 +01:00
Adam Tauber	57149661e4	Merge pull request #830 from davidar/se Semantic Scholar	2017-01-18 23:50:11 +01:00
Adam Tauber	b1d49bacb0	Merge pull request #827 from davidar/spell [enh] show spelling corrections	2017-01-18 23:49:01 +01:00
David A Roberts	7814d4b796	Semantic Scholar	2017-01-17 21:15:53 +10:00
David A Roberts	7492997c51	[fix] allow empty content	2017-01-17 21:14:33 +10:00
David A Roberts	1d30141c20	[enh] show spelling corrections	2017-01-16 13:31:16 +10:00
Alexandre Flament	7a16aca346	Merge branch 'master' into flask_perimeter	2017-01-15 22:18:20 +01:00
jcherqui	d98705bd06	Add 1337x icon	2017-01-15 16:13:23 +01:00
jcherqui	39a97825d9	Add torrent infos	2017-01-15 16:13:23 +01:00
jcherqui	4776abd1ac	Remove categories	2017-01-15 16:13:23 +01:00
jcherqui	a320328dda	Fix test	2017-01-15 16:13:23 +01:00
jcherqui	0549fb40d2	Add 1337x.to engine	2017-01-15 16:13:23 +01:00
Alexandre Flament	448903cd4a	[fix] searching for "!google_images text" doesn't work (bang with underscore)	2017-01-12 16:17:29 +01:00
Adam Tauber	d6cbc6b78b	[enh] 0.11.0 version bump	2017-01-10 21:09:04 +01:00
Adam Tauber	108392f8da	[fix] skip non-complete google news results	2017-01-10 11:03:05 +01:00
Dalf	06bea82935	[mod] /config API : add language_support, paging, safesearch, supported_languages, time_range_support, timeout fields.	2017-01-07 14:42:55 +01:00
Adam Tauber	0d4da30c7f	[enh] add instant answers to google engine	2017-01-05 17:20:12 +01:00
Adam Tauber	fc14fb0a67	[fix] french translation template var name	2017-01-05 15:47:54 +01:00
Adam Tauber	261015002e	[enh] update translations	2017-01-05 15:24:45 +01:00
Adam Tauber	14b96b8824	[enh] propagate all search properties to the results page's components	2017-01-05 15:24:45 +01:00
Adam Tauber	627962ce40	Merge branch 'master' into flask_perimeter	2017-01-04 19:09:12 +01:00
Noémi Ványi	e8319fa2cb	Revert "Merge pull request #793 from kvch/pics-modal" This reverts commit `bff41987a4`, reversing changes made to `d08108be62`.	2017-01-03 22:04:09 +01:00
Noémi Ványi	8af29d9797	Revert "Merge pull request #799 from kvch/modal-arrows" This reverts commit `79ceb13577`, reversing changes made to `eaa0fb8102`.	2017-01-03 22:03:59 +01:00
Adam Tauber	7b1daf254e	[fix] autocomplete unicode issue - closes #808	2017-01-03 13:11:38 +01:00
Adam Tauber	525e5d275c	Merge pull request #801 from dalf/extract_text [fix] extract_text: use html.tostring instead html_to_text.	2017-01-02 12:36:50 +01:00
Alexandre Flament	84a2c97a65	[mod] searx uses flask framework only in webapp.py. Make migration to another framework easier.	2017-01-02 12:06:04 +01:00
Alexandre Flament	90e1db3e5c	[fix] extract_text: use html.tostring instead html_to_text. Fix #711	2016-12-31 13:56:09 +01:00
Adam Tauber	3d8c9bab96	Merge pull request #800 from dalf/searchpy5 search.py : Fix and some minor modifications	2016-12-30 19:51:12 +01:00
Adam Tauber	6bf9c398a7	[fix] use english as default language in bing If no language is specified, bing returns results with multiple languages for one query which isn't really useful. Setting english as default insted if nothing.	2016-12-30 18:17:14 +01:00
Alexandre Flament	5a9551925d	[fix] fix bugs introduced by commit `0a2fde19d0` from dalf/searchpy4	2016-12-30 18:10:14 +01:00
Alexandre Flament	28d51fd063	[mod] timeout in log are readable (the timeouts are compare to the start_time of the request).	2016-12-30 17:37:46 +01:00
Alexandre Flament	3a8ab5880a	[mod] result_container.extend sets result['engine'] = engine_name for each result	2016-12-30 17:18:02 +01:00
NoÃ©mi VÃ¡nyi	d18d09a98b	[fix] change modal glyphicon arrows to image icons	2016-12-30 14:59:46 +01:00
Alexandre Flament	0a2fde19d0	[mod] add a search_one_request_safe function wrapper to call search_one_request. All exceptions are catched in this wrapper.	2016-12-30 11:51:49 +01:00
Noémi Ványi	1710043eb7	remove unnecessary media query && generated files	2016-12-29 23:40:23 +01:00
Noémi Ványi	420ef433ae	add img pagination support of infinite scroll	2016-12-29 23:40:23 +01:00
Noémi Ványi	2ec6034c85	add modal window for pointhi style	2016-12-29 23:40:23 +01:00
Noémi Ványi	d82f64238f	fix opening of result on new tab	2016-12-29 23:40:23 +01:00
Noémi Ványi	1157cefb1e	add generated css of modal window	2016-12-29 23:40:23 +01:00
Noemi Vanyi	5fa6af648d	add own pics modal window	2016-12-29 23:40:23 +01:00
marc	896c0c3734	revert language support column in preferences	2016-12-29 01:56:04 -06:00
marc	1175b3906f	change language list to only include languages with a minimum of engines that support them. users can still query lesser supported through the :lang_code bang.	2016-12-29 01:55:30 -06:00
Adam Tauber	7388067f15	[fix] load engines with uwsgi too	2016-12-28 21:17:51 +01:00
Adam Tauber	116521192e	[mod] display supported languages in preferences engine view	2016-12-28 21:01:19 +01:00
Adam Tauber	8bff42f049	Merge branch 'master' into languages	2016-12-28 20:00:53 +01:00
Adam Tauber	ea034fafa9	[fix] proper engine init	2016-12-27 17:55:44 +01:00
Adam Tauber	68cbf0448f	[fix] do not reload engines twice if started with debug mode	2016-12-27 17:31:14 +01:00
Adam Tauber	a605377c40	[enh] explicit engine init	2016-12-27 17:31:14 +01:00
Adam Tauber	14f58bdaec	[fix] robot tests ++ set default value for server http protocol version	2016-12-25 23:31:51 +01:00
Adam Tauber	a98bbefbcf	[enh] configurable listening http protocol version	2016-12-25 23:05:01 +01:00
Stefan Antoni	89914e52e3	Update settings.yml	2016-12-25 22:04:45 +01:00
Stefan Antoni	e6d69b082f	Merge branch 'master' into add_ccctv_to_settings	2016-12-25 14:59:52 +01:00
Adam Tauber	07448e15e4	[fix] disable etymonline by default - closes #789	2016-12-25 09:34:17 +01:00
Adam Tauber	b6fc154616	[enh] add searx engine	2016-12-24 22:23:36 +01:00
Stefan Antoni	96c8d36e7b	Add ccctv engine to settings.yml	2016-12-24 16:44:12 +01:00
Adam Tauber	0171db5c3f	[fix] handle missing images in google news	2016-12-23 12:59:52 +01:00
Adam Tauber	4b225eb7ef	Merge pull request #661 from davidar/et Online Etymology Dictionary	2016-12-23 12:54:02 +01:00
marc	f30d5e8793	[fix] supported languages column in preferences page	2016-12-16 22:17:41 -06:00
marc	7fba3d1179	Merge branch 'master' into languages	2016-12-16 22:14:36 -06:00
marc	4a1ff56389	minor fixes in utils/fetch_languages.py	2016-12-16 22:14:14 -06:00
Adam Tauber	19cd2bf3b5	[fix] re-enable ssl verification for searchcode closes #784	2016-12-16 15:21:27 +01:00
Adam Tauber	cf5c7d050a	[fix] engine setting if no categories specified	2016-12-15 11:59:21 +01:00
marc	af35eee10b	tests for _fetch_supported_languages in engines and refactor method to make it testable without making requests	2016-12-15 00:40:21 -06:00
marc	e0c270bd72	tests for language support in engines	2016-12-13 23:51:15 -06:00
marc	1b46ecd21a	[fix] broken language selector	2016-12-13 21:36:40 -06:00
marc	93233c786a	Refactor search language preference.	2016-12-13 20:59:31 -06:00
marc	f62ce21f50	[mod] fetch supported languages for several engines utils/fetch_languages.py gets languages supported by each engine and generates engines_languages.json with each engine's supported language.	2016-12-13 19:58:10 -06:00
marc	92c6e88ad3	small fixes	2016-12-13 19:56:59 -06:00
marc	727c287856	[fix] backwards compatibility with old language cookies	2016-12-13 19:56:58 -06:00
marc	922d51bf0c	Add country names in language list.	2016-12-13 19:32:43 -06:00
marc	a11948c71b	Add language support for more engines.	2016-12-13 19:32:43 -06:00
marc	a11230819f	automatic search when language is selected	2016-12-13 19:32:00 -06:00
marc	c677aee58a	filter langauges	2016-12-13 19:32:00 -06:00
marc	149802c569	[enh] add supported_languages on engines and auto-generate languages.py	2016-12-13 19:32:00 -06:00
Noémi Ványi	b034356825	add year filter to engines with time range support && tests Following engines does not support "Last year": * Bing News * DeviantArt * DuckDuckGo * Yahoo * YouTube (noapi)	2016-12-11 16:58:31 +01:00
Noémi Ványi	c59c76e6ee	add year to time range to engines which support "Last year" Engines: * Bing images * Flickr (noapi) * Google * Google Images * Google News	2016-12-11 16:58:31 +01:00
Noémi Ványi	2fc1091b7f	add "Last year" option to time range selection	2016-12-11 16:58:31 +01:00
Thomas Renard	16c40ffefd	htmlize yacy contents	2016-12-11 14:05:07 +01:00
Noémi Ványi	9c8ec209e1	[mod] add timeout to gigablast	2016-12-11 11:58:49 +01:00
Noémi Ványi	553f3a3a1a	fix xpath of yandex	2016-12-11 11:58:49 +01:00
Noémi Ványi	85f363774c	fix habrahabr xpath	2016-12-11 11:58:49 +01:00
Noémi Ványi	c6ed0dae6c	fix google play movies xpath	2016-12-11 11:58:49 +01:00
Adam Tauber	4676e1dcde	[fix] remove result escaping from engine	2016-12-11 03:24:26 +01:00
Adam Tauber	1a82ed6f54	[mod] 500px rewrite	2016-12-11 03:22:42 +01:00
Adam Tauber	f6e9c074bb	[fix] vimeo engine change follow-up	2016-12-11 02:33:04 +01:00
Adam Tauber	a2c94895c1	[fix] google news engine change follow-up	2016-12-11 01:03:52 +01:00
Adam Tauber	a764ebb4b1	[enh] extend json response with suggestions, infoboxes and answers	2016-12-10 21:38:34 +01:00
Adam Tauber	c3dcebb778	[fix] remove html tags from qwant results	2016-12-10 21:31:05 +01:00
Adam Tauber	be6ae81cb2	Merge pull request #776 from asciimoo/voat-engine add voat.co engine	2016-12-10 00:49:16 +01:00
Adam Tauber	e12a137a2f	[fix] unicode response in deezer and spotify	2016-12-10 00:30:34 +01:00
Adam Tauber	75aa46a6b3	[fix] remove unused variable	2016-12-10 00:15:53 +01:00
Adam Tauber	0205838f25	[enh] handle engine response crashes	2016-12-10 00:15:33 +01:00
Alexandre Flament	e48f07a367	Merge branch 'master' into searchpy2	2016-12-09 23:11:45 +01:00
Adam Tauber	d80fb2c8e8	[enh] central handling of empty result titles	2016-12-09 19:57:28 +01:00
Adam Tauber	72a217f983	[mod] return empty string on missing osm title Sometimes openstreetmap returns with None as title. In these cases use an empty string instead.	2016-12-09 19:53:54 +01:00
Adam Tauber	fdf63940e8	[fix] tests ++ flickr error	2016-12-09 19:11:22 +01:00
Adam Tauber	ef2ef7974a	[enh] central html escaping of results	2016-12-09 19:10:33 +01:00
Adam Tauber	7e1f27e459	[enh] add author to image result content	2016-12-09 18:59:24 +01:00
Adam Tauber	39f5035e13	[fix] query escaping in rss/opensearch output	2016-12-09 18:59:24 +01:00
Adam Tauber	16bdc0baf4	[mod] do not escape html content in engines	2016-12-09 18:59:19 +01:00
Adam Tauber	28f12ef5a0	[fix] proper escaping of the search query in templates	2016-12-04 23:07:46 +01:00
Adam Tauber	7986d4cf41	[fix] correct path for autoscroll on non-root urls closes #758	2016-12-04 11:17:17 +01:00
Noémi Ványi	3007e4e451	add voat.co engine	2016-12-02 20:34:00 +01:00
Adam Tauber	0724bd8168	[fix] pep8	2016-11-19 21:18:12 +01:00
Adam Tauber	7eed8a5dd9	[enh] add statistics answerer	2016-11-19 21:03:27 +01:00
Adam Tauber	971ed0abd1	[enh] add quick answer functionality with an example answerer	2016-11-19 20:53:51 +01:00
Adam Tauber	55dc538398	[mod] move load_module function to utils	2016-11-19 17:51:19 +01:00
Adam Tauber	827f9e41ca	[fix] gettext requires request.preferences	2016-11-15 09:56:18 +01:00
Noémi Ványi	299c882304	search: make language configurable from settings.yml	2016-11-14 23:32:19 +01:00
Noémi Ványi	12c369e858	preferences: refactor to check consistently input values	2016-11-14 22:29:27 +01:00
Adam Tauber	a757c2f005	[fix] remove unused imports	2016-11-14 22:15:03 +01:00
Adam Tauber	832cf37a97	[enh] display errors also tried flask's flash feature but flask creates session cookies if it isn't flushed. Avoiding session cookies to preserve privacy	2016-11-14 22:07:23 +01:00
Adam Tauber	88dfee858e	[fix] rewrite missing variable	2016-11-14 17:25:21 +01:00
Adam Tauber	96f182d75d	[fix] allow empty autocomplete setting closes #756 closes #761	2016-11-14 16:17:11 +01:00
Adam Tauber	43ddbc60da	[fix] pep8	2016-11-14 16:09:16 +01:00
Adam Tauber	16f2e346b3	[fix] bing unicode issue part III.	2016-11-14 15:52:29 +01:00
Adam Tauber	94196c4b6c	[enh] show traceback of search errors	2016-11-14 15:49:06 +01:00
Adam Tauber	1176505fa4	[fix] bing character encoding - closes #760	2016-11-14 15:47:42 +01:00
Adam Tauber	17b08d096c	[fix] unicode search expression for bing	2016-11-07 22:33:17 +01:00
Adam Tauber	16ff8d06c7	[fix] bing paging and language support see https://msdn.microsoft.com/en-us/library/ff795620.aspx for bing specific search operators closes #755	2016-11-07 22:30:20 +01:00
Alexandre Flament	219f047bf3	Merge branch 'master' into searchpy2	2016-11-06 09:44:07 +01:00
Adam Tauber	7d26b3f8f8	[fix] suspend end time check	2016-11-06 02:53:09 +01:00
Noémi Ványi	c7906555a0	add lobste.rs xpath engine	2016-11-06 01:17:30 +01:00
Alexandre Flament	01e2648e93	Simplify search.py, basically updated PR #518 The timeouts in settings.yml is about the total time (not only the HTTP request but also the prepare the request and parsing the response) It was more or less the case before since the threaded_requests function ignores the thread after the timeout even the HTTP request is ended. New / changed stats : * page_load_time : record the HTTP request time * page_load_count: the number of HTTP request * engine_time : the execution total time of an engine * engine_time_count : the number of "engine_time" measure The avg response times in the preferences are the engine response time (engine_load_time / engine_load_count) To sum up : * Search.search() filters the engines that can't process the request * Search.search() call search_multiple_requests function * search_multiple_requests creates one thread per engine, each thread runs the search_one_request function * search_one_request calls the request function, make the HTTP request, calls the response function, extends the result_container * search_multiple_requests waits for the the thread to finish (or timeout)	2016-11-05 13:45:20 +01:00
Alexandre Flament	58a6c045c8	[mod] replace references request.request_data (GET or POST parameters) by request.form (based on merge of POST and GET parameters)	2016-11-02 14:52:22 +01:00
dalf	fbb080f358	Change plugin API : - pre_search(request, search) - post_search(request, search) - on_result(request, search, result) with - request is the Flask request - search a searx.Search instance - result a searx result as usual	2016-11-02 14:22:16 +01:00
dalf	67e11c42b9	Clean up the architecture Purposes : - isolate the plugins calls - distinction between parsing the web request and running the search (Search class). To be able to test code easily, to run searx code outside a web server, to filter the search query parameters with plugins more easily, etc... Details : - request.request_data contains request.form or request.args (initialize inside pre_request() function) - Query class is renamed RawTextQuery - SearchQuery class defines all search parameters - get_search_query_from_webapp create a SearchQuery instance (basically the previous Search.__init__ code) - Search class and SearchWithPlugins class takes a SearchQuery instance as class constructor parameter - SearchWithPlugins class inherites from Search class, and run plugins - A dedicated function search_with_plugins executes plugins to have a well define locals() (which is used by the plugins code). - All plugins code is executed inside the try...except block (webapp.py, index function) - advanced_search HTTP parameter value stays in webapp.py (it is only part of UI) - multiple calls to result_container.get_ordered_results() doesn't compute the order multiple time (note : this method was call only once before) - paging value is stored in the result_container class (compute in the extend method) - test about engine.suspend_end_time is done during search method call (instead of __init__) - check that the format parameter value is one of these : html, rss, json, rss (before the html value was assumed but some text formatting wasn't not done)	2016-11-02 14:22:16 +01:00
Adam Tauber	142cd87095	[fix] menu style in pointhi oscar theme	2016-11-02 12:26:54 +01:00
Adam Tauber	9782633054	[fix] menu without js - closes #747	2016-11-01 23:12:46 +01:00
Noémi Ványi	1490d6bc93	add time range search for flickr	2016-11-01 17:58:29 +01:00
Noémi Ványi	5c02b9ef31	add time range support for bing images	2016-11-01 17:58:29 +01:00
Noémi Ványi	d2e0cbafb2	add time range search for youtube noapi	2016-11-01 17:58:29 +01:00
Noémi Ványi	f70d405202	add time range search for bing news	2016-11-01 17:58:29 +01:00
Noémi Ványi	e3d748ded4	show time range support in preferences	2016-11-01 17:57:58 +01:00
Adam Tauber	6243639f01	[mod] do not proxify images if image proxy is not set	2016-10-30 21:15:46 +01:00
Noémi Ványi	6334fca11c	add version info to config endpoint	2016-10-30 15:58:34 +01:00
Adam Tauber	1b9045ed89	[enh] use morty proxy for image proxification too if it is configured	2016-10-29 23:21:07 +02:00
Adam Tauber	a67a4bf2c0	[enh] allow morty proxy without hmac key	2016-10-29 23:21:07 +02:00
Adam Tauber	574d9d40d2	Merge pull request #697 from Eig8phei/http1.1 serve pages with HTTP/1.1	2016-10-29 17:46:57 +02:00
dalf	3e7554422b	[mod] the environment variable SEARX_DEBUG can override the general.debug value in settings.yml	2016-10-22 21:36:13 +02:00
Adam Tauber	e249698b26	Merge pull request #737 from dalf/ixquick [fix] ixquick : fetch results from ixquick.eu instead of ixquick.com	2016-10-22 21:33:25 +02:00
dalf	972f32d973	[fix] ixquick : fetch results from ixquick.eu instead of ixquick.com, close #727	2016-10-22 20:56:18 +02:00
Noémi Ványi	db8c2ebc3f	[fix] images modal with infinite scroll	2016-10-22 20:05:05 +02:00
Adam Tauber	760cb3c5af	Merge pull request #734 from dalf/seeks_url [fix] seeks URLS, close #731	2016-10-22 14:48:39 +02:00
Alexandre Flament	a88768efd8	Merge branch 'master' into http1.1	2016-10-22 14:25:50 +02:00
Noémi Ványi	53c9fde992	fix kickass torrents engine	2016-10-22 05:27:18 +02:00
Adam Tauber	218857999e	Merge pull request #726 from mmuman/opensearch_shortname [fix] set the title on the opensearch link tag	2016-10-22 05:10:49 +02:00
Adam Tauber	d5c0dcd18a	[fix] unicode url proxiing	2016-10-17 01:32:31 +02:00
Adam Tauber	1be6e72d51	[enh] add result proxy support - #707	2016-10-17 00:23:15 +02:00
Adam Tauber	19a6ca0b68	[enh] use HMAC for image proxy url verification	2016-10-16 23:41:33 +02:00
Alexandre Flament	5b21a7fb65	Merge branch 'master' into opensearch_shortname	2016-10-16 20:03:14 +02:00
dalf	cae84e71a5	[fix] seeks URLS, close #731	2016-10-15 18:43:03 +02:00
Alexander Minges	3c5883408c	initial commit of pdbe engine Adds support for queries to the Protein Data Bank Europe (PDBe).	2016-10-13 00:40:38 +02:00
François Revol	96cfdc77d2	[fix] set the title on the opensearch link tag Firefox uses the title attributes instead of the ShortName from the xml file as set in `0fbd7052` which closed #405	2016-10-09 01:12:56 +02:00
Pydo	beff8c6007	Merge branch 'master' of https://github.com/asciimoo/searx into feature/seedpeer-engine-integration	2016-10-01 19:26:51 -04:00
Pydo	01844b6f04	Set default categories for seedpeer provider	2016-10-01 19:22:36 -04:00
Adam Tauber	dceb903114	[mod] disallow search results for robots	2016-10-01 20:22:52 +02:00
Pydo	55a5b686ed	Merge branch 'master' of https://github.com/asciimoo/searx into feature/seedpeer-engine-integration Resolved conflict searx/settings.yml	2016-10-01 10:46:18 -04:00
Pydo	6f87bf2a1c	Disabled seepeer.eu by default since it does not support https	2016-10-01 10:28:01 -04:00
Adam Tauber	812ade82b1	[fix] robot test engine names	2016-09-28 22:49:29 +02:00
Adam Tauber	86daef2063	[fix] do not allow underscore in engine names - closes #708	2016-09-28 22:30:05 +02:00
Adam Tauber	bee7b497a3	[mod] rename "default" theme to "legacy"	2016-09-22 23:51:07 +02:00
marc	d1d4ed4376	[fix] results with digbit don't truncate anymore	2016-09-20 16:11:33 -05:00
Eig8phei	f90eb428c6	serve pages with HTTP/1.1	2016-09-15 14:47:09 +03:00
Lorenzo J. Lucchini	2bc42b378d	Remove unrelated change that mistakenly ended up into this branch	2016-09-10 17:44:22 -04:00
firebovine	e145fdb86d	#607 - noapi fix	2016-09-10 17:43:12 -04:00
Lorenzo J. Lucchini	05206f86e3	Adding Urban Dictionary xpath engine	2016-09-10 17:42:19 -04:00
Lorenzo J. Lucchini	a8907224a1	Improving Wolfram Alpha search hit content Making WA search hits contain - the (parsed) input inside the "title" instead of just "Wolfram\|Alpha", to better match other hit titles and to confirm correct parsing of input to the user - the first output field that contains any text (skipping ones that are only pictures; this is usually the most meaningful "result" field) instead of the raw input as the "content", making it additionally possible to obtain WA computations from JSON API calls	2016-09-10 17:42:19 -04:00
marc	09ee2aa69d	[fix] Result text in Wolfram\|Alpha (#607 )	2016-09-10 17:42:04 -04:00
firebovine	baeb3ff911	fix xpath expressions for urban dictionary	2016-09-10 17:08:34 -04:00
Adam Tauber	8d4dd3c515	[fix] 404 HTTP status on not found pages - closes #681	2016-09-07 08:32:01 +02:00
Adam Tauber	ce371f766a	[enh] version 0.10.0 closes #659	2016-09-06 18:31:25 +02:00
Adam Tauber	ea19e19ff2	[enh] translation updates	2016-09-06 18:12:01 +02:00
Adam Tauber	3144ec1d59	[fix] unicode urls	2016-09-06 17:17:42 +02:00
potato	983415bc38	[enh] is_valid_lang moved to utils	2016-09-06 16:43:48 +02:00
potato	b7d578ae80	[enh] engine header comments	2016-09-06 16:36:04 +02:00
potato	5ed9846bbf	[fix] revert the port change	2016-09-06 16:35:12 +02:00
potato	8c72a22757	[enh] api_key usage, disable the engine by default	2016-09-06 16:12:34 +02:00
potato	c051e6a2c3	[fix] pep8	2016-09-06 15:44:05 +02:00
potato	ab471fd13b	[enh] mymemory translated engine added for multi-word translations	2016-09-06 15:40:07 +02:00
potato	22bd39fd42	[fix] only 1-word search triggers the engine	2016-09-06 15:07:47 +02:00
potato	7bf1013c15	[enh] removed missing params; [fix] pep8	2016-09-06 14:24:08 +02:00
potato	bc806bfab1	[fix] no lambda anymore, cgi.escape	2016-09-06 14:12:46 +02:00
potato	5416f0f248	[enh] dictionary engine renamed to dictzone	2016-09-06 12:50:56 +02:00
potato	84ff6e289e	[enh] filter non-existing language code/name containing requests	2016-09-06 12:46:18 +02:00
potato	b808a2e266	[fix] don't merge with suggestions	2016-09-06 12:37:26 +02:00
potato	3f4cc2146c	[enh] return results instead of answers	2016-09-06 12:34:20 +02:00
potato	9d08c81f47	Merge branch 'master' of https://github.com/asciimoo/searx	2016-09-06 11:47:34 +02:00
potato	f4525880ed	[enh] dictionary engine added	2016-09-06 11:47:27 +02:00
Adam Tauber	55abf07a4f	[fix] thread safe threaded_requests() function	2016-09-06 00:36:33 +02:00
Adam Tauber	b816752719	[enh] more compact image results ++ fixed modal links	2016-09-06 00:26:32 +02:00
Adam Tauber	3a1b6fa818	[fix] replace modal-content class to prevent remote content load details: http://stackoverflow.com/questions/18378720/bootstrap-3-with-remote-modal	2016-09-06 00:15:29 +02:00
Adam Tauber	fa5bc3a563	[fix] use threading to recover after incomplete request crashes - closes #651 #662	2016-09-05 22:46:25 +02:00
Adam Tauber	b27f07af23	[enh] socks proxy support	2016-09-05 22:35:54 +02:00
Adam Tauber	da4f1c2512	[mod] truncate result content in html - closes #224	2016-09-05 22:22:25 +02:00
Adam Tauber	94b5f2ca77	[fix] result url wrap - closes #652	2016-09-05 21:57:49 +02:00
Adam Tauber	959497e26b	[fix] remove trailing whitespaces	2016-09-05 21:56:19 +02:00
Pydo	41ce76e9c9	Merge branch 'master' of https://github.com/asciimoo/searx into feature/seedpeer-engine-integration	2016-09-05 14:56:53 -04:00
Pydo	2c2123b2e8	Added seepeer to config and added seepeer search parser	2016-09-05 14:51:02 -04:00
Adam Tauber	465d47283f	[fix] 404 page localization #2	2016-09-04 19:07:07 +02:00
Adam Tauber	c2f4d4449d	[fix] 404 page localization	2016-09-04 18:38:25 +02:00
Adam Tauber	b4b0231617	[fix] links in new tabs without js ++ noopener bug fix - closes #674	2016-09-04 15:57:43 +02:00
Adam Tauber	7591c8bfe3	Merge pull request #672 from kvch/self-info-paging Self information on later pages	2016-08-27 22:10:33 +02:00
Adam Tauber	3043c404e4	Merge pull request #671 from kvch/custom-404 Custom 404 message - fixes #317	2016-08-27 22:08:58 +02:00
Noemi Vanyi	aa227180e2	remove self info answers from pages after first one	2016-08-27 16:45:25 +02:00
Noemi Vanyi	0056c4035e	add custom 404 page	2016-08-24 19:53:09 +02:00
Adam Tauber	b72aec0a9b	[fix] remove btdigg - see https://torrentfreak.com/btdigg-shut-down-due-to-torrent-spam-for-now-160711/	2016-08-16 13:52:55 +02:00
Adam Tauber	32604be790	[fix] piratebay engine - using pirateproxy.red - see https://proxybay.tv/	2016-08-16 10:44:00 +02:00
Adam Tauber	f693a54ad7	Merge pull request #664 from kvch/uncapitalize-searx uncapitalize searx in templates	2016-08-16 10:38:13 +02:00
Adam Tauber	13bed1f872	Merge pull request #639 from kvch/digbt-engine add digbt engine - fixes #638	2016-08-16 10:37:17 +02:00
Noémi Ványi	4bd44cd98f	uncapitalize searx in templates	2016-08-15 17:12:43 +02:00
David A Roberts	45120bc711	Add Hoogle search engine	2016-08-14 22:10:25 +10:00
David A Roberts	1e9dab08e6	[fix] behaviour for page_size>1 and first_page_num>0 eg. pageno=1,21,41,... instead of 20,40,60,...	2016-08-14 22:10:25 +10:00
David A Roberts	413e143707	[fix] don't merge results with distinct fragments	2016-08-14 22:09:29 +10:00
David A Roberts	ee320d4e5b	Online Etymology Dictionary	2016-08-14 19:25:29 +10:00
Noémi Ványi	d320dd0efc	diable digbt engine in settings.yml	2016-08-14 01:05:21 +02:00
Noemi Vanyi	3a1c5876b1	add digbt engine Unfortunately, it is quite slow so it is disabled. Furthermore, the display of number of files is wrong on digbt.org, so it is not displayed on searx.	2016-08-13 16:19:00 +02:00
Adam Tauber	104cdb7d03	[fix] remove unused imports ++ int token timestamp by default	2016-08-13 01:13:41 +02:00
Adam Tauber	eb57481450	[fix] google images paging - closes #571	2016-08-13 01:13:41 +02:00
David A Roberts	61fe5daf30	Add Microsoft Academic search engine	2016-08-12 20:19:10 +10:00
Adam Tauber	31866d9f33	Merge pull request #629 from stepshal/E305 Add missing blank lines after class or function definition.	2016-08-11 13:33:59 +02:00
stepshal	7e16c9d360	Add missing blank lines after class or function definition.	2016-08-11 17:18:12 +07:00
Adam Tauber	827aba4599	Merge pull request #658 from davidar/scroll [enh] infinite scroll	2016-08-11 11:38:43 +02:00
David A Roberts	678b9e994a	[enh] infinite scroll resolves #649	2016-08-11 19:16:42 +10:00
Adam Tauber	4fae62cd88	Merge pull request #656 from cy8aer/openrepos openrepos: Meego/Sailfish application repository	2016-08-11 11:04:55 +02:00
Adam Tauber	975bd5beb5	[fix] oscar grunt css build	2016-08-10 14:50:36 +02:00
David A Roberts	4ffe18b4bb	[fix] delete trailing quote	2016-08-10 21:33:05 +10:00
David A Roberts	117d36b66e	Add Crossref search engine and DOAI rewrite plugin	2016-08-10 11:15:30 +10:00
Noémi Ványi	e7f93f4f12	set type of cursor to pointer in advanced search	2016-08-09 15:51:34 +02:00
Thomas Renard	9c18abfe5a	openrepos: Meego/Sailfish application repository	2016-08-09 12:01:18 +02:00
Adam Tauber	f1262ffa9e	Merge pull request #588 from a01200356/wikidata [enh] More data from Wikidata	2016-08-09 10:14:32 +02:00
Noemi Vanyi	c59ef83353	redesign toggle button of engines && plugins	2016-08-07 23:25:27 +02:00
marc	ad58b14be7	[fix] merge infoboxes based on weight also minor changes in attributes and images from wikidata	2016-08-05 23:51:04 -05:00
marc	c2e4014287	[fix] urls merge in infobox (#593 ) TODO: merge attributes	2016-08-05 23:51:04 -05:00
marc	a0a1284998	wikidata refactor and more attributes (see issue #560 )	2016-08-05 23:51:04 -05:00
marc	a4c77f88d0	[fix] exception if locale doesn't have a date format occitan, for example	2016-08-05 23:51:04 -05:00
a01200356	93ef11adc0	[enh] multilingual wikidata disambiguation and tags are in local language TOFIX: needs to query the api every time to know each label's name	2016-08-05 23:51:04 -05:00
Adam Tauber	c553523f5b	Merge pull request #645 from dalf/remove_kickass [mod] remove the kickass engine from settings.yml	2016-08-01 22:09:33 +02:00
Adam Tauber	ffbee4bb82	[fix] collect garbage after searches to reduce memory footprint	2016-07-31 23:39:58 +02:00
Adam Tauber	bf92aa3fdd	[fix] wrap categories on small screens ++ some code formatting - closes #647	2016-07-27 02:08:24 +02:00
Adam Tauber	350a84520d	[fix] time range detection	2016-07-26 00:28:48 +02:00
Adam Tauber	3a8d193d1f	[mod] disable ddg by default - it just proxies yahoo/bing results: https://duck.co/help/company/yahoo-partnership	2016-07-26 00:08:42 +02:00
Adam Tauber	7d9c898170	Merge pull request #634 from kvch/advanced-search support time range search	2016-07-26 00:06:16 +02:00
Noemi Vanyi	90e74fbb28	search on filter select	2016-07-25 23:40:31 +02:00
Adam Tauber	54d987636e	[fix] do not load engines which cannot be initialized - closes #585	2016-07-25 23:36:52 +02:00
Noemi Vanyi	16a8641649	advanced-search: panel is visible when checked before	2016-07-25 23:30:48 +02:00
Noemi Vanyi	128b5245ab	time range selection as dropdown	2016-07-25 23:30:48 +02:00
Noemi Vanyi	e046c0d7ae	add time range strings to be translated	2016-07-25 23:28:14 +02:00
Noemi Vanyi	cddc9d3792	add 'Advanced settings' to strings to be translated	2016-07-25 23:28:14 +02:00
Noemi Vanyi	a7c8d5882c	fix pep8	2016-07-25 23:28:14 +02:00
Noemi Vanyi	e7baf24ec1	add time range search for deviantart	2016-07-25 23:28:14 +02:00
Noemi Vanyi	e9a78f1434	add time range search for google images	2016-07-25 23:28:14 +02:00
Noemi Vanyi	f13b9fa36a	add time range search for duckduckgo	2016-07-25 23:28:14 +02:00
Noemi Vanyi	2e5839503f	add time range search for google	2016-07-25 23:28:14 +02:00
Noemi Vanyi	713d30400b	add advanced settings to pointhi style	2016-07-25 23:28:14 +02:00
Noemi Vanyi	074521fd8a	follow up changes in search_category_on_select	2016-07-25 23:26:26 +02:00
Noemi Vanyi	2e8ab34d76	add advanced settings for logicodev style	2016-07-25 23:26:26 +02:00
Noemi Vanyi	93c0c49e9a	add time range search with yahoo	2016-07-25 23:19:46 +02:00
Adam Tauber	3a9c3fbd68	Merge pull request #644 from dalf/logicodev_fix [fix] close #637 : the search box doesn't overlap the menu.	2016-07-25 18:50:47 +02:00
Harry Wood	cd072676e9	moving a comma	2016-07-25 16:16:16 +01:00
Alexandre Flament	bd4d904002	[mod] remove the kickass engine from settings.yml	2016-07-25 16:00:05 +02:00
Alexandre Flament	e655e44133	[fix] close #637 : the search box doesn't overlap the menu.	2016-07-25 15:45:58 +02:00
Alexandre Flament	34835b77e2	[fix] Close #640 : remove MapQuest maps. Add in comment maps.wikimedia.org maps, see https://www.mediawiki.org/wiki/Maps	2016-07-25 15:28:25 +02:00
Noemi Vanyi	ba590de7f1	[fix] deviantart engine xpaths	2016-07-19 09:37:02 +02:00
Adam Tauber	aa09f963eb	Merge pull request #621 from stepshal/anomalous-backslash-in-string Fix anomalous backslash in string	2016-07-18 22:27:17 +02:00
Adam Tauber	21c5fb1c45	[fix] pep8	2016-07-17 00:03:22 +02:00
Adam Tauber	a7260ac497	[fix] do not replace image href urls - closes #594 These lines were added to fix a js image load issue (#535) what i cannot reproduce. Hopefully we don't see it again	2016-07-16 23:37:02 +02:00
Adam Tauber	5b5478bbd9	[fix] compute the order of results only once per search	2016-07-16 21:44:28 +02:00
Adam Tauber	485da54961	[mod][fix] use the average of results number ++ do not display smaller result number than the actual result count - closes #600	2016-07-16 21:44:17 +02:00
David A Roberts	144b7be70d	Add Google Scholar search engine	2016-07-16 11:52:27 +10:00
Adam Tauber	f7a3e9771d	Merge pull request #615 from mmuman/scanr Add ScanR structures search engine	2016-07-15 13:02:29 +02:00
marc	aac4ed6971	[fix] guess country code if not specified in duckduckgo engine	2016-07-14 16:36:52 -05:00
a01200356	8fc4b8156a	[fix] multilingual duckduckgo only works if both country and language are set	2016-07-12 23:44:39 -05:00
François Revol	1dba6dcbac	Add ScanR structures search engine In theory ScanR should also search for projects but the API is different, so we'd need another engine.	2016-07-12 15:47:04 +02:00
stepshal	b3ab221b98	Fix anomalous backslash in string	2016-07-11 23:53:13 +07:00
stepshal	cd9b494cb5	Fix quantity of blank lines after code object.	2016-07-10 21:44:27 +07:00
François Revol	b538de568a	Add INA search engine	2016-07-09 22:09:54 +02:00
Adam Tauber	fbbb307f2e	[enh] add engine shortcut to config api	2016-07-07 09:27:34 +02:00
Adam Tauber	9f64fd6745	[enh] update useragent versions	2016-07-04 23:12:44 +02:00
Adam Tauber	257e52954a	[enh][fix] update to latest dependencies ++ fix tests & travis test runner WARNING: dependency changes	2016-07-04 22:46:43 +02:00
Noemi Vanyi	c428f2d980	[fix] remove unecessary capitalize of name of instance	2016-07-02 16:48:58 +02:00
Adam Tauber	5924abd483	[fix] mobile navbar errors - closes #596	2016-06-28 21:17:33 +02:00
Adam Tauber	8ee32d5372	[fix] hide number of results if 0	2016-06-28 00:21:18 +02:00
Adam Tauber	2f7752b410	[enh] display number of results	2016-06-28 00:06:50 +02:00
Adam Tauber	36c8977390	[fix] rtl result template	2016-06-27 23:52:24 +02:00
Adam Tauber	1ee2a3d25d	[mod] more compact logicodev skin	2016-06-26 14:34:08 +02:00
Adam Tauber	0c9c063141	[fix] result url block selection	2016-06-26 14:13:03 +02:00

... 26 27 28 29 30 ...

4139 Commits