zaclys/searxng
1
0
Fork 1
mirror of https://github.com/searxng/searxng synced 2024-01-01 18:24:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,812 Commits 5 Branches 17 Tags 71 MiB
4a28b593c2
Commit Graph

5812 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Markus Heiser
4a28b593c2 [fix] google images engine: Fix 'scrap_img_by_id' function 
The 'scrap_img_by_id' function didn't return any longer anything useful.  This
fix allows the google images engine to present the full source image instead of
only the thumbnail.

The function scrap_img_by_id() is rpelaced by a fully rewrite to parse image
URLs by a regular expression. The new function parse_urls_img_from_js(dom)
returns a mapping of data-id to image URL.

Closes: https://github.com/searxng/searxng/issues/909
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-19 14:33:56 +01:00
Markus Heiser
e9a227c606
Merge pull request #893 from return42/mvw-video 
[mod] mediathekviewweb engine: add data_src and use videos template
 2022-02-19 00:55:46 +01:00
Markus Heiser
943a7fdcb5 [mod] mediathekviewweb engine: add iframe_src and use videos template 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-19 00:50:54 +01:00
Alexandre Flament
29182eb1c9
Merge pull request #899 from dalf/limiter_update 
[limiter] update
 2022-02-18 22:17:26 +01:00
Alexandre Flament
bf2a2ed48f
Merge pull request #882 from return42/fix-873 
[fix] replace embedded HTML by data_src
 2022-02-18 20:55:40 +01:00
Markus Heiser
c81b46150e
Merge pull request #903 from searxng/dependabot/pip/master/nose2-coverage_plugin--0.11.0 
Bump nose2[coverage_plugin] from 0.10.0 to 0.11.0
 2022-02-18 20:28:16 +01:00
Markus Heiser
949df1f63e
Merge pull request #904 from searxng/dependabot/pip/master/typing-extensions-4.1.1 
Bump typing-extensions from 4.0.1 to 4.1.1
 2022-02-18 19:52:59 +01:00
Markus Heiser
761885682d [build] /static 2022-02-18 19:00:51 +01:00
Markus Heiser
8acf540f0e [mod] simple theme: set height of embedded content (iframe) 
This commit sets appropriate height of the (embedded) player from:

- soundcloud
- mixcloud
- deezer

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-18 19:00:51 +01:00
Markus Heiser
7352c6bc79 [mod] templates: rename field for <iframe> URL to iframe_src 
Rename result field data_src to iframe_src

Suggested-by: @dalf https://github.com/searxng/searxng/pull/882#issuecomment-1037997402
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-18 19:00:49 +01:00
Markus Heiser
f5e8cfade2 [fix] simple theme: support browsers which do not have aspect-ratio 
Suggested-by: @dalf https://github.com/searxng/searxng/pull/882#discussion_r805187303
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-18 19:00:02 +01:00
Markus Heiser
50ee7bcac6 [oscar] add scrolling="no" to iframes in HTML templates 
Suggested-by: @dalf https://github.com/searxng/searxng/pull/882#discussion_r805180787
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-18 19:00:02 +01:00
Markus Heiser
795e8af61d [fix] hostname_replace.py: don't stop replace URL in fields 
This is a rewrite of the hostname_replace.py that:

- don't stop to replace URL in fields ('data_src', 'audio_src') if there isn't a
  'parsed_url',
- adds a comment about keep or remove a result from the result list
- adds a loop over ['data_src', 'audio_src'] instead of doubling code lines

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-18 18:59:58 +01:00
Alexandre Flament
12b5f9e561
Merge pull request #905 from searxng/dependabot/pip/master/flask-2.0.3 
Bump flask from 2.0.2 to 2.0.3
 2022-02-18 11:54:42 +01:00
Alexandre Flament
4a669247ed
Merge pull request #902 from searxng/dependabot/pip/master/lxml-4.8.0 
Bump lxml from 4.7.1 to 4.8.0
 2022-02-18 11:54:29 +01:00
Alexandre Flament
bcd71e0998
Merge pull request #901 from searxng/dependabot/pip/master/redis-4.1.4 
Bump redis from 4.1.3 to 4.1.4
 2022-02-18 08:37:40 +01:00
Alexandre Flament
eb25f06d8b
Merge pull request #907 from searxng/translations_update 
Update translations
 2022-02-18 08:36:14 +01:00
searxng-bot
1084f5f42c [translations] update from Weblate 
8daeaf72 - 2022-02-16 - mezysinc <mezysinc@mailsac.com>
f373b0a4 - 2022-02-13 - temp <temp@mykolab.com>
273ae271 - 2022-02-16 - Márton Farkas <farkasmrton@gmail.com>
956496a3 - 2022-02-12 - Alexandre Flament <alex@al-f.net>
acf6d3ae - 2022-02-15 - Markus Heiser <markus.heiser@darmarit.de>
aec5670e - 2022-02-11 - Markus Heiser <markus.heiser@darmarit.de>
 2022-02-18 07:17:24 +00:00
dependabot[bot]
ec55eea435
Bump flask from 2.0.2 to 2.0.3 
Bumps [flask](https://github.com/pallets/flask) from 2.0.2 to 2.0.3.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/2.0.2...2.0.3)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-18 07:07:35 +00:00
dependabot[bot]
ca2e878f34
Bump typing-extensions from 4.0.1 to 4.1.1 
Bumps [typing-extensions](https://github.com/python/typing) from 4.0.1 to 4.1.1.
- [Release notes](https://github.com/python/typing/releases)
- [Changelog](https://github.com/python/typing/blob/master/typing_extensions/CHANGELOG)
- [Commits](https://github.com/python/typing/compare/4.0.1...4.1.1)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-18 07:07:29 +00:00
dependabot[bot]
b75c99bb41
Bump nose2[coverage_plugin] from 0.10.0 to 0.11.0 
Bumps [nose2[coverage_plugin]](https://github.com/nose-devs/nose2) from 0.10.0 to 0.11.0.
- [Release notes](https://github.com/nose-devs/nose2/releases)
- [Changelog](https://github.com/nose-devs/nose2/blob/main/docs/changelog.rst)
- [Commits](https://github.com/nose-devs/nose2/compare/0.10.0...0.11.0)

---
updated-dependencies:
- dependency-name: nose2[coverage_plugin]
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-18 07:07:24 +00:00
dependabot[bot]
72b0b84743
Bump lxml from 4.7.1 to 4.8.0 
Bumps [lxml](https://github.com/lxml/lxml) from 4.7.1 to 4.8.0.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.7.1...lxml-4.8.0)

---
updated-dependencies:
- dependency-name: lxml
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-18 07:07:18 +00:00
dependabot[bot]
5fa56f442e
Bump redis from 4.1.3 to 4.1.4 
Bumps [redis](https://github.com/redis/redis-py) from 4.1.3 to 4.1.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.1.3...v4.1.4)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-18 07:07:09 +00:00
Alexandre Flament
d1b7debac6 [limiter] update 2022-02-17 20:27:02 +01:00
Alexandre Flament
288e3086d2
Merge pull request #896 from return42/fi-peertube 
[fix] replace peer.tube by peertube.biz
 2022-02-15 13:04:07 +01:00
Markus Heiser
ae8b174e93 [fix] replace peer.tube by peertube.biz 
More peertube instances are listed at [1]

[1] https://instances.joinpeertube.org/instances

Closes: https://github.com/searxng/searxng/issues/881
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-13 22:48:09 +01:00
Markus Heiser
98cab4cf75 [mod] result_templates/default.html replace embedded HTML by data_src audio_src 
Embedded HTML breaks SearXNG architecture.  To modularize, HTML is generated in
the templates (oscar & simple) and result parameter 'embedded' is replaced by
'data_src' (and 'audio_src'), an URL for embedded content (<iframe>).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-13 14:20:47 +01:00
Markus Heiser
b9a2e8b387 [mod] hostname_replace: replace hostnames in result's data_src param 
To test you need to redirect embeded videos (e.g.) from youtube to a invidios
instance.  Search for videos using engine `!youtube lebowski`.  The result URLs
and the embeded videos should link to the invidios instance.

Here is an example of such a `hostname_replace` configuration::

    hostname_replace:

      # youtube --> Invidious

      '(.*\.)?youtube-nocookie\.com': 'invidio.xamh.de'
      '(.*\.)?youtube\.com$': 'invidio.xamh.de'
      '(.*\.)?invidious\.snopyta\.org$': 'invidio.xamh.de'
      '(.*\.)?vid\.puffyan\.us': 'invidio.xamh.de'
      '(.*\.)?invidious\.kavin\.rocks$': 'invidio.xamh.de'
      '(.*\.)?inv\.riverside\.rocks$': 'invidio.xamh.de'

Closes: https://github.com/searxng/searxng/issues/873
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-13 14:20:47 +01:00
Markus Heiser
46e131fdad [mod] result_templates/videos.html: replace embedded HTML by data_src 
Embedded HTML breaks SearXNG architecture.  To modularize, HTML is generated in
the templates (oscar & simple) and result parameter 'embedded' is replaced by
'data_src', an URL for embedded content (<iframe>).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-13 14:20:47 +01:00
Alexandre Flament
a4942213a1
Merge pull request #892 from dalf/limiter-update 
plugin limiter: check only /image_proxy and /search
 2022-02-12 18:17:05 +01:00
Alexandre Flament
b99ccd7c02 plugin limiter: check only /image_proxy and /search 
also adjust the number of req/time
 2022-02-12 15:57:07 +01:00
Markus Heiser
9cd9dfd26e
Merge pull request #887 from unixfox/patch-5 
Update the XPath for fetching the Google results
 2022-02-12 15:11:27 +01:00
Alexandre Flament
8aba858057
Merge pull request #877 from return42/fix-876 
[fix] docker generated new settings.yml does not work
 2022-02-11 22:44:22 +01:00
Alexandre Flament
782c81ec17
Merge pull request #884 from return42/disable-deezer 
[mod] disable deezer engine by default
 2022-02-11 22:39:18 +01:00
Alexandre Flament
9e4ef7a6ce
Merge pull request #889 from searxng/dependabot/pip/master/mistletoe-0.8.2 
Bump mistletoe from 0.8.1 to 0.8.2
 2022-02-11 22:38:49 +01:00
dependabot[bot]
4ad818ccf5
Bump mistletoe from 0.8.1 to 0.8.2 
Bumps [mistletoe](https://github.com/miyuchina/mistletoe) from 0.8.1 to 0.8.2.
- [Release notes](https://github.com/miyuchina/mistletoe/releases)
- [Changelog](https://github.com/miyuchina/mistletoe/blob/master/cutting-a-release.md)
- [Commits](https://github.com/miyuchina/mistletoe/compare/v0.8.1...v0.8.2)

---
updated-dependencies:
- dependency-name: mistletoe
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-11 21:28:31 +00:00
Alexandre Flament
ab94e49385
Merge pull request #890 from searxng/dependabot/pip/master/redis-4.1.3 
Bump redis from 4.1.2 to 4.1.3
 2022-02-11 22:27:10 +01:00
Markus Heiser
0a89c526d2
Merge pull request #891 from searxng/translations_update 
Update translations
 2022-02-11 08:34:11 +01:00
searxng-bot
eee41a2857 [translations] update from Weblate 
085368cc - 2022-02-08 - akynr <ak.red@web.de>
9b531712 - 2022-02-09 - Justas Zabulionis <justas.zabulionis@gmail.com>
6e13d297 - 2022-02-06 - Markus Heiser <markus.heiser@darmarit.de>
b1ac1da2 - 2022-02-06 - Markus Heiser <markus.heiser@darmarit.de>
de117bfe - 2022-02-10 - Tamas Veres <zsumba1985@gmail.com>
7392a5b0 - 2022-02-10 - Markus Heiser <markus.heiser@darmarit.de>
a28a60d9 - 2022-02-07 - Markus Heiser <markus.heiser@darmarit.de>
 2022-02-11 07:16:09 +00:00
dependabot[bot]
072f64282d
Bump redis from 4.1.2 to 4.1.3 
Bumps [redis](https://github.com/redis/redis-py) from 4.1.2 to 4.1.3.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.1.2...v4.1.3)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-11 07:10:07 +00:00
Émilien Devos
7d3e8118b0
Update the XPath for fetching the Google results 2022-02-09 14:34:14 +01:00
Markus Heiser
f2e16904a5 [mod] disable deezer engine by default 
To play content from deezer a account is needed, the majority of the SearXNG
won't have.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-07 22:58:05 +01:00
Markus Heiser
5cb6301fbc
Merge pull request #880 from return42/fix-osm 
[fix] openstreatmap: load thumbnail from uploads.wikimedia.org
 2022-02-07 15:05:40 +01:00
Markus Heiser
906a0a99cd [fix] openstreatmap: load thumbnail from uploads.wikimedia.org 
Openstreatmap images are now loaded from uploads.wikimedia.org instead of
commons.wikimedia.org to prevent redirects.

With `image_proxy` enabled images from commons.wikimedia.org cant be loaded
since they are redirected.  We already discussed this issue [875] and
@tiekoetter fixed this issue in PR [878].

Related-to:
- [875] https://github.com/searxng/searxng/issues/875
- [878] https://github.com/searxng/searxng/pull/878
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-07 13:05:52 +01:00
Markus Heiser
ae8e3f3543
Merge pull request #878 from tiekoetter/fix-wikidata 
Fix wikidata info box images
 2022-02-07 10:43:36 +01:00
Markus Heiser
a967e59590 [pylint] searx/engines/wikidata.py (no functional change) 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-07 10:15:32 +01:00
Léon Tiekötter
1c151ae92b
[fix] wikidata: URL decoding and file extension handling 
Add '.png' to the second img_src_name if it has the extension '.svg'.
Use urllib.parse.unquote for URL decoding.
 2022-02-07 00:21:02 +01:00
Markus Heiser
a13c5d70c7 [fix] wikidata engine: select image with higher (not lower) priority 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-06 23:35:55 +01:00
Léon Tiekötter
a50f32bcfc
wikidata: load thumbnail instead of full image 2022-02-06 23:25:50 +01:00
Léon Tiekötter
560a14e77b
[fix] wikidata info box images 
Wikidata info box images are now loaded from uploads.wikimedia.org instead of commons.wikimedia.org to prevent redirects

Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-02-06 22:16:06 +01:00