Commit graph

6093 commits

Author SHA1 Message Date
Markus Heiser
86ba4ea189 [format.python] based on bugfix in 998ec900
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-23 09:50:24 +02:00
Markus Heiser
998ec900cc [fix] format.python: regexp argument '--include' in BLACK_TARGETS
--include TEXT

  A regular expression that matches files and directories that should be
  included on recursive searches. An empty value means all files are included
  regardless of the name.  ...  Exclusions are calculated first, inclusions
  later.  [default: \.pyi?$]

Closes: https://github.com/searxng/searxng/issues/1142
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-23 09:44:55 +02:00
Markus Heiser
a865130539
Merge pull request #1141 from return42/fix-git-v2.35.2
[fix] since git v2.35.2 root can't read from unsafe repository
2022-04-22 17:49:44 +02:00
Markus Heiser
463254e3b4 [fix] since git v2.35.2 root can't read from unsafe repository
Git v2.35.2 closes an security issue, it is no longer possible that root uses a
git repo that is owned by someone else, the error message is::

    fatal: unsafe repository ('/share/darmarit.org/cache/searxng' is owned by someone else)

The fix is to run the `git diff --name-only` not as root in a sudo command.

[1] https://github.blog/2022-04-12-git-security-vulnerability-announced/
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 17:37:04 +02:00
Markus Heiser
4341ceceb4
Merge pull request #1096 from capric98/yahoo
fix: FutureWarning from lxml
2022-04-22 16:19:18 +02:00
capric98
8c7e6cc983 [fix] FutureWarning from lxml
Just in case if content is None, the original code will skip extract_text(), and
just append the None value to 'content'. So just add allow_none=True, and this
will return None without raising a ValueError in extract_text().
2022-04-22 16:09:36 +02:00
Markus Heiser
6ff48859e3
Merge pull request #1139 from return42/missing-languages
[fix] add back missing languages & regions (followup of PR #1071)
2022-04-22 15:30:45 +02:00
Markus Heiser
837d5a1d33
Merge pull request #1140 from return42/limiter-doc
[docs] document the missing server:limiter setting
2022-04-22 12:58:09 +02:00
Markus Heiser
44dd5a9615 [docs] document the missing server:limiter setting
BTW: fix some minor typos in docs/admin/engines/settings.rst

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 12:48:12 +02:00
Markus Heiser
62982c8812 [fix] add back missing languages & regions (followup of PR #1071)
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.

As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].

This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.

[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)

Requested-by: @tiekoetter in a Matrix chat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 12:09:42 +02:00
Markus Heiser
4ea33bddcf
Merge pull request #1137 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-contrib-uglify-5.2.1
Bump grunt-contrib-uglify from 5.1.0 to 5.2.1 in /searx/static/themes/simple
2022-04-22 11:38:44 +02:00
dependabot[bot]
1974a85461
Bump grunt-contrib-uglify in /searx/static/themes/simple
Bumps [grunt-contrib-uglify](https://github.com/gruntjs/grunt-contrib-uglify) from 5.1.0 to 5.2.1.
- [Release notes](https://github.com/gruntjs/grunt-contrib-uglify/releases)
- [Changelog](https://github.com/gruntjs/grunt-contrib-uglify/blob/main/CHANGELOG)
- [Commits](https://github.com/gruntjs/grunt-contrib-uglify/compare/v5.1.0...v5.2.1)

---
updated-dependencies:
- dependency-name: grunt-contrib-uglify
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 09:28:01 +00:00
Markus Heiser
50bac93363
Merge pull request #1094 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-1.5.2
Bump grunt from 1.4.1 to 1.5.2 in /searx/static/themes/simple
2022-04-22 11:25:12 +02:00
Markus Heiser
52e662baec
Merge pull request #1133 from searxng/dependabot/pip/master/typing-extensions-4.2.0
Bump typing-extensions from 4.1.1 to 4.2.0
2022-04-22 11:22:29 +02:00
Markus Heiser
cf644b413e [test.pyright] suppress unneeded error & warning messages
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 11:16:41 +02:00
Markus Heiser
0e648bd2da
Merge pull request #1135 from searxng/dependabot/pip/master/myst-parser-0.17.2
Bump myst-parser from 0.17.0 to 0.17.2
2022-04-22 11:07:57 +02:00
Markus Heiser
f01c757393
Merge pull request #1134 from searxng/dependabot/pip/master/babel-2.10.1
Bump babel from 2.9.1 to 2.10.1
2022-04-22 11:01:13 +02:00
dependabot[bot]
5a156a0bef
Bump typing-extensions from 4.1.1 to 4.2.0
Bumps [typing-extensions](https://github.com/python/typing) from 4.1.1 to 4.2.0.
- [Release notes](https://github.com/python/typing/releases)
- [Changelog](https://github.com/python/typing/blob/master/typing_extensions/CHANGELOG.md)
- [Commits](https://github.com/python/typing/compare/4.1.1...4.2.0)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 08:52:46 +00:00
Markus Heiser
f2c33550e5
Merge pull request #1132 from searxng/dependabot/pip/master/markdown-it-py-2.1.0
Bump markdown-it-py from 2.0.1 to 2.1.0
2022-04-22 10:51:57 +02:00
Markus Heiser
bb81cc5230
Merge pull request #1131 from searxng/dependabot/pip/master/pylint-2.13.7
Bump pylint from 2.13.5 to 2.13.7
2022-04-22 10:46:33 +02:00
Markus Heiser
70938e4f45
Merge pull request #1138 from searxng/translations_update
Update translations
2022-04-22 10:45:20 +02:00
searxng-bot
9fd5d3b2ac [translations] update from Weblate
9398019a - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
2768987d - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
dc9e7f98 - 2022-04-21 - Markus Heiser <markus.heiser@darmarit.de>
b223bd62 - 2022-04-17 - Egor Ermakov <eg.ermakov2016@gmail.com>
715e7dac - 2022-04-18 - Mihai <miihairadu@gmail.com>
5c53a0ec - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
5906fd34 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
691702ed - 2022-04-19 - Markus Heiser <markus.heiser@darmarit.de>
cc8bb018 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
ebfab76a - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
a8ce22fa - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
e9b6e3c6 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
6266ea2e - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
1729fbd8 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
0d0f5293 - 2022-04-18 - Mihai <miihairadu@gmail.com>
1b022583 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
f2a71d93 - 2022-04-18 - A. B <gamemc@virgilio.it>
30206782 - 2022-04-15 - Mico Hautaluoma <m@mha.fi>
10f54679 - 2022-04-17 - smallaxe80 <smallaxe1980@gmail.com>
2022-04-22 07:18:46 +00:00
dependabot[bot]
28f2e98917
Bump myst-parser from 0.17.0 to 0.17.2
Bumps [myst-parser](https://github.com/executablebooks/MyST-Parser) from 0.17.0 to 0.17.2.
- [Release notes](https://github.com/executablebooks/MyST-Parser/releases)
- [Changelog](https://github.com/executablebooks/MyST-Parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/MyST-Parser/compare/v0.17.0...v0.17.2)

---
updated-dependencies:
- dependency-name: myst-parser
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:05:09 +00:00
dependabot[bot]
19f17e7123
Bump babel from 2.9.1 to 2.10.1
Bumps [babel](https://github.com/python-babel/babel) from 2.9.1 to 2.10.1.
- [Release notes](https://github.com/python-babel/babel/releases)
- [Changelog](https://github.com/python-babel/babel/blob/master/CHANGES.rst)
- [Commits](https://github.com/python-babel/babel/compare/v2.9.1...v2.10.1)

---
updated-dependencies:
- dependency-name: babel
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:05:04 +00:00
dependabot[bot]
91babe8a62
Bump markdown-it-py from 2.0.1 to 2.1.0
Bumps [markdown-it-py](https://github.com/executablebooks/markdown-it-py) from 2.0.1 to 2.1.0.
- [Release notes](https://github.com/executablebooks/markdown-it-py/releases)
- [Changelog](https://github.com/executablebooks/markdown-it-py/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/markdown-it-py/compare/v2.0.1...v2.1.0)

---
updated-dependencies:
- dependency-name: markdown-it-py
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:04:56 +00:00
dependabot[bot]
d6a4ceff83
Bump pylint from 2.13.5 to 2.13.7
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.13.5 to 2.13.7.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.13.5...v2.13.7)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:04:53 +00:00
Paul Braeuning
7f2185cec2
Merge pull request #1123 from return42/fix-1027
[fix] add missing result.length and result.author to the simple theme
2022-04-20 01:08:09 +02:00
Markus Heiser
4ab189315b [build] /static 2022-04-19 09:37:58 +02:00
Markus Heiser
2bcd610eeb [fix] add missing result.length and result.author to simple theme
Closes: https://github.com/searxng/searxng/issues/1027
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-19 09:37:41 +02:00
Alexandre Flament
e22dc2ba36
Merge pull request #1099 from dalf/update_engine_descriptions
Update engine descriptions
2022-04-17 11:37:36 +02:00
Alexandre Flament
bbf13a4657
Merge pull request #1101 from allendema/pass-cookies-from-settings
[enh] Allow passing headers/cookies from settings.yml
2022-04-17 11:37:07 +02:00
Allen
dae8a08089
[fix[ Update only cookies/headers 2022-04-17 11:29:23 +02:00
Alexandre Flament
52298d676d
Merge pull request #1102 from allendema/ebay-domains
[mod] Pass desired ebay domain in settings
2022-04-17 10:55:29 +02:00
Allen
67fb6fba84
[lint] Remove whitespace
From GH GUI
2022-04-17 10:42:25 +02:00
Allen
f039873e1a
[mod] Make a default domain for ebay
Which can be changed.
2022-04-17 10:37:12 +02:00
Allen
15862ebc35
[mod] Pass desired ebay domain in settings
https://www.ebay.de
https://www.ebay.com
htttps://www.ebay.es

etc
2022-04-16 19:10:35 +02:00
Allen
155333f625
[enh] Allow passing headers/cookies from settings.yml
Example:

   - engine: xpath
   - search_url: example.org
   - headers: {'example_header': 'example_header'}
   - cookies: {'safesearch': 'off'}
2022-04-16 17:42:04 +02:00
Alexandre Flament
7bf9e12db9 Update searx.data - update_engine_descriptions.py 2022-04-16 13:17:39 +02:00
Alexandre Flament
ec59a1580c GitHub monthly data update: add engine descriptions 2022-04-16 13:16:27 +02:00
Alexandre Flament
c474616642
Merge pull request #1071 from return42/fix-lang-dailymotion
[fix] dailymotion engine: filter by language & country
2022-04-16 11:54:49 +02:00
Alexandre Flament
4224607c62 searx.utils.html_to_text: replace <br/> by a space 2022-04-16 09:45:57 +02:00
Alexandre Flament
1a82e79b50 dailymotion: send valid value for the language parameter 2022-04-16 09:27:34 +02:00
Markus Heiser
3bb62823ec [fix] dailymotion engine: filter by language & country
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.

This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.

[1] https://developers.dailymotion.com/tools/

Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-16 09:27:34 +02:00
Alexandre Flament
ab9a4b7328
Merge pull request #1090 from vfosnar/master
[enh] add seznam autocomplete
2022-04-15 17:50:32 +02:00
Alexandre Flament
ab522b4388
Merge pull request #1092 from searxng/dependabot/pip/master/setproctitle-1.2.3
Bump setproctitle from 1.2.2 to 1.2.3
2022-04-15 17:24:16 +02:00
Vojtěch Fošnár
ccd8305465
Merge branch 'searxng:master' into master 2022-04-15 16:10:49 +02:00
Markus Heiser
7e7d6f7742
Merge pull request #1095 from searxng/translations_update
Update translations
2022-04-15 09:22:17 +02:00
searxng-bot
9109ad706d [translations] update from Weblate
10e2e02d - 2022-04-14 - Markus Heiser <markus.heiser@darmarit.de>
723fc2b4 - 2022-04-14 - Markus Heiser <markus.heiser@darmarit.de>
8c3ef0ce - 2022-04-12 - Linerly <linerly@protonmail.com>
19b08ebf - 2022-04-10 - A. B <gamemc@virgilio.it>
5838445a - 2022-04-10 - BriLHR <brianlimapp@gmail.com>
a9541b96 - 2022-04-10 - Markus Heiser <markus.heiser@darmarit.de>
8f9c7cee - 2022-04-10 - Michal Kuncl <michal.kuncl@gmail.com>
54ea2973 - 2022-04-11 - Taufik Hidayat <tfkhdyt@pm.me>
2022-04-15 07:18:31 +00:00
dependabot[bot]
e314cfe667
Bump grunt from 1.4.1 to 1.5.2 in /searx/static/themes/simple
Bumps [grunt](https://github.com/gruntjs/grunt) from 1.4.1 to 1.5.2.
- [Release notes](https://github.com/gruntjs/grunt/releases)
- [Changelog](https://github.com/gruntjs/grunt/blob/main/CHANGELOG)
- [Commits](https://github.com/gruntjs/grunt/compare/v1.4.1...v1.5.2)

---
updated-dependencies:
- dependency-name: grunt
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-15 07:11:47 +00:00
dependabot[bot]
3407f1a170
Bump setproctitle from 1.2.2 to 1.2.3
Bumps [setproctitle](https://github.com/dvarrazzo/py-setproctitle) from 1.2.2 to 1.2.3.
- [Release notes](https://github.com/dvarrazzo/py-setproctitle/releases)
- [Changelog](https://github.com/dvarrazzo/py-setproctitle/blob/master/HISTORY.rst)
- [Commits](https://github.com/dvarrazzo/py-setproctitle/compare/version-1.2.2...version-1.2.3)

---
updated-dependencies:
- dependency-name: setproctitle
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-15 07:06:06 +00:00