Commit Graph

6896 Commits

Author SHA1 Message Date
Léon Tiekötter 02026bcc76
[fix] library genesis engine: xpath and url
Changed the xpath to use the official download mirror.

Changed the URL to libgen.fun as this is the official instance. (https://en.wikipedia.org/wiki/Library_Genesis)
2022-04-27 13:11:34 +02:00
Alexandre Flament d502e7d403
Merge pull request #1144 from allendema/brave-pagination
[enh] Add pagination to Brave
2022-04-24 22:44:55 +02:00
Allen 624b58764a
[enh] Add pagination to Brave
Also added ```&spellcheck=1``` because now it is disabled by default, not returning any ```suggestion_xpath```.
2022-04-23 14:06:53 +02:00
Alexandre Flament ca1a5f9d27
Merge pull request #1013 from return42/test-pybabel
[mod] add test.pybabel to cover issues in translation tasks
2022-04-23 10:58:36 +02:00
Markus Heiser 50a4e30830 [mod] add test.pybabel to cover issues in translation tasks
We need to cover issue related to pybabel/translation tasks.  By example there
was an issue [1] (fixed [2]) when upgrading jinja2 from 3.0.3 to 3.1.0 [3] that
has not been covered by the CI tests.

[1] https://github.com/searxng/searxng/runs/5688624325?check_suite_focus=true#step:6:348
[2] https://github.com/searxng/searxng/pull/1011
[3] https://github.com/searxng/searxng/pull/1008

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-23 10:20:22 +02:00
Markus Heiser a865130539
Merge pull request #1141 from return42/fix-git-v2.35.2
[fix] since git v2.35.2 root can't read from unsafe repository
2022-04-22 17:49:44 +02:00
Markus Heiser 463254e3b4 [fix] since git v2.35.2 root can't read from unsafe repository
Git v2.35.2 closes an security issue, it is no longer possible that root uses a
git repo that is owned by someone else, the error message is::

    fatal: unsafe repository ('/share/darmarit.org/cache/searxng' is owned by someone else)

The fix is to run the `git diff --name-only` not as root in a sudo command.

[1] https://github.blog/2022-04-12-git-security-vulnerability-announced/
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 17:37:04 +02:00
Markus Heiser 4341ceceb4
Merge pull request #1096 from capric98/yahoo
fix: FutureWarning from lxml
2022-04-22 16:19:18 +02:00
capric98 8c7e6cc983 [fix] FutureWarning from lxml
Just in case if content is None, the original code will skip extract_text(), and
just append the None value to 'content'. So just add allow_none=True, and this
will return None without raising a ValueError in extract_text().
2022-04-22 16:09:36 +02:00
Markus Heiser 6ff48859e3
Merge pull request #1139 from return42/missing-languages
[fix] add back missing languages & regions (followup of PR #1071)
2022-04-22 15:30:45 +02:00
Markus Heiser 837d5a1d33
Merge pull request #1140 from return42/limiter-doc
[docs] document the missing server:limiter setting
2022-04-22 12:58:09 +02:00
Markus Heiser 44dd5a9615 [docs] document the missing server:limiter setting
BTW: fix some minor typos in docs/admin/engines/settings.rst

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 12:48:12 +02:00
Markus Heiser 62982c8812 [fix] add back missing languages & regions (followup of PR #1071)
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.

As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].

This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.

[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)

Requested-by: @tiekoetter in a Matrix chat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 12:09:42 +02:00
Markus Heiser 4ea33bddcf
Merge pull request #1137 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-contrib-uglify-5.2.1
Bump grunt-contrib-uglify from 5.1.0 to 5.2.1 in /searx/static/themes/simple
2022-04-22 11:38:44 +02:00
dependabot[bot] 1974a85461
Bump grunt-contrib-uglify in /searx/static/themes/simple
Bumps [grunt-contrib-uglify](https://github.com/gruntjs/grunt-contrib-uglify) from 5.1.0 to 5.2.1.
- [Release notes](https://github.com/gruntjs/grunt-contrib-uglify/releases)
- [Changelog](https://github.com/gruntjs/grunt-contrib-uglify/blob/main/CHANGELOG)
- [Commits](https://github.com/gruntjs/grunt-contrib-uglify/compare/v5.1.0...v5.2.1)

---
updated-dependencies:
- dependency-name: grunt-contrib-uglify
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 09:28:01 +00:00
Markus Heiser 50bac93363
Merge pull request #1094 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-1.5.2
Bump grunt from 1.4.1 to 1.5.2 in /searx/static/themes/simple
2022-04-22 11:25:12 +02:00
Markus Heiser 52e662baec
Merge pull request #1133 from searxng/dependabot/pip/master/typing-extensions-4.2.0
Bump typing-extensions from 4.1.1 to 4.2.0
2022-04-22 11:22:29 +02:00
Markus Heiser cf644b413e [test.pyright] suppress unneeded error & warning messages
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 11:16:41 +02:00
Markus Heiser 0e648bd2da
Merge pull request #1135 from searxng/dependabot/pip/master/myst-parser-0.17.2
Bump myst-parser from 0.17.0 to 0.17.2
2022-04-22 11:07:57 +02:00
Markus Heiser f01c757393
Merge pull request #1134 from searxng/dependabot/pip/master/babel-2.10.1
Bump babel from 2.9.1 to 2.10.1
2022-04-22 11:01:13 +02:00
dependabot[bot] 5a156a0bef
Bump typing-extensions from 4.1.1 to 4.2.0
Bumps [typing-extensions](https://github.com/python/typing) from 4.1.1 to 4.2.0.
- [Release notes](https://github.com/python/typing/releases)
- [Changelog](https://github.com/python/typing/blob/master/typing_extensions/CHANGELOG.md)
- [Commits](https://github.com/python/typing/compare/4.1.1...4.2.0)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 08:52:46 +00:00
Markus Heiser f2c33550e5
Merge pull request #1132 from searxng/dependabot/pip/master/markdown-it-py-2.1.0
Bump markdown-it-py from 2.0.1 to 2.1.0
2022-04-22 10:51:57 +02:00
Markus Heiser bb81cc5230
Merge pull request #1131 from searxng/dependabot/pip/master/pylint-2.13.7
Bump pylint from 2.13.5 to 2.13.7
2022-04-22 10:46:33 +02:00
Markus Heiser 70938e4f45
Merge pull request #1138 from searxng/translations_update
Update translations
2022-04-22 10:45:20 +02:00
searxng-bot 9fd5d3b2ac [translations] update from Weblate
9398019a - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
2768987d - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
dc9e7f98 - 2022-04-21 - Markus Heiser <markus.heiser@darmarit.de>
b223bd62 - 2022-04-17 - Egor Ermakov <eg.ermakov2016@gmail.com>
715e7dac - 2022-04-18 - Mihai <miihairadu@gmail.com>
5c53a0ec - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
5906fd34 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
691702ed - 2022-04-19 - Markus Heiser <markus.heiser@darmarit.de>
cc8bb018 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
ebfab76a - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
a8ce22fa - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
e9b6e3c6 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
6266ea2e - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
1729fbd8 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
0d0f5293 - 2022-04-18 - Mihai <miihairadu@gmail.com>
1b022583 - 2022-04-18 - Markus Heiser <markus.heiser@darmarit.de>
f2a71d93 - 2022-04-18 - A. B <gamemc@virgilio.it>
30206782 - 2022-04-15 - Mico Hautaluoma <m@mha.fi>
10f54679 - 2022-04-17 - smallaxe80 <smallaxe1980@gmail.com>
2022-04-22 07:18:46 +00:00
dependabot[bot] 28f2e98917
Bump myst-parser from 0.17.0 to 0.17.2
Bumps [myst-parser](https://github.com/executablebooks/MyST-Parser) from 0.17.0 to 0.17.2.
- [Release notes](https://github.com/executablebooks/MyST-Parser/releases)
- [Changelog](https://github.com/executablebooks/MyST-Parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/MyST-Parser/compare/v0.17.0...v0.17.2)

---
updated-dependencies:
- dependency-name: myst-parser
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:05:09 +00:00
dependabot[bot] 19f17e7123
Bump babel from 2.9.1 to 2.10.1
Bumps [babel](https://github.com/python-babel/babel) from 2.9.1 to 2.10.1.
- [Release notes](https://github.com/python-babel/babel/releases)
- [Changelog](https://github.com/python-babel/babel/blob/master/CHANGES.rst)
- [Commits](https://github.com/python-babel/babel/compare/v2.9.1...v2.10.1)

---
updated-dependencies:
- dependency-name: babel
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:05:04 +00:00
dependabot[bot] 91babe8a62
Bump markdown-it-py from 2.0.1 to 2.1.0
Bumps [markdown-it-py](https://github.com/executablebooks/markdown-it-py) from 2.0.1 to 2.1.0.
- [Release notes](https://github.com/executablebooks/markdown-it-py/releases)
- [Changelog](https://github.com/executablebooks/markdown-it-py/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/markdown-it-py/compare/v2.0.1...v2.1.0)

---
updated-dependencies:
- dependency-name: markdown-it-py
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:04:56 +00:00
dependabot[bot] d6a4ceff83
Bump pylint from 2.13.5 to 2.13.7
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.13.5 to 2.13.7.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.13.5...v2.13.7)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 07:04:53 +00:00
Paul Braeuning 7f2185cec2
Merge pull request #1123 from return42/fix-1027
[fix] add missing result.length and result.author to the simple theme
2022-04-20 01:08:09 +02:00
Markus Heiser 4ab189315b [build] /static 2022-04-19 09:37:58 +02:00
Markus Heiser 2bcd610eeb [fix] add missing result.length and result.author to simple theme
Closes: https://github.com/searxng/searxng/issues/1027
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-19 09:37:41 +02:00
Alexandre Flament e22dc2ba36
Merge pull request #1099 from dalf/update_engine_descriptions
Update engine descriptions
2022-04-17 11:37:36 +02:00
Alexandre Flament bbf13a4657
Merge pull request #1101 from allendema/pass-cookies-from-settings
[enh] Allow passing headers/cookies from settings.yml
2022-04-17 11:37:07 +02:00
Allen dae8a08089
[fix[ Update only cookies/headers 2022-04-17 11:29:23 +02:00
Alexandre Flament 52298d676d
Merge pull request #1102 from allendema/ebay-domains
[mod] Pass desired ebay domain in settings
2022-04-17 10:55:29 +02:00
Allen 67fb6fba84
[lint] Remove whitespace
From GH GUI
2022-04-17 10:42:25 +02:00
Allen f039873e1a
[mod] Make a default domain for ebay
Which can be changed.
2022-04-17 10:37:12 +02:00
Allen 15862ebc35
[mod] Pass desired ebay domain in settings
https://www.ebay.de
https://www.ebay.com
htttps://www.ebay.es

etc
2022-04-16 19:10:35 +02:00
Allen 155333f625
[enh] Allow passing headers/cookies from settings.yml
Example:

   - engine: xpath
   - search_url: example.org
   - headers: {'example_header': 'example_header'}
   - cookies: {'safesearch': 'off'}
2022-04-16 17:42:04 +02:00
Alexandre Flament 7bf9e12db9 Update searx.data - update_engine_descriptions.py 2022-04-16 13:17:39 +02:00
Alexandre Flament ec59a1580c GitHub monthly data update: add engine descriptions 2022-04-16 13:16:27 +02:00
Alexandre Flament c474616642
Merge pull request #1071 from return42/fix-lang-dailymotion
[fix] dailymotion engine: filter by language & country
2022-04-16 11:54:49 +02:00
Alexandre Flament 4224607c62 searx.utils.html_to_text: replace <br/> by a space 2022-04-16 09:45:57 +02:00
Alexandre Flament 1a82e79b50 dailymotion: send valid value for the language parameter 2022-04-16 09:27:34 +02:00
Markus Heiser 3bb62823ec [fix] dailymotion engine: filter by language & country
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.

This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.

[1] https://developers.dailymotion.com/tools/

Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-16 09:27:34 +02:00
Alexandre Flament ab9a4b7328
Merge pull request #1090 from vfosnar/master
[enh] add seznam autocomplete
2022-04-15 17:50:32 +02:00
Alexandre Flament ab522b4388
Merge pull request #1092 from searxng/dependabot/pip/master/setproctitle-1.2.3
Bump setproctitle from 1.2.2 to 1.2.3
2022-04-15 17:24:16 +02:00
Vojtěch Fošnár ccd8305465
Merge branch 'searxng:master' into master 2022-04-15 16:10:49 +02:00
Markus Heiser 7e7d6f7742
Merge pull request #1095 from searxng/translations_update
Update translations
2022-04-15 09:22:17 +02:00