searxngRebrandZaclys/searx/templates/simple
Markus Heiser 80aaef6c95
Merge pull request #2357 / limiter -> botdetection
The monolithic implementation of the limiter was divided into methods and
implemented in the Python package searx.botdetection.  Detailed documentation on
the methods has been added.

The methods are divided into two groups:

1. Probe HTTP headers

- Method http_accept
- Method http_accept_encoding
- Method http_accept_language
- Method http_connection
- Method http_user_agent

2. Rate limit:

- Method ip_limit
- Method link_token (new)

The (reduced) implementation of the limiter is now in the module
searx.botdetection.limiter.  The first group was transferred unchanged to this
module.  The ip_limit contains the sliding windows implemented by the limiter so
far.

This merge also fixes some long outstandig issue:

- limiter does not evaluate the Accept-Language correct [1]
- limiter needs a IPv6 prefix to block networks instead of IPs [2]

Without additional configuration the limiter works as before (apart from the
bugfixes).  For the commissioning of additional methods (link_toke), a
configuration must be made in an additional configuration file.  Without this
configuration, the limiter runs as before (zero configuration).

The ip_limit Method implements the sliding windows of the vanilla limiter,
additionally the link_token method can be used in this method.  The link_token
method can be used to investigate whether a request is suspicious. To activate
the link_token method in the ip_limit method add the following to your
/etc/searxng/limiter.toml::

    [botdetection.ip_limit]
    link_token = true


[1] https://github.com/searxng/searxng/issues/2455
[2] https://github.com/searxng/searxng/issues/2477
2023-06-03 06:00:15 +02:00
..
elements [fix] simple theme: move engine alerts in case of no results into sidebar 2023-05-28 12:19:32 +02:00
filters [mod] replace searx.languages by searx.sxng_locales 2023-03-24 10:37:42 +01:00
messages [fix] simple theme: move engine alerts in case of no results into sidebar 2023-05-28 12:19:32 +02:00
preferences [fix] URL percent-encoding in translations fail in babel 2023-06-02 20:30:41 +02:00
result_templates [mod] paper.html: simplify template by using result_link macro 2022-09-24 16:13:36 +02:00
404.html Drop Python 2 (2/n): templates 2020-09-10 10:39:04 +02:00
base.html [mod] limiter -> botdetection: modularization and documentation 2023-05-29 14:54:56 +02:00
categories.html [fix] don't show a category if there is no active engine in 2023-04-10 09:22:21 +02:00
icons.html [build] /static 2022-07-02 10:05:43 +02:00
index.html Workaround: index.html: remove image preload 2022-06-18 09:04:13 +02:00
info.html Theme: add Help and Donate links in all pages 2022-06-25 20:31:40 +02:00
macros.html [mod] template preferences: split into elements (no functional change) 2023-06-02 19:05:43 +02:00
new_issue.html [mod] allow brand.issue_url to overwrite the step1 url 2022-07-10 18:43:53 +02:00
opensearch_response_rss.xml theme: remove __common__ 2022-05-07 19:40:48 +02:00
opensearch.xml [fix] improve OpenSearch description 2022-08-11 19:04:36 +02:00
page_with_header.html [mod] template preferences: split into elements (no functional change) 2023-06-02 19:05:43 +02:00
preferences.html [mod] template preferences: split into elements (no functional change) 2023-06-02 19:05:43 +02:00
results.html [fix] simple theme: move engine alerts in case of no results into sidebar 2023-05-28 12:19:32 +02:00
search.html [simple theme] set tab index for search page input field #1891 2023-01-08 13:41:48 +03:00
searxng-wordmark.min.svg theme: remove __common__ 2022-05-07 19:40:48 +02:00
simple_search.html Merge pull request #1004 from MontyQI/search_url 2022-03-26 17:08:50 +01:00
stats.html Stats: display only the score per result, no anymore the score 2022-09-02 08:30:38 +00:00