forked from zaclys/searxng
6e5f22e558
Implementations of the *traits* of the engines.
Engine's traits are fetched from the origin engine and stored in a JSON file in
the *data folder*. Most often traits are languages and region codes and their
mapping from SearXNG's representation to the representation in the origin search
engine.
To load traits from the persistence::
searx.enginelib.traits.EngineTraitsMap.from_data()
For new traits new properties can be added to the class::
searx.enginelib.traits.EngineTraits
.. hint::
Implementation is downward compatible to the deprecated *supported_languages
method* from the vintage implementation.
The vintage code is tagged as *deprecated* an can be removed when all engines
has been ported to the *traits method*.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
68 lines
1.9 KiB
YAML
68 lines
1.9 KiB
YAML
name: "Update searx.data"
|
|
on:
|
|
schedule:
|
|
- cron: "59 23 28 * *"
|
|
workflow_dispatch:
|
|
|
|
jobs:
|
|
updateData:
|
|
name: Update data - ${{ matrix.fetch }}
|
|
runs-on: ubuntu-20.04
|
|
if: ${{ github.repository_owner == 'searxng'}}
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
fetch:
|
|
- update_ahmia_blacklist.py
|
|
- update_currencies.py
|
|
- update_external_bangs.py
|
|
- update_firefox_version.py
|
|
- update_engine_traits.py
|
|
- update_wikidata_units.py
|
|
- update_engine_descriptions.py
|
|
steps:
|
|
- name: Checkout
|
|
uses: actions/checkout@v2
|
|
|
|
- name: Install Ubuntu packages
|
|
run: |
|
|
sudo ./utils/searxng.sh install packages
|
|
|
|
- name: Set up Python
|
|
uses: actions/setup-python@v2
|
|
with:
|
|
python-version: '3.9'
|
|
architecture: 'x64'
|
|
|
|
- name: Install Python dependencies
|
|
run: |
|
|
make V=1 install
|
|
|
|
- name: Fetch data
|
|
env:
|
|
FETCH_SCRIPT: ./searxng_extra/update/${{ matrix.fetch }}
|
|
run: |
|
|
V=1 ./manage pyenv.cmd python "$FETCH_SCRIPT"
|
|
|
|
- name: Create Pull Request
|
|
id: cpr
|
|
uses: peter-evans/create-pull-request@v3
|
|
with:
|
|
commit-message: Update searx.data - ${{ matrix.fetch }}
|
|
committer: searxng-bot <noreply@github.com>
|
|
author: ${{ github.actor }} <${{ github.actor }}@users.noreply.github.com>
|
|
signoff: false
|
|
branch: update_data_${{ matrix.fetch }}
|
|
delete-branch: true
|
|
draft: false
|
|
title: 'Update searx.data - ${{ matrix.fetch }}'
|
|
body: |
|
|
Update searx.data - ${{ matrix.fetch }}
|
|
labels: |
|
|
data
|
|
|
|
- name: Check outputs
|
|
run: |
|
|
echo "Pull Request Number - ${{ steps.cpr.outputs.pull-request-number }}"
|
|
echo "Pull Request URL - ${{ steps.cpr.outputs.pull-request-url }}"
|