searxng

Table of Contents

Engine updates
settings.yml
Changes

statistics & errors in engines

Themes
Docker
Development
Fixes
Documentation
Code refactoring and cleanup
Lint
/utils/* scripts
Translations
Misc
Not in searxng but in searx

⚠️ Warning: this list has not been updated for a long time. Please see the list of merged pull requests

This document is produced using:

https://gist.github.com/dalf/d4466f11f0599bb3dbd4cc7494b91023
manual review

It may contains some errors.

Last update of this document: 2021-09-06

✨ = in searxng, not in searx

Engine updates

ahmia ( #211 ) - @MarcAbonce
artic ( #14 ) - @habsinn(searx#2665)
azlyrics ( #287 ) - @allendema(searx#2955)
brave ( #179 #196 #288 ) - @kaonashi696(searx#2857) @allendema
core ( #16 ) - @marc-cenon(searx#2688)
docker_hub ( #117 ) - @SuperSonicHub1(searx#2543)
~dogpile~ ( #203 ) - @return42
google ( #267 #205 #177 #165 #160 #134 ) - @return42 @unixfox @kvch @dalf
google_images ( #200 #165 #134 ) - @unixfox @return42
google_news ( #165 #156 #134 ) - @return42
google_scholar ( #134 ) - @dalf
google_videos ( #165 #134 ) - @return42
gpodder ( #198 ) - @allendema(searx#2885) @return42
invidious ( #286 ) - @allendema(searx#2959)
mankier ( #111 #118 ) - @jordemort(searx#2829, searx#a881e74) @return42
metasearch ( #108 ) - @allendema(searx#2822)
mongodb ( #207 ) - @asciimoo(searx@198aad4)
mysql_server ( #109 ) - @kvch
not_evil ( #211 ) - @MarcAbonce
openstreetmap ( #90 #113 ) - significant changes - @dalf
packagist ( #275 ) - @koelle25
peertube ( #221 #131 ) - @dalf
pypi ( #112 ) - @jordemort (searx#2830) @return42
postgresql ( #109 ) - @kvch
qwant ( #223 #206 #204 #52 ) - @return42 @MarcAbonce (searx#2799) ✨
redis_server ( #124 ) - @asciimoo
seznam ( #227 ) - @dudik(searx#2905)
solidtorrents ( #42 ) - @mikeri(searx#2786)
springer ( #15 ) - @pchg(searx#2663)
sqlite ( #103 ) - @dalf @kvch (searx#8e90a214ce5cf60e0640e2ba812fa432d7bdef2f)
unsplash ( #96 ) - @return42
whaleSlide ( #178 ) - @allendema(searx#2861) @return42
wikimini ( #107 ) @CrocodileCroco(searx#2819) @return42
woxikon ( #197 ) - @allendema(searx#2883) @return42
xpath ( #92 #83 ) - @return42
youtube_noapi ( #10 ) - @return42

settings.yml

#54 - result_proxy.proxify_results: option to enable or disable "proxy" button next to each result - @return42 ✨
#99 #226 - search.formats: add settings option to enable/disable search formats - @return42 ✨
#11 - doi_resolvers: add DOI resolver from sci-hub / replace default DOI - @return42 ✨
#247 - locales: remove this section - @dalf ✨
#253 - replace http:// URLs by https:// - @return42

Changes

#1 #32 #64 - Use httpx instead of requests - @dalf
#59 - searx.network.client: the same configuration reuses the same ssl.SSLContext - @dalf
#229 #263 - display the git commit in the page footer (even without Docker) - @dalf ✨
#257 - enhancement of the embedded image proxy - @dalf ✨
#114 - the bittorent search engines are available only in the files category - @dalf ✨
#110 - change category order (General, Images, Videso, News, ...) - @dalf ✨
#86 - remove call to gc.collect() after each user request - @dalf ✨
#60 - Server-Timing header: add render field - @dalf ✨
#9 - drop plugin HTTPS rewrite - rule base is to old (update is to big) - @return42 ✨
#37 - drop idna from requirements.txt - @return42 ✨

statistics & errors in engines

#7 #85 - store more detail metrics (only in the server memory) - @dalf ✨
#12 #23 #34 #81 - update URL /stats - @dalf ✨
#28 - processors: show identical error messages on /search and /stats #28 - @dalf ✨
#40 #54 #269 - search results: link to /stats to create an github issue about broken engines - @dalf ✨

Themes

#136 - [oscar theme] /preferences: use simple layout for the oscar theme - @dalf ✨
#244 - [simple theme] eslint - @return42 ✨
#276 - [simple theme] bug fixes @dalf ✨
#41 - fix various theme issues - @return42 ✨
#235 - dependabot.yml: check npm packages - @dalf ✨
#292 - make HTML templates more CSP compliant - @return42 ✨

Docker

#22 - images for amd64, arm64, arm/v7 - @dalf ✨
#164 #68 - upgrade to alpine 3.14 - @dalf ✨
#66 - review of docker entry point & docker documentation - @return42 ✨

Development

#250 #249 #238 - translation: use weblate instead transifex, continuous integration - @dalf ✨
#174 #171 #157 #151 - tools to build and commit the static files - @dalf ✨
#128 - flask debug mode: reload the app when searx/settings.yml changes - @dalf ✨
#132 - make docs doesn't initialize the engines (no HTTP requests) - @dalf ✨
#31 - get PYLINT_FILES from tag '# lint: pylint' - @return42 ✨

Fixes

#285 - typo in searx.webadapter.parse_lang ✨
#259 - searx.search.checker.get_result() always return a dict - @dalf ✨
#220 - /preferences: remove the empty engine category "social medias"(it is "social media") - @dalf ✨
#180 #167 - decoding of saved preferences in the URL - @return42
#123 - searx_extra/update/update_languages.py - @dalf ✨
#84 - unit test: don't load /etc/searx/settings.yml - @dalf ✨
#67 - fix usage of docker environment variable INSTANCE_NAME - @dalf ✨
#58 - engine initialization: use the proxy configuration as expected - @dalf ✨
#27 - debug log: UnicodeEncodeError: 'ascii' codec can't encode - @return42

Documentation

#239 - [fix] documentation - remove brand.git_url & brand.git_branch - @return42 ✨
#225 - [docs] document NoSLQ engines MongoDB and redis - @return42
#149 - [doc] admin manual - describe installation of external plugins - @return42
#138 - [fix] section "Overrides" in engine's documentation - @return42 ✨
#97 - [docs] reorder blog articles - @return42 ✨
#91 - [doc] add documentation about the XPath engine - @return42 ✨
#76 - [fix] sphinx-tabs should not overlap sidebar - @return42 ✨
#24 - [fix doc] manage.sh update_packages does not exists anymore - @return42 ✨
#13 - [fix] Fix typo in morty installation instruction - @return42 ✨

Code refactoring and cleanup

#110 - move all default settings into searx.settings_defaults - @dalf ✨
#116 - searx.engines.__init__: refactoring - @dalf ✨
#135 - searx.webapp: refactoring - @dalf ✨
#260 - searx.webapp.get_locale: read locale from the preferences - @dalf ✨
#213 - searx.brand: drop namespace - @return42 ✨
#258 - plugins: minor change - @dalf ✨
#33 - removed deprecated files - @dalf ✨
#169 - tidy up ignore lists .gitignore & .dockerignore - @return42 ✨
#281 - move test code from searx directory to tests ✨

Lint

#146 #139 #100 #94 #93 #74 - pylint ✨
#168 - Lint the less files of the simple theme - @return42 ✨
#152 - [fix] typo in a searx/settings.yml - @return42 ✨
#105 - [enh] add test.yamllint - lint yaml files - @return42 ✨

/utils/* scripts

#266 - [fix] utils/searx.sh install settings - do not eval the template - @return42 ✨
#236 - manage script: remove unused reference to utils/brand.env and .config.sh - @dalf ✨
#216 - normalize environment of installation tasks (shell) with YAML settings - @return42 ✨
#212 - [fix] ./manage script, prompt the unknown command - @return42 ✨
#194 - [fix] some minor issues in Makefile and shell scripts - @return42 ✨
#182 - [fix] .config.sh: typo SEARX_INTERNAL_URL --> SEARX_INTERNAL_HTTP - @return42 ✨
#181 - [fix] utils/lib.sh: prefix_stdout show cursor (ANSI escape \e[?25h) - @return42 ✨
#173 - [mod] utils/lxc.sh: detect conflict of docker & LXC in the iptables - @return42 ✨
#172 - [fix] utils/searx.sh: signature of YAML settings has been changed - @return42 ✨
#161 - [fix] py.build - fix small typo in the build message - @return42 ✨
#158 - [fix] node.clean - ignore npm dependencies when npm is not installed - @return42 ✨
#148 - [fix] test.yamllint - fixed typo - @return42 ✨
#145 - [fix] utils/morty.sh - PUBLIC_URL_MORTY is based on PUBLIC_URL - @return42 ✨
#144 - [yamllint] ./utils/templates/etc/searx/*.yml - @return42 ✨
#78 - Revert "[fix] docutils v0.17 incompatibility to previeous v0.16" - @return42 ✨
#35 - [fix] manage - fix miss usage of 'set -e' - @return42 ✨
#20 - [CI] JamesIves/github-pages-deploy-action COMMIT_MESSAGE - @return42 ✨
#19 - [CI] JamesIves/github-pages-deploy-action SINGLE_COMMIT - @return42 ✨
#8 - Replace Makefile boilerplate by shell scripts - @return42 ✨
#38 - [filtron.sh] make filtron rule file configurable - @return42 ✨

Translations

#230 - Remove zh_Hant_TW translation - @dalf ✨
#282 #274 #265 #262 - Update translations - @searxng-bot ✨

see https://github.com/searxng/searxng/commits/translations ✨

Translators:

@comradekingu
@MadTooth
@return42
@gnu-ewm
@dalf

Misc

#25 #30 #26 #17 - searxng brand ✨
#170 #143 - update .dir-locals.el - @return42 ✨

Not in searxng but in searx

9b5415ea - disable /stats page by default to prevent potential data leak
6cd3bf37 - activate pylint only for the tests
searx#2814
hostname_replace plugin #2724
some engines:
- ask - searx#2898
- kaufland - searx#2915
- libgen : pagination - searx#2887
- petalsearch - searx#2897 searx#2932