Commit Graph

1461 Commits

Author SHA1 Message Date
Thomas Pointhuber
5538c6771a improve publishDate extraction from yahoo 2014-03-15 19:20:29 +01:00
Thomas Pointhuber
b88146d669 showing publishedDate for news 2014-03-14 09:55:11 +01:00
Adam Tauber
3acdf3f9a1 [fix] pep8 2014-03-10 16:46:11 +01:00
Adam Tauber
0fc481f47e [fix] yahoo url extraction 2014-03-08 19:09:03 +01:00
Adam Tauber
2be94c2078 [enh] engine default category init 2014-03-08 13:59:50 +01:00
potato
6f535b6fae [fix] error when xpath_results in extraxt_text is _ElementUnicodeResult instead of _ElementStringResult 2014-03-04 19:43:41 +01:00
Adam Tauber
98b6313d5d [fix] pep8 2014-03-04 14:20:29 +01:00
Adam Tauber
ee1ffbc87f [fix] yahoo engine url extraction 2014-03-04 14:19:59 +01:00
Thomas Pointhuber
f1404ce72d Create yahoo_news.py 2014-03-04 13:11:53 +01:00
Thomas Pointhuber
0549f8c7c8 Create google_news.py 2014-03-04 13:11:04 +01:00
Thomas Pointhuber
1d5741954e Create bing_news.py 2014-03-04 13:10:04 +01:00
Adam Tauber
4627788834 [fix] yahoo url mods 2014-02-27 10:59:39 +01:00
asciimoo
7db4558de7 [mod][fix] startpage engine updates 2014-02-18 16:14:31 +01:00
asciimoo
5b2680be4b [enh] new engine parameter: timeout 2014-02-13 17:08:22 +01:00
asciimoo
c1d7d30b8e [mod] len() removed from conditions 2014-02-11 13:13:51 +01:00
asciimoo
9eb31c0186 [fix] unicode and pep8 fixes 2014-02-07 02:45:12 +01:00
Gabor Nagy
22fd0746d9 Improves PEP8 compatibility. 2014-02-05 20:24:31 +01:00
asciimoo
88425f05d6 [enh] shortcut support added to engines 2014-01-31 15:45:18 +01:00
asciimoo
3a2b9a8682 [fix] pep8 2014-01-31 05:11:37 +01:00
asciimoo
68a0832524 [enh] search language support upadtes 2014-01-31 05:10:49 +01:00
asciimoo
2a788c8f29 [enh] search language support init 2014-01-31 04:35:23 +01:00
asciimoo
c573d3d69e [fix] print removed 2014-01-30 14:17:14 +01:00
asciimoo
b647244abf [fix] function parameters 2014-01-30 03:10:20 +01:00
asciimoo
72793725e2 [fix] print removed 2014-01-30 02:36:15 +01:00
asciimoo
3dcb835910 [fix] function parameters 2014-01-30 02:36:05 +01:00
asciimoo
642986c2e7 [enh] yahoo engine added 2014-01-30 02:33:24 +01:00
asciimoo
fe82637eac [enh] importable url extractor 2014-01-30 02:32:58 +01:00
asciimoo
14f4083ba1 [fix] print removed 2014-01-30 02:13:43 +01:00
asciimoo
9a74113b1c [enh] startpage paging init 2014-01-30 02:10:32 +01:00
asciimoo
7de506bbcd [enh] paging support for stackoverflow 2014-01-30 01:55:49 +01:00
asciimoo
6cbf9bf67d [enh] paging support for soundcloud 2014-01-30 01:50:15 +01:00
asciimoo
c567308e49 [enh] paging support for piratebay 2014-01-30 01:48:07 +01:00
asciimoo
35ecb6ec5d [enh] paging support for mediawiki 2014-01-30 01:44:12 +01:00
asciimoo
81b4cc77da [fix] comment removed 2014-01-30 01:23:23 +01:00
asciimoo
8b4d445c42 [enh] paging support for google images 2014-01-30 01:21:33 +01:00
asciimoo
89b676ea6f [enh] paging support for flickr 2014-01-30 01:19:51 +01:00
asciimoo
012c8517e0 [enh] paging support for filecrop 2014-01-30 01:14:08 +01:00
asciimoo
c0afc4fea7 [enh] paging support for ddg 2014-01-30 01:03:19 +01:00
asciimoo
805e6f1884 [enh] paging support for youtube 2014-01-30 00:50:47 +01:00
asciimoo
1fd91bd911 [enh] paging support for deviantart 2014-01-30 00:09:47 +01:00
asciimoo
5d54c7d500 [enh] paging support for dailymotion 2014-01-30 00:01:42 +01:00
asciimoo
ca271fd861 [enh] bing, google paging support 2014-01-29 21:14:38 +01:00
asciimoo
8bb94e3dc4 [enh] paging support 2014-01-29 20:52:04 +01:00
asciimoo
3207a396bd [enh] google engine added 2014-01-29 19:28:38 +01:00
Matej Cotman
6624dd51f5 add robot tests 2014-01-29 04:58:10 +01:00
asciimoo
85b81be35b [fix] pep8 2014-01-24 09:35:27 +01:00
pw3t
b82ba74a7d Merge branch 'ixquick' of https://github.com/pw3t/searx into ixquick
Conflicts:
	searx/engines/startpage.py
2014-01-23 22:17:19 +01:00
pw3t
a01042ae61 [ehn] added ixquick engine, using startpage engine 2014-01-23 22:14:03 +01:00
asciimoo
59eeeaab87 [fix] html tag removal 2014-01-23 11:08:08 +01:00
asciimoo
2b1d2dbc84 [enh] i18n support 2014-01-22 00:17:49 +01:00
asciimoo
b2492c94f4 [fix] pep/flake8 compatibility 2014-01-20 02:31:20 +01:00
Matej Cotman
dd4662978d fix: robot fw, entry points, some flake8, package searx egg 2014-01-20 01:06:29 +01:00
asciimoo
4f4cb1caca [enh] results favico handling 2014-01-19 22:58:50 +01:00
asciimoo
bfdd6ebb92 Merge branch 'featured_result' of https://github.com/pw3t/searx 2014-01-19 22:39:56 +01:00
pw3t
1dd35e9916 [ehn] added ixquick engine, using startpage engine 2014-01-19 21:20:07 +01:00
pw3t
d6b017efb5 Merge branch 'featured_result' 2014-01-19 19:54:52 +01:00
pw3t
9e72ebe064 Merge branch 'master' of https://github.com/asciimoo/searx 2014-01-19 19:50:17 +01:00
asciimoo
3afdd1d994 [enh] settings unification - new dependency: pyyaml 2014-01-19 00:17:02 +01:00
asciimoo
39ebe1d519 [fix] weight configurable via engines.cfg 2014-01-18 21:55:42 +01:00
asciimoo
046e190721 [mod] function name 2014-01-18 21:53:59 +01:00
pw3t
380b440a55 [fix] replace the png icons by ico's, minor chnage in the html 2014-01-17 20:47:17 +01:00
pw3t
a62b94e21c Merge branch 'master' of https://github.com/asciimoo/searx 2014-01-17 20:32:38 +01:00
asciimoo
2d179c4cf6 [enh] general torrent search with piratebay 2014-01-17 17:07:25 +01:00
pw3t
a8ec7fe6a4 [ehn] add favicons for vimeo, soundcloud, twitter and youtube 2014-01-16 22:03:43 +01:00
pw3t
cf8f444e85 [ehn] Add a 'featured result feature'm putting on top of the reasults ddg definitions and wikipedia (ugly html / css)
[ehn] Add a templates for videos, so the thumbnails all have the same side
2014-01-16 22:03:43 +01:00
András Veres-Szentkirályi
8dfc272191 [enh] simplified mediawiki response processing 2014-01-14 10:34:35 +01:00
asciimoo
a65070a72d [enh] own useragent handling init 2014-01-12 20:13:14 +01:00
asciimoo
060ea4d2f5 [fix] whitespaces removed 2014-01-12 18:48:38 +01:00
asciimoo
fa6f430f2e [fix] title escaping 2014-01-11 12:39:39 +01:00
asciimoo
0eb3cdf664 [mod] vimeo engine mods 2014-01-11 11:14:46 +01:00
Adam Tauber
6f8daea724 Merge pull request #18 from rsdy/master
highlight different search results differently
2014-01-11 02:12:40 -08:00
rhapsodhy
b0a4404217 [enh] highlight piratebay results with light grey border, and indent peers+magnet link 2014-01-11 03:33:41 +00:00
rhapsodhy
74ca542a02 [enh] set up special css classes for highlighting results + highlight definitions with dark grey border 2014-01-11 03:31:54 +00:00
asciimoo
7b4ec5c5e9 [fix] highlighting only html 2014-01-10 23:38:08 +01:00
Adam Tauber
1ba2762b67 Merge pull request #17 from pw3t/vimeo
Vimeo engine added
2014-01-08 03:05:57 -08:00
pw3t
1950e697d6 [enh] Improved vimeo search engines, and add the configuration in the sample 2014-01-06 22:15:46 +01:00
asciimoo
a5544ab95e [enh] score per result stat added 2014-01-05 23:13:53 +01:00
pw3t
68364df342 [enh] 1st version of vimeo search engine (need improvments) 2014-01-05 22:10:46 +01:00
Adam Tauber
5c9f6d5174 Merge pull request #16 from dalf/master
bug fixes
2014-01-05 05:49:39 -08:00
Dalf
3dc3fc7770 [mod][fix] xpath engine simplified, yahoo engine never returns truncated urls 2014-01-05 14:06:52 +01:00
Dalf
a2928e8d83 [fix] startpage engine : characters with diacritic were preceded by whitespace, and cleaner way to parse the result. 2014-01-05 14:00:10 +01:00
Dalf
bf56ec4fb1 [mod] bing and duckduckgo engines : add / rename locale parameter 2014-01-05 13:58:17 +01:00
Dalf
49c85fce51 [fix] dailymotion engine : no more html tag in the description 2014-01-05 13:55:17 +01:00
Dalf
e88cf0a0a8 [mod] minor fixes (duckduck_definitions : if a ddg bang is in the query, avoid a useless redirect) 2014-01-05 13:50:17 +01:00
asciimoo
53878fde2d [fix] error percentage @ stats page 2014-01-05 01:00:32 +01:00
asciimoo
d13c5aa37b [mod] unused imports and whitespaces purged 2014-01-05 00:46:42 +01:00
pw3t
efb6eca39e Merge branch 'master' of https://github.com/asciimoo/searx 2014-01-02 19:52:21 +01:00
asciimoo
76c9b2c782 [fix] piratebay.sx is no longer available - using piratebay.se 2013-12-31 15:35:51 +01:00
dalf
d3e272d035 add dailymotion engine 2013-12-30 22:42:37 +01:00
dalf
664c039b38 xpath engine: bug fix 2013-12-30 22:34:35 +01:00
dalf
9eddcdb8e4 flickr engine: bug fix 2013-12-30 22:24:42 +01:00
pw3t
6f2b8aca5e [fix] fix an error in the query 2013-12-29 21:43:56 +01:00
pw3t
a492ca6ded [enh] add support for yacy engine (localhost) 2013-12-29 21:39:23 +01:00
pw3t
b71bddad06 [enh] 1st version of filecrop engine, to discover how searx works 2013-12-29 16:30:03 +01:00
asciimoo
5f065886ff [fix] not highlighting Nonetype 2013-12-16 14:06:53 +01:00
asciimoo
ab7fb1190d [enh] smarter currency query parse II. 2013-12-01 16:42:37 +01:00
asciimoo
a35128f5e0 [enh] smarter currency query parse 2013-12-01 16:41:24 +01:00
asciimoo
1cb489ba1a [enh] json engine added 2013-11-19 15:49:52 +01:00
asciimoo
3755f437e4 [fix] utf8 content highlighting 2013-11-19 11:27:17 +01:00
asciimoo
e50a72b0e3 [enh] suggestion support for xpath engine 2013-11-13 19:33:09 +01:00
asciimoo
66ff28bb9d [enh] suggestion support added 2013-11-13 19:32:46 +01:00
asciimoo
9688495b9f [mod] result scoring separated 2013-11-12 21:34:28 +01:00
asciimoo
1240be48fb [fix] currency converter - valid date url param 2013-11-10 22:03:16 +01:00
asciimoo
b9ebf18f59 [fix] query highlight fix 2013-11-10 21:47:42 +01:00
asciimoo
cbb397939d [enh] incasesensitive query highlighting 2013-11-10 21:41:01 +01:00
asciimoo
14cd1d6faf [enh] moar weight for currency convertor 2013-11-10 21:20:22 +01:00
asciimoo
6d956a7d1d [enh] engine score weight support @ config and engines 2013-11-10 21:16:25 +01:00
asciimoo
17bf00ee42 [enh] removing result html tags 2013-11-09 18:39:20 +01:00
asciimoo
14a53e3430 [enh] search query highlight in result texts 2013-11-09 18:37:25 +01:00
asciimoo
cfff04f7d0 [enh] currency converter engine added 2013-11-04 21:47:16 +01:00
asciimoo
1a2cf205f9 [enh] skipping empty/nonetype categories 2013-11-04 21:46:23 +01:00
asciimoo
4cc391169a [enh] ignoring empty request urls 2013-11-04 21:06:53 +01:00
asciimoo
70278567ec [mod] searching by selected engines 2013-11-04 00:18:07 +01:00
asciimoo
d2a952ecdf [enh] request arg refactor 2013-11-03 00:40:45 +01:00
asciimoo
443af2ba83 [fix] varname 2013-11-03 00:34:09 +01:00
asciimoo
a8797839a1 [enh] request timeout added 2013-11-03 00:31:03 +01:00
asciimoo
c3c9d147ce [enh] clickable youtube thumbnail 2013-11-02 18:18:45 +01:00
asciimoo
326a33fafe [enh] better url comparison 2013-11-02 18:07:48 +01:00
asciimoo
cd268f90e2 [fix] correct scheme @ parsed url 2013-11-02 18:04:13 +01:00
asciimoo
ec95fddce2 [mod] scoring 2013-10-28 11:38:33 +01:00
asciimoo
e13fe033ed [enh] engine exception handling ++ stats 2013-10-27 20:45:21 +01:00
asciimoo
ca0800306f [mod] scoring mods 2013-10-27 19:06:30 +01:00
asciimoo
21e9c87305 [mod] pageload stat order 2013-10-27 14:55:47 +01:00
asciimoo
f01e67dbd4 [mod] scoring mods 2013-10-27 14:48:16 +01:00
asciimoo
0f301adf60 [enh] score stat mods 2013-10-27 14:39:23 +01:00
asciimoo
09154c1f01 [mod] results engines mods 2013-10-27 14:34:35 +01:00
asciimoo
22c94ec149 [fix] using https links 2013-10-27 14:23:53 +01:00
asciimoo
e2c1c10657 [enh] engine score stats 2013-10-27 14:21:23 +01:00
asciimoo
13a4582a40 [enh] search count 2013-10-27 13:55:18 +01:00
asciimoo
7965da55a7 [fix] urlparsing fix 2013-10-27 12:01:03 +01:00
asciimoo
afe767d8e9 [enh] stat bar graphs 2013-10-27 02:59:32 +02:00
asciimoo
4f4ec44bb3 [enh] stat updates 2013-10-27 02:50:24 +02:00
asciimoo
43ac547bc1 [enh] new stat: average request duration 2013-10-27 01:23:13 +02:00
asciimoo
b8191f43e7 [enh] engine statistics 2013-10-27 01:02:28 +02:00
asciimoo
09e7353307 [enh] config checks 2013-10-26 18:44:58 +02:00
asciimoo
5d764f95cf [enh] xpath engine absolute xpath support 2013-10-26 13:45:43 +02:00
asciimoo
badd988545 [enh] xpath engine added 2013-10-26 02:22:20 +02:00
asciimoo
89b68242d3 [mod] var rename 2013-10-26 02:21:55 +02:00
asciimoo
34bdeda6d4 [enh] basic config check 2013-10-25 23:41:14 +02:00
asciimoo
5dcddbc0ab [enh] engine params to response callbacks 2013-10-25 22:00:56 +02:00
asciimoo
f4fdb1e756 [fix] url encoding 2013-10-25 11:20:46 +02:00
asciimoo
d9011f673e [fix] debug msg removed 2013-10-25 01:46:12 +02:00
asciimoo
aa41c2b8ac [enh] bing updates ++ language support 2013-10-25 01:37:48 +02:00
asciimoo
2ca4cf7f2d [enh] bing engine added 2013-10-24 23:52:57 +02:00
asciimoo
cf6a92a996 [fix] urljoin removed 2013-10-24 23:43:39 +02:00
asciimoo
7ddf7d43ba [fix] character encoding fix 2013-10-24 21:00:44 +02:00
asciimoo
74b6be3991 [enh] engine cfg compatibilty 2013-10-23 23:55:37 +02:00
asciimoo
39d229e110 [enh][mod] engines.cfg support 2013-10-23 23:54:46 +02:00
asciimoo
75a2a6fb73 [enh] mediawiki engine added 2013-10-23 23:53:27 +02:00
asciimoo
e7792d77a7 [mod] wikipedia engine removed 2013-10-23 23:46:33 +02:00
asciimoo
5e358ea9a9 [enh] merging only results with same rendering templates 2013-10-23 12:24:51 +02:00
asciimoo
708fa6f88a [fix] handling missing github descriptions 2013-10-23 12:24:09 +02:00
asciimoo
dbf1049c79 [fix] debug print removed 2013-10-22 23:36:10 +02:00
asciimoo
0d6368a092 [fix] skipping empty urls 2013-10-22 23:35:17 +02:00
asciimoo
3a6d3e3377 [enh][mod] using image template rendering 2013-10-22 23:34:45 +02:00
asciimoo
9bd4459638 [fix] description escaping 2013-10-22 23:17:22 +02:00
asciimoo
831add33f0 [enh] thumbnails to youtube video results 2013-10-22 19:36:30 +02:00
asciimoo
ea03aaecb4 [enh] magnet link added 2013-10-22 19:15:41 +02:00
asciimoo
ef7e1199c3 [enh] displaying seeders/leechers 2013-10-22 19:15:30 +02:00
asciimoo
9ad8013a45 [enh] piratebay engine added 2013-10-22 18:58:01 +02:00
asciimoo
8520be3cd6 [enh] categories to request callback 2013-10-22 18:57:20 +02:00
asciimoo
42d2cc2068 [enh] github engine added 2013-10-20 21:53:49 +02:00
asciimoo
7ce7aaed3d [fix] handling empty resultsets III. 2013-10-20 21:40:14 +02:00
asciimoo
e1768ed292 [fix] url encoding fix 2013-10-20 21:31:16 +02:00
asciimoo
15a2c27864 [fix] link attrib 2013-10-20 20:53:12 +02:00
asciimoo
ec28b77a93 [fix] filtering 2013-10-20 20:47:00 +02:00
asciimoo
95e4a9353a [fix] request header parametering 2013-10-20 20:20:10 +02:00
asciimoo
986c8e51a8 [fix] handling empty resultset II. 2013-10-20 20:02:20 +02:00
asciimoo
126682a6ce [fix] handling empty resultset 2013-10-20 19:45:13 +02:00
asciimoo
f56649e3a9 [enh] deviantart engine added 2013-10-20 11:12:10 +02:00
asciimoo
c7b5cddc48 [enh] twitter engine added 2013-10-20 10:40:02 +02:00
asciimoo
7b6e5b5d14 [enh] soundcloud playlists 2013-10-20 00:52:32 +02:00
asciimoo
b9cdad9178 [mod] content formatting 2013-10-19 23:18:39 +02:00
asciimoo
4e5624a507 [mod] engine rename 2013-10-19 23:13:21 +02:00
asciimoo
83af0b6224 [enh] google images refactor 2013-10-19 23:12:18 +02:00
Adam Tauber
225c7ecbcf Merge pull request #2 from stef/master
google images engine
2013-10-19 13:36:55 -07:00
asciimoo
68bd8a19e9 [enh] cookie support 2013-10-19 22:34:46 +02:00
stef
b305af4541 [mod] category -> images 2013-10-19 22:19:31 +02:00
stef
7c11c7056f [enh] added google images engine 2013-10-19 22:19:14 +02:00
asciimoo
b3c418b36c [enh] youtube engine added 2013-10-19 20:46:10 +02:00
asciimoo
9ea84b285b [fix] better url comparison II. 2013-10-19 20:44:35 +02:00
asciimoo
1e5cbc5f9e [fix] sanitize results II. 2013-10-19 20:13:48 +02:00
asciimoo
d2da51179a [fix] sanitize results 2013-10-19 20:12:22 +02:00
asciimoo
ad2ff1fda8 [fix] better url comparison 2013-10-19 20:11:56 +02:00
asciimoo
38c003bf3d [enh] custom engine result weights 2013-10-19 19:04:46 +02:00
asciimoo
5ee0b7bb80 [enh] engine blacklist support 2013-10-19 19:01:06 +02:00
asciimoo
1308ebf657 [fix] using https 2013-10-19 18:30:08 +02:00
asciimoo
57eaeb9b74 [enh] startpage engine added 2013-10-19 18:29:39 +02:00
asciimoo
39a223091e [enh] displaying all search engines in results 2013-10-19 18:28:48 +02:00
asciimoo
70cbc09e93 [enh] better url comparison 2013-10-19 17:36:44 +02:00
asciimoo
b1a996ef4a [fix] several fixes 2013-10-18 09:35:29 +02:00
Adam Tauber
3b85089e77 Merge pull request #1 from stef/master
[enh] added flickr engine
2013-10-17 23:30:40 -07:00
asciimoo
90cec08e25 [fix] dict keys 2013-10-18 08:24:58 +02:00
stef
812d307062 [enh] added flickr engine 2013-10-18 02:15:26 +02:00
asciimoo
b915386456 [enh] soundcloud search added 2013-10-17 21:21:23 +02:00
asciimoo
668040e569 [enh] category added 2013-10-17 21:07:09 +02:00
asciimoo
f76d80de54 [enh] category support 2013-10-17 21:06:28 +02:00
asciimoo
e47258ce38 [fix] proper html escaping 2013-10-17 20:43:05 +02:00
asciimoo
cf36b20b5d [enh] license infos 2013-10-17 00:32:32 +02:00
asciimoo
e467a24843 [enh] stackoverflow added 2013-10-17 00:27:25 +02:00
asciimoo
a0037313ea [mod] wikipedia limited to first result 2013-10-16 23:21:04 +02:00
asciimoo
fa9c9e090b [enh] result ordering and deduplication 2013-10-16 23:03:26 +02:00
asciimoo
a346327c6f [enh] result ordering 2013-10-15 23:20:26 +02:00
asciimoo
4bf44076d4 [enh] proper urls 2013-10-15 22:28:27 +02:00
asciimoo
9e1ded688f [enh] engine selection support 2013-10-15 22:18:08 +02:00
asciimoo
e4b768b6cc [enh] wikipedia search added 2013-10-15 20:51:35 +02:00
asciimoo
d793c2733c [enh] engine types 2013-10-15 19:11:43 +02:00
asciimoo
d5ec0f43e4 [mod] search refactor 2013-10-15 18:19:06 +02:00
asciimoo
cfba30f1ba [fix] comments removed 2013-10-15 01:19:51 +02:00
asciimoo
e91e4e7fdb [enh] duckduckgo definitions 2013-10-14 23:54:33 +02:00
asciimoo
ae9fb1d7dc [enh] initial commit 2013-10-14 23:09:13 +02:00