videosite.git
10 years agoStart converting videosite-irssi.pl to libvideosite
Ralf Ertzinger [Tue, 30 Apr 2013 13:48:21 +0000 (15:48 +0200)]
Start converting videosite-irssi.pl to libvideosite

10 years agoModify videosite-test.pl to use libvideosite
Ralf Ertzinger [Tue, 30 Apr 2013 13:41:44 +0000 (15:41 +0200)]
Modify videosite-test.pl to use libvideosite

10 years agoModify videosite-dl.pl to use libvideosite
Ralf Ertzinger [Tue, 30 Apr 2013 13:41:23 +0000 (15:41 +0200)]
Modify videosite-dl.pl to use libvideosite

10 years agoModify readme for plugins
Ralf Ertzinger [Tue, 30 Apr 2013 13:40:50 +0000 (15:40 +0200)]
Modify readme for plugins

10 years agoFix Dailymotion grabber
Ralf Ertzinger [Tue, 30 Apr 2013 13:28:38 +0000 (15:28 +0200)]
Fix Dailymotion grabber

11 years agoRename videosite.pl to videosite-irssi.pl
Ralf Ertzinger [Sat, 27 Apr 2013 19:21:57 +0000 (21:21 +0200)]
Rename videosite.pl to videosite-irssi.pl

11 years agoAllow proper subclassing of complete Getters/Grabbers
Ralf Ertzinger [Wed, 24 Apr 2013 11:42:37 +0000 (13:42 +0200)]
Allow proper subclassing of complete Getters/Grabbers

11 years agoMove config handling to API
Ralf Ertzinger [Wed, 24 Apr 2013 11:42:11 +0000 (13:42 +0200)]
Move config handling to API

11 years agoRemove _prepare_parameters() and mergeconfig()
Ralf Ertzinger [Wed, 24 Apr 2013 11:39:40 +0000 (13:39 +0200)]
Remove _prepare_parameters() and mergeconfig()

11 years agoUse API for active connectors
Ralf Ertzinger [Wed, 24 Apr 2013 11:38:33 +0000 (13:38 +0200)]
Use API for active connectors

11 years agoUse API for output
Ralf Ertzinger [Wed, 24 Apr 2013 11:37:49 +0000 (13:37 +0200)]
Use API for output

11 years agoAdd default "enabled" property
Ralf Ertzinger [Wed, 24 Apr 2013 11:32:04 +0000 (13:32 +0200)]
Add default "enabled" property

11 years agoAdd a register_api() call to Base.pm
Ralf Ertzinger [Wed, 24 Apr 2013 11:31:15 +0000 (13:31 +0200)]
Add a register_api() call to Base.pm

11 years agoChange new() function in plugins to avoid having to call _prepare_parameters() in...
Ralf Ertzinger [Sun, 21 Apr 2013 17:32:48 +0000 (19:32 +0200)]
Change new() function in plugins to avoid having to call _prepare_parameters() in each

11 years agoAdd skeleton for weechat plugin
Ralf Ertzinger [Sun, 14 Apr 2013 20:12:41 +0000 (22:12 +0200)]
Add skeleton for weechat plugin

11 years agoYoutube: Simplify regex for scraping
Ralf Ertzinger [Sat, 23 Mar 2013 13:14:20 +0000 (14:14 +0100)]
Youtube: Simplify regex for scraping

11 years agoRemove debugging output
Ralf Ertzinger [Sat, 23 Mar 2013 13:13:57 +0000 (14:13 +0100)]
Remove debugging output

11 years agoYoutube: New site format for scraper
Ralf Ertzinger [Fri, 22 Mar 2013 18:52:48 +0000 (19:52 +0100)]
Youtube: New site format for scraper

11 years agoAdd MotherlessGrabber
Maximilian Rehkopf [Wed, 13 Mar 2013 23:02:10 +0000 (00:02 +0100)]
Add MotherlessGrabber

11 years agoAdd sane user-agent header for Async*FileGetters
Maximilian Rehkopf [Wed, 13 Mar 2013 23:02:09 +0000 (00:02 +0100)]
Add sane user-agent header for Async*FileGetters

11 years agoRemove old JSON parsers, we require the JSON module now
Ralf Ertzinger [Mon, 4 Mar 2013 19:03:17 +0000 (20:03 +0100)]
Remove old JSON parsers, we require the JSON module now

11 years agoConvert to use of a json style config file
Ralf Ertzinger [Mon, 4 Mar 2013 19:02:20 +0000 (20:02 +0100)]
Convert to use of a json style config file

11 years agoFix Vimeo grabber, support SD only video
Ralf Ertzinger [Fri, 18 Jan 2013 22:58:17 +0000 (23:58 +0100)]
Fix Vimeo grabber, support SD only video

11 years agoSet timeout for URL shortener to 5 seconds
Ralf Ertzinger [Fri, 21 Dec 2012 14:02:01 +0000 (15:02 +0100)]
Set timeout for URL shortener to 5 seconds

11 years agoVimeo: Match mobile URL
Ralf Ertzinger [Sat, 3 Nov 2012 11:30:51 +0000 (12:30 +0100)]
Vimeo: Match mobile URL

11 years agoYoutube: Add new signature to download URLs
Ralf Ertzinger [Fri, 28 Sep 2012 14:43:07 +0000 (16:43 +0200)]
Youtube: Add new signature to download URLs

11 years agoYoutube: remove old matching code
Ralf Ertzinger [Thu, 9 Aug 2012 14:07:46 +0000 (16:07 +0200)]
Youtube: remove old matching code

11 years agoYoutube: Add new URL format
Ralf Ertzinger [Thu, 9 Aug 2012 11:25:33 +0000 (13:25 +0200)]
Youtube: Add new URL format

11 years agoVimeoGrabber: rework to new site layout
Ralf Ertzinger [Sat, 28 Jul 2012 19:32:19 +0000 (21:32 +0200)]
VimeoGrabber: rework to new site layout

11 years agoAsync*Getter: fix escaping in filenames
Christian Garbs [Sun, 11 Mar 2012 16:44:17 +0000 (17:44 +0100)]
Async*Getter: fix escaping in filenames

11 years agoMerge branch 'master' of http://10.200.0.3/GIT/videosite
Ralf Ertzinger [Wed, 30 May 2012 08:49:46 +0000 (10:49 +0200)]
Merge branch 'master' of 10.200.0.3/GIT/videosite

11 years agoYoutube: Add new video format
Ralf Ertzinger [Wed, 30 May 2012 08:49:33 +0000 (10:49 +0200)]
Youtube: Add new video format

12 years agoMerge branch 'master' of ssh://ryoko:22003/home/sun/GIT/videosite
Ralf Ertzinger [Mon, 27 Feb 2012 18:03:55 +0000 (19:03 +0100)]
Merge branch 'master' of ssh://ryoko:22003/home/sun/GIT/videosite

12 years agoYoutube: Simplify match pattern
Ralf Ertzinger [Mon, 27 Feb 2012 18:03:22 +0000 (19:03 +0100)]
Youtube: Simplify match pattern

12 years agoYoutube: Disable the scrap handlers for the 2009 and 2010 page formats, they should...
Ralf Ertzinger [Wed, 15 Feb 2012 07:21:38 +0000 (08:21 +0100)]
Youtube: Disable the scrap handlers for the 2009 and 2010 page formats, they should not be in use any more

12 years agoMerge branch 'master' of ssh://ryoko:22003/home/sun/GIT/videosite
Ralf Ertzinger [Tue, 14 Feb 2012 23:11:34 +0000 (00:11 +0100)]
Merge branch 'master' of ssh://ryoko:22003/home/sun/GIT/videosite

12 years agoYoutube: Add new page format (yt.playerConfig)
Ralf Ertzinger [Tue, 14 Feb 2012 23:11:24 +0000 (00:11 +0100)]
Youtube: Add new page format (yt.playerConfig)

12 years agovideosite-test: Fix environment proxy use
Ralf Ertzinger [Tue, 14 Feb 2012 20:41:59 +0000 (21:41 +0100)]
videosite-test: Fix environment proxy use

12 years agovideosite-test: Autoflush STDOUT
Ralf Ertzinger [Tue, 14 Feb 2012 20:41:48 +0000 (21:41 +0100)]
videosite-test: Autoflush STDOUT

12 years agovideosite-dl: Fix environment proxy use
Ralf Ertzinger [Tue, 14 Feb 2012 20:40:15 +0000 (21:40 +0100)]
videosite-dl: Fix environment proxy use

12 years agoVimeo: Add self test information
Ralf Ertzinger [Tue, 14 Feb 2012 20:39:47 +0000 (21:39 +0100)]
Vimeo: Add self test information

12 years agoYoutube: match .../watch?&v=... URLs
Ralf Ertzinger [Mon, 13 Feb 2012 12:26:30 +0000 (13:26 +0100)]
Youtube: match .../watch?&v=... URLs

12 years agoZero Punctuation: fix grabber
Ralf Ertzinger [Sun, 12 Feb 2012 16:15:59 +0000 (17:15 +0100)]
Zero Punctuation: fix grabber

12 years agoVeoh: Fix grabber
Ralf Ertzinger [Sun, 12 Feb 2012 16:15:23 +0000 (17:15 +0100)]
Veoh: Fix grabber

12 years agoYoutube: remove COOKIE metadata
Ralf Ertzinger [Sat, 11 Feb 2012 19:12:44 +0000 (20:12 +0100)]
Youtube: remove COOKIE metadata

12 years agoGrabberBase: remove debug print statements
Ralf Ertzinger [Sat, 11 Feb 2012 17:44:48 +0000 (18:44 +0100)]
GrabberBase: remove debug print statements

12 years agoAutomatically add cookies gathered during grabbing to the metadata
Ralf Ertzinger [Sat, 11 Feb 2012 17:42:35 +0000 (18:42 +0100)]
Automatically add cookies gathered during grabbing to the metadata

12 years agoAdd test URLs to BlipTV, Collegehumor, Redtube, Sevenload, Snotr, Wimp and Youtube
Ralf Ertzinger [Sat, 11 Feb 2012 17:22:06 +0000 (18:22 +0100)]
Add test URLs to BlipTV, Collegehumor, Redtube, Sevenload, Snotr, Wimp and Youtube

12 years agoAdd _selftest() function and test script to verify Grabber functionality
Ralf Ertzinger [Sat, 11 Feb 2012 17:21:19 +0000 (18:21 +0100)]
Add _selftest() function and test script to verify Grabber functionality

12 years agoSnotr: Fix video title acquisition
Ralf Ertzinger [Sat, 11 Feb 2012 17:19:42 +0000 (18:19 +0100)]
Snotr: Fix video title acquisition

12 years agoSevenload: Fix grabber
Ralf Ertzinger [Sat, 11 Feb 2012 17:19:00 +0000 (18:19 +0100)]
Sevenload: Fix grabber

12 years agoRedtube: Fix grabber
Ralf Ertzinger [Sat, 11 Feb 2012 17:18:31 +0000 (18:18 +0100)]
Redtube: Fix grabber

12 years agoBlipTV: Fix grabber
Ralf Ertzinger [Sat, 11 Feb 2012 17:17:47 +0000 (18:17 +0100)]
BlipTV: Fix grabber

12 years agoBase: lower timeout for default UserAgent object
Ralf Ertzinger [Sat, 11 Feb 2012 14:53:41 +0000 (15:53 +0100)]
Base: lower timeout for default UserAgent object

12 years agoReplace use of LWP::Simple in all grabbers by $self->simple_get()
Ralf Ertzinger [Sat, 11 Feb 2012 14:43:41 +0000 (15:43 +0100)]
Replace use of LWP::Simple in all grabbers by $self->simple_get()

12 years agoWimp: Catch possibe use of undefined variable
Ralf Ertzinger [Sat, 11 Feb 2012 14:39:25 +0000 (15:39 +0100)]
Wimp: Catch possibe use of undefined variable

12 years agoBase: Add simple_get() function
Ralf Ertzinger [Sat, 11 Feb 2012 14:37:41 +0000 (15:37 +0100)]
Base: Add simple_get() function

12 years agoWimp: Obfuscating download URLs? Nasty.
Ralf Ertzinger [Fri, 10 Feb 2012 22:45:23 +0000 (23:45 +0100)]
Wimp: Obfuscating download URLs? Nasty.

12 years agovideosite: add a general scheme for immutable connectors
Ralf Ertzinger [Wed, 7 Dec 2011 19:45:43 +0000 (20:45 +0100)]
videosite: add a general scheme for immutable connectors

12 years agoYoutube: Add video format info to metadata
Ralf Ertzinger [Wed, 7 Dec 2011 19:42:20 +0000 (20:42 +0100)]
Youtube: Add video format info to metadata

12 years agoYoutube: Add/annotate more video formats
Ralf Ertzinger [Thu, 17 Nov 2011 09:44:11 +0000 (10:44 +0100)]
Youtube: Add/annotate more video formats

12 years agoMerge branch 'master' of http://10.200.0.3/GIT/videosite
Ralf Ertzinger [Thu, 10 Nov 2011 08:12:16 +0000 (09:12 +0100)]
Merge branch 'master' of 10.200.0.3/GIT/videosite

12 years agoYoutube: new video formats, again
Ralf Ertzinger [Thu, 10 Nov 2011 08:11:55 +0000 (09:11 +0100)]
Youtube: new video formats, again

12 years agogo green
Christian Garbs [Tue, 18 Oct 2011 18:46:00 +0000 (20:46 +0200)]
go green

restore the environment after polluting it with _proxy variables

12 years agoadd connector support to AsyncFileGetter
Christian Garbs [Wed, 7 Sep 2011 16:23:09 +0000 (18:23 +0200)]
add connector support to AsyncFileGetter

12 years agoYoutube: new video formats, again
Ralf Ertzinger [Fri, 14 Oct 2011 07:10:21 +0000 (09:10 +0200)]
Youtube: new video formats, again

12 years agoYoutube: new video formats, again
Ralf Ertzinger [Tue, 13 Sep 2011 21:52:23 +0000 (23:52 +0200)]
Youtube: new video formats, again

12 years agovideosite: add connector to main help
Ralf Ertzinger [Wed, 7 Sep 2011 16:22:47 +0000 (18:22 +0200)]
videosite: add connector to main help

12 years agovideosite: print help if no connector subcommand given, lowercase connector names...
Ralf Ertzinger [Wed, 7 Sep 2011 16:21:02 +0000 (18:21 +0200)]
videosite: print help if no connector subcommand given, lowercase connector names for select

12 years agoFileGetter: Add support for connectors from metadata
Ralf Ertzinger [Sun, 4 Sep 2011 13:07:39 +0000 (15:07 +0200)]
FileGetter: Add support for connectors from metadata

12 years agovideosite: add connectors support
Ralf Ertzinger [Sun, 4 Sep 2011 13:06:27 +0000 (15:06 +0200)]
videosite: add connectors support
 - add new subcommand '/videosite connector' to manage connectors

12 years agoBase, GrabberBase: change hash keys for connectors
Ralf Ertzinger [Sat, 3 Sep 2011 23:31:01 +0000 (01:31 +0200)]
Base, GrabberBase: change hash keys for connectors

12 years agoMerge branch 'master' of http://10.200.0.3/GIT/videosite
Ralf Ertzinger [Sat, 3 Sep 2011 23:15:51 +0000 (01:15 +0200)]
Merge branch 'master' of 10.200.0.3/GIT/videosite

12 years agoYouTube: Add comment to format list
Ralf Ertzinger [Sat, 3 Sep 2011 23:15:48 +0000 (01:15 +0200)]
YouTube: Add comment to format list

12 years agoYouTube: add config variable to disable use of HTTPS URLs (where possible)
Ralf Ertzinger [Sat, 3 Sep 2011 22:10:42 +0000 (00:10 +0200)]
YouTube: add config variable to disable use of HTTPS URLs (where possible)

12 years agoBase: remove debugging code accidentially left in
Ralf Ertzinger [Sat, 3 Sep 2011 22:09:57 +0000 (00:09 +0200)]
Base: remove debugging code accidentially left in

12 years agovideosite-dl: Add a connector callback which uses the http_proxy and https_proxy...
Ralf Ertzinger [Sat, 3 Sep 2011 22:02:03 +0000 (00:02 +0200)]
videosite-dl: Add a connector callback which uses the http_proxy and https_proxy environment variables

12 years agoGrabberBase; make use of new connector infrastructure
Ralf Ertzinger [Sat, 3 Sep 2011 22:01:10 +0000 (00:01 +0200)]
GrabberBase; make use of new connector infrastructure

12 years agoBase: Add support for connectors
Ralf Ertzinger [Sat, 3 Sep 2011 21:58:07 +0000 (23:58 +0200)]
Base: Add support for connectors
 A connector is basically a list of proxies to use for HTTP/HTTPS
 connections.
 Grabbers can request this list and try them in order until one
 yields a result.

 This is especially useful to work around silly YouTube videos, which
 are not available in all countries.

12 years agovideosite-dl: Add -d switch for debug messages
Ralf Ertzinger [Sat, 3 Sep 2011 20:18:54 +0000 (22:18 +0200)]
videosite-dl: Add -d switch for debug messages

12 years agoBase, YouTube: add a function to decode URL query strings and make the Youtube grabbe...
Ralf Ertzinger [Sat, 3 Sep 2011 20:18:17 +0000 (22:18 +0200)]
Base, YouTube: add a function to decode URL query strings and make the Youtube grabber use it

12 years agovideosite-dl: Add -i command line option to print information instead of downloading
Ralf Ertzinger [Sat, 3 Sep 2011 19:44:14 +0000 (21:44 +0200)]
videosite-dl: Add -i command line option to print information instead of downloading

12 years agoYoutube: specify video formats more clearly
Ralf Ertzinger [Wed, 17 Aug 2011 20:57:48 +0000 (22:57 +0200)]
Youtube: specify video formats more clearly

12 years agoYouTube: explicitly specify first pass decoding for _decode_url_encoded_fmt_stream_map
Ralf Ertzinger [Tue, 9 Aug 2011 16:31:39 +0000 (18:31 +0200)]
YouTube: explicitly specify first pass decoding for _decode_url_encoded_fmt_stream_map

12 years agoYouTube: Correctly parse url_encoded_fmt_stream_map from the web scape, too
Ralf Ertzinger [Mon, 8 Aug 2011 20:16:23 +0000 (22:16 +0200)]
YouTube: Correctly parse url_encoded_fmt_stream_map from the web scape, too

12 years agoYoutube: Add support for url_encoded_fmt_stream_map and use decode_hexurl()
Ralf Ertzinger [Wed, 3 Aug 2011 21:11:30 +0000 (23:11 +0200)]
Youtube: Add support for url_encoded_fmt_stream_map and use decode_hexurl()

12 years agoBase: Add decode_hexurl function
Ralf Ertzinger [Wed, 3 Aug 2011 21:10:58 +0000 (23:10 +0200)]
Base: Add decode_hexurl function

12 years agoCollegeHumor: Fix video URLs, and the title is in the XML now!
Ralf Ertzinger [Sat, 23 Jul 2011 20:51:10 +0000 (22:51 +0200)]
CollegeHumor: Fix video URLs, and the title is in the XML now!

12 years agoYouTube: fix some warnings
Ralf Ertzinger [Sat, 23 Jul 2011 20:34:19 +0000 (22:34 +0200)]
YouTube: fix some warnings

12 years agoFileGetter: Use full blown HTTP::UserAgent to set the User-Agent
Ralf Ertzinger [Sat, 23 Jul 2011 20:33:50 +0000 (22:33 +0200)]
FileGetter: Use full blown HTTP::UserAgent to set the User-Agent

12 years agoBase: fix the default output function
Ralf Ertzinger [Sat, 23 Jul 2011 19:32:03 +0000 (21:32 +0200)]
Base: fix the default output function

12 years agoYoutube: Add video format 44 and 45 (also WebM)
Ralf Ertzinger [Fri, 22 Jul 2011 06:33:07 +0000 (08:33 +0200)]
Youtube: Add video format 44 and 45 (also WebM)

12 years agoYoutube: Add video format 43 (WebM)
Ralf Ertzinger [Fri, 22 Jul 2011 06:26:26 +0000 (08:26 +0200)]
Youtube: Add video format 43 (WebM)

12 years agoYoutube: decode UTF8 video titles to the internal perl format
Ralf Ertzinger [Sat, 18 Jun 2011 12:55:20 +0000 (14:55 +0200)]
Youtube: decode UTF8 video titles to the internal perl format

12 years agoBase, YouTube: Do not use process persistent LWP::UserAgent objects, they accumulate...
Ralf Ertzinger [Sun, 12 Jun 2011 17:44:50 +0000 (19:44 +0200)]
Base, YouTube: Do not use process persistent LWP::UserAgent objects, they accumulate cookies and stop working after a while

12 years agoBase: Add module name to error and debug output
Ralf Ertzinger [Wed, 8 Jun 2011 18:39:24 +0000 (20:39 +0200)]
Base: Add module name to error and debug output

12 years agoAsyncWgetFileGetter: Remove base64 encoding from command line debug
Ralf Ertzinger [Wed, 8 Jun 2011 18:21:17 +0000 (20:21 +0200)]
AsyncWgetFileGetter: Remove base64 encoding from command line debug

12 years agoJSArrayParser: dispense with the fallback crap, just return a JSJSONArrayParser or...
Ralf Ertzinger [Wed, 8 Jun 2011 06:27:22 +0000 (08:27 +0200)]
JSArrayParser: dispense with the fallback crap, just return a JSJSONArrayParser or die if that does not work

12 years agoYoutube: factor out url selection routine
Ralf Ertzinger [Fri, 3 Jun 2011 09:26:09 +0000 (11:26 +0200)]
Youtube: factor out url selection routine

12 years agoYoutube: Add a parser that uses /get_video_info, with a fallback to the old method
Ralf Ertzinger [Fri, 3 Jun 2011 09:20:19 +0000 (11:20 +0200)]
Youtube: Add a parser that uses /get_video_info, with a fallback to the old method