Ralf Ertzinger [Wed, 15 Feb 2012 07:21:38 +0000 (08:21 +0100)]
Youtube: Disable the scrap handlers for the 2009 and 2010 page formats, they should not be in use any more
Ralf Ertzinger [Tue, 14 Feb 2012 23:11:34 +0000 (00:11 +0100)]
Merge branch 'master' of ssh://ryoko:22003/home/sun/GIT/videosite
Ralf Ertzinger [Tue, 14 Feb 2012 23:11:24 +0000 (00:11 +0100)]
Youtube: Add new page format (yt.playerConfig)
Ralf Ertzinger [Tue, 14 Feb 2012 20:41:59 +0000 (21:41 +0100)]
videosite-test: Fix environment proxy use
Ralf Ertzinger [Tue, 14 Feb 2012 20:41:48 +0000 (21:41 +0100)]
videosite-test: Autoflush STDOUT
Ralf Ertzinger [Tue, 14 Feb 2012 20:40:15 +0000 (21:40 +0100)]
videosite-dl: Fix environment proxy use
Ralf Ertzinger [Tue, 14 Feb 2012 20:39:47 +0000 (21:39 +0100)]
Vimeo: Add self test information
Ralf Ertzinger [Mon, 13 Feb 2012 12:26:30 +0000 (13:26 +0100)]
Youtube: match .../watch?&v=... URLs
Ralf Ertzinger [Sun, 12 Feb 2012 16:15:59 +0000 (17:15 +0100)]
Zero Punctuation: fix grabber
Ralf Ertzinger [Sun, 12 Feb 2012 16:15:23 +0000 (17:15 +0100)]
Veoh: Fix grabber
Ralf Ertzinger [Sat, 11 Feb 2012 19:12:44 +0000 (20:12 +0100)]
Youtube: remove COOKIE metadata
Ralf Ertzinger [Sat, 11 Feb 2012 17:44:48 +0000 (18:44 +0100)]
GrabberBase: remove debug print statements
Ralf Ertzinger [Sat, 11 Feb 2012 17:42:35 +0000 (18:42 +0100)]
Automatically add cookies gathered during grabbing to the metadata
Ralf Ertzinger [Sat, 11 Feb 2012 17:22:06 +0000 (18:22 +0100)]
Add test URLs to BlipTV, Collegehumor, Redtube, Sevenload, Snotr, Wimp and Youtube
Ralf Ertzinger [Sat, 11 Feb 2012 17:21:19 +0000 (18:21 +0100)]
Add _selftest() function and test script to verify Grabber functionality
Ralf Ertzinger [Sat, 11 Feb 2012 17:19:42 +0000 (18:19 +0100)]
Snotr: Fix video title acquisition
Ralf Ertzinger [Sat, 11 Feb 2012 17:19:00 +0000 (18:19 +0100)]
Sevenload: Fix grabber
Ralf Ertzinger [Sat, 11 Feb 2012 17:18:31 +0000 (18:18 +0100)]
Redtube: Fix grabber
Ralf Ertzinger [Sat, 11 Feb 2012 17:17:47 +0000 (18:17 +0100)]
BlipTV: Fix grabber
Ralf Ertzinger [Sat, 11 Feb 2012 14:53:41 +0000 (15:53 +0100)]
Base: lower timeout for default UserAgent object
Ralf Ertzinger [Sat, 11 Feb 2012 14:43:41 +0000 (15:43 +0100)]
Replace use of LWP::Simple in all grabbers by $self->simple_get()
Ralf Ertzinger [Sat, 11 Feb 2012 14:39:25 +0000 (15:39 +0100)]
Wimp: Catch possibe use of undefined variable
Ralf Ertzinger [Sat, 11 Feb 2012 14:37:41 +0000 (15:37 +0100)]
Base: Add simple_get() function
Ralf Ertzinger [Fri, 10 Feb 2012 22:45:23 +0000 (23:45 +0100)]
Wimp: Obfuscating download URLs? Nasty.
Ralf Ertzinger [Wed, 7 Dec 2011 19:45:43 +0000 (20:45 +0100)]
videosite: add a general scheme for immutable connectors
Ralf Ertzinger [Wed, 7 Dec 2011 19:42:20 +0000 (20:42 +0100)]
Youtube: Add video format info to metadata
Ralf Ertzinger [Thu, 17 Nov 2011 09:44:11 +0000 (10:44 +0100)]
Youtube: Add/annotate more video formats
Ralf Ertzinger [Thu, 10 Nov 2011 08:12:16 +0000 (09:12 +0100)]
Merge branch 'master' of 10.200.0.3/GIT/videosite
Ralf Ertzinger [Thu, 10 Nov 2011 08:11:55 +0000 (09:11 +0100)]
Youtube: new video formats, again
Christian Garbs [Tue, 18 Oct 2011 18:46:00 +0000 (20:46 +0200)]
go green
restore the environment after polluting it with _proxy variables
Christian Garbs [Wed, 7 Sep 2011 16:23:09 +0000 (18:23 +0200)]
add connector support to AsyncFileGetter
Ralf Ertzinger [Fri, 14 Oct 2011 07:10:21 +0000 (09:10 +0200)]
Youtube: new video formats, again
Ralf Ertzinger [Tue, 13 Sep 2011 21:52:23 +0000 (23:52 +0200)]
Youtube: new video formats, again
Ralf Ertzinger [Wed, 7 Sep 2011 16:22:47 +0000 (18:22 +0200)]
videosite: add connector to main help
Ralf Ertzinger [Wed, 7 Sep 2011 16:21:02 +0000 (18:21 +0200)]
videosite: print help if no connector subcommand given, lowercase connector names for select
Ralf Ertzinger [Sun, 4 Sep 2011 13:07:39 +0000 (15:07 +0200)]
FileGetter: Add support for connectors from metadata
Ralf Ertzinger [Sun, 4 Sep 2011 13:06:27 +0000 (15:06 +0200)]
videosite: add connectors support
- add new subcommand '/videosite connector' to manage connectors
Ralf Ertzinger [Sat, 3 Sep 2011 23:31:01 +0000 (01:31 +0200)]
Base, GrabberBase: change hash keys for connectors
Ralf Ertzinger [Sat, 3 Sep 2011 23:15:51 +0000 (01:15 +0200)]
Merge branch 'master' of 10.200.0.3/GIT/videosite
Ralf Ertzinger [Sat, 3 Sep 2011 23:15:48 +0000 (01:15 +0200)]
YouTube: Add comment to format list
Ralf Ertzinger [Sat, 3 Sep 2011 22:10:42 +0000 (00:10 +0200)]
YouTube: add config variable to disable use of HTTPS URLs (where possible)
Ralf Ertzinger [Sat, 3 Sep 2011 22:09:57 +0000 (00:09 +0200)]
Base: remove debugging code accidentially left in
Ralf Ertzinger [Sat, 3 Sep 2011 22:02:03 +0000 (00:02 +0200)]
videosite-dl: Add a connector callback which uses the http_proxy and https_proxy environment variables
Ralf Ertzinger [Sat, 3 Sep 2011 22:01:10 +0000 (00:01 +0200)]
GrabberBase; make use of new connector infrastructure
Ralf Ertzinger [Sat, 3 Sep 2011 21:58:07 +0000 (23:58 +0200)]
Base: Add support for connectors
A connector is basically a list of proxies to use for HTTP/HTTPS
connections.
Grabbers can request this list and try them in order until one
yields a result.
This is especially useful to work around silly YouTube videos, which
are not available in all countries.
Ralf Ertzinger [Sat, 3 Sep 2011 20:18:54 +0000 (22:18 +0200)]
videosite-dl: Add -d switch for debug messages
Ralf Ertzinger [Sat, 3 Sep 2011 20:18:17 +0000 (22:18 +0200)]
Base, YouTube: add a function to decode URL query strings and make the Youtube grabber use it
Ralf Ertzinger [Sat, 3 Sep 2011 19:44:14 +0000 (21:44 +0200)]
videosite-dl: Add -i command line option to print information instead of downloading
Ralf Ertzinger [Wed, 17 Aug 2011 20:57:48 +0000 (22:57 +0200)]
Youtube: specify video formats more clearly
Ralf Ertzinger [Tue, 9 Aug 2011 16:31:39 +0000 (18:31 +0200)]
YouTube: explicitly specify first pass decoding for _decode_url_encoded_fmt_stream_map
Ralf Ertzinger [Mon, 8 Aug 2011 20:16:23 +0000 (22:16 +0200)]
YouTube: Correctly parse url_encoded_fmt_stream_map from the web scape, too
Ralf Ertzinger [Wed, 3 Aug 2011 21:11:30 +0000 (23:11 +0200)]
Youtube: Add support for url_encoded_fmt_stream_map and use decode_hexurl()
Ralf Ertzinger [Wed, 3 Aug 2011 21:10:58 +0000 (23:10 +0200)]
Base: Add decode_hexurl function
Ralf Ertzinger [Sat, 23 Jul 2011 20:51:10 +0000 (22:51 +0200)]
CollegeHumor: Fix video URLs, and the title is in the XML now!
Ralf Ertzinger [Sat, 23 Jul 2011 20:34:19 +0000 (22:34 +0200)]
YouTube: fix some warnings
Ralf Ertzinger [Sat, 23 Jul 2011 20:33:50 +0000 (22:33 +0200)]
FileGetter: Use full blown HTTP::UserAgent to set the User-Agent
Ralf Ertzinger [Sat, 23 Jul 2011 19:32:03 +0000 (21:32 +0200)]
Base: fix the default output function
Ralf Ertzinger [Fri, 22 Jul 2011 06:33:07 +0000 (08:33 +0200)]
Youtube: Add video format 44 and 45 (also WebM)
Ralf Ertzinger [Fri, 22 Jul 2011 06:26:26 +0000 (08:26 +0200)]
Youtube: Add video format 43 (WebM)
Ralf Ertzinger [Sat, 18 Jun 2011 12:55:20 +0000 (14:55 +0200)]
Youtube: decode UTF8 video titles to the internal perl format
Ralf Ertzinger [Sun, 12 Jun 2011 17:44:50 +0000 (19:44 +0200)]
Base, YouTube: Do not use process persistent LWP::UserAgent objects, they accumulate cookies and stop working after a while
Ralf Ertzinger [Wed, 8 Jun 2011 18:39:24 +0000 (20:39 +0200)]
Base: Add module name to error and debug output
Ralf Ertzinger [Wed, 8 Jun 2011 18:21:17 +0000 (20:21 +0200)]
AsyncWgetFileGetter: Remove base64 encoding from command line debug
Ralf Ertzinger [Wed, 8 Jun 2011 06:27:22 +0000 (08:27 +0200)]
JSArrayParser: dispense with the fallback crap, just return a JSJSONArrayParser or die if that does not work
Ralf Ertzinger [Fri, 3 Jun 2011 09:26:09 +0000 (11:26 +0200)]
Youtube: factor out url selection routine
Ralf Ertzinger [Fri, 3 Jun 2011 09:20:19 +0000 (11:20 +0200)]
Youtube: Add a parser that uses /get_video_info, with a fallback to the old method
Ralf Ertzinger [Fri, 3 Jun 2011 09:18:47 +0000 (11:18 +0200)]
base: Initialize a LWP::UserAgent instance for subclasses to use
Ralf Ertzinger [Fri, 27 May 2011 07:40:08 +0000 (09:40 +0200)]
videosite: safely rewrite config file
Ralf Ertzinger [Fri, 27 May 2011 07:21:20 +0000 (09:21 +0200)]
Add HTTPJSONGetter
Ralf Ertzinger [Thu, 12 May 2011 21:39:08 +0000 (23:39 +0200)]
videosite: add goo.gl URL shortener
Ralf Ertzinger [Thu, 12 May 2011 18:57:54 +0000 (20:57 +0200)]
Revert "Wimp: adapt to new player"
This reverts commit
0437b1deb77761a06685eec5afe09f747e5cbe77.
Ralf Ertzinger [Thu, 12 May 2011 18:56:12 +0000 (20:56 +0200)]
Revert "Wimp: Use JSON parser to handle player args"
This reverts commit
717cceda344e9bebb0f0d000a4905bd755c3a1a2.
Ralf Ertzinger [Wed, 11 May 2011 20:01:53 +0000 (22:01 +0200)]
Youtube: extend support for /user/<username>#p/ URLs.
Ralf Ertzinger [Wed, 11 May 2011 19:58:51 +0000 (21:58 +0200)]
Youtube: Add simple live stream detection
Ralf Ertzinger [Mon, 9 May 2011 20:32:55 +0000 (22:32 +0200)]
JSJSONArrayParser: Allow single quotes (wimp, you are trying to annoy me, right?)
Ralf Ertzinger [Sun, 8 May 2011 11:29:17 +0000 (13:29 +0200)]
JSJSONArrayParser: Allow bareword keys
Ralf Ertzinger [Sun, 8 May 2011 11:28:47 +0000 (13:28 +0200)]
Wimp: Use JSON parser to handle player args
Ralf Ertzinger [Sun, 8 May 2011 11:13:40 +0000 (13:13 +0200)]
Wimp: adapt to new player
Ralf Ertzinger [Fri, 29 Apr 2011 17:58:47 +0000 (19:58 +0200)]
Youtube: extend support for /user/<username>#p/ URLs. Now without the /user!
Ralf Ertzinger [Wed, 27 Apr 2011 13:42:50 +0000 (15:42 +0200)]
Youtube: extend support for /user/<username>#p/ URLs
Ralf Ertzinger [Sat, 9 Apr 2011 20:20:58 +0000 (22:20 +0200)]
Youtube: add support for /user/<username>#p/ URLs
Ralf Ertzinger [Thu, 3 Mar 2011 18:56:12 +0000 (19:56 +0100)]
videosite: add 1.ly URL shortener
Ralf Ertzinger [Thu, 3 Mar 2011 08:35:17 +0000 (09:35 +0100)]
Youtube: Remove leftover debug statement
Ralf Ertzinger [Thu, 3 Mar 2011 08:34:37 +0000 (09:34 +0100)]
Youtube: Add support for the latest page redesign variant (PLAYER_CONFIG)
Ralf Ertzinger [Wed, 2 Mar 2011 17:44:00 +0000 (18:44 +0100)]
Youtube: add support for /watch_popup/ URLs
Ralf Ertzinger [Mon, 28 Feb 2011 17:36:27 +0000 (18:36 +0100)]
Youtube: Add new error condition detection
Ralf Ertzinger [Sun, 13 Feb 2011 22:04:47 +0000 (23:04 +0100)]
Merge branch 'master' of 10.200.0.3/GIT/videosite
Ralf Ertzinger [Sun, 13 Feb 2011 22:04:27 +0000 (23:04 +0100)]
Youtube: Support HTTPS URLs and use https to load site
Ralf Ertzinger [Sat, 29 Jan 2011 18:15:28 +0000 (19:15 +0100)]
Youtube: check for meta attribute existance before usage
Ralf Ertzinger [Thu, 30 Dec 2010 21:40:05 +0000 (22:40 +0100)]
Youtube: Add new link format (youtube.com/user/...)
Ralf Ertzinger [Thu, 2 Dec 2010 13:00:44 +0000 (14:00 +0100)]
videosite: add shar.es, 2.ly, t.co URL shorteners
Ralf Ertzinger [Wed, 1 Dec 2010 20:41:27 +0000 (21:41 +0100)]
JSJSONArrayParser: use more relaxed parsing
Ralf Ertzinger [Wed, 1 Dec 2010 20:30:40 +0000 (21:30 +0100)]
JSArrayParser: Add JSJSONArrayParser as new (and preferred) method to parse JSON
Ralf Ertzinger [Thu, 9 Sep 2010 16:36:11 +0000 (18:36 +0200)]
dailymotion: Add a more generic way of parsing the JSON structure
Ralf Ertzinger [Thu, 9 Sep 2010 16:34:17 +0000 (18:34 +0200)]
General: Expand JSLexArrayParser to recognize [, ] and # in strings, and add debugging
Ralf Ertzinger [Fri, 27 Aug 2010 19:15:55 +0000 (21:15 +0200)]
Youtube: Add new URL format youtu.be/watch?v=
Ralf Ertzinger [Wed, 25 Aug 2010 06:38:05 +0000 (08:38 +0200)]
Youtube: Enhance error check in the login process
Ralf Ertzinger [Tue, 10 Aug 2010 20:58:07 +0000 (22:58 +0200)]
main: Fix is.gd regexp
Ralf Ertzinger [Tue, 10 Aug 2010 12:03:12 +0000 (14:03 +0200)]
main: Add URL shortener post.ly
Ralf Ertzinger [Sun, 8 Aug 2010 13:25:56 +0000 (15:25 +0200)]
videosite.pl: Add pop.is URL shortener
git://git.camperquake.de / videosite.git / log