Ralf Ertzinger [Sat, 11 Feb 2012 14:37:41 +0000 (15:37 +0100)]
Base: Add simple_get() function
Ralf Ertzinger [Fri, 10 Feb 2012 22:45:23 +0000 (23:45 +0100)]
Wimp: Obfuscating download URLs? Nasty.
Ralf Ertzinger [Wed, 7 Dec 2011 19:45:43 +0000 (20:45 +0100)]
videosite: add a general scheme for immutable connectors
Ralf Ertzinger [Wed, 7 Dec 2011 19:42:20 +0000 (20:42 +0100)]
Youtube: Add video format info to metadata
Ralf Ertzinger [Thu, 17 Nov 2011 09:44:11 +0000 (10:44 +0100)]
Youtube: Add/annotate more video formats
Ralf Ertzinger [Thu, 10 Nov 2011 08:12:16 +0000 (09:12 +0100)]
Merge branch 'master' of 10.200.0.3/GIT/videosite
Ralf Ertzinger [Thu, 10 Nov 2011 08:11:55 +0000 (09:11 +0100)]
Youtube: new video formats, again
Christian Garbs [Tue, 18 Oct 2011 18:46:00 +0000 (20:46 +0200)]
go green
restore the environment after polluting it with _proxy variables
Christian Garbs [Wed, 7 Sep 2011 16:23:09 +0000 (18:23 +0200)]
add connector support to AsyncFileGetter
Ralf Ertzinger [Fri, 14 Oct 2011 07:10:21 +0000 (09:10 +0200)]
Youtube: new video formats, again
Ralf Ertzinger [Tue, 13 Sep 2011 21:52:23 +0000 (23:52 +0200)]
Youtube: new video formats, again
Ralf Ertzinger [Wed, 7 Sep 2011 16:22:47 +0000 (18:22 +0200)]
videosite: add connector to main help
Ralf Ertzinger [Wed, 7 Sep 2011 16:21:02 +0000 (18:21 +0200)]
videosite: print help if no connector subcommand given, lowercase connector names for select
Ralf Ertzinger [Sun, 4 Sep 2011 13:07:39 +0000 (15:07 +0200)]
FileGetter: Add support for connectors from metadata
Ralf Ertzinger [Sun, 4 Sep 2011 13:06:27 +0000 (15:06 +0200)]
videosite: add connectors support
- add new subcommand '/videosite connector' to manage connectors
Ralf Ertzinger [Sat, 3 Sep 2011 23:31:01 +0000 (01:31 +0200)]
Base, GrabberBase: change hash keys for connectors
Ralf Ertzinger [Sat, 3 Sep 2011 23:15:51 +0000 (01:15 +0200)]
Merge branch 'master' of 10.200.0.3/GIT/videosite
Ralf Ertzinger [Sat, 3 Sep 2011 23:15:48 +0000 (01:15 +0200)]
YouTube: Add comment to format list
Ralf Ertzinger [Sat, 3 Sep 2011 22:10:42 +0000 (00:10 +0200)]
YouTube: add config variable to disable use of HTTPS URLs (where possible)
Ralf Ertzinger [Sat, 3 Sep 2011 22:09:57 +0000 (00:09 +0200)]
Base: remove debugging code accidentially left in
Ralf Ertzinger [Sat, 3 Sep 2011 22:02:03 +0000 (00:02 +0200)]
videosite-dl: Add a connector callback which uses the http_proxy and https_proxy environment variables
Ralf Ertzinger [Sat, 3 Sep 2011 22:01:10 +0000 (00:01 +0200)]
GrabberBase; make use of new connector infrastructure
Ralf Ertzinger [Sat, 3 Sep 2011 21:58:07 +0000 (23:58 +0200)]
Base: Add support for connectors
A connector is basically a list of proxies to use for HTTP/HTTPS
connections.
Grabbers can request this list and try them in order until one
yields a result.
This is especially useful to work around silly YouTube videos, which
are not available in all countries.
Ralf Ertzinger [Sat, 3 Sep 2011 20:18:54 +0000 (22:18 +0200)]
videosite-dl: Add -d switch for debug messages
Ralf Ertzinger [Sat, 3 Sep 2011 20:18:17 +0000 (22:18 +0200)]
Base, YouTube: add a function to decode URL query strings and make the Youtube grabber use it
Ralf Ertzinger [Sat, 3 Sep 2011 19:44:14 +0000 (21:44 +0200)]
videosite-dl: Add -i command line option to print information instead of downloading
Ralf Ertzinger [Wed, 17 Aug 2011 20:57:48 +0000 (22:57 +0200)]
Youtube: specify video formats more clearly
Ralf Ertzinger [Tue, 9 Aug 2011 16:31:39 +0000 (18:31 +0200)]
YouTube: explicitly specify first pass decoding for _decode_url_encoded_fmt_stream_map
Ralf Ertzinger [Mon, 8 Aug 2011 20:16:23 +0000 (22:16 +0200)]
YouTube: Correctly parse url_encoded_fmt_stream_map from the web scape, too
Ralf Ertzinger [Wed, 3 Aug 2011 21:11:30 +0000 (23:11 +0200)]
Youtube: Add support for url_encoded_fmt_stream_map and use decode_hexurl()
Ralf Ertzinger [Wed, 3 Aug 2011 21:10:58 +0000 (23:10 +0200)]
Base: Add decode_hexurl function
Ralf Ertzinger [Sat, 23 Jul 2011 20:51:10 +0000 (22:51 +0200)]
CollegeHumor: Fix video URLs, and the title is in the XML now!
Ralf Ertzinger [Sat, 23 Jul 2011 20:34:19 +0000 (22:34 +0200)]
YouTube: fix some warnings
Ralf Ertzinger [Sat, 23 Jul 2011 20:33:50 +0000 (22:33 +0200)]
FileGetter: Use full blown HTTP::UserAgent to set the User-Agent
Ralf Ertzinger [Sat, 23 Jul 2011 19:32:03 +0000 (21:32 +0200)]
Base: fix the default output function
Ralf Ertzinger [Fri, 22 Jul 2011 06:33:07 +0000 (08:33 +0200)]
Youtube: Add video format 44 and 45 (also WebM)
Ralf Ertzinger [Fri, 22 Jul 2011 06:26:26 +0000 (08:26 +0200)]
Youtube: Add video format 43 (WebM)
Ralf Ertzinger [Sat, 18 Jun 2011 12:55:20 +0000 (14:55 +0200)]
Youtube: decode UTF8 video titles to the internal perl format
Ralf Ertzinger [Sun, 12 Jun 2011 17:44:50 +0000 (19:44 +0200)]
Base, YouTube: Do not use process persistent LWP::UserAgent objects, they accumulate cookies and stop working after a while
Ralf Ertzinger [Wed, 8 Jun 2011 18:39:24 +0000 (20:39 +0200)]
Base: Add module name to error and debug output
Ralf Ertzinger [Wed, 8 Jun 2011 18:21:17 +0000 (20:21 +0200)]
AsyncWgetFileGetter: Remove base64 encoding from command line debug
Ralf Ertzinger [Wed, 8 Jun 2011 06:27:22 +0000 (08:27 +0200)]
JSArrayParser: dispense with the fallback crap, just return a JSJSONArrayParser or die if that does not work
Ralf Ertzinger [Fri, 3 Jun 2011 09:26:09 +0000 (11:26 +0200)]
Youtube: factor out url selection routine
Ralf Ertzinger [Fri, 3 Jun 2011 09:20:19 +0000 (11:20 +0200)]
Youtube: Add a parser that uses /get_video_info, with a fallback to the old method
Ralf Ertzinger [Fri, 3 Jun 2011 09:18:47 +0000 (11:18 +0200)]
base: Initialize a LWP::UserAgent instance for subclasses to use
Ralf Ertzinger [Fri, 27 May 2011 07:40:08 +0000 (09:40 +0200)]
videosite: safely rewrite config file
Ralf Ertzinger [Fri, 27 May 2011 07:21:20 +0000 (09:21 +0200)]
Add HTTPJSONGetter
Ralf Ertzinger [Thu, 12 May 2011 21:39:08 +0000 (23:39 +0200)]
videosite: add goo.gl URL shortener
Ralf Ertzinger [Thu, 12 May 2011 18:57:54 +0000 (20:57 +0200)]
Revert "Wimp: adapt to new player"
This reverts commit
0437b1deb77761a06685eec5afe09f747e5cbe77.
Ralf Ertzinger [Thu, 12 May 2011 18:56:12 +0000 (20:56 +0200)]
Revert "Wimp: Use JSON parser to handle player args"
This reverts commit
717cceda344e9bebb0f0d000a4905bd755c3a1a2.
Ralf Ertzinger [Wed, 11 May 2011 20:01:53 +0000 (22:01 +0200)]
Youtube: extend support for /user/<username>#p/ URLs.
Ralf Ertzinger [Wed, 11 May 2011 19:58:51 +0000 (21:58 +0200)]
Youtube: Add simple live stream detection
Ralf Ertzinger [Mon, 9 May 2011 20:32:55 +0000 (22:32 +0200)]
JSJSONArrayParser: Allow single quotes (wimp, you are trying to annoy me, right?)
Ralf Ertzinger [Sun, 8 May 2011 11:29:17 +0000 (13:29 +0200)]
JSJSONArrayParser: Allow bareword keys
Ralf Ertzinger [Sun, 8 May 2011 11:28:47 +0000 (13:28 +0200)]
Wimp: Use JSON parser to handle player args
Ralf Ertzinger [Sun, 8 May 2011 11:13:40 +0000 (13:13 +0200)]
Wimp: adapt to new player
Ralf Ertzinger [Fri, 29 Apr 2011 17:58:47 +0000 (19:58 +0200)]
Youtube: extend support for /user/<username>#p/ URLs. Now without the /user!
Ralf Ertzinger [Wed, 27 Apr 2011 13:42:50 +0000 (15:42 +0200)]
Youtube: extend support for /user/<username>#p/ URLs
Ralf Ertzinger [Sat, 9 Apr 2011 20:20:58 +0000 (22:20 +0200)]
Youtube: add support for /user/<username>#p/ URLs
Ralf Ertzinger [Thu, 3 Mar 2011 18:56:12 +0000 (19:56 +0100)]
videosite: add 1.ly URL shortener
Ralf Ertzinger [Thu, 3 Mar 2011 08:35:17 +0000 (09:35 +0100)]
Youtube: Remove leftover debug statement
Ralf Ertzinger [Thu, 3 Mar 2011 08:34:37 +0000 (09:34 +0100)]
Youtube: Add support for the latest page redesign variant (PLAYER_CONFIG)
Ralf Ertzinger [Wed, 2 Mar 2011 17:44:00 +0000 (18:44 +0100)]
Youtube: add support for /watch_popup/ URLs
Ralf Ertzinger [Mon, 28 Feb 2011 17:36:27 +0000 (18:36 +0100)]
Youtube: Add new error condition detection
Ralf Ertzinger [Sun, 13 Feb 2011 22:04:47 +0000 (23:04 +0100)]
Merge branch 'master' of 10.200.0.3/GIT/videosite
Ralf Ertzinger [Sun, 13 Feb 2011 22:04:27 +0000 (23:04 +0100)]
Youtube: Support HTTPS URLs and use https to load site
Ralf Ertzinger [Sat, 29 Jan 2011 18:15:28 +0000 (19:15 +0100)]
Youtube: check for meta attribute existance before usage
Ralf Ertzinger [Thu, 30 Dec 2010 21:40:05 +0000 (22:40 +0100)]
Youtube: Add new link format (youtube.com/user/...)
Ralf Ertzinger [Thu, 2 Dec 2010 13:00:44 +0000 (14:00 +0100)]
videosite: add shar.es, 2.ly, t.co URL shorteners
Ralf Ertzinger [Wed, 1 Dec 2010 20:41:27 +0000 (21:41 +0100)]
JSJSONArrayParser: use more relaxed parsing
Ralf Ertzinger [Wed, 1 Dec 2010 20:30:40 +0000 (21:30 +0100)]
JSArrayParser: Add JSJSONArrayParser as new (and preferred) method to parse JSON
Ralf Ertzinger [Thu, 9 Sep 2010 16:36:11 +0000 (18:36 +0200)]
dailymotion: Add a more generic way of parsing the JSON structure
Ralf Ertzinger [Thu, 9 Sep 2010 16:34:17 +0000 (18:34 +0200)]
General: Expand JSLexArrayParser to recognize [, ] and # in strings, and add debugging
Ralf Ertzinger [Fri, 27 Aug 2010 19:15:55 +0000 (21:15 +0200)]
Youtube: Add new URL format youtu.be/watch?v=
Ralf Ertzinger [Wed, 25 Aug 2010 06:38:05 +0000 (08:38 +0200)]
Youtube: Enhance error check in the login process
Ralf Ertzinger [Tue, 10 Aug 2010 20:58:07 +0000 (22:58 +0200)]
main: Fix is.gd regexp
Ralf Ertzinger [Tue, 10 Aug 2010 12:03:12 +0000 (14:03 +0200)]
main: Add URL shortener post.ly
Ralf Ertzinger [Sun, 8 Aug 2010 13:25:56 +0000 (15:25 +0200)]
videosite.pl: Add pop.is URL shortener
Ralf Ertzinger [Fri, 6 Aug 2010 15:02:31 +0000 (17:02 +0200)]
videosite.pl: Add is.gd URL shortener, cancel URL shortener replacement after 10 loops
Ralf Ertzinger [Sun, 1 Aug 2010 20:18:08 +0000 (22:18 +0200)]
main: Add URL shortener otf.me
Ralf Ertzinger [Thu, 29 Jul 2010 14:32:16 +0000 (16:32 +0200)]
main: Add URL shorteners hel.me, 7ax.de and ow.ly
Ralf Ertzinger [Mon, 19 Jul 2010 20:59:58 +0000 (22:59 +0200)]
Vimeo: switch to LWP::UserAgent
Ralf Ertzinger [Wed, 14 Jul 2010 07:35:42 +0000 (09:35 +0200)]
General: Use just the first level of redirection for URL shortening serivces
Ralf Ertzinger [Mon, 12 Jul 2010 14:01:19 +0000 (16:01 +0200)]
General: Add support for URL shortening services:
- bit.ly
- j.mp
- tinyurl.com
Ralf Ertzinger [Mon, 12 Jul 2010 13:12:34 +0000 (15:12 +0200)]
General: short circuit out of the URL loop if there is only whitespace left
Ralf Ertzinger [Mon, 12 Jul 2010 13:01:52 +0000 (15:01 +0200)]
General: Fix debug/error printing for modules (no more rainbow debug)
Ralf Ertzinger [Mon, 12 Jul 2010 13:01:06 +0000 (15:01 +0200)]
YouTube: Clean up video format printing code
Ralf Ertzinger [Sat, 10 Jul 2010 18:11:13 +0000 (20:11 +0200)]
Merge branch 'master' of 10.200.0.3/GIT/videosite
Ralf Ertzinger [Sat, 10 Jul 2010 18:10:55 +0000 (20:10 +0200)]
Youtube: Add support for 4k video format
- Add support for video type 38 (4k)
- Add quality level "insane", which prefers this format
Christian Garbs [Wed, 2 Jun 2010 21:01:27 +0000 (23:01 +0200)]
AsyncWgetFileGetter: create files with wallclock timestamp
otherwise newest downloads can't be retrieved via `ls -lrt`
Maximilian Rehkopf [Mon, 31 May 2010 19:14:34 +0000 (21:14 +0200)]
Add support for new Youtube login
Ralf Ertzinger [Sat, 17 Apr 2010 16:22:01 +0000 (18:22 +0200)]
Fix DailyMotionGrabber, it now needs a JSON parser
Ralf Ertzinger [Sat, 17 Apr 2010 16:21:10 +0000 (18:21 +0200)]
Add a new JSON parser, replacing jsarray. This parser
can do all jsarray could, and much more.
Ralf Ertzinger [Sat, 17 Apr 2010 16:17:27 +0000 (18:17 +0200)]
Select better names for YouTube page types
Ralf Ertzinger [Sat, 17 Apr 2010 16:16:37 +0000 (18:16 +0200)]
Add some more status messages
Ralf Ertzinger [Fri, 19 Mar 2010 20:50:40 +0000 (21:50 +0100)]
Add support for the new YouTube page layout
Ralf Ertzinger [Mon, 8 Mar 2010 10:25:05 +0000 (11:25 +0100)]
Add a new youtube URL format
Youtube, could you pretty please stop inventing new ways to reference your
videos every two days? Thank you.
Ralf Ertzinger [Fri, 5 Mar 2010 13:51:38 +0000 (14:51 +0100)]
Add a new youtube URL format
Ralf Ertzinger [Thu, 11 Feb 2010 20:43:43 +0000 (21:43 +0100)]
- Fix MyVideo grabber
Christian Garbs [Mon, 8 Feb 2010 20:54:11 +0000 (21:54 +0100)]
add youtu.be short links
also fix dot detection in regexp