9908e03528
Merge pull request #4076 from ghedo/direct_type
...
[generic] indicate when a direct video has been extracted
2014-11-06 22:23:14 +01:00
37aab27808
[brightcove] Extract m3u8 formats ( #3541 )
2014-11-06 00:14:33 +02:00
bdf9701729
[generic/brightcove] Add a new test case for kijk.nl ( #3541 )
2014-11-03 23:13:46 +02:00
8c25f81bee
[util] Move compatibility functions out of util
...
utils is large enough without these compatibility functions.
Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
2014-11-02 11:23:42 +01:00
ccdd0ffb80
[generic] indicate when a direct video has been extracted
...
Fixes #4052 .
2014-11-01 15:34:00 +01:00
5263cdfcf9
[generic] Improve MLB iframe regex
2014-11-01 04:01:58 +07:00
ac645ac7d0
[generic] Allow soundcloud embeds with additional attributes
2014-10-29 20:27:58 +01:00
48a24ab746
[generic] Fix HTML5 video regexp
2014-10-28 10:41:24 +01:00
d6d9186f0d
[generic] Fix test title
2014-10-27 00:45:15 +01:00
37d66e7f1e
[generic] Correct call to _webpage_read_full_content
2014-10-26 20:58:09 +01:00
70b7e3fbb6
[generic] Add a test case for direct links with broken HEAD ( #4032 )
2014-10-26 20:49:51 +01:00
23be51d8ce
[generic] Handle audio streams that do not implement HEAD ( Fixes #4032 )
2014-10-26 17:05:44 +01:00
a7e97f6db1
[generic] Allow new SWFObject()-style imports
...
This embed style is used on http://www.bitburger-open.de/ , but that is not included as a test case since the format is likely to be temporary.
2014-10-26 14:15:49 +01:00
f2f2c0c2c6
[generic] Allow --default-search without colon
2014-10-23 21:13:45 +02:00
281d3f1d68
[generic/wistia] Improve regex
2014-10-23 23:03:07 +07:00
85d7b76586
[thoughtworks] wistia regex modified
2014-10-23 21:23:56 +05:30
52cffcb186
[thoughtworks] wistia support added
2014-10-23 20:28:39 +05:30
9471c44405
[generic] Make sure Wistia embed URLs contain the protocol ( Closes #3977 )
...
Also, improve detection (Addresses #3662 )
2014-10-18 01:55:21 +03:00
09a42738fc
[generic] Correct handling of embedded vimeo players ( #3955 )
2014-10-15 13:50:53 +02:00
1419fafd36
[condenast] Add support for embedded videos ( Closes #3929 )
2014-10-13 19:59:35 +07:00
ced659bb4d
[generic] Ignore some non-video file extensions during generic extraction ( Closes #3900 )
2014-10-09 19:26:23 +07:00
8489578df4
[generic] Support embedded Dailymotion playlists ( fixes #3822 )
2014-10-02 21:42:45 +03:00
07e764439a
[generic] Delete test case
...
The page is not available any more.
2014-10-01 00:08:19 +02:00
761e1645e0
[generic] Remove unstable test checksum
2014-09-29 05:18:45 +02:00
a8eb5a8e61
[generic] Fix testcases
2014-09-29 05:12:57 +02:00
d6e6a42256
[vimeo:likes] Add new extractor ( Fixes #3835 )
2014-09-28 12:14:16 +02:00
c6e90caaa6
Merge remote-tracking branch 'naglis/wistia'
2014-09-25 02:03:49 +02:00
6b08cdf626
[youtube] Support for embedded /p players ( Fixes #3821 )
2014-09-25 01:59:02 +02:00
3b2f933b01
[generic] Allow embedded YoutubePlaylists ( Fixes #3821 )
2014-09-24 11:05:14 +02:00
746c67d72f
[wistia] Use API and make more generic
2014-09-20 03:02:11 +03:00
a04aa7a9e6
[generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes ( fixes #3770 )
...
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/ .
2014-09-16 22:53:48 +02:00
1bf5423e82
[generic/youtube] Recognize youtube nocookie embeds ( Closes #3713 )
2014-09-10 18:29:20 +07:00
1a94ff6865
[mlb] Add support for embedded videos ( Closes #3653 )
2014-09-02 20:19:28 +07:00
b759a0d4d2
fix up imports
2014-08-28 01:00:59 +02:00
22a6f15061
Move playlist tests to extractors.
...
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
2014-08-28 00:58:24 +02:00
aff216edf4
[generic] Prevent <video> search from skipping over empty sources ( #3546 )
2014-08-27 02:09:59 +02:00
1cb6dcdbbe
[generic] Do not download images as videos by accident
2014-08-27 02:07:11 +02:00
f971dcbba0
Merge branch 'master' of github.com:rg3/youtube-dl
2014-08-25 18:36:42 +02:00
0990305d2a
[generic] Fix rss under Python 2.x and move test to extractor
2014-08-25 18:03:01 +02:00
bcc069a937
[generic] Remove debug statement
2014-08-25 17:21:58 +02:00
5f90042bd6
[generic] remove unused imports
2014-08-24 14:28:58 +02:00
ebab4520ff
[generic] Use default opener for HEAD request ( Fixes #3528 )
2014-08-24 06:58:11 +02:00
4d805e063c
[generic] Automatic detection of flow player and age_limit ( Fixes #3576 )
2014-08-24 05:31:32 +02:00
4d54ef20a2
[ministrygrid] Add extractor ( Fixes #2900 )
2014-08-24 04:47:28 +02:00
1f8b6af773
[bip.tv] Allow underscore in lookup ids ( Fixes #3573 )
2014-08-24 03:20:31 +02:00
10eaeb20c5
[generic] Require og:video URLs to contain a dot
2014-08-24 02:29:56 +02:00
fa8deaf38b
[generic] Prevent from downloading a .swf as a video
...
We're seeing quite a number of people who do not put a video file in the og:video field, but the player URL. Try to detect some of these and filter them out.
2014-08-24 02:24:49 +02:00
c8e9a235d9
[generic] Add support for camtasia videos ( Fixes #3574 )
2014-08-24 02:02:17 +02:00
2ef6fcb5d8
[sbs] Add new extractor ( Fixes #3566 )
2014-08-23 15:20:56 +02:00
ed2d6a1960
[generic] Simplify playlist support ( #2948 )
2014-08-22 18:19:56 +02:00
c71dfccc98
Merge remote-tracking branch 'anovicecodemonkey/generic-data-video-url'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-08-22 17:40:36 +02:00
49807b4ac6
[yahoo] Add support for embedded videos ( Closes #3525 )
2014-08-16 13:56:22 +07:00
1f7ccb9014
[generic] Add --default-search fixup_error
...
This restores the ability to enter URLs without a scheme (and default to http), but still fail if the input is a search term.
2014-07-29 17:17:46 +02:00
eef4a7a304
Fix typo: “ytseach” → “ytsearch”
2014-07-20 18:37:44 -06:00
7571c02c8a
[generic] Set default-search to error
...
This prevents users from submitting bug reports where they mistyped a URL, and prevents me from getting a weird video when holding shift and thus searching for :Tds
2014-07-06 11:22:44 +02:00
0364fa8b65
[generic] Add support for ivi.ru embedded player
2014-06-29 20:18:23 +07:00
c5cd249e41
[generic] Extract mtvservices embedded videos
2014-06-22 21:39:36 +02:00
826ec77fb2
[Vulture] Add support for vulture.com
2014-06-09 23:06:39 +02:00
2b88feedf7
[generic] Add support for <embed YouTube
2014-06-09 22:06:45 +02:00
37e3cbe22e
Move duplicate check to generic.py
2014-06-01 01:16:35 +09:30
610134730a
Add a _TEST_
2014-05-21 19:25:37 +09:30
0e67ab0d8e
[generic] Abort if user passes in URL "url" ( #2942 )
2014-05-19 17:10:11 +02:00
3442b30ab2
[generic] Support data-video-url for YouTube embeds ( Fixes #2862 )
2014-05-18 23:15:09 +09:30
8dfa187b8a
[generic] Support pagespeed_iframe for NovaMov embeds
2014-05-17 18:12:12 +07:00
a5a45015ba
[generic] Fix redirect
2014-05-16 20:32:53 +07:00
2099125333
[soundcloud/generic] Add support for playlists
2014-05-05 03:15:17 +02:00
669f0e7cda
[generic] Fix wrong entries index
2014-05-01 16:28:37 +07:00
b30b8698ea
[generic] Allow multiple matches for generic hits ( Fixes #2818 )
2014-04-30 02:23:51 +02:00
ebd3c7b370
[generic] Add support for protocol-independent URLs ( Fixes #2810 )
2014-04-30 01:46:06 +02:00
c0292e8ab7
[generic] Improve jwplayer detection ( Fixes #2731 )
2014-04-21 16:16:53 +02:00
48099643cc
[generic] Be more relaxed when looking for aparat embeds ( Fixes #2784 )
2014-04-21 12:37:41 +02:00
fa35cdad02
[condenast|generic] Add support for condenast embeds ( Fixes #2783 )
2014-04-21 05:47:52 +02:00
fd50bf623c
[generic] Modernize tests
2014-04-14 18:56:29 +07:00
d360a14678
[generic] Update test
2014-04-14 18:51:46 +07:00
15c0e8e7b2
[generic] Generalize novamov based embeds
2014-04-05 17:20:05 +07:00
7cd3bc5f99
[nowvideo] Support more domains
2014-04-05 16:38:57 +07:00
50f566076f
[generic] Add support for videoweed embeds
2014-04-05 15:49:45 +07:00
ca6aada48e
Fix _TEST for Ustream embed URLs
2014-04-05 03:26:29 +10:30
5c38625259
[UstreamIE] [generic] Added support for Ustream embed URLs ( Fixes #2694 )
2014-04-05 00:53:09 +10:30
9ad400f75e
[generic] Remove test case that has become a 404
2014-04-04 01:47:17 +02:00
0479c625a4
[brightcove] Encode object_str with utf-8
2014-04-01 20:17:35 +07:00
9c1fc022ae
[generic] Warn before fallback to automatic search
2014-03-30 15:57:35 +02:00
cb3ac1c610
[smotri] Modernize and add support for emdebbed videos ( Closes #2585 )
2014-03-28 19:58:49 +07:00
893f8832b5
[arte] Add support for embedded videos ( Fixes #2620 )
2014-03-24 22:01:47 +01:00
7e2ede9891
[generic] Run TED detection before JW Player detection
...
Otherwise it overwrittes the `mobj` variable.
2014-03-22 10:20:44 +01:00
0f2a2ba14b
Merge remote-tracking branch 'dstftw/generic-webpage-unescape'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-21 22:14:24 +01:00
750f9020ae
[generic] Recognize more Ooyala embedded videos ( #2569 )
2014-03-21 21:51:33 +01:00
aab74fa106
[ted] Simplify embed code ( #2587 )
2014-03-20 16:33:23 +01:00
8d7c0cca13
[generic] Add support for embeded TED videos
2014-03-20 00:56:32 +10:30
ecbe1ad207
[generic] Fix access to removed function in python 3.4
...
The `Request.get_origin_req_host` method was deprecated in 3.3, use the
`origin_req_host` property if it's not available, see http://docs.python.org/3.3/library/urllib.request.html#urllib.request.Request.get_origin_req_host .
2014-03-17 21:59:21 +01:00
93d020dd65
[generic] Add support for embedded rutv player
2014-03-17 02:00:31 +07:00
15fd51b37c
[generic] More generic support for embedded vimeo player ( #1602 )
2014-03-16 00:47:04 +07:00
d95e35d659
[generic] Add nowvideo test hidden behind percent encoding
2014-03-15 04:39:53 +07:00
1439073049
[generic] Add comment for unescaping webpage contents
2014-03-15 04:38:49 +07:00
1f7659dbe9
[generic] Unescape webpage contents
2014-03-15 04:21:17 +07:00
60cc4dc4b4
[generic/funnyordie] Add support for funnyordie embeds ( Fixes #2546 )
2014-03-11 16:51:36 +01:00
bcf89ce62c
[generic] Suppress warning about doctypes in RSS parser
2014-03-10 17:31:32 +01:00
0a5bce566f
[generic] Add all test attributes for embedly ( #2447 )
...
In the future, we may want to not only print something, but throw an error for untested properties.
2014-03-05 14:05:50 +01:00
8012bd2424
[generic] Get a better ID
2014-03-05 14:02:14 +01:00
f55a1f0a88
Merge remote-tracking branch 'rzhxeo/embedly'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-05 14:01:53 +01:00
ca97a56e4b
[vk] Add support for embedded videos ( Closes #2473 )
2014-02-28 23:51:54 +07:00
1b86cc41cf
Add support for embed.ly
2014-02-27 08:14:28 +01:00
89ef304bed
[generic] Add support for <meta redirect>
...
Fixes #413
2014-02-27 07:22:02 +01:00
b1c6c32f78
[generic] Add support for nowvideo embedded videos
2014-02-24 23:37:42 +07:00
f7300c5c90
[generic] Fix on python 2.6
...
`ParseError` is not available, it raises `xml.parsers.expat.ExpatError`.
The webpage needs to be encoded.
2014-02-21 16:59:10 +01:00
4fc946b546
[generic] Add support for RSS feeds ( Fixes #667 )
2014-02-20 13:14:09 +01:00
99877772d0
[generic] Add support for multiple brightcove URLs ( Fixes #2283 )
2014-02-03 15:19:40 +01:00
ab083b08ab
[generic] remove testcase
...
The video seems to have been removed from the site.
2014-01-30 06:10:57 +01:00
9f8928d032
[generic] Match JWPlayerOptions
...
This adds support for The Guardian, among others
Closes #2271 , fixes #2267
2014-01-30 05:29:10 +01:00
c3f51436bf
Improve some regexes for embedded players
2014-01-30 04:26:46 +07:00
17ab4d3b5e
[brightcove] Move test to generic
2014-01-28 03:35:32 +01:00
db1f388878
[huffpost] Add support
2014-01-27 05:47:38 +01:00
04b4d394d9
Add new --default-search option ( #2193 )
2014-01-22 14:16:43 +01:00
9834872bf6
[facebook] Add support for embeds
...
Example URL: http://www.hostblogger.de/blog/archives/6181-Auto-jagt-Betonmischer.html
2014-01-21 18:10:17 +01:00
3486df383b
[generic] Improve testcase
2014-01-21 01:40:34 +01:00
2f21eb2db6
[generic] Do not fetch XML URLs ( Fixes #2162 )
2014-01-17 02:13:00 +01:00
3fabeaa1f4
[vimeo] Support protocol-relative URLs
2014-01-08 22:42:52 +01:00
5f59ee7942
[novamov] Remove superfluous tabs
2014-01-08 08:11:46 +07:00
8f89e68781
[novamov] Add embedded player support
2014-01-08 08:09:13 +07:00
42e4fcf23a
[generic] Fix regexes
2014-01-07 11:04:27 +01:00
c93c2ab1c3
[mpora] Add support ( Fixes #2096 )
2014-01-07 08:07:46 +01:00
79f8295303
Use original Referer URL in Brightcove requests ( Fixes #2110 )
2014-01-07 05:34:14 +01:00
796495886e
[generic] Use unicode_literals instead of duplicating the u'
2014-01-06 01:47:52 +01:00
fc9713a1d2
[youtube] Support jwplayer with YouTube URLs ( Closes #2075 )
2014-01-06 01:42:58 +01:00
d981cef6b9
[generic] Support gorillavid.in
...
Previously, we were a little bit over-eager and got a random swf file.
Fixes #2084 .
2014-01-05 05:34:08 +01:00
aff24732b9
Merge remote-tracking branch 'rzhxeo/blip'
...
Conflicts:
youtube_dl/extractor/bliptv.py
2014-01-05 03:48:45 +01:00
19dab5e6cc
[GenericIE] Outsource embedded blip.tv player video id extraction to BlipTVIE and fix minor errors in RegEx
2013-12-30 06:15:02 +01:00
c1d1facd06
[generic] Output something before making network requests
2013-12-27 08:38:42 +01:00
7115ca84aa
[vimeo/generic] Add support for embedded SWF vimeo videos
2013-12-22 03:34:13 +01:00
aa94a6d315
[aparat] Add support ( Fixes #2012 )
2013-12-20 17:05:39 +01:00
1f9da9049b
[generic] Support YouTube swf embed ( Fixes #2010 )
2013-12-19 20:44:30 +01:00
c0d0b01f0e
[generic] Detect ooyala videos ( fixes #2013 )
2013-12-19 20:32:12 +01:00
3e78514568
[generic] Support application/ogg for direct links
...
Also remove some debugging code.
2013-12-17 16:26:34 +01:00
42393ce234
Add support for direct links to a video ( #1973 )
2013-12-17 12:33:55 +01:00
cecaaf3f58
[generic] Do not use compatibility result fallback
2013-12-17 12:04:33 +01:00
f25571ffbf
Add support for embedded vevo player ( Fixes #1957 )
2013-12-16 21:45:21 +01:00
ee3e63e477
[GenericIE] Add support for embedded blip.tv
2013-12-16 20:08:23 +01:00
ef4fd84857
[wistia] Add extractor
2013-12-06 09:15:04 +01:00
355e4fd07e
[generic] Find embedded dailymotion videos ( Fixes #1848 )
2013-12-01 01:21:33 +01:00
113577e155
[generic] Improve detection
...
Allow download of http://goo.gl/7X5tOk
Fixes #1818
2013-11-25 03:35:53 +01:00
0980426559
[bandcamp] add support for albums (reported in #1270 )
2013-11-22 16:05:14 +01:00
887c6acdf2
Support multiple embedded YouTube URLs ( Fixes #1787 )
2013-11-18 13:28:26 +01:00
dd5bcdc4c9
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter ( fixes #1553 )
2013-11-07 21:06:48 +01:00
eeb165e674
[brightcove] Add the extraction of the url from generic
2013-11-06 16:58:03 +01:00
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
2013-11-06 16:43:26 +01:00
2dcf7d8f99
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
2013-11-05 02:08:02 +01:00
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
2013-10-27 14:40:25 +01:00
aa929c37d5
[generic] Fix test video's checksum
2013-10-27 14:21:37 +01:00
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
2013-10-18 11:44:57 +02:00
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
2013-10-15 12:05:13 +02:00
3283533149
Fix Brightcove detection when another Flash object is on the page
...
The regex used non-greedy match, but alas it failed on input like this:
<object class="...> ... class="BrightcoveExperience"
It captured two objects and the intervening HTML. This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.
Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
2013-10-11 21:52:33 -04:00
e484c81f0c
[generic] Clarify error messages
2013-10-06 16:03:18 +02:00
592882aa9f
[brightcove] Support videos that only provide flv versions ( fixes #1504 )
...
Moved the test from generic.py to brightcove.py
2013-09-26 13:54:31 +02:00
a7130543fa
[generic] If the url doesn't specify the protocol, then try to extract prepending 'http://'
2013-09-06 18:39:35 +02:00
08e291b54d
[generic] Recognize html5 video in the format '<video src=".+?"' and only unquote the url when extracting the id ( fixes #1372 )
2013-09-05 18:02:17 +02:00
a5caba1eb0
[generic] simply use urljoin
2013-08-28 12:47:27 +02:00
ae3531adf9
[generic] Fix URL concatenation
...
When the url is something like http://example.org/foo/bar?x=y and the added is file/video.mp4 , we want http://example.org/foo/file/video.mp4
Fixes #1268 .
2013-08-28 12:08:17 +02:00
627a91a9a8
[generic] small typo
2013-08-26 21:29:31 +02:00
9585f890f8
[generic] add support for relative URLs ( Fixes #1308 )
2013-08-24 22:56:37 +02:00
0838239e8e
[generic] Support double slash URLs ( Fixes #1309 )
2013-08-24 22:52:45 +02:00
7fea7156cb
[generic] support HTML5 video
2013-08-21 04:32:22 +02:00
3093468977
[generic] Ignore stupid HTTP servers ( #1284 )
2013-08-21 04:32:07 +02:00
232eb88bfe
GenericIE: allow to match declaration of the Brightocove parameters that use ' instead of "
2013-07-12 14:52:01 +02:00
117adb0f0f
GenericIE: detect more Brightcove videos
...
In some sites "class" contains more that BrightcoveExperience
2013-07-11 00:25:38 +02:00
cfe50f04ed
GenericIE: Detect videos from Brightcove
...
Brightcove videos info is usually found in an <object class="BrightcoveExperience"></object> node, this is passed to a new method of BrightcoveIE that builds a url to extract the video.
2013-07-10 17:49:11 +02:00
5c44c15438
GenericIE: match titles that spread across multiple lines (related #904 )
2013-07-01 20:50:50 +02:00
0f81866329
Add --list-extractor-descriptions (human-readable list of IEs)
2013-07-01 18:52:19 +02:00
4269e78a80
Merge branch 'master' of github.com:rg3/youtube-dl
2013-06-27 20:47:03 +02:00
6f5ac90cf3
Move tests to the IE definitions
2013-06-27 20:46:46 +02:00
27473d18da
Made 'video' the default title for generic IE
2013-06-27 19:18:15 +01:00
52c8ade4ad
Made generic IE handle more cases
...
Added a possible quote after file, so it can now handle cases like:
'file': 'http://www.a.com/b.mp4 '
2013-06-27 19:16:09 +01:00
9b122384e9
Move GenericIE into its own file
2013-06-23 20:31:45 +02:00
Jaime Marquínez Ferrándiz
Naglis Jonaitis
Philipp Hagemeister
Alessandro Ghedini
Sergey M․
dinesh
Jaime Marquínez Ferrándiz
Anthony J. Bentley
anovicecodemonkey
rzhxeo
Joey Adams
Albert Kim