48a24ab746
[generic] Fix HTML5 video regexp
2014-10-28 10:41:24 +01:00
d6d9186f0d
[generic] Fix test title
2014-10-27 00:45:15 +01:00
37d66e7f1e
[generic] Correct call to _webpage_read_full_content
2014-10-26 20:58:09 +01:00
70b7e3fbb6
[generic] Add a test case for direct links with broken HEAD ( #4032 )
2014-10-26 20:49:51 +01:00
23be51d8ce
[generic] Handle audio streams that do not implement HEAD ( Fixes #4032 )
2014-10-26 17:05:44 +01:00
a7e97f6db1
[generic] Allow new SWFObject()-style imports
...
This embed style is used on http://www.bitburger-open.de/ , but that is not included as a test case since the format is likely to be temporary.
2014-10-26 14:15:49 +01:00
f2f2c0c2c6
[generic] Allow --default-search without colon
2014-10-23 21:13:45 +02:00
281d3f1d68
[generic/wistia] Improve regex
2014-10-23 23:03:07 +07:00
85d7b76586
[thoughtworks] wistia regex modified
2014-10-23 21:23:56 +05:30
52cffcb186
[thoughtworks] wistia support added
2014-10-23 20:28:39 +05:30
9471c44405
[generic] Make sure Wistia embed URLs contain the protocol ( Closes #3977 )
...
Also, improve detection (Addresses #3662 )
2014-10-18 01:55:21 +03:00
09a42738fc
[generic] Correct handling of embedded vimeo players ( #3955 )
2014-10-15 13:50:53 +02:00
1419fafd36
[condenast] Add support for embedded videos ( Closes #3929 )
2014-10-13 19:59:35 +07:00
ced659bb4d
[generic] Ignore some non-video file extensions during generic extraction ( Closes #3900 )
2014-10-09 19:26:23 +07:00
8489578df4
[generic] Support embedded Dailymotion playlists ( fixes #3822 )
2014-10-02 21:42:45 +03:00
07e764439a
[generic] Delete test case
...
The page is not available any more.
2014-10-01 00:08:19 +02:00
761e1645e0
[generic] Remove unstable test checksum
2014-09-29 05:18:45 +02:00
a8eb5a8e61
[generic] Fix testcases
2014-09-29 05:12:57 +02:00
d6e6a42256
[vimeo:likes] Add new extractor ( Fixes #3835 )
2014-09-28 12:14:16 +02:00
c6e90caaa6
Merge remote-tracking branch 'naglis/wistia'
2014-09-25 02:03:49 +02:00
6b08cdf626
[youtube] Support for embedded /p players ( Fixes #3821 )
2014-09-25 01:59:02 +02:00
3b2f933b01
[generic] Allow embedded YoutubePlaylists ( Fixes #3821 )
2014-09-24 11:05:14 +02:00
746c67d72f
[wistia] Use API and make more generic
2014-09-20 03:02:11 +03:00
a04aa7a9e6
[generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes ( fixes #3770 )
...
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/ .
2014-09-16 22:53:48 +02:00
1bf5423e82
[generic/youtube] Recognize youtube nocookie embeds ( Closes #3713 )
2014-09-10 18:29:20 +07:00
1a94ff6865
[mlb] Add support for embedded videos ( Closes #3653 )
2014-09-02 20:19:28 +07:00
b759a0d4d2
fix up imports
2014-08-28 01:00:59 +02:00
22a6f15061
Move playlist tests to extractors.
...
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
2014-08-28 00:58:24 +02:00
aff216edf4
[generic] Prevent <video> search from skipping over empty sources ( #3546 )
2014-08-27 02:09:59 +02:00
1cb6dcdbbe
[generic] Do not download images as videos by accident
2014-08-27 02:07:11 +02:00
f971dcbba0
Merge branch 'master' of github.com:rg3/youtube-dl
2014-08-25 18:36:42 +02:00
0990305d2a
[generic] Fix rss under Python 2.x and move test to extractor
2014-08-25 18:03:01 +02:00
bcc069a937
[generic] Remove debug statement
2014-08-25 17:21:58 +02:00
5f90042bd6
[generic] remove unused imports
2014-08-24 14:28:58 +02:00
ebab4520ff
[generic] Use default opener for HEAD request ( Fixes #3528 )
2014-08-24 06:58:11 +02:00
4d805e063c
[generic] Automatic detection of flow player and age_limit ( Fixes #3576 )
2014-08-24 05:31:32 +02:00
4d54ef20a2
[ministrygrid] Add extractor ( Fixes #2900 )
2014-08-24 04:47:28 +02:00
1f8b6af773
[bip.tv] Allow underscore in lookup ids ( Fixes #3573 )
2014-08-24 03:20:31 +02:00
10eaeb20c5
[generic] Require og:video URLs to contain a dot
2014-08-24 02:29:56 +02:00
fa8deaf38b
[generic] Prevent from downloading a .swf as a video
...
We're seeing quite a number of people who do not put a video file in the og:video field, but the player URL. Try to detect some of these and filter them out.
2014-08-24 02:24:49 +02:00
c8e9a235d9
[generic] Add support for camtasia videos ( Fixes #3574 )
2014-08-24 02:02:17 +02:00
2ef6fcb5d8
[sbs] Add new extractor ( Fixes #3566 )
2014-08-23 15:20:56 +02:00
ed2d6a1960
[generic] Simplify playlist support ( #2948 )
2014-08-22 18:19:56 +02:00
c71dfccc98
Merge remote-tracking branch 'anovicecodemonkey/generic-data-video-url'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-08-22 17:40:36 +02:00
49807b4ac6
[yahoo] Add support for embedded videos ( Closes #3525 )
2014-08-16 13:56:22 +07:00
1f7ccb9014
[generic] Add --default-search fixup_error
...
This restores the ability to enter URLs without a scheme (and default to http), but still fail if the input is a search term.
2014-07-29 17:17:46 +02:00
eef4a7a304
Fix typo: “ytseach” → “ytsearch”
2014-07-20 18:37:44 -06:00
7571c02c8a
[generic] Set default-search to error
...
This prevents users from submitting bug reports where they mistyped a URL, and prevents me from getting a weird video when holding shift and thus searching for :Tds
2014-07-06 11:22:44 +02:00
0364fa8b65
[generic] Add support for ivi.ru embedded player
2014-06-29 20:18:23 +07:00
c5cd249e41
[generic] Extract mtvservices embedded videos
2014-06-22 21:39:36 +02:00
826ec77fb2
[Vulture] Add support for vulture.com
2014-06-09 23:06:39 +02:00
2b88feedf7
[generic] Add support for <embed YouTube
2014-06-09 22:06:45 +02:00
37e3cbe22e
Move duplicate check to generic.py
2014-06-01 01:16:35 +09:30
610134730a
Add a _TEST_
2014-05-21 19:25:37 +09:30
0e67ab0d8e
[generic] Abort if user passes in URL "url" ( #2942 )
2014-05-19 17:10:11 +02:00
3442b30ab2
[generic] Support data-video-url for YouTube embeds ( Fixes #2862 )
2014-05-18 23:15:09 +09:30
8dfa187b8a
[generic] Support pagespeed_iframe for NovaMov embeds
2014-05-17 18:12:12 +07:00
a5a45015ba
[generic] Fix redirect
2014-05-16 20:32:53 +07:00
2099125333
[soundcloud/generic] Add support for playlists
2014-05-05 03:15:17 +02:00
669f0e7cda
[generic] Fix wrong entries index
2014-05-01 16:28:37 +07:00
b30b8698ea
[generic] Allow multiple matches for generic hits ( Fixes #2818 )
2014-04-30 02:23:51 +02:00
ebd3c7b370
[generic] Add support for protocol-independent URLs ( Fixes #2810 )
2014-04-30 01:46:06 +02:00
c0292e8ab7
[generic] Improve jwplayer detection ( Fixes #2731 )
2014-04-21 16:16:53 +02:00
48099643cc
[generic] Be more relaxed when looking for aparat embeds ( Fixes #2784 )
2014-04-21 12:37:41 +02:00
fa35cdad02
[condenast|generic] Add support for condenast embeds ( Fixes #2783 )
2014-04-21 05:47:52 +02:00
fd50bf623c
[generic] Modernize tests
2014-04-14 18:56:29 +07:00
d360a14678
[generic] Update test
2014-04-14 18:51:46 +07:00
15c0e8e7b2
[generic] Generalize novamov based embeds
2014-04-05 17:20:05 +07:00
7cd3bc5f99
[nowvideo] Support more domains
2014-04-05 16:38:57 +07:00
50f566076f
[generic] Add support for videoweed embeds
2014-04-05 15:49:45 +07:00
ca6aada48e
Fix _TEST for Ustream embed URLs
2014-04-05 03:26:29 +10:30
5c38625259
[UstreamIE] [generic] Added support for Ustream embed URLs ( Fixes #2694 )
2014-04-05 00:53:09 +10:30
9ad400f75e
[generic] Remove test case that has become a 404
2014-04-04 01:47:17 +02:00
0479c625a4
[brightcove] Encode object_str with utf-8
2014-04-01 20:17:35 +07:00
9c1fc022ae
[generic] Warn before fallback to automatic search
2014-03-30 15:57:35 +02:00
cb3ac1c610
[smotri] Modernize and add support for emdebbed videos ( Closes #2585 )
2014-03-28 19:58:49 +07:00
893f8832b5
[arte] Add support for embedded videos ( Fixes #2620 )
2014-03-24 22:01:47 +01:00
7e2ede9891
[generic] Run TED detection before JW Player detection
...
Otherwise it overwrittes the `mobj` variable.
2014-03-22 10:20:44 +01:00
0f2a2ba14b
Merge remote-tracking branch 'dstftw/generic-webpage-unescape'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-21 22:14:24 +01:00
750f9020ae
[generic] Recognize more Ooyala embedded videos ( #2569 )
2014-03-21 21:51:33 +01:00
aab74fa106
[ted] Simplify embed code ( #2587 )
2014-03-20 16:33:23 +01:00
8d7c0cca13
[generic] Add support for embeded TED videos
2014-03-20 00:56:32 +10:30
ecbe1ad207
[generic] Fix access to removed function in python 3.4
...
The `Request.get_origin_req_host` method was deprecated in 3.3, use the
`origin_req_host` property if it's not available, see http://docs.python.org/3.3/library/urllib.request.html#urllib.request.Request.get_origin_req_host .
2014-03-17 21:59:21 +01:00
93d020dd65
[generic] Add support for embedded rutv player
2014-03-17 02:00:31 +07:00
15fd51b37c
[generic] More generic support for embedded vimeo player ( #1602 )
2014-03-16 00:47:04 +07:00
d95e35d659
[generic] Add nowvideo test hidden behind percent encoding
2014-03-15 04:39:53 +07:00
1439073049
[generic] Add comment for unescaping webpage contents
2014-03-15 04:38:49 +07:00
1f7659dbe9
[generic] Unescape webpage contents
2014-03-15 04:21:17 +07:00
60cc4dc4b4
[generic/funnyordie] Add support for funnyordie embeds ( Fixes #2546 )
2014-03-11 16:51:36 +01:00
bcf89ce62c
[generic] Suppress warning about doctypes in RSS parser
2014-03-10 17:31:32 +01:00
0a5bce566f
[generic] Add all test attributes for embedly ( #2447 )
...
In the future, we may want to not only print something, but throw an error for untested properties.
2014-03-05 14:05:50 +01:00
8012bd2424
[generic] Get a better ID
2014-03-05 14:02:14 +01:00
f55a1f0a88
Merge remote-tracking branch 'rzhxeo/embedly'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-05 14:01:53 +01:00
ca97a56e4b
[vk] Add support for embedded videos ( Closes #2473 )
2014-02-28 23:51:54 +07:00
1b86cc41cf
Add support for embed.ly
2014-02-27 08:14:28 +01:00
89ef304bed
[generic] Add support for <meta redirect>
...
Fixes #413
2014-02-27 07:22:02 +01:00
b1c6c32f78
[generic] Add support for nowvideo embedded videos
2014-02-24 23:37:42 +07:00
f7300c5c90
[generic] Fix on python 2.6
...
`ParseError` is not available, it raises `xml.parsers.expat.ExpatError`.
The webpage needs to be encoded.
2014-02-21 16:59:10 +01:00
4fc946b546
[generic] Add support for RSS feeds ( Fixes #667 )
2014-02-20 13:14:09 +01:00
99877772d0
[generic] Add support for multiple brightcove URLs ( Fixes #2283 )
2014-02-03 15:19:40 +01:00
ab083b08ab
[generic] remove testcase
...
The video seems to have been removed from the site.
2014-01-30 06:10:57 +01:00
9f8928d032
[generic] Match JWPlayerOptions
...
This adds support for The Guardian, among others
Closes #2271 , fixes #2267
2014-01-30 05:29:10 +01:00
c3f51436bf
Improve some regexes for embedded players
2014-01-30 04:26:46 +07:00
17ab4d3b5e
[brightcove] Move test to generic
2014-01-28 03:35:32 +01:00
db1f388878
[huffpost] Add support
2014-01-27 05:47:38 +01:00
04b4d394d9
Add new --default-search option ( #2193 )
2014-01-22 14:16:43 +01:00
9834872bf6
[facebook] Add support for embeds
...
Example URL: http://www.hostblogger.de/blog/archives/6181-Auto-jagt-Betonmischer.html
2014-01-21 18:10:17 +01:00
3486df383b
[generic] Improve testcase
2014-01-21 01:40:34 +01:00
2f21eb2db6
[generic] Do not fetch XML URLs ( Fixes #2162 )
2014-01-17 02:13:00 +01:00
3fabeaa1f4
[vimeo] Support protocol-relative URLs
2014-01-08 22:42:52 +01:00
5f59ee7942
[novamov] Remove superfluous tabs
2014-01-08 08:11:46 +07:00
8f89e68781
[novamov] Add embedded player support
2014-01-08 08:09:13 +07:00
42e4fcf23a
[generic] Fix regexes
2014-01-07 11:04:27 +01:00
c93c2ab1c3
[mpora] Add support ( Fixes #2096 )
2014-01-07 08:07:46 +01:00
79f8295303
Use original Referer URL in Brightcove requests ( Fixes #2110 )
2014-01-07 05:34:14 +01:00
796495886e
[generic] Use unicode_literals instead of duplicating the u'
2014-01-06 01:47:52 +01:00
fc9713a1d2
[youtube] Support jwplayer with YouTube URLs ( Closes #2075 )
2014-01-06 01:42:58 +01:00
d981cef6b9
[generic] Support gorillavid.in
...
Previously, we were a little bit over-eager and got a random swf file.
Fixes #2084 .
2014-01-05 05:34:08 +01:00
aff24732b9
Merge remote-tracking branch 'rzhxeo/blip'
...
Conflicts:
youtube_dl/extractor/bliptv.py
2014-01-05 03:48:45 +01:00
19dab5e6cc
[GenericIE] Outsource embedded blip.tv player video id extraction to BlipTVIE and fix minor errors in RegEx
2013-12-30 06:15:02 +01:00
c1d1facd06
[generic] Output something before making network requests
2013-12-27 08:38:42 +01:00
7115ca84aa
[vimeo/generic] Add support for embedded SWF vimeo videos
2013-12-22 03:34:13 +01:00
aa94a6d315
[aparat] Add support ( Fixes #2012 )
2013-12-20 17:05:39 +01:00
1f9da9049b
[generic] Support YouTube swf embed ( Fixes #2010 )
2013-12-19 20:44:30 +01:00
c0d0b01f0e
[generic] Detect ooyala videos ( fixes #2013 )
2013-12-19 20:32:12 +01:00
3e78514568
[generic] Support application/ogg for direct links
...
Also remove some debugging code.
2013-12-17 16:26:34 +01:00
42393ce234
Add support for direct links to a video ( #1973 )
2013-12-17 12:33:55 +01:00
cecaaf3f58
[generic] Do not use compatibility result fallback
2013-12-17 12:04:33 +01:00
f25571ffbf
Add support for embedded vevo player ( Fixes #1957 )
2013-12-16 21:45:21 +01:00
ee3e63e477
[GenericIE] Add support for embedded blip.tv
2013-12-16 20:08:23 +01:00
ef4fd84857
[wistia] Add extractor
2013-12-06 09:15:04 +01:00
355e4fd07e
[generic] Find embedded dailymotion videos ( Fixes #1848 )
2013-12-01 01:21:33 +01:00
113577e155
[generic] Improve detection
...
Allow download of http://goo.gl/7X5tOk
Fixes #1818
2013-11-25 03:35:53 +01:00
0980426559
[bandcamp] add support for albums (reported in #1270 )
2013-11-22 16:05:14 +01:00
887c6acdf2
Support multiple embedded YouTube URLs ( Fixes #1787 )
2013-11-18 13:28:26 +01:00
dd5bcdc4c9
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter ( fixes #1553 )
2013-11-07 21:06:48 +01:00
eeb165e674
[brightcove] Add the extraction of the url from generic
2013-11-06 16:58:03 +01:00
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
2013-11-06 16:43:26 +01:00
2dcf7d8f99
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
2013-11-05 02:08:02 +01:00
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
2013-10-27 14:40:25 +01:00
aa929c37d5
[generic] Fix test video's checksum
2013-10-27 14:21:37 +01:00
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
2013-10-18 11:44:57 +02:00
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
2013-10-15 12:05:13 +02:00
3283533149
Fix Brightcove detection when another Flash object is on the page
...
The regex used non-greedy match, but alas it failed on input like this:
<object class="...> ... class="BrightcoveExperience"
It captured two objects and the intervening HTML. This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.
Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
2013-10-11 21:52:33 -04:00
e484c81f0c
[generic] Clarify error messages
2013-10-06 16:03:18 +02:00
592882aa9f
[brightcove] Support videos that only provide flv versions ( fixes #1504 )
...
Moved the test from generic.py to brightcove.py
2013-09-26 13:54:31 +02:00
a7130543fa
[generic] If the url doesn't specify the protocol, then try to extract prepending 'http://'
2013-09-06 18:39:35 +02:00
08e291b54d
[generic] Recognize html5 video in the format '<video src=".+?"' and only unquote the url when extracting the id ( fixes #1372 )
2013-09-05 18:02:17 +02:00
a5caba1eb0
[generic] simply use urljoin
2013-08-28 12:47:27 +02:00
ae3531adf9
[generic] Fix URL concatenation
...
When the url is something like http://example.org/foo/bar?x=y and the added is file/video.mp4 , we want http://example.org/foo/file/video.mp4
Fixes #1268 .
2013-08-28 12:08:17 +02:00
627a91a9a8
[generic] small typo
2013-08-26 21:29:31 +02:00
9585f890f8
[generic] add support for relative URLs ( Fixes #1308 )
2013-08-24 22:56:37 +02:00
0838239e8e
[generic] Support double slash URLs ( Fixes #1309 )
2013-08-24 22:52:45 +02:00
7fea7156cb
[generic] support HTML5 video
2013-08-21 04:32:22 +02:00
3093468977
[generic] Ignore stupid HTTP servers ( #1284 )
2013-08-21 04:32:07 +02:00
232eb88bfe
GenericIE: allow to match declaration of the Brightocove parameters that use ' instead of "
2013-07-12 14:52:01 +02:00
117adb0f0f
GenericIE: detect more Brightcove videos
...
In some sites "class" contains more that BrightcoveExperience
2013-07-11 00:25:38 +02:00
cfe50f04ed
GenericIE: Detect videos from Brightcove
...
Brightcove videos info is usually found in an <object class="BrightcoveExperience"></object> node, this is passed to a new method of BrightcoveIE that builds a url to extract the video.
2013-07-10 17:49:11 +02:00
5c44c15438
GenericIE: match titles that spread across multiple lines (related #904 )
2013-07-01 20:50:50 +02:00
0f81866329
Add --list-extractor-descriptions (human-readable list of IEs)
2013-07-01 18:52:19 +02:00
4269e78a80
Merge branch 'master' of github.com:rg3/youtube-dl
2013-06-27 20:47:03 +02:00
6f5ac90cf3
Move tests to the IE definitions
2013-06-27 20:46:46 +02:00
27473d18da
Made 'video' the default title for generic IE
2013-06-27 19:18:15 +01:00
52c8ade4ad
Made generic IE handle more cases
...
Added a possible quote after file, so it can now handle cases like:
'file': 'http://www.a.com/b.mp4 '
2013-06-27 19:16:09 +01:00
9b122384e9
Move GenericIE into its own file
2013-06-23 20:31:45 +02:00
Philipp Hagemeister
Sergey M․
dinesh
Naglis Jonaitis
Jaime Marquínez Ferrándiz
Anthony J. Bentley
anovicecodemonkey
rzhxeo
Joey Adams
Albert Kim