c3d3110f6a
Merge pull request #7185 from remitamine/ooyala
...
[ooyala] extract more formats and metadata
2015-12-04 08:23:21 +01:00
78653a33aa
Merge remote-tracking branch 'upstream/master' into bliptv
2015-12-03 20:33:22 +01:00
5c2266df4b
Switch codebase to use sanitized_Request instead of
...
compat_urllib_request.Request
[downloader/dash] Use sanitized_Request
[downloader/http] Use sanitized_Request
[atresplayer] Use sanitized_Request
[bambuser] Use sanitized_Request
[bliptv] Use sanitized_Request
[brightcove] Use sanitized_Request
[cbs] Use sanitized_Request
[ceskatelevize] Use sanitized_Request
[collegerama] Use sanitized_Request
[extractor/common] Use sanitized_Request
[crunchyroll] Use sanitized_Request
[dailymotion] Use sanitized_Request
[dcn] Use sanitized_Request
[dramafever] Use sanitized_Request
[dumpert] Use sanitized_Request
[eitb] Use sanitized_Request
[escapist] Use sanitized_Request
[everyonesmixtape] Use sanitized_Request
[extremetube] Use sanitized_Request
[facebook] Use sanitized_Request
[fc2] Use sanitized_Request
[flickr] Use sanitized_Request
[4tube] Use sanitized_Request
[gdcvault] Use sanitized_Request
[extractor/generic] Use sanitized_Request
[hearthisat] Use sanitized_Request
[hotnewhiphop] Use sanitized_Request
[hypem] Use sanitized_Request
[iprima] Use sanitized_Request
[ivi] Use sanitized_Request
[keezmovies] Use sanitized_Request
[letv] Use sanitized_Request
[lynda] Use sanitized_Request
[metacafe] Use sanitized_Request
[minhateca] Use sanitized_Request
[miomio] Use sanitized_Request
[meovideo] Use sanitized_Request
[mofosex] Use sanitized_Request
[moniker] Use sanitized_Request
[mooshare] Use sanitized_Request
[movieclips] Use sanitized_Request
[mtv] Use sanitized_Request
[myvideo] Use sanitized_Request
[neteasemusic] Use sanitized_Request
[nfb] Use sanitized_Request
[niconico] Use sanitized_Request
[noco] Use sanitized_Request
[nosvideo] Use sanitized_Request
[novamov] Use sanitized_Request
[nowness] Use sanitized_Request
[nuvid] Use sanitized_Request
[played] Use sanitized_Request
[pluralsight] Use sanitized_Request
[pornhub] Use sanitized_Request
[pornotube] Use sanitized_Request
[primesharetv] Use sanitized_Request
[promptfile] Use sanitized_Request
[qqmusic] Use sanitized_Request
[rtve] Use sanitized_Request
[safari] Use sanitized_Request
[sandia] Use sanitized_Request
[shared] Use sanitized_Request
[sharesix] Use sanitized_Request
[sina] Use sanitized_Request
[smotri] Use sanitized_Request
[sohu] Use sanitized_Request
[spankwire] Use sanitized_Request
[sportdeutschland] Use sanitized_Request
[streamcloud] Use sanitized_Request
[streamcz] Use sanitized_Request
[tapely] Use sanitized_Request
[tube8] Use sanitized_Request
[tubitv] Use sanitized_Request
[twitch] Use sanitized_Request
[twitter] Use sanitized_Request
[udemy] Use sanitized_Request
[vbox7] Use sanitized_Request
[veoh] Use sanitized_Request
[vessel] Use sanitized_Request
[vevo] Use sanitized_Request
[viddler] Use sanitized_Request
[videomega] Use sanitized_Request
[viewvster] Use sanitized_Request
[viki] Use sanitized_Request
[vk] Use sanitized_Request
[vodlocker] Use sanitized_Request
[voicerepublic] Use sanitized_Request
[wistia] Use sanitized_Request
[xfileshare] Use sanitized_Request
[xtube] Use sanitized_Request
[xvideos] Use sanitized_Request
[yandexmusic] Use sanitized_Request
[youku] Use sanitized_Request
[youporn] Use sanitized_Request
[youtube] Use sanitized_Request
[patreon] Use sanitized_Request
[extractor/common] Remove unused import
[nfb] PEP 8
2015-11-23 21:56:23 +06:00
750b9ff032
[generic] Extract M3U8 formats ( closes #7582 )
2015-11-21 16:43:01 +08:00
28602e747c
[generic] Refactor
2015-11-21 16:08:54 +08:00
6cc37c69e2
[generic] Unescape URLs from JWPlayer ( #7582 )
2015-11-21 14:12:34 +08:00
6da620de58
[kaltura] Add test for referrer protected video ( #7409 )
2015-11-21 01:40:28 +06:00
5b5fae5f20
[generic] Use referrer from source kaltura embed URLs ( #7409 )
2015-11-21 01:35:58 +06:00
c39fd7b1ca
[UDNEmbed] Fix generic UDN pages
...
Closes #7547
2015-11-19 22:32:56 +08:00
3b7d9aa487
Rename all references to legacy studio Brightcove extractor
2015-11-14 06:05:46 +06:00
1f4b722b00
[generic] Clarify Brightcove Legacy Studio comment
2015-11-14 06:03:32 +06:00
f6519f89b0
[generic] Extract Brightcove New Studio embeds
2015-11-14 06:03:07 +06:00
5c17f0a67a
[brightcove:embedinpage] Rename extractor to brightcove new
...
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
2015-11-14 05:55:59 +06:00
4fcaa4f4a5
[brightcove] Rename extractor to brightcove legacy
...
Old embedding approaches are now "Legacy Studio"
2015-11-14 05:54:16 +06:00
a2973eb597
Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed
2015-11-14 01:23:15 +06:00
6a5d6de1e3
[generic] Improve kaltura embed detection (2)
2015-11-09 20:49:42 +06:00
1c31a5b0e0
[generic] Improve kaltura embed detection ( Closes #7409 )
2015-11-09 20:49:06 +06:00
30eecc6a04
Merge pull request #7296 from jaimeMF/xml_attrib_unicode
...
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
2015-10-31 18:15:21 +00:00
e327b736ca
[generic] Update test
2015-10-31 23:05:30 +06:00
f78546272c
[compat] compat_etree_fromstring: also decode the text attribute
...
Deletes parse_xml from utils, because it also does it.
2015-10-26 16:41:24 +01:00
cce9d15d01
[ooyala] extract domain,handle errors and change related tests
2015-10-16 16:02:40 +01:00
77302fe5c9
[bliptv] remove extractor and add support for site replacement(makertv)
2015-10-15 23:27:46 +01:00
dd467d33d0
[extractor/generic] Add support for condenast script embeds ( Closes #6885 , closes #6991 )
2015-09-27 05:55:48 +06:00
46fde8a1a2
[extractor/generic] Use _extract_url for mtvservices
2015-09-26 19:47:20 +06:00
6aeba407db
[jukebox] remove extractor and handle it using generic extractor
2015-09-25 10:52:48 +01:00
6c91a5a7f5
[extractor/generic] Fix following redirect in Refresh HTTP header on python 2
2015-09-20 11:16:12 +06:00
ed1269000f
[brightcove] add support for brightcove in page embed( fixes #6824 )
2015-09-11 04:46:21 +01:00
12439dd5ec
[generic] Capture <audio> tags in addition to <video> tags
2015-09-05 21:53:10 +06:00
1f8125805e
[generic] Add test for screenwavemedia embed
2015-08-29 19:12:38 +06:00
efd712c69b
[generic] Use screenwavemedia embed pattern
2015-08-29 19:07:31 +06:00
8ca31a0e05
[generic] Look for ScreenwaveMedia embeds
2015-08-29 18:38:23 +06:00
0791ac1b44
[extractor/generic] Clarify comment
2015-08-09 19:47:58 +06:00
1de5cd3ba5
[extractor/generic] Add test for xspf playlist
2015-08-09 19:47:08 +06:00
729accb482
[extractor/generic] Add support for xspf playlists
2015-08-09 19:43:42 +06:00
d5d7bdaeb5
Merge pull request #6428 from dstftw/improve-generic-smil-support
...
Improve generic SMIL support
2015-08-08 05:47:33 +06:00
bf94d763ba
[extractor/generic] Add test for #6485
2015-08-08 02:00:49 +06:00
8a37aa1517
[extractor/generic] Expand ooyala regex ( Closes #6485 )
2015-08-08 01:55:59 +06:00
54a9328b20
[generic] Expand jwplayer support
2015-08-05 21:19:52 +06:00
8765222d22
[extractor/generic] Add generic SMIL tests
2015-08-02 01:16:21 +06:00
e5e8d20a3a
[extractor/generic] Improve generic SMIL detection
2015-08-02 01:13:59 +06:00
88ed52aec9
[bbc] Add support for direct bbc.co.uk embeds
2015-07-27 22:05:51 +06:00
653789afc7
add google drive embeds
2015-07-23 11:59:12 +01:00
b37317d8b0
[generic] Unescape HTML escape sequences in redirect urls ( fixes #6311 )
2015-07-22 23:33:49 +02:00
a1b85269a4
[extractor/generic] Support vid.me embeds
2015-07-20 18:49:53 +08:00
cbd55ade68
[extractor/generic] Add support for francetv embeds
2015-07-18 22:56:00 +06:00
f7e6f7fa23
[extractor/generic] Use compat_urllib_parse_unquote
2015-07-17 23:39:32 +06:00
45eedbe58c
Generic: use compat_urllib_parse_unquote to prevent utf8 mangling
...
of the entire page in python 2.
-requires- fixed compat_urllib_parse_unquote
example - the following will save with a mangled playlist title,
instead of the kanji for 'tsunami'. This affects all utf8encoded
urls as well
youtube-dl -f18 -o '%(playlist_title)s-%(title)s.%(ext)s' \
61c14c1e3a/tsunami.html
2015-07-15 15:30:47 -05:00
bf20b9c540
[extractor/generic] Add test for myvi embed
2015-07-10 01:15:55 +06:00
6dd94d3a79
[myvi:embed] Rename to myvi
2015-07-10 00:27:44 +06:00
e6c2d9ad29
[extractor/generic:myvi] Add support for myvi embeds
2015-07-10 00:25:36 +06:00
66e568de3b
[extractor/generic] Improve kaltura embeds support ( Closes #6137 )
2015-07-02 21:39:46 +06:00
b8c1cc1a51
[extractor/generic] Add test for snagfilms embeds
2015-06-27 18:28:10 +06:00
eedd20ef96
[extractor/generic] Add support for snagfilms embeds
2015-06-27 18:26:14 +06:00
8084be78c5
[extractor/generic] Add test for OnionStudios embeds
2015-06-24 23:23:16 +06:00
1ac1c4c26e
[extractor/generic] Add support for OnionStudios embeds ( Closes #5841 )
2015-06-24 23:19:50 +06:00
3c3b4176bd
Merge pull request #5961 from dstftw/force-generic-extractor
...
Add --force-generic-extractor
2015-06-24 19:10:45 +05:00
2fece970b8
[extractor/generic] Clarify generic extraction warning
2015-06-24 03:08:24 +06:00
a5158f38a3
[generic/adobetv] Support AdobeTVVideo embeds ( #6039 )
2015-06-22 15:07:32 +08:00
c76799c555
[extractor/generic] Add test for xhamster embed
2015-06-21 23:18:28 +06:00
2bb5b6d0a1
[generic] Add support for xhamster embeds
2015-06-21 23:11:25 +06:00
756f574e4e
[dailymotion/generic] Add DailymotionCloudIE
2015-06-21 21:30:34 +08:00
b407e173e4
[vimeo/generic] Move detection logic from GenericIE to VimeoIE
2015-06-21 18:23:58 +08:00
78e2b74bb9
[tumblr] Add support for pornhub embeds ( Closes #5963 )
2015-06-13 03:39:14 +06:00
65d161c480
[extractor/generic] Add support for pornhub embeds
2015-06-13 03:36:16 +06:00
d22dec74ff
Add `--force-generic-extractor`
...
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
2015-06-12 19:20:12 +06:00
9872d3110c
[extractor/generic] Add support for tvigle embeds
2015-06-12 18:37:09 +06:00
b859971873
[extractor/generic] Rename tvc embed url variable
2015-06-12 18:15:30 +06:00
f37bdbe537
[extractor/generic] Add test for tvc embed
2015-06-12 16:28:45 +06:00
2da09ff8b0
[extractor/generic] Fix tvc ie_key
2015-06-12 16:26:31 +06:00
954c1d0529
[tvc] Refactor extractor names
2015-06-12 16:24:13 +06:00
494f20cbdc
[extractor/generic] Add support for tvc embeds
2015-06-12 16:22:46 +06:00
97b570a94c
[generic] Improve rtl.nl embeds detection ( Closes #5950 )
2015-06-11 19:04:12 +06:00
b26733ba7f
[brightcove] Allow single quotes in Brightcove URLs ( fixes #5901 )
2015-06-07 15:29:42 +08:00
c5138a7ce4
[extractor/generic] Clarify test comment
2015-05-31 02:36:20 +06:00
c5fa81fe81
[extractor/generic] Put all direct link tests near to each other for better navigation
2015-05-31 02:22:29 +06:00
a074e92296
[extractor/generic] Add test for large compressed media
2015-05-31 02:13:24 +06:00
1ddb9456c4
[extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL
2015-05-31 01:23:58 +06:00
58bde34a23
[extractor/generic] Force Accept-Encoding to any for extraction pass
2015-05-31 00:44:54 +06:00
339516072b
[extractor/generic] Unescape video_id and title extracted from URL
2015-05-30 23:16:14 +06:00
25c3a7348f
[generic] Fix typo
2015-05-15 23:23:51 +06:00
b827a6015c
[generic] Add test for sportbox embeds
2015-05-15 23:18:21 +06:00
d40a3b5b55
[generic] Add support for sportbox embeds
2015-05-15 23:09:34 +06:00
3b5f65a64c
[mlb] Fix extraction of articles
...
And move test from generic, since it's directly handled by MLBIE
2015-05-09 12:41:56 +02:00
dc455a5f88
[extractor/generic] Add test for svt embed
2015-05-09 00:27:37 +06:00
bab19a8e91
[extractor/generic] Add support for svt embeds ( Closes #5622 )
2015-05-09 00:23:35 +06:00
406224be52
[extractor/generic] Fix following incomplete redirects ( #5640 )
2015-05-07 21:02:59 +06:00
8001607e90
[generic] Detect more MLB videos ( fixes #5443 )
2015-05-04 02:20:07 +08:00
0954cd8aa4
[Cinemassacre] Add detection for videos from blip.tv
2015-04-21 13:48:02 +08:00
2fe1b5bd2a
[CSpan] Add detection for Senate ISVP. Closes #5302
2015-04-21 03:18:38 +08:00
6225984681
[generic] Update pladform embed test
2015-04-16 21:37:15 +06:00
d6fd958c5f
[generic] Extract videos from SMIL manifests ( closes #5145 and fixes #5135 )
2015-04-16 17:16:11 +08:00
c798f15b98
[generic] Add test for playwire embed ( #5430 )
2015-04-15 22:14:29 +06:00
2dcc114f84
[generic] Add support for playwire embeds ( Closes #5430 )
2015-04-15 22:10:08 +06:00
01c58f8473
[generic] Fix test generic_51
...
The website replaced the original video with a new one
2015-04-14 13:10:10 +08:00
edfcf7abe2
[generic] Support another type of Ooyala embedded video
2015-04-14 12:45:43 +08:00
a4257017ef
[generic] Add tests for Crooks and Liars embeds
2015-04-11 20:26:42 +06:00
18153f1b32
[generic] Add support for Crooks and Liars embeds
2015-04-11 20:20:20 +06:00
0a1603634b
[utils] Remove url_infer_protocol
2015-04-08 21:39:34 +08:00
418c5cc3fc
[udn] Add new extractor
2015-04-08 17:26:51 +08:00
facecb84a1
[generic] Add working NBC Sports vplayer test
2015-03-31 20:11:14 +06:00
a2edf2e7ff
[NBC/ThePlatform/Generic] Add a generic detector for NBCSportsVPlayer and enhance error detection in ThePlatformIE
2015-03-31 03:36:09 +08:00
ad320e9b83
[generic] Add support for 5min embeds ( #5310 )
2015-03-29 04:57:37 +03:00
2051acdeb2
[extractor/generic] Add test for Libsyn embed
2015-03-22 08:20:27 +06:00
cefdf970cc
[extractor/generic] Support Libsyn embeds
2015-03-22 08:18:13 +06:00
3378d67a18
[generic] Add support for nytimes embeds ( Closes #5234 )
2015-03-19 21:26:57 +06:00
ed9a25dd61
[generic] Generalize redirect regex
2015-03-18 00:05:40 +06:00
84f8101606
[generic] Follow redirects specified by `Refresh` HTTP header
2015-03-17 23:51:40 +06:00
f838875726
[pladform] Add support for embeds
2015-03-08 18:07:10 +06:00
d47ae7f620
[eagleplatform] Add support for ClipYou embeds
2015-03-07 22:34:44 +06:00
135c9c42bf
[eagleplatform] Add support for embeds
2015-03-07 22:22:57 +06:00
76c73715fb
[generic] Parse RSS enclosure URLs ( Fixes #5091 )
2015-03-02 18:21:31 +01:00
e3216b82bf
[generic] Support dynamic Kaltura embeds ( #5016 ) ( #5073 )
2015-02-27 00:34:19 +02:00
13d8fbef30
[generic] Don't set the 'title' if it's not defined in the entry ( closes #5061 )
...
Some of them may be an 'url' result, which in general don't have the 'title' field.
2015-02-25 17:56:51 +01:00
255fca5eea
[generic] Add support for Zapiks embeds ( #5014 )
2015-02-22 01:39:26 +06:00
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
2015-02-19 02:00:52 +01:00
11e611a7fa
Extend various playlist tests
2015-02-18 00:49:10 +01:00
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
2015-02-16 15:45:45 +01:00
e98b8e79ea
[generic] Improve SBS detection ( Fixes #4899 )
2015-02-09 14:46:10 +01:00
a0f7198544
[generic] Add support for jwPlayer YouTube videos
...
This makes nationalarchives.gov.uk work (Fixes #4907 , fixes #4876 )
2015-02-09 10:43:01 +01:00
f076b63821
[generic/ooyala] Add support for Ooyala embeds on SBN network websites ( Fixes #4859 )
2015-02-04 15:33:37 +02:00
52585fd6dc
The opening curly brace `{` is a regex reserved [control character]( http://stackoverflow.com/a/400316/1106367 ), so it needs to be escaped.
2015-01-30 18:41:40 +11:00
cb454b333d
[generic] Improve some regexes
2015-01-28 23:07:37 +06:00
796df3c631
fixed viddler support - needed a Referer header; also added a viddler
...
generic extractor
2015-01-28 00:08:19 -05:00
b1b0b1ca30
[generic] Improve description testcase in rss test
2015-01-25 18:14:59 +01:00
501f13fbf3
[generic] Add support for Cinerama player ( Fixes #4752 )
2015-01-23 12:00:25 +01:00
61ca9a80b3
[generic] Add support for BOMs ( Fixes #4753 )
2015-01-23 01:21:30 +01:00
d7cc31b63e
[generic] PEP8
2015-01-05 18:16:47 +01:00
cd791a5ea0
[ted] Add support for embed-ssl.ted.com embedded videos
2015-01-05 13:11:13 +01:00
87830900a9
[generic] Update some tests
2015-01-05 13:07:24 +01:00
faa4ea68c0
[generic] Add BBC iPlayer playlist test
2015-01-02 20:56:42 +06:00
476eae0c2a
[generic] Generalize BBC iPlayer playlist extraction
2015-01-02 20:55:09 +06:00
8399267671
[generic] Make getter None by default
2015-01-02 20:54:30 +06:00
db546cf87f
[generic] Add support for BBC iPlayer embeds ( Closes #4619 )
2015-01-02 20:46:17 +06:00
416c7fcbce
Add documentation about supported sites ( Fixes #4503 )
2014-12-30 19:35:35 +01:00
42bdd9d051
[cinchcast] Add new extractor ( Fixes #4428 )
2014-12-12 02:57:36 +01:00
4e262a8838
[generic] Detect direct video links ( Fixes #4149 , #4313 )
2014-11-26 10:44:39 +01:00
65f3a228b1
[generic] Add support for LazyYT embeds ( Fixes #4306 )
2014-11-25 14:34:19 +01:00
b74e86f48a
Fix all PEP8 issues except E501
2014-11-23 22:21:46 +01:00
9e1a5b8455
PEP8: applied even more rules
2014-11-23 21:39:15 +01:00
2514d2635e
PEP8: E225,E227
2014-11-23 21:23:05 +01:00
8bcc875676
PEP8: more applied
2014-11-23 21:20:46 +01:00
5f6a1245ff
PEP8 applied
2014-11-23 20:41:03 +01:00
9b32eca3ce
[generic] Add support for single quotes in HTML5 videos ( Fixes #4265 )
2014-11-21 22:01:25 +01:00
af63fed7d8
[generic] Add support for livestream embeds ( Fixes #4185 )
2014-11-13 16:12:51 +01:00
9908e03528
Merge pull request #4076 from ghedo/direct_type
...
[generic] indicate when a direct video has been extracted
2014-11-06 22:23:14 +01:00
37aab27808
[brightcove] Extract m3u8 formats ( #3541 )
2014-11-06 00:14:33 +02:00
bdf9701729
[generic/brightcove] Add a new test case for kijk.nl ( #3541 )
2014-11-03 23:13:46 +02:00
8c25f81bee
[util] Move compatibility functions out of util
...
utils is large enough without these compatibility functions.
Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
2014-11-02 11:23:42 +01:00
ccdd0ffb80
[generic] indicate when a direct video has been extracted
...
Fixes #4052 .
2014-11-01 15:34:00 +01:00
5263cdfcf9
[generic] Improve MLB iframe regex
2014-11-01 04:01:58 +07:00
remitamine
Sergey M?
Yen Chi Hsuan
Jaime Marquínez Ferrándiz
felix
fnord
Naglis Jonaitis
Philipp Hagemeister
codesparkle
Shaya G
Jouke Waleson
Jaime Marquínez Ferrándiz
Alessandro Ghedini