remitamine
78653a33aa
Merge remote-tracking branch 'upstream/master' into bliptv
2015-12-03 20:33:22 +01:00
Sergey M?
5c2266df4b
Switch codebase to use sanitized_Request instead of
...
compat_urllib_request.Request
[downloader/dash] Use sanitized_Request
[downloader/http] Use sanitized_Request
[atresplayer] Use sanitized_Request
[bambuser] Use sanitized_Request
[bliptv] Use sanitized_Request
[brightcove] Use sanitized_Request
[cbs] Use sanitized_Request
[ceskatelevize] Use sanitized_Request
[collegerama] Use sanitized_Request
[extractor/common] Use sanitized_Request
[crunchyroll] Use sanitized_Request
[dailymotion] Use sanitized_Request
[dcn] Use sanitized_Request
[dramafever] Use sanitized_Request
[dumpert] Use sanitized_Request
[eitb] Use sanitized_Request
[escapist] Use sanitized_Request
[everyonesmixtape] Use sanitized_Request
[extremetube] Use sanitized_Request
[facebook] Use sanitized_Request
[fc2] Use sanitized_Request
[flickr] Use sanitized_Request
[4tube] Use sanitized_Request
[gdcvault] Use sanitized_Request
[extractor/generic] Use sanitized_Request
[hearthisat] Use sanitized_Request
[hotnewhiphop] Use sanitized_Request
[hypem] Use sanitized_Request
[iprima] Use sanitized_Request
[ivi] Use sanitized_Request
[keezmovies] Use sanitized_Request
[letv] Use sanitized_Request
[lynda] Use sanitized_Request
[metacafe] Use sanitized_Request
[minhateca] Use sanitized_Request
[miomio] Use sanitized_Request
[meovideo] Use sanitized_Request
[mofosex] Use sanitized_Request
[moniker] Use sanitized_Request
[mooshare] Use sanitized_Request
[movieclips] Use sanitized_Request
[mtv] Use sanitized_Request
[myvideo] Use sanitized_Request
[neteasemusic] Use sanitized_Request
[nfb] Use sanitized_Request
[niconico] Use sanitized_Request
[noco] Use sanitized_Request
[nosvideo] Use sanitized_Request
[novamov] Use sanitized_Request
[nowness] Use sanitized_Request
[nuvid] Use sanitized_Request
[played] Use sanitized_Request
[pluralsight] Use sanitized_Request
[pornhub] Use sanitized_Request
[pornotube] Use sanitized_Request
[primesharetv] Use sanitized_Request
[promptfile] Use sanitized_Request
[qqmusic] Use sanitized_Request
[rtve] Use sanitized_Request
[safari] Use sanitized_Request
[sandia] Use sanitized_Request
[shared] Use sanitized_Request
[sharesix] Use sanitized_Request
[sina] Use sanitized_Request
[smotri] Use sanitized_Request
[sohu] Use sanitized_Request
[spankwire] Use sanitized_Request
[sportdeutschland] Use sanitized_Request
[streamcloud] Use sanitized_Request
[streamcz] Use sanitized_Request
[tapely] Use sanitized_Request
[tube8] Use sanitized_Request
[tubitv] Use sanitized_Request
[twitch] Use sanitized_Request
[twitter] Use sanitized_Request
[udemy] Use sanitized_Request
[vbox7] Use sanitized_Request
[veoh] Use sanitized_Request
[vessel] Use sanitized_Request
[vevo] Use sanitized_Request
[viddler] Use sanitized_Request
[videomega] Use sanitized_Request
[viewvster] Use sanitized_Request
[viki] Use sanitized_Request
[vk] Use sanitized_Request
[vodlocker] Use sanitized_Request
[voicerepublic] Use sanitized_Request
[wistia] Use sanitized_Request
[xfileshare] Use sanitized_Request
[xtube] Use sanitized_Request
[xvideos] Use sanitized_Request
[yandexmusic] Use sanitized_Request
[youku] Use sanitized_Request
[youporn] Use sanitized_Request
[youtube] Use sanitized_Request
[patreon] Use sanitized_Request
[extractor/common] Remove unused import
[nfb] PEP 8
2015-11-23 21:56:23 +06:00
Yen Chi Hsuan
750b9ff032
[generic] Extract M3U8 formats ( closes #7582 )
2015-11-21 16:43:01 +08:00
Yen Chi Hsuan
28602e747c
[generic] Refactor
2015-11-21 16:08:54 +08:00
Yen Chi Hsuan
6cc37c69e2
[generic] Unescape URLs from JWPlayer ( #7582 )
2015-11-21 14:12:34 +08:00
Sergey M․
6da620de58
[kaltura] Add test for referrer protected video ( #7409 )
2015-11-21 01:40:28 +06:00
Sergey M․
5b5fae5f20
[generic] Use referrer from source kaltura embed URLs ( #7409 )
2015-11-21 01:35:58 +06:00
Yen Chi Hsuan
c39fd7b1ca
[UDNEmbed] Fix generic UDN pages
...
Closes #7547
2015-11-19 22:32:56 +08:00
Sergey M․
3b7d9aa487
Rename all references to legacy studio Brightcove extractor
2015-11-14 06:05:46 +06:00
Sergey M․
1f4b722b00
[generic] Clarify Brightcove Legacy Studio comment
2015-11-14 06:03:32 +06:00
Sergey M․
f6519f89b0
[generic] Extract Brightcove New Studio embeds
2015-11-14 06:03:07 +06:00
Sergey M․
5c17f0a67a
[brightcove:embedinpage] Rename extractor to brightcove new
...
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
2015-11-14 05:55:59 +06:00
Sergey M․
4fcaa4f4a5
[brightcove] Rename extractor to brightcove legacy
...
Old embedding approaches are now "Legacy Studio"
2015-11-14 05:54:16 +06:00
Sergey M․
a2973eb597
Merge branch 'brightcove_in_page_embed' of https://github.com/remitamine/youtube-dl into remitamine-brightcove_in_page_embed
2015-11-14 01:23:15 +06:00
Sergey M․
6a5d6de1e3
[generic] Improve kaltura embed detection (2)
2015-11-09 20:49:42 +06:00
Sergey M․
1c31a5b0e0
[generic] Improve kaltura embed detection ( Closes #7409 )
2015-11-09 20:49:06 +06:00
Sergey M
30eecc6a04
Merge pull request #7296 from jaimeMF/xml_attrib_unicode
...
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
2015-10-31 18:15:21 +00:00
Sergey M․
e327b736ca
[generic] Update test
2015-10-31 23:05:30 +06:00
Jaime Marquínez Ferrándiz
f78546272c
[compat] compat_etree_fromstring: also decode the text attribute
...
Deletes parse_xml from utils, because it also does it.
2015-10-26 16:41:24 +01:00
remitamine
cce9d15d01
[ooyala] extract domain,handle errors and change related tests
2015-10-16 16:02:40 +01:00
remitamine
77302fe5c9
[bliptv] remove extractor and add support for site replacement(makertv)
2015-10-15 23:27:46 +01:00
Sergey M․
dd467d33d0
[extractor/generic] Add support for condenast script embeds ( Closes #6885 , closes #6991 )
2015-09-27 05:55:48 +06:00
Sergey M․
46fde8a1a2
[extractor/generic] Use _extract_url for mtvservices
2015-09-26 19:47:20 +06:00
remitamine
6aeba407db
[jukebox] remove extractor and handle it using generic extractor
2015-09-25 10:52:48 +01:00
Sergey M․
6c91a5a7f5
[extractor/generic] Fix following redirect in Refresh HTTP header on python 2
2015-09-20 11:16:12 +06:00
remitamine
ed1269000f
[brightcove] add support for brightcove in page embed( fixes #6824 )
2015-09-11 04:46:21 +01:00
felix
12439dd5ec
[generic] Capture <audio> tags in addition to <video> tags
2015-09-05 21:53:10 +06:00
Sergey M․
1f8125805e
[generic] Add test for screenwavemedia embed
2015-08-29 19:12:38 +06:00
Sergey M․
efd712c69b
[generic] Use screenwavemedia embed pattern
2015-08-29 19:07:31 +06:00
felix
8ca31a0e05
[generic] Look for ScreenwaveMedia embeds
2015-08-29 18:38:23 +06:00
Sergey M․
0791ac1b44
[extractor/generic] Clarify comment
2015-08-09 19:47:58 +06:00
Sergey M․
1de5cd3ba5
[extractor/generic] Add test for xspf playlist
2015-08-09 19:47:08 +06:00
Sergey M․
729accb482
[extractor/generic] Add support for xspf playlists
2015-08-09 19:43:42 +06:00
Sergey M.
d5d7bdaeb5
Merge pull request #6428 from dstftw/improve-generic-smil-support
...
Improve generic SMIL support
2015-08-08 05:47:33 +06:00
Sergey M․
bf94d763ba
[extractor/generic] Add test for #6485
2015-08-08 02:00:49 +06:00
Sergey M․
8a37aa1517
[extractor/generic] Expand ooyala regex ( Closes #6485 )
2015-08-08 01:55:59 +06:00
Sergey M․
54a9328b20
[generic] Expand jwplayer support
2015-08-05 21:19:52 +06:00
Sergey M․
8765222d22
[extractor/generic] Add generic SMIL tests
2015-08-02 01:16:21 +06:00
Sergey M․
e5e8d20a3a
[extractor/generic] Improve generic SMIL detection
2015-08-02 01:13:59 +06:00
Sergey M․
88ed52aec9
[bbc] Add support for direct bbc.co.uk embeds
2015-07-27 22:05:51 +06:00
remitamine
653789afc7
add google drive embeds
2015-07-23 11:59:12 +01:00
Jaime Marquínez Ferrándiz
b37317d8b0
[generic] Unescape HTML escape sequences in redirect urls ( fixes #6311 )
2015-07-22 23:33:49 +02:00
Yen Chi Hsuan
a1b85269a4
[extractor/generic] Support vid.me embeds
2015-07-20 18:49:53 +08:00
Sergey M․
cbd55ade68
[extractor/generic] Add support for francetv embeds
2015-07-18 22:56:00 +06:00
Sergey M․
f7e6f7fa23
[extractor/generic] Use compat_urllib_parse_unquote
2015-07-17 23:39:32 +06:00
fnord
45eedbe58c
Generic: use compat_urllib_parse_unquote to prevent utf8 mangling
...
of the entire page in python 2.
-requires- fixed compat_urllib_parse_unquote
example - the following will save with a mangled playlist title,
instead of the kanji for 'tsunami'. This affects all utf8encoded
urls as well
youtube-dl -f18 -o '%(playlist_title)s-%(title)s.%(ext)s' \
61c14c1e3a/tsunami.html
2015-07-15 15:30:47 -05:00
Sergey M․
bf20b9c540
[extractor/generic] Add test for myvi embed
2015-07-10 01:15:55 +06:00
Sergey M․
6dd94d3a79
[myvi:embed] Rename to myvi
2015-07-10 00:27:44 +06:00
Sergey M․
e6c2d9ad29
[extractor/generic:myvi] Add support for myvi embeds
2015-07-10 00:25:36 +06:00
Sergey M․
66e568de3b
[extractor/generic] Improve kaltura embeds support ( Closes #6137 )
2015-07-02 21:39:46 +06:00
Sergey M․
b8c1cc1a51
[extractor/generic] Add test for snagfilms embeds
2015-06-27 18:28:10 +06:00
Sergey M․
eedd20ef96
[extractor/generic] Add support for snagfilms embeds
2015-06-27 18:26:14 +06:00
Sergey M․
8084be78c5
[extractor/generic] Add test for OnionStudios embeds
2015-06-24 23:23:16 +06:00
Sergey M․
1ac1c4c26e
[extractor/generic] Add support for OnionStudios embeds ( Closes #5841 )
2015-06-24 23:19:50 +06:00
Sergey M.
3c3b4176bd
Merge pull request #5961 from dstftw/force-generic-extractor
...
Add --force-generic-extractor
2015-06-24 19:10:45 +05:00
Sergey M․
2fece970b8
[extractor/generic] Clarify generic extraction warning
2015-06-24 03:08:24 +06:00
Yen Chi Hsuan
a5158f38a3
[generic/adobetv] Support AdobeTVVideo embeds ( #6039 )
2015-06-22 15:07:32 +08:00
Sergey M․
c76799c555
[extractor/generic] Add test for xhamster embed
2015-06-21 23:18:28 +06:00
Sergey M․
2bb5b6d0a1
[generic] Add support for xhamster embeds
2015-06-21 23:11:25 +06:00
Yen Chi Hsuan
756f574e4e
[dailymotion/generic] Add DailymotionCloudIE
2015-06-21 21:30:34 +08:00
Yen Chi Hsuan
b407e173e4
[vimeo/generic] Move detection logic from GenericIE to VimeoIE
2015-06-21 18:23:58 +08:00
Sergey M․
78e2b74bb9
[tumblr] Add support for pornhub embeds ( Closes #5963 )
2015-06-13 03:39:14 +06:00
Sergey M․
65d161c480
[extractor/generic] Add support for pornhub embeds
2015-06-13 03:36:16 +06:00
Sergey M․
d22dec74ff
Add `--force-generic-extractor`
...
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
2015-06-12 19:20:12 +06:00
Sergey M․
9872d3110c
[extractor/generic] Add support for tvigle embeds
2015-06-12 18:37:09 +06:00
Sergey M․
b859971873
[extractor/generic] Rename tvc embed url variable
2015-06-12 18:15:30 +06:00
Sergey M․
f37bdbe537
[extractor/generic] Add test for tvc embed
2015-06-12 16:28:45 +06:00
Sergey M․
2da09ff8b0
[extractor/generic] Fix tvc ie_key
2015-06-12 16:26:31 +06:00
Sergey M․
954c1d0529
[tvc] Refactor extractor names
2015-06-12 16:24:13 +06:00
Sergey M․
494f20cbdc
[extractor/generic] Add support for tvc embeds
2015-06-12 16:22:46 +06:00
Sergey M․
97b570a94c
[generic] Improve rtl.nl embeds detection ( Closes #5950 )
2015-06-11 19:04:12 +06:00
Yen Chi Hsuan
b26733ba7f
[brightcove] Allow single quotes in Brightcove URLs ( fixes #5901 )
2015-06-07 15:29:42 +08:00
Sergey M․
c5138a7ce4
[extractor/generic] Clarify test comment
2015-05-31 02:36:20 +06:00
Sergey M․
c5fa81fe81
[extractor/generic] Put all direct link tests near to each other for better navigation
2015-05-31 02:22:29 +06:00
Sergey M․
a074e92296
[extractor/generic] Add test for large compressed media
2015-05-31 02:13:24 +06:00
Sergey M․
1ddb9456c4
[extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL
2015-05-31 01:23:58 +06:00
Sergey M․
58bde34a23
[extractor/generic] Force Accept-Encoding to any for extraction pass
2015-05-31 00:44:54 +06:00
Sergey M․
339516072b
[extractor/generic] Unescape video_id and title extracted from URL
2015-05-30 23:16:14 +06:00
Sergey M․
25c3a7348f
[generic] Fix typo
2015-05-15 23:23:51 +06:00
Sergey M․
b827a6015c
[generic] Add test for sportbox embeds
2015-05-15 23:18:21 +06:00
Sergey M․
d40a3b5b55
[generic] Add support for sportbox embeds
2015-05-15 23:09:34 +06:00
Jaime Marquínez Ferrándiz
3b5f65a64c
[mlb] Fix extraction of articles
...
And move test from generic, since it's directly handled by MLBIE
2015-05-09 12:41:56 +02:00
Sergey M․
dc455a5f88
[extractor/generic] Add test for svt embed
2015-05-09 00:27:37 +06:00
Sergey M․
bab19a8e91
[extractor/generic] Add support for svt embeds ( Closes #5622 )
2015-05-09 00:23:35 +06:00
Sergey M․
406224be52
[extractor/generic] Fix following incomplete redirects ( #5640 )
2015-05-07 21:02:59 +06:00
Yen Chi Hsuan
8001607e90
[generic] Detect more MLB videos ( fixes #5443 )
2015-05-04 02:20:07 +08:00
Yen Chi Hsuan
0954cd8aa4
[Cinemassacre] Add detection for videos from blip.tv
2015-04-21 13:48:02 +08:00
Yen Chi Hsuan
2fe1b5bd2a
[CSpan] Add detection for Senate ISVP. Closes #5302
2015-04-21 03:18:38 +08:00
Sergey M․
6225984681
[generic] Update pladform embed test
2015-04-16 21:37:15 +06:00
Yen Chi Hsuan
d6fd958c5f
[generic] Extract videos from SMIL manifests ( closes #5145 and fixes #5135 )
2015-04-16 17:16:11 +08:00
Sergey M․
c798f15b98
[generic] Add test for playwire embed ( #5430 )
2015-04-15 22:14:29 +06:00
Sergey M․
2dcc114f84
[generic] Add support for playwire embeds ( Closes #5430 )
2015-04-15 22:10:08 +06:00
Yen Chi Hsuan
01c58f8473
[generic] Fix test generic_51
...
The website replaced the original video with a new one
2015-04-14 13:10:10 +08:00
Yen Chi Hsuan
edfcf7abe2
[generic] Support another type of Ooyala embedded video
2015-04-14 12:45:43 +08:00
Sergey M․
a4257017ef
[generic] Add tests for Crooks and Liars embeds
2015-04-11 20:26:42 +06:00
Sergey M․
18153f1b32
[generic] Add support for Crooks and Liars embeds
2015-04-11 20:20:20 +06:00
Yen Chi Hsuan
0a1603634b
[utils] Remove url_infer_protocol
2015-04-08 21:39:34 +08:00
Yen Chi Hsuan
418c5cc3fc
[udn] Add new extractor
2015-04-08 17:26:51 +08:00
Sergey M․
facecb84a1
[generic] Add working NBC Sports vplayer test
2015-03-31 20:11:14 +06:00
Yen Chi Hsuan
a2edf2e7ff
[NBC/ThePlatform/Generic] Add a generic detector for NBCSportsVPlayer and enhance error detection in ThePlatformIE
2015-03-31 03:36:09 +08:00
Naglis Jonaitis
ad320e9b83
[generic] Add support for 5min embeds ( #5310 )
2015-03-29 04:57:37 +03:00
Sergey M․
2051acdeb2
[extractor/generic] Add test for Libsyn embed
2015-03-22 08:20:27 +06:00
Sergey M․
cefdf970cc
[extractor/generic] Support Libsyn embeds
2015-03-22 08:18:13 +06:00
Sergey M․
3378d67a18
[generic] Add support for nytimes embeds ( Closes #5234 )
2015-03-19 21:26:57 +06:00
Sergey M․
ed9a25dd61
[generic] Generalize redirect regex
2015-03-18 00:05:40 +06:00
Sergey M․
84f8101606
[generic] Follow redirects specified by `Refresh` HTTP header
2015-03-17 23:51:40 +06:00
Sergey M․
f838875726
[pladform] Add support for embeds
2015-03-08 18:07:10 +06:00
Sergey M․
d47ae7f620
[eagleplatform] Add support for ClipYou embeds
2015-03-07 22:34:44 +06:00
Sergey M․
135c9c42bf
[eagleplatform] Add support for embeds
2015-03-07 22:22:57 +06:00
Philipp Hagemeister
76c73715fb
[generic] Parse RSS enclosure URLs ( Fixes #5091 )
2015-03-02 18:21:31 +01:00
Naglis Jonaitis
e3216b82bf
[generic] Support dynamic Kaltura embeds ( #5016 ) ( #5073 )
2015-02-27 00:34:19 +02:00
Jaime Marquínez Ferrándiz
13d8fbef30
[generic] Don't set the 'title' if it's not defined in the entry ( closes #5061 )
...
Some of them may be an 'url' result, which in general don't have the 'title' field.
2015-02-25 17:56:51 +01:00
Sergey M․
255fca5eea
[generic] Add support for Zapiks embeds ( #5014 )
2015-02-22 01:39:26 +06:00
Philipp Hagemeister
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
2015-02-19 02:00:52 +01:00
Philipp Hagemeister
11e611a7fa
Extend various playlist tests
2015-02-18 00:49:10 +01:00
Philipp Hagemeister
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
2015-02-16 15:45:45 +01:00
Philipp Hagemeister
e98b8e79ea
[generic] Improve SBS detection ( Fixes #4899 )
2015-02-09 14:46:10 +01:00
Philipp Hagemeister
a0f7198544
[generic] Add support for jwPlayer YouTube videos
...
This makes nationalarchives.gov.uk work (Fixes #4907 , fixes #4876 )
2015-02-09 10:43:01 +01:00
naglis
f076b63821
[generic/ooyala] Add support for Ooyala embeds on SBN network websites ( Fixes #4859 )
2015-02-04 15:33:37 +02:00
codesparkle
52585fd6dc
The opening curly brace `{` is a regex reserved [control character]( http://stackoverflow.com/a/400316/1106367 ), so it needs to be escaped.
2015-01-30 18:41:40 +11:00
Sergey M․
cb454b333d
[generic] Improve some regexes
2015-01-28 23:07:37 +06:00
Shaya G
796df3c631
fixed viddler support - needed a Referer header; also added a viddler
...
generic extractor
2015-01-28 00:08:19 -05:00
Philipp Hagemeister
b1b0b1ca30
[generic] Improve description testcase in rss test
2015-01-25 18:14:59 +01:00
Philipp Hagemeister
501f13fbf3
[generic] Add support for Cinerama player ( Fixes #4752 )
2015-01-23 12:00:25 +01:00
Philipp Hagemeister
61ca9a80b3
[generic] Add support for BOMs ( Fixes #4753 )
2015-01-23 01:21:30 +01:00
Philipp Hagemeister
d7cc31b63e
[generic] PEP8
2015-01-05 18:16:47 +01:00
Jaime Marquínez Ferrándiz
cd791a5ea0
[ted] Add support for embed-ssl.ted.com embedded videos
2015-01-05 13:11:13 +01:00
Jaime Marquínez Ferrándiz
87830900a9
[generic] Update some tests
2015-01-05 13:07:24 +01:00
Sergey M․
faa4ea68c0
[generic] Add BBC iPlayer playlist test
2015-01-02 20:56:42 +06:00
Sergey M․
476eae0c2a
[generic] Generalize BBC iPlayer playlist extraction
2015-01-02 20:55:09 +06:00
Sergey M․
8399267671
[generic] Make getter None by default
2015-01-02 20:54:30 +06:00
Sergey M․
db546cf87f
[generic] Add support for BBC iPlayer embeds ( Closes #4619 )
2015-01-02 20:46:17 +06:00
Philipp Hagemeister
416c7fcbce
Add documentation about supported sites ( Fixes #4503 )
2014-12-30 19:35:35 +01:00
Philipp Hagemeister
42bdd9d051
[cinchcast] Add new extractor ( Fixes #4428 )
2014-12-12 02:57:36 +01:00
Philipp Hagemeister
4e262a8838
[generic] Detect direct video links ( Fixes #4149 , #4313 )
2014-11-26 10:44:39 +01:00
Philipp Hagemeister
65f3a228b1
[generic] Add support for LazyYT embeds ( Fixes #4306 )
2014-11-25 14:34:19 +01:00
Philipp Hagemeister
b74e86f48a
Fix all PEP8 issues except E501
2014-11-23 22:21:46 +01:00
Jouke Waleson
9e1a5b8455
PEP8: applied even more rules
2014-11-23 21:39:15 +01:00
Jouke Waleson
2514d2635e
PEP8: E225,E227
2014-11-23 21:23:05 +01:00
Jouke Waleson
8bcc875676
PEP8: more applied
2014-11-23 21:20:46 +01:00
Jouke Waleson
5f6a1245ff
PEP8 applied
2014-11-23 20:41:03 +01:00
Philipp Hagemeister
9b32eca3ce
[generic] Add support for single quotes in HTML5 videos ( Fixes #4265 )
2014-11-21 22:01:25 +01:00
Philipp Hagemeister
af63fed7d8
[generic] Add support for livestream embeds ( Fixes #4185 )
2014-11-13 16:12:51 +01:00
Jaime Marquínez Ferrándiz
9908e03528
Merge pull request #4076 from ghedo/direct_type
...
[generic] indicate when a direct video has been extracted
2014-11-06 22:23:14 +01:00
Naglis Jonaitis
37aab27808
[brightcove] Extract m3u8 formats ( #3541 )
2014-11-06 00:14:33 +02:00
Naglis Jonaitis
bdf9701729
[generic/brightcove] Add a new test case for kijk.nl ( #3541 )
2014-11-03 23:13:46 +02:00
Philipp Hagemeister
8c25f81bee
[util] Move compatibility functions out of util
...
utils is large enough without these compatibility functions.
Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
2014-11-02 11:23:42 +01:00
Alessandro Ghedini
ccdd0ffb80
[generic] indicate when a direct video has been extracted
...
Fixes #4052 .
2014-11-01 15:34:00 +01:00
Sergey M․
5263cdfcf9
[generic] Improve MLB iframe regex
2014-11-01 04:01:58 +07:00
Philipp Hagemeister
ac645ac7d0
[generic] Allow soundcloud embeds with additional attributes
2014-10-29 20:27:58 +01:00
Philipp Hagemeister
48a24ab746
[generic] Fix HTML5 video regexp
2014-10-28 10:41:24 +01:00
Philipp Hagemeister
d6d9186f0d
[generic] Fix test title
2014-10-27 00:45:15 +01:00
Philipp Hagemeister
37d66e7f1e
[generic] Correct call to _webpage_read_full_content
2014-10-26 20:58:09 +01:00
Philipp Hagemeister
70b7e3fbb6
[generic] Add a test case for direct links with broken HEAD ( #4032 )
2014-10-26 20:49:51 +01:00
Philipp Hagemeister
23be51d8ce
[generic] Handle audio streams that do not implement HEAD ( Fixes #4032 )
2014-10-26 17:05:44 +01:00
Philipp Hagemeister
a7e97f6db1
[generic] Allow new SWFObject()-style imports
...
This embed style is used on http://www.bitburger-open.de/ , but that is not included as a test case since the format is likely to be temporary.
2014-10-26 14:15:49 +01:00
Philipp Hagemeister
f2f2c0c2c6
[generic] Allow --default-search without colon
2014-10-23 21:13:45 +02:00
Sergey M․
281d3f1d68
[generic/wistia] Improve regex
2014-10-23 23:03:07 +07:00
dinesh
85d7b76586
[thoughtworks] wistia regex modified
2014-10-23 21:23:56 +05:30
dinesh
52cffcb186
[thoughtworks] wistia support added
2014-10-23 20:28:39 +05:30
Naglis Jonaitis
9471c44405
[generic] Make sure Wistia embed URLs contain the protocol ( Closes #3977 )
...
Also, improve detection (Addresses #3662 )
2014-10-18 01:55:21 +03:00
Philipp Hagemeister
09a42738fc
[generic] Correct handling of embedded vimeo players ( #3955 )
2014-10-15 13:50:53 +02:00
Sergey M․
1419fafd36
[condenast] Add support for embedded videos ( Closes #3929 )
2014-10-13 19:59:35 +07:00
Sergey M․
ced659bb4d
[generic] Ignore some non-video file extensions during generic extraction ( Closes #3900 )
2014-10-09 19:26:23 +07:00
Naglis Jonaitis
8489578df4
[generic] Support embedded Dailymotion playlists ( fixes #3822 )
2014-10-02 21:42:45 +03:00
Philipp Hagemeister
07e764439a
[generic] Delete test case
...
The page is not available any more.
2014-10-01 00:08:19 +02:00
Philipp Hagemeister
761e1645e0
[generic] Remove unstable test checksum
2014-09-29 05:18:45 +02:00
Philipp Hagemeister
a8eb5a8e61
[generic] Fix testcases
2014-09-29 05:12:57 +02:00
Philipp Hagemeister
d6e6a42256
[vimeo:likes] Add new extractor ( Fixes #3835 )
2014-09-28 12:14:16 +02:00
Philipp Hagemeister
c6e90caaa6
Merge remote-tracking branch 'naglis/wistia'
2014-09-25 02:03:49 +02:00
Philipp Hagemeister
6b08cdf626
[youtube] Support for embedded /p players ( Fixes #3821 )
2014-09-25 01:59:02 +02:00
Philipp Hagemeister
3b2f933b01
[generic] Allow embedded YoutubePlaylists ( Fixes #3821 )
2014-09-24 11:05:14 +02:00
Naglis Jonaitis
746c67d72f
[wistia] Use API and make more generic
2014-09-20 03:02:11 +03:00
Jaime Marquínez Ferrándiz
a04aa7a9e6
[generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes ( fixes #3770 )
...
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/ .
2014-09-16 22:53:48 +02:00
Sergey M․
1bf5423e82
[generic/youtube] Recognize youtube nocookie embeds ( Closes #3713 )
2014-09-10 18:29:20 +07:00
Sergey M․
1a94ff6865
[mlb] Add support for embedded videos ( Closes #3653 )
2014-09-02 20:19:28 +07:00
Philipp Hagemeister
b759a0d4d2
fix up imports
2014-08-28 01:00:59 +02:00
Philipp Hagemeister
22a6f15061
Move playlist tests to extractors.
...
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
2014-08-28 00:58:24 +02:00
Philipp Hagemeister
aff216edf4
[generic] Prevent <video> search from skipping over empty sources ( #3546 )
2014-08-27 02:09:59 +02:00
Philipp Hagemeister
1cb6dcdbbe
[generic] Do not download images as videos by accident
2014-08-27 02:07:11 +02:00
Philipp Hagemeister
f971dcbba0
Merge branch 'master' of github.com:rg3/youtube-dl
2014-08-25 18:36:42 +02:00
Philipp Hagemeister
0990305d2a
[generic] Fix rss under Python 2.x and move test to extractor
2014-08-25 18:03:01 +02:00
Jaime Marquínez Ferrándiz
bcc069a937
[generic] Remove debug statement
2014-08-25 17:21:58 +02:00
Philipp Hagemeister
5f90042bd6
[generic] remove unused imports
2014-08-24 14:28:58 +02:00
Philipp Hagemeister
ebab4520ff
[generic] Use default opener for HEAD request ( Fixes #3528 )
2014-08-24 06:58:11 +02:00
Philipp Hagemeister
4d805e063c
[generic] Automatic detection of flow player and age_limit ( Fixes #3576 )
2014-08-24 05:31:32 +02:00
Philipp Hagemeister
4d54ef20a2
[ministrygrid] Add extractor ( Fixes #2900 )
2014-08-24 04:47:28 +02:00
Philipp Hagemeister
1f8b6af773
[bip.tv] Allow underscore in lookup ids ( Fixes #3573 )
2014-08-24 03:20:31 +02:00
Philipp Hagemeister
10eaeb20c5
[generic] Require og:video URLs to contain a dot
2014-08-24 02:29:56 +02:00
Philipp Hagemeister
fa8deaf38b
[generic] Prevent from downloading a .swf as a video
...
We're seeing quite a number of people who do not put a video file in the og:video field, but the player URL. Try to detect some of these and filter them out.
2014-08-24 02:24:49 +02:00
Philipp Hagemeister
c8e9a235d9
[generic] Add support for camtasia videos ( Fixes #3574 )
2014-08-24 02:02:17 +02:00
Philipp Hagemeister
2ef6fcb5d8
[sbs] Add new extractor ( Fixes #3566 )
2014-08-23 15:20:56 +02:00
Philipp Hagemeister
ed2d6a1960
[generic] Simplify playlist support ( #2948 )
2014-08-22 18:19:56 +02:00
Philipp Hagemeister
c71dfccc98
Merge remote-tracking branch 'anovicecodemonkey/generic-data-video-url'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-08-22 17:40:36 +02:00
Sergey M․
49807b4ac6
[yahoo] Add support for embedded videos ( Closes #3525 )
2014-08-16 13:56:22 +07:00
Philipp Hagemeister
1f7ccb9014
[generic] Add --default-search fixup_error
...
This restores the ability to enter URLs without a scheme (and default to http), but still fail if the input is a search term.
2014-07-29 17:17:46 +02:00
Anthony J. Bentley
eef4a7a304
Fix typo: “ytseach” → “ytsearch”
2014-07-20 18:37:44 -06:00
Philipp Hagemeister
7571c02c8a
[generic] Set default-search to error
...
This prevents users from submitting bug reports where they mistyped a URL, and prevents me from getting a weird video when holding shift and thus searching for :Tds
2014-07-06 11:22:44 +02:00
Sergey M․
0364fa8b65
[generic] Add support for ivi.ru embedded player
2014-06-29 20:18:23 +07:00
Jaime Marquínez Ferrándiz
c5cd249e41
[generic] Extract mtvservices embedded videos
2014-06-22 21:39:36 +02:00
Philipp Hagemeister
826ec77fb2
[Vulture] Add support for vulture.com
2014-06-09 23:06:39 +02:00
Philipp Hagemeister
2b88feedf7
[generic] Add support for <embed YouTube
2014-06-09 22:06:45 +02:00
anovicecodemonkey
37e3cbe22e
Move duplicate check to generic.py
2014-06-01 01:16:35 +09:30
anovicecodemonkey
610134730a
Add a _TEST_
2014-05-21 19:25:37 +09:30
Philipp Hagemeister
0e67ab0d8e
[generic] Abort if user passes in URL "url" ( #2942 )
2014-05-19 17:10:11 +02:00
anovicecodemonkey
3442b30ab2
[generic] Support data-video-url for YouTube embeds ( Fixes #2862 )
2014-05-18 23:15:09 +09:30
Sergey M․
8dfa187b8a
[generic] Support pagespeed_iframe for NovaMov embeds
2014-05-17 18:12:12 +07:00
Sergey M․
a5a45015ba
[generic] Fix redirect
2014-05-16 20:32:53 +07:00
Philipp Hagemeister
2099125333
[soundcloud/generic] Add support for playlists
2014-05-05 03:15:17 +02:00
Sergey M․
669f0e7cda
[generic] Fix wrong entries index
2014-05-01 16:28:37 +07:00
Philipp Hagemeister
b30b8698ea
[generic] Allow multiple matches for generic hits ( Fixes #2818 )
2014-04-30 02:23:51 +02:00
Philipp Hagemeister
ebd3c7b370
[generic] Add support for protocol-independent URLs ( Fixes #2810 )
2014-04-30 01:46:06 +02:00
Philipp Hagemeister
c0292e8ab7
[generic] Improve jwplayer detection ( Fixes #2731 )
2014-04-21 16:16:53 +02:00
Philipp Hagemeister
48099643cc
[generic] Be more relaxed when looking for aparat embeds ( Fixes #2784 )
2014-04-21 12:37:41 +02:00
Philipp Hagemeister
fa35cdad02
[condenast|generic] Add support for condenast embeds ( Fixes #2783 )
2014-04-21 05:47:52 +02:00
Sergey M․
fd50bf623c
[generic] Modernize tests
2014-04-14 18:56:29 +07:00
Sergey M․
d360a14678
[generic] Update test
2014-04-14 18:51:46 +07:00
Sergey M․
15c0e8e7b2
[generic] Generalize novamov based embeds
2014-04-05 17:20:05 +07:00
Sergey M․
7cd3bc5f99
[nowvideo] Support more domains
2014-04-05 16:38:57 +07:00
Sergey M․
50f566076f
[generic] Add support for videoweed embeds
2014-04-05 15:49:45 +07:00
anovicecodemonkey
ca6aada48e
Fix _TEST for Ustream embed URLs
2014-04-05 03:26:29 +10:30
anovicecodemonkey
5c38625259
[UstreamIE] [generic] Added support for Ustream embed URLs ( Fixes #2694 )
2014-04-05 00:53:09 +10:30
Philipp Hagemeister
9ad400f75e
[generic] Remove test case that has become a 404
2014-04-04 01:47:17 +02:00
Sergey M․
0479c625a4
[brightcove] Encode object_str with utf-8
2014-04-01 20:17:35 +07:00
Philipp Hagemeister
9c1fc022ae
[generic] Warn before fallback to automatic search
2014-03-30 15:57:35 +02:00
Sergey M․
cb3ac1c610
[smotri] Modernize and add support for emdebbed videos ( Closes #2585 )
2014-03-28 19:58:49 +07:00
Philipp Hagemeister
893f8832b5
[arte] Add support for embedded videos ( Fixes #2620 )
2014-03-24 22:01:47 +01:00
Jaime Marquínez Ferrándiz
7e2ede9891
[generic] Run TED detection before JW Player detection
...
Otherwise it overwrittes the `mobj` variable.
2014-03-22 10:20:44 +01:00
Jaime Marquínez Ferrándiz
0f2a2ba14b
Merge remote-tracking branch 'dstftw/generic-webpage-unescape'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-21 22:14:24 +01:00
Jaime Marquínez Ferrándiz
750f9020ae
[generic] Recognize more Ooyala embedded videos ( #2569 )
2014-03-21 21:51:33 +01:00
Philipp Hagemeister
aab74fa106
[ted] Simplify embed code ( #2587 )
2014-03-20 16:33:23 +01:00
anovicecodemonkey
8d7c0cca13
[generic] Add support for embeded TED videos
2014-03-20 00:56:32 +10:30
Jaime Marquínez Ferrándiz
ecbe1ad207
[generic] Fix access to removed function in python 3.4
...
The `Request.get_origin_req_host` method was deprecated in 3.3, use the
`origin_req_host` property if it's not available, see http://docs.python.org/3.3/library/urllib.request.html#urllib.request.Request.get_origin_req_host .
2014-03-17 21:59:21 +01:00
Sergey M․
93d020dd65
[generic] Add support for embedded rutv player
2014-03-17 02:00:31 +07:00
Sergey M․
15fd51b37c
[generic] More generic support for embedded vimeo player ( #1602 )
2014-03-16 00:47:04 +07:00
Sergey M․
d95e35d659
[generic] Add nowvideo test hidden behind percent encoding
2014-03-15 04:39:53 +07:00
Sergey M․
1439073049
[generic] Add comment for unescaping webpage contents
2014-03-15 04:38:49 +07:00
Sergey M
1f7659dbe9
[generic] Unescape webpage contents
2014-03-15 04:21:17 +07:00
Philipp Hagemeister
60cc4dc4b4
[generic/funnyordie] Add support for funnyordie embeds ( Fixes #2546 )
2014-03-11 16:51:36 +01:00
Philipp Hagemeister
bcf89ce62c
[generic] Suppress warning about doctypes in RSS parser
2014-03-10 17:31:32 +01:00
Philipp Hagemeister
0a5bce566f
[generic] Add all test attributes for embedly ( #2447 )
...
In the future, we may want to not only print something, but throw an error for untested properties.
2014-03-05 14:05:50 +01:00
Philipp Hagemeister
8012bd2424
[generic] Get a better ID
2014-03-05 14:02:14 +01:00
Philipp Hagemeister
f55a1f0a88
Merge remote-tracking branch 'rzhxeo/embedly'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-05 14:01:53 +01:00
Sergey M.
ca97a56e4b
[vk] Add support for embedded videos ( Closes #2473 )
2014-02-28 23:51:54 +07:00
rzhxeo
1b86cc41cf
Add support for embed.ly
2014-02-27 08:14:28 +01:00
Philipp Hagemeister
89ef304bed
[generic] Add support for <meta redirect>
...
Fixes #413
2014-02-27 07:22:02 +01:00
Sergey M.
b1c6c32f78
[generic] Add support for nowvideo embedded videos
2014-02-24 23:37:42 +07:00
Jaime Marquínez Ferrándiz
f7300c5c90
[generic] Fix on python 2.6
...
`ParseError` is not available, it raises `xml.parsers.expat.ExpatError`.
The webpage needs to be encoded.
2014-02-21 16:59:10 +01:00
Philipp Hagemeister
4fc946b546
[generic] Add support for RSS feeds ( Fixes #667 )
2014-02-20 13:14:09 +01:00
Philipp Hagemeister
99877772d0
[generic] Add support for multiple brightcove URLs ( Fixes #2283 )
2014-02-03 15:19:40 +01:00