Commit Graph

12383 Commits

Author SHA1 Message Date
Remita Amine 99d537a5e0 [ooyala] fix typo 2017-01-14 07:12:50 +01:00
Sergey M․ abe8cb763f
[cbc] Improve playlist support (closes #11704) 2017-01-14 08:30:00 +07:00
Sergey M․ 5d4c7daa49
release 2017.01.14 2017-01-14 07:31:07 +07:00
Jakub Wilk 4f66c16f33 [brightcove:legacy] Fix misplaced backslash in a regexp 2017-01-14 06:26:11 +07:00
Sergey M․ e54fc0524e
[cmt] Add support for video-clips 2017-01-14 06:23:24 +07:00
Sergey M․ adf063dad1
[mtv,cc,cmt,spike] Improve and refactor
- Eliminate _transform_rtmp_url
* Generalize triforce mgid extraction
+ [cmt] Add support for full-episodes (closes #11623)
2017-01-14 06:18:38 +07:00
Remita Amine 5e8eebb600 [mitele] extract dash formats 2017-01-13 23:06:59 +01:00
Remita Amine 9837cb7507 [ooyala] add support for videos with embedToken(#11684) 2017-01-13 23:06:59 +01:00
Sergey M․ fb6a59205e
[mixcloud] Fix extraction (closes #11674) 2017-01-13 23:56:16 +07:00
Vijay Singh 06e9363b7a
[openload] Fix extraction (closes #10408)
Just a minor fix for openload
2017-01-13 23:40:19 +07:00
Remita Amine 1f393a3241 [tv4] improve extraction(closes #11698)
- remove check for requires_subscription
- extract more formats
- extract subtitles
2017-01-13 10:21:37 +01:00
Remita Amine c4251b9aaa [common] add possibility to customize akamai manifest host 2017-01-13 10:21:36 +01:00
Sergey M․ 3a407e707a
[freesound] Improve and remove unrelated metadata (closes #11608) 2017-01-12 23:03:53 +07:00
Sergey M․ cb655f34fb
[utils] Add more date formats 2017-01-12 22:39:45 +07:00
sh!zeeg ed06da4e7b
[freesound] Fix extraction and extended (closes #11602) 2017-01-12 22:35:14 +07:00
Sergey M․ 365d136b7c
[vimeo] Fix tests 2017-01-11 22:57:08 +07:00
Sergey M․ 1fd0fc42bd
[vimeo:ondemand] Fix test (closes #11651) 2017-01-11 22:51:03 +07:00
Sergey M․ 10cd2003b4
[nick] Add support for beta.nick.com (closes #11655) 2017-01-10 22:32:34 +07:00
Sergey M․ cdd11c0540
[mtv] Use native hls by default 2017-01-10 22:31:20 +07:00
Sergey M․ 67fc365b86
[mtv,cc] Use hls by default (closes #11641) 2017-01-10 22:30:47 +07:00
Sergey M․ 20faad74b6
[mtv] Fix non-hls extraction
method attribute may not be present
2017-01-10 22:27:23 +07:00
Sergey M․ 2032d935d1
[mtv] Add default value for use_hls
These methods are used across codebase with old number of arguments
2017-01-10 22:25:33 +07:00
Sergey M․ 31ea2ad89d
release 2017.01.10 2017-01-10 21:29:20 +07:00
Sergey M․ d1aeacd9bf
[youtube] Fix extraction (closes #11663, #11664) 2017-01-10 21:25:29 +07:00
Sergey M․ 366b759a60
[inc] Improve (closes #11647) 2017-01-09 23:08:59 +07:00
Déstin Reed 7f0bdc7a31
[inc] Add extractor 2017-01-09 22:57:14 +07:00
Sergey M․ 022a5d663b
[youtube] Add test for itag 212 (#11575) 2017-01-09 22:30:46 +07:00
Kacper Michajłow 8409b3683c [youtube] Add itag 212
Seen on video with id 1t24XAntNCY
2017-01-09 22:29:03 +07:00
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
2017-01-09 11:24:40 +01:00
Sergey M․ e7ea724cb9
release 2017.01.08 2017-01-08 20:58:43 +07:00
Sergey M․ 364131584b
[hitrecord] Improve (closes #11626) 2017-01-08 20:17:18 +07:00
J 553c68bbd9
[hitrecord] Add extractor 2017-01-08 20:17:18 +07:00
Remita Amine 827961b122 [videott] remove extractor 2017-01-07 14:47:36 +01:00
Remita Amine a5eefc492b [swrmediathek] skip tests correctly 2017-01-06 15:09:10 +01:00
Remita Amine a9cd1691b2 [swrmediathek] improve extraction 2017-01-06 15:06:08 +01:00
Remita Amine 2365f94412 [sharesix] remove extractor 2017-01-06 13:56:58 +01:00
Remita Amine 32b7c2a57e [aol] remove AolFeaturesIE 2017-01-06 12:10:47 +01:00
Remita Amine 221ce32529 [break] merge BreakIE and ScreenJunkiesIE 2017-01-06 11:25:48 +01:00
Remita Amine e5dfdc8164 [sendtonews] improve info extraction 2017-01-06 11:23:43 +01:00
Remita Amine a814da3f62 [skynews] update test 2017-01-06 11:22:35 +01:00
Sergey M․ b2727d0bee
[3sat,phoenix] Fix extraction (closes #11619) 2017-01-06 17:13:53 +07:00
Philipp Hagemeister dbaf601646 [comedycentral/mtv] Add support for HLS videos (fixes #11600)
Currently, the HTTP files of the RTMP urls are not present for the The Daily Show.
Use HLS instead for now.
2017-01-05 22:36:07 +01:00
Yen Chi Hsuan ec85ded83c
Fix "invalid escape sequences" error on Python 3.6 2017-01-06 00:58:56 +08:00
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
2017-01-05 18:50:34 +08:00
Sergey M․ 7232bb299b
release 2017.01.05 2017-01-05 04:10:15 +07:00
Sergey M․ fb47cb5b23
[zdf] Improve (closes #11055, closes #11063) 2017-01-05 04:05:27 +07:00
Paul Hartmann b6de53ea8a
[zdf] Fix extraction 2017-01-05 04:04:53 +07:00
Sergey M․ 96d315c2be
[pornhub:playlist] Improve extraction (closes #11594) 2017-01-04 05:32:18 +07:00
Sergey M․ 1911d77d28
[cctv] Add support for ncpa-classic.com (closes #11591) 2017-01-04 01:30:40 +07:00
Sergey M․ 027e231295
[tunein] Add support for embeds (closes #11579) 2017-01-03 01:45:59 +07:00
Sergey M․ 7a9e066972
[cctv] Relax some video id regexes 2017-01-03 01:13:02 +07:00
Sergey M․ 2021b650dd
release 2017.01.02 2017-01-02 23:55:04 +07:00
Sergey M․ 3783a5ccba
[cctv] Relax _VALID_URL 2017-01-02 23:18:44 +07:00
Sergey M․ 327caf661a
[cctv] Do not fallback on video id extracted from URL 2017-01-02 23:00:37 +07:00
Sergey M․ ce7ccb1caa
[cctv] Improve and merge with cntv (closes #879, closes #6753, closes #8541) 2017-01-02 22:55:24 +07:00
RPing 295eac6165
[cntv] Add extractor 2017-01-02 22:55:19 +07:00
Sergey M․ 966815e139
[nrktv:episodes] Add support for episodes (#11571) 2017-01-01 21:26:32 +07:00
Sergey M․ 1f766b6e7b
[arkena] Add support for video.arkena.com (closes #11568) 2017-01-01 02:46:47 +07:00
Sergey M․ dc48a35404
release 2016.12.31 2016-12-31 23:58:41 +07:00
Sergey M․ b6ee45e9fa
Improve custom config support (closes #10648) 2016-12-31 23:41:37 +07:00
Fabian Stahl e66dca5e4a
Add option --config-location
A configfile can now be passed to youtube_dl.

undo changes

Raise parser error if file not found, change to user_conf

change metavar hand helptext for --configfile

Fix help for --configfile

Update help for --configfile

Numbering placeholder in configfile error msg

minor fix

Change option --configfile top --config-file

Fix -config-file error
2016-12-31 23:04:16 +07:00
Sergey M․ 3f1ce16876
[twitch:vod] Improve _VALID_URL (closes #11537) 2016-12-31 22:40:42 +07:00
Robert Smith 9a0f999585
[twitch] Added support for player.twitch.tv URLs (closes #11535) 2016-12-31 22:32:49 +07:00
David Haberthür 3540fe262f
[README.md] Fix spelling and harmonize line length 2016-12-31 22:29:35 +07:00
Sergey M․ e186a9ec03
[videa] Add support for videa embeds 2016-12-31 22:05:32 +07:00
Sergey M․ 69677f3ee2
[videa] Improve and simplify (closes #8181, closes #11133) 2016-12-31 22:05:32 +07:00
Bagira e746021577
[videa] Add extractor 2016-12-31 22:05:32 +07:00
Sergey M․ 424ed37ec4
[vk] Fix postlive videos extraction 2016-12-30 04:31:19 +07:00
Sergey M․ 9cdb0a338d
[vk] Extract from playerParams (closes #11555) 2016-12-30 04:21:49 +07:00
Sergey M․ 6cf261d882
[freevideo] Remove extractor (closes #11515)
Handled by generic extractor
2016-12-30 00:32:23 +07:00
Sergey M․ df086e74e2
[showroomlive] Improve (closes #11458) 2016-12-30 00:12:35 +07:00
Arjan Verwer 963bd5ecfc
[showroomlive] Add extractor 2016-12-29 23:17:00 +07:00
Sergey M․ 51378d359e
[xhamster] Fix duration extraction (closes #11549) 2016-12-28 23:04:46 +07:00
Sergey M․ b63005f5af
[rtve:live] Fix extraction (closes #11529) 2016-12-25 04:02:29 +07:00
Yen Chi Hsuan 4606c34e19 [extractor/common] Allow non-lang in subtitles' keys
See 264e77c406
2016-12-25 01:50:50 +08:00
Sergey M․ 53a664edf4
[brightcove:legacy] Improve embeds detection (closes #11523) 2016-12-24 22:46:27 +07:00
Sergey M․ 264e77c406
[twitch] Add support for rechat messages (closes #11524) 2016-12-24 22:10:54 +07:00
Mattias Wadman 846fd69bac [acast] Add test with multiple blings 2016-12-24 14:28:30 +01:00
Mattias Wadman 12da830993 [acast] Fix broken audio URL and timestamp extraction
Before first bling was used now we look for the first bling with
type BlingAudio.

Before publishingDate was a ms unix timestamp now it is iso8601.
2016-12-24 14:28:30 +01:00
Sergey M․ 5e77c0b58e
release 2016.12.22 2016-12-22 22:52:54 +07:00
Remita Amine a07588369f [common] improve detection for video only formats and m3u8 manifest(fixes #11507) 2016-12-22 10:02:56 +01:00
Remita Amine f5a723a78a [theplatform] pass geo verification headers to smil request(closes #10146) 2016-12-21 20:59:03 +01:00
Remita Amine f120646f04 [viu] pass geo verification headers to auth request 2016-12-21 20:50:10 +01:00
Remita Amine 9c5b5f2115 [rtl2] extract more formats and metadata 2016-12-21 18:46:25 +01:00
Sergey M․ ae806db628
[vbox7] Skip malformed JSON-LD (closes #11501) 2016-12-21 22:39:05 +07:00
Remita Amine bfa1073e11 [uplynk] force downloading using hls native downloader(closes #11496) 2016-12-20 19:49:45 +01:00
Remita Amine e029c43bd4 [laola1] add support for another extraction scenario(closes #11460) 2016-12-20 18:22:57 +01:00
Sergey M․ 90352a8041
release 2016.12.20 2016-12-20 22:39:39 +07:00
Sergey M․ 3d6761ba92
[vbox7] Fix extraction (closes #11494) 2016-12-20 21:53:51 +07:00
Remita Amine f59d1146c0 [uktvplay] Add new extractor(closes #11027) 2016-12-20 12:52:46 +01:00
Remita Amine b1c357975d [piksel] Add new extractor(closes #11246) 2016-12-20 12:35:03 +01:00
Remita Amine d8c507c9e2 [vimeo] fix extraction for hls formats and add support for dash formats(closes #11490) 2016-12-20 12:35:03 +01:00
Remita Amine 7fe1592073 [common] fix dash codec information for mixed videos and fragment url construction(#11490) 2016-12-20 12:35:03 +01:00
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Sergey M․ c80db5d398
[nrktv:direkte] Add support for live streams (#11488) 2016-12-19 23:47:45 +07:00
Remita Amine 5aaf012a4e [pbs] fix extraction for geo restricted videos(#7095) 2016-12-19 16:27:12 +01:00
Remita Amine 954529c10f [brightcove:new] skip widevine classic videos 2016-12-18 21:39:59 +01:00
Remita Amine ed7b333fbf [viu] extract supported hls manifest 2016-12-18 18:24:01 +01:00
Remita Amine 723103151e [viu] improve extraction(closes #10607)(closes #11329) 2016-12-18 17:20:53 +01:00
ping e7b6caef24 [viu] New extractor for viu.com 2016-12-18 17:20:53 +01:00
Sergey M․ f73d7d5074
release 2016.12.18 2016-12-18 19:50:33 +07:00
Remita Amine 199a47abba [ccma] Add new extractor(closes #11359) 2016-12-18 10:49:10 +01:00
Remita Amine b42a0bf360 [laola1tv] add support embed urls and improve extraction(#11460) 2016-12-17 21:48:45 +01:00
Remita Amine 6e416b210c [nbc] fix extraction for msnbc videos(fixes #11466) 2016-12-17 18:11:13 +01:00
Sergey M․ 04bf59ff64
[extractors] Add missing twitch imports 2016-12-17 23:03:50 +07:00
Sergey M․ 87a449c1ed
[extractor/common] Recognize DASH formats in html5 media entries 2016-12-17 23:03:13 +07:00
Sergey M․ 93753aad20
[twitch] Adapt to new videos pages schema (closes #11469) 2016-12-17 20:20:23 +07:00
Sergey M․ 2786818c33
[meipai] Fix regular videos extraction and improve (closes #10718) 2016-12-17 19:42:34 +07:00
Philip Xu 9b785768ac
[meipai] Add extractor 2016-12-17 19:41:35 +07:00
Sergey M․ 47c914f995
[ondemandkorea] Fix extraction (closes #10772) 2016-12-17 18:50:12 +07:00
Sergey M․ 732d116aa7
[jwplatform] Improve duration extraction 2016-12-17 18:50:07 +07:00
Sergey M․ a495840d3b
[jwplatform] Improve subtitles extraction 2016-12-17 18:50:00 +07:00
Sergey M․ b0c65c677f
[utils] Improve urljoin 2016-12-17 18:49:55 +07:00
ping 594601f545
[ondemandkorea] Add extractor 2016-12-17 18:49:45 +07:00
Sergey M․ 0ae9560eea
[vporn] Use urljoin for thumbnail 2016-12-16 23:57:51 +07:00
Remita Amine dc1f3a9f20 [vvvvid] do not cache the conn_id 2016-12-16 11:05:46 +01:00
Remita Amine 7b1e80792b [vvvvid] Add new extractor(closes #5915) 2016-12-16 09:05:34 +01:00
Sergey M․ 38be3bc568
release 2016.12.15 2016-12-15 21:16:55 +07:00
Yen Chi Hsuan 5c32a5be95 [openload] Recognize oload.tv URLs (#10408) 2016-12-15 17:51:26 +08:00
Yen Chi Hsuan 30918999f5
[facebook] Recognize .onion URLs (closes #11443) 2016-12-15 01:04:49 +08:00
Sergey M․ 069f918302
[vlive] Use live titles for live streams 2016-12-14 21:30:33 +07:00
Sergey M․ 89c63cc5f8
[vlive] Add video params extraction fallback and improve (closes #11375) 2016-12-14 21:05:50 +07:00
Corey Nicholson 577748075b
[vlive] Update extraction 2016-12-14 21:05:32 +07:00
Remita Amine 67dcbc0add [canvas] extract dash formats 2016-12-13 17:59:22 +01:00
Sergey M․ 3a40f859b5
[melonvod] Improve (closes #11419) 2016-12-13 02:27:26 +07:00
Sergey M․ e34c33614d
[utils] Add convenience urljoin 2016-12-13 02:23:49 +07:00
ping abf3494ac7
[melonvod] Add extractor for vod.melon.com 2016-12-13 02:13:40 +07:00
Sergey M․ 3c1e9dc4ec
release 2016.12.12 2016-12-12 01:44:50 +07:00
Sergey M․ 3530e0d3d9
[dplay] Use Safari user-agent for hls (closes #11418) 2016-12-12 00:58:08 +07:00
Sergey M․ fb37eb25d9
[utils] Add common user agents map 2016-12-12 00:49:07 +07:00
Sergey M․ d2d2495e16
[facebook] Detect login required error message 2016-12-11 01:40:30 +07:00
Sergey M․ 19b4900b7b
[facebook] Improve video selection (closes #11390) 2016-12-11 01:22:01 +07:00
Sergey M․ 6ca478d44a
[canalplus] Add another video id regex (closes #11399) 2016-12-11 00:45:27 +07:00
Sergey M․ 655cb545ab
[mixcloud] Relax _VALID_URL (closes #11406) 2016-12-10 23:48:18 +07:00
Remita Amine f0b69fa91a [ctvnews] relax _VALID_URL regex(closes #11394) 2016-12-10 17:36:32 +01:00
Remita Amine 8821a718cf [common] recognize hls manifests that contain video only formats(#11394) 2016-12-10 17:22:15 +01:00
Remita Amine 0d7d9f9404 [rte] improve extraction(closes #10498)(closes #7746) 2016-12-10 16:34:01 +01:00
Remita Amine f41db40596 [prosiebensat1] extract dash formats 2016-12-10 13:29:51 +01:00
Remita Amine 68601ef3ac [rts,srgssr] improve extraction for geo restricted videos(fixes #11089)(closes #4989) 2016-12-10 10:47:56 +01:00
Sergey M․ 18ece70c4d
release 2016.12.09 2016-12-09 02:46:18 +07:00
Yen Chi Hsuan 6c20a0bb99
[openload] Fix extraction (closes #10408) 2016-12-09 02:15:16 +08:00
Sergey M․ f43795e56b
[pandoratv] PEP 8 and simplify 2016-12-07 23:50:10 +07:00
Serkora 7441915b1e [pandoratv] Fix extraction (closes #11023) 2016-12-07 23:46:42 +07:00
Remita Amine 283d1c6a8b [telebruxelles] extract all formats and add support for emission urls 2016-12-06 19:01:17 +01:00
Sergey M․ 875ddd7409
[bloomberg] Add another video id regex (closes #11371) 2016-12-06 00:41:03 +07:00
Sergey M․ 4afa4ff223
[1tv] Fix video id extraction 2016-12-05 23:28:57 +07:00
vordep 3ed81714d8
[fusion] Update ooyala id regex 2016-12-05 22:43:36 +07:00
Yen Chi Hsuan 4bd7d9d4ae
[socks] Refine exception model for better error handling
1. ProxyError now inherits from socket.error instead of IOError

The only functions socks.py overrides are connect and connect_ex. In
Python 2.x and Python <= 3.2, socket functions raises socket.error. In
newer Python versions, those functions raises OSError instead. The name
socket.error is preserved as an alias of OSError for backward
compability. To keep socks.py compatible with Python's standard library,
it should raise the same exception as raw sockets.

See PEP 3151 (https://www.python.org/dev/peps/pep-3151/) for more
information about the change in Python 3.3.

2. Raise EOFError instead of IOError when the socket receives less data
than it expects

There's no common convention, but both ftplib and telnetlib raises
EOFError for similar situations. socks.py follows them.

Closes #11355

In #11355, only Python 2 is affected. In Python 3, both socket.error and
IOError are alias of OSError, so AbstractHTTPHandler.do_open correctly
catches the error and thus InfoExtractor._is_valid_url works fine.
2016-12-05 00:43:37 +08:00
Sergey M․ 9b5288c92a
[1tv] Improve extraction and add support for playlists (closes #11335) 2016-12-04 23:35:21 +07:00
Yen Chi Hsuan 8344296619
[socks] Fix error reporting (#11355) 2016-12-03 21:53:41 +08:00
Remita Amine a94e7f4a0c [aenetworks] extract more formats(closes #11321) 2016-12-01 12:15:35 +01:00
Yen Chi Hsuan d17bfe4095
[thisoldhouse] Recognize /tv-episode/ URLs and update _TESTS
Closes #11271
2016-12-01 14:56:52 +08:00
Sergey M․ 73ec479c7d
release 2016.12.01 2016-12-01 00:15:12 +07:00
Sergey M․ 4c4765dba2
[soundcloud] Update client id (closes #11327) 2016-11-30 23:17:30 +07:00
Philipp Hagemeister f882554815 [comedcycentral] Give /shows/.+/full-episodes URLs to the COmedyCentralFullEpisodesIE 2016-11-30 11:52:19 +01:00
Sergey M․ db75f14d8a
[ruutu] Detect DRM videos 2016-11-30 04:19:38 +07:00
Sergey M․ 8b0d3ee64e
[liveleak] Simplify and PEP 8 2016-11-29 23:42:19 +07:00
Varun 3779d524df [liveleak] Add support for youtube embeds 2016-11-29 23:37:30 +07:00
Mark Lee 6303fc8204 [spike] Fix full episodes extraction 2016-11-29 23:06:01 +07:00
Philipp Hagemeister cc61fc3934 [comedycentral] Add new extractor for full-episodes
CC seems to have added yet another indirection for full episodes - the mgid is now only in a linked feed.
This may be a little brittle, but it's better than failing outright.
Plus, the current The Daily Show episode now works :)
2016-11-29 10:12:18 +01:00
Sergey M․ c2530d3319
[teamfourstar] Simplify _VALID_URL and relax regexes 2016-11-28 23:22:29 +07:00
felix 8953319916 [screenwavemedia] Remove extractor
Rewrite TeamFourStar and Normalboots extractors in terms of JWPlatform
2016-11-28 23:17:56 +07:00
Sergey M․ 2b380fc299
release 2016.11.27 2016-11-27 20:05:32 +07:00
Sergey M․ 83f1481baa
[extractor/generic] Add support for webcaster.pro embeds 2016-11-27 19:56:32 +07:00
Sergey M․ f25e1c8d8c
[webcaster] Add support for webcaster.pro 2016-11-27 19:54:59 +07:00
Sergey M․ 6901673868
[azubu] Add support for azubu.uol.com.br (closes #11305) 2016-11-27 15:40:28 +07:00
Sergey M․ 560c8c6ec0
[viki] Prefer hls 2016-11-26 00:14:09 +07:00
Sergey M․ 9338a0eae3
[viki] Fix rtmp formats extraction (closes #11255) 2016-11-26 00:13:46 +07:00
Sergey M․ 74394b5e10
[puls4] Relax _VALID_URL (closes #11267) 2016-11-25 23:37:32 +07:00
Sergey M․ 1db058466d
[vevo] Allow video info to fail in tests 2016-11-24 23:10:58 +07:00
Sergey M․ e94eeb1dd3
[vevo] Simplify artists extraction 2016-11-24 23:09:35 +07:00
Andrew J. Erickson 8b27d83e4e
vevo: fixing naming when there are featured artists 2016-11-24 23:07:28 +07:00
Sergey M․ 8eb7b5c3f1
[mitele] Modernize and extract more metadata 2016-11-24 22:43:02 +07:00
zurfyx b68599ed47
[mitele] Relax _VALID_URL 2016-11-24 21:57:53 +07:00
Yen Chi Hsuan 44444f0d3b
[cbslocal] Support newyork.cbslocal.com
Closes #11285
2016-11-24 20:32:17 +08:00
Sergey M․ c867adc68c
[youtube:playlist] Pass disable_polymer in query (closes #11193, closes #11270) 2016-11-23 23:28:32 +07:00
Sergey M․ 3b5daf0736
release 2016.11.22 2016-11-22 22:32:16 +07:00
Andy Savicki 868630fbe5
[hellporno] Add support for hellporno.net and improve ext extraction 2016-11-22 22:16:10 +07:00
Yen Chi Hsuan 1d6ae5628f
[amcnetworks] Recognize more BBC America URLs
Closes #11263
2016-11-22 20:40:57 +08:00
Sergey M․ 6334794f2a
[funnyordie] Copy formats' metadata from hls and sort formats 2016-11-21 23:46:55 +07:00
Andy Savicki 4eece8ba57
[funnyordie] Improve extraction 2016-11-21 22:16:26 +07:00
Sergey M․ 8f8f182d0b
[extractor/generic] Improve limelight embeds support 2016-11-20 02:13:21 +07:00
Yen Chi Hsuan fb27d0ce5e
Merge branch 'master' of https://github.com/DarkstaIkers/youtube-dl into DarkstaIkers-master 2016-11-20 00:05:11 +08:00
Sergey M․ 0aacd2deb1
[bandcamp] Fix free downloads extraction and extract all formats (closes #11067) 2016-11-19 04:18:21 +07:00
Sergey M․ df46b19cb8
[toutv] Fix login form regex (closes #11223) 2016-11-19 01:56:31 +07:00
Sergey M․ 748a462fbe
[twitter:card] Relax _VALID_URL (closes #11225) 2016-11-19 01:49:13 +07:00
Sergey M․ c131fc3372
[tvanouvelles] Add extractor (closes #10616) 2016-11-18 01:16:33 +07:00
Sergey M․ b25459b88a
release 2016.11.18 2016-11-18 00:25:24 +07:00
Yen Chi Hsuan 582be35847
Update coding style after pycodestyle 2.1.0
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.

See https://github.com/PyCQA/pycodestyle/issues/400

See also #10689; thanks @stepshal for first mentioning this issue and
initial patches
2016-11-17 19:45:42 +08:00
Sergey M․ 073d5bf583
[youtube:live] Relax _VALID_URL (closes #11164) 2016-11-16 23:15:19 +07:00
Yen Chi Hsuan 315cb86a95 Merge pull request #11210 from FooBarQuaxx/patch-2
Strip only args urls
2016-11-16 23:29:37 +08:00
FooBarQuaxx b2fc1c4fb9 Add explanatory comment 2016-11-16 18:18:54 +03:00
Yen Chi Hsuan eceba9f805 Merge pull request #11122 from kasper93/openload
[openload] Fix extraction.
2016-11-16 20:43:19 +08:00
MAA d755396804 Strip only args urls 2016-11-16 09:00:30 +03:00
Sergey M․ 58355a3bf1
[vlive] Add test for #11203 2016-11-15 22:11:47 +07:00
ping 49b69ad91c [vlive] Prefer locale over language for subtitles id 2016-11-15 22:07:17 +07:00
Sergey M․ 6b4dfa2819
release 2016.11.14.1 2016-11-14 02:48:15 +07:00
Sergey M․ b3d4bd05f9
release 2016.11.14 2016-11-14 02:39:50 +07:00
felix a0758dfa1a [filmon] new extractor 2016-11-13 17:28:17 +01:00
Sergey M․ 50913b8241
[nrk] Improve geo restriction detection 2016-11-13 22:29:36 +07:00
Sergey M․ 7e08e2cab0
[nrk] Add X-Forwarded-For HTTP header in info dict 2016-11-13 22:28:29 +07:00
Sergey M․ 690355551c
[downoader/fragment,f4m,hls] Add internal support for custom HTTP headers 2016-11-13 22:22:10 +07:00
Sergey M․ 754e6c8322
[nrk] Workaround geo restriction and improve error messages 2016-11-13 20:54:34 +07:00
Sergey M․ e58609b22c
[afreecatv] Add support for vod.afreecatv.com (closes #11174) 2016-11-13 06:02:26 +07:00
Sergey M․ 4ea4c0bb22
[extractor/common] Fix Bandwidth substitution in media template (closes #11175) 2016-11-13 05:43:34 +07:00
Kacper Michajłow 577281b0c6
[cda] Fix and improve extraction
Fixes #10929
2016-11-13 01:01:29 +07:00
Sergey M․ 3d2729514f
[plays] Improve extraction and add support for embed URLs 2016-11-12 23:08:05 +07:00
Sergey M․ f076d7972c
[extractor/common] Improve thumbnail extraction from JSON-LD 2016-11-12 23:01:05 +07:00
cpm 8b1aeadc33
[plays] Fix extraction 2016-11-12 22:59:39 +07:00
Kacper Michajłow 95ad9ce573 [openload] Fix extraction.
aadecode code was restored from commit c1decda58c
with some optimizations (2x faster).

Fixes #10408
2016-11-11 15:36:57 +01:00
Kacper Michajłow 189935f159 [jsinterp] Fix function calls without arguments. 2016-11-11 15:36:57 +01:00
Sergey M․ bc40b3a5ba
[eagleplatform] Fix extraction (closes #11160) 2016-11-11 03:26:29 +07:00
Yen Chi Hsuan 3eaaa8abac [audioboom] Recognize /posts/ URLs (closes #11149) 2016-11-10 14:52:34 +08:00
Sergey M․ db3367f43e
release 2016.11.08.1 2016-11-08 22:30:53 +07:00
Sergey M․ 4719af097c
[extractors] Add forgotten import for espn:article 2016-11-08 22:27:02 +07:00
Sergey M․ 9946aa5ccf
[franceculture] Fix extraction (closes #11140) 2016-11-08 22:26:33 +07:00
Sergey M․ c58e07a7aa
release 2016.11.08 2016-11-08 22:11:21 +07:00
Yen Chi Hsuan 5d47b38cf5 [tmz:article] Fix extraction (closes #11052) 2016-11-08 21:53:41 +08:00
Sergey M․ ebc7ab1e23
[espn] Fix extraction (closes #11041) 2016-11-08 00:29:12 +07:00
DarkZeros cb882540e8 [mitele] Fix extraction after website redesign (fixes #10824) 2016-11-07 11:13:59 +01:00
Sergey M․ 98708e6cbd
[ard] Remove age restriction check (closes #11129) 2016-11-06 23:20:15 +07:00
Sergey M․ b52c9ef165
[extractor/generic] Improve support for pornhub embeds (closes #11100) 2016-11-06 21:52:00 +07:00
Sergey M․ e28ed498e6
[extractor/generic] Add support for redtube embds (closes #11099) 2016-11-06 21:42:41 +07:00
Sergey M․ 5021ca6c13
[redtube] Add support for embed URLs 2016-11-06 21:39:29 +07:00
Sergey M․ 37e7a71c6c
[extractor/generic] Add support for drtuber embds (closes #11098) 2016-11-06 21:33:51 +07:00
Sergey M․ f5c4b06f17
[drtuber] Fix title extraction 2016-11-06 21:29:15 +07:00
Sergey M․ 519d897049
[drtuber] Add support for embed URLs 2016-11-06 21:28:51 +07:00
Sergey M․ b61cd51869
[yahoo] Add test and improve some content id regex 2016-11-06 21:16:33 +07:00
Sergey M․ f420902a3b
[yahoo] Add another content id regex (closes #11088) 2016-11-06 21:14:15 +07:00
Sergey M․ de328af362
[toutv] Relax _VALID_URL (closes #11121) 2016-11-05 03:24:42 +07:00
Sergey M․ b30e4c2754
release 2016.11.04 2016-11-04 22:07:54 +07:00
Sergey M․ 640aff1d0c
[anvato] Improve formats extraction 2016-11-04 21:45:24 +07:00
Sergey M․ c897af8aac
[cbslocal] Update test 2016-11-04 21:33:08 +07:00
Sergey M․ f3c705f8ec
[fox9] Add extractor (closes #11110) 2016-11-04 21:32:30 +07:00
Sergey M․ f93ac1d175
[anvato] Extract more metadata 2016-11-04 21:17:56 +07:00
Sergey M․ c4c9b8440c
[extractor/common] Tolerate malformed RESOLUTION attribute in m3u8 manifests (closes #11113) 2016-11-04 05:02:31 +07:00
Sergey M․ 32f2627aed
[vodlocker] Add another removed file pattern (closes #11106) 2016-11-03 22:22:40 +07:00
Sergey M․ 9d64e1dcdc
[downloader/ism] Fix typo 2016-11-03 22:15:09 +07:00
Remita Amine 10380e55de [downloader/ism] fix AVC Decoder Configuration Record creation in python 3 2016-11-03 16:08:57 +01:00
Remita Amine 22979993e7 [vice] add coding cookie 2016-11-03 16:07:22 +01:00
Remita Amine b47ecd0b74 [vzaar] Add new extractor(closes #11093) 2016-11-03 12:50:41 +01:00
Remita Amine b811b4c93b [vice] add support for uplynk preplay videos(#11101) 2016-11-03 10:37:07 +01:00
Remita Amine f4dfa9a5ed [tubitv] fix extraction(closes #11061) 2016-11-03 09:04:20 +01:00
Remita Amine 3b4b66b50c [shahid] add support for authentication(closes #11091) 2016-11-03 00:44:12 +01:00
Sergey M․ 4119a96ce5
[extractor/generic] Skip URLs we came from when delegating ISM extraction 2016-11-02 23:43:41 +07:00
Sergey M․ 26aae56690
[extractor/generic] Improve ISM extraction 2016-11-02 23:34:37 +07:00
Remita Amine 4f9cd4d36f [radiocanada] extract subtitle(closes #11096) 2016-11-02 13:55:40 +01:00
Sergey M․ cc99a77ac1
[extractor/generic] Add support for ISM manifests 2016-11-02 03:01:13 +07:00
Sergey M․ 8956d6608a
release 2016.11.02 2016-11-02 02:39:36 +07:00
Sergey M․ 3365ea8929
[extractor/common] Remove unused code 2016-11-02 02:34:23 +07:00
Sergey M․ 1616f9b452
[extractor/common] Fix typo 2016-11-02 02:30:25 +07:00
Sergey M․ 02dc0a36b7
[utils] Introduce base_url 2016-11-02 02:30:18 +07:00
Remita Amine 639e3b5c99 extract ISM formats in some of the extractors 2016-11-02 01:54:45 +07:00
Remita Amine b2758123c5 add Basic support for Smooth Streaming protocol(#8118) 2016-11-02 01:54:45 +07:00
Sergey M․ f449c061d0
[nicknight] Improve extraction (closes #10769) 2016-11-02 01:35:53 +07:00
Sergey M․ 9c82bba05d
[nickde] Improve extraction 2016-11-02 01:29:05 +07:00
NeroBurner e3577722b0
[nicknight] Add extractor 2016-11-02 01:25:59 +07:00
Sergey M․ b82c33dd67
[extractor/common] Improve mpd base URL extraction (closes #10909, closes #11079) 2016-11-01 01:15:46 +07:00
Sergey M․ e5a088dc4b
[utils] Fix --match-filter for int-like strings (closes #11082) 2016-10-31 23:32:08 +07:00
Sergey M․ 2c6da7df4a
release 2016.10.31 2016-10-31 01:36:53 +07:00
Sergey M․ e70a5e6566
release 2016.10.30 2016-10-30 18:24:49 +07:00
Sergey M․ a901fc5fc2
[vessel] Add tests for #11068 2016-10-30 18:17:15 +07:00
dundua cae6bc0118 [vessel] Improve video id extraction 2016-10-30 18:14:51 +07:00
Yen Chi Hsuan d9ee2e5cf6
[facebook] Remove SWF params so that 1080P are detected
Closes #11073

In the provided link, SWF params give up to 720P, and VideoConfig
gives 1080P for both best and bestvideo. I guess all Facebook videos
supports HTML5 now, so I remove the old detection for SWF params
2016-10-30 18:20:55 +08:00
Yen Chi Hsuan e1a0b3b81c
[imgur] Recognize /r/ URLs (closes #11071) 2016-10-30 17:02:03 +08:00
Sergey M․ 2a048f9878
[beeg] Fix extraction (closes #11069) 2016-10-30 05:27:50 +07:00
Yen Chi Hsuan f02700a1fa
[openload] Fix extraction (#10408)
Thanks @TwelveCharzz again for studying openload codes
2016-10-29 18:00:30 +08:00
Sergey M․ f3517569f6
[gvsearch] Modernize and fix page result request (closes #11051) 2016-10-28 23:19:59 +07:00
neutric c725333d41 [ard] Fix typo 2016-10-27 03:59:00 +07:00
Yen Chi Hsuan a5a8877f9c
[adultswim] Fix extraction (closes #10979) 2016-10-27 02:16:48 +08:00
Remita Amine 43c53a1700 [nobelprize] Add new extractor(closes #9999) 2016-10-26 18:15:23 +01:00
Yen Chi Hsuan ec8705117a
[hornbunny] Fix extraction (#10981) 2016-10-27 00:10:51 +08:00
Remita Amine 3d8d44c7b1 [tvp] improve video id extraction(closes #10585) 2016-10-26 16:47:22 +01:00
Sergey M․ 88839f4380
release 2016.10.26 2016-10-26 19:55:09 +07:00
Sergey M․ 773017c648
[rentv] Move rentv test from generic extractor and add only matching tests 2016-10-26 19:52:43 +07:00
Remita Amine 777d90dc28 [rentv] Add new extractor(closes #10620) 2016-10-26 10:07:35 +01:00
Sergey M․ 3791d84acc
[ard] Detect unavailable videos (closes #11018) 2016-10-25 21:21:47 +07:00
Sergey M․ 9305a0dc60
[vk] Fix extraction (closes #11022) 2016-10-25 21:05:29 +07:00
Sergey M․ 94e08950e3
release 2016.10.25 2016-10-25 03:19:36 +07:00
Sergey M․ d3b6b3b95b
[jamendo] Improve 2016-10-25 02:46:48 +07:00
Thor77 b17422753f [jamendo] Add extractor 2016-10-25 02:43:03 +07:00
Sergey M․ d2e96a8ed4
[pandatv] Extract m3u8, document reverse source and PEP 8 2016-10-25 01:51:37 +07:00
Zhong Jianxin 2e7c8cab55 [pandatv] Add new extractor 2016-10-25 01:46:02 +07:00
Sergey M․ d7d4481c6a
[movieclips] Fix _VALID_URL 2016-10-24 23:54:42 +07:00
Yen Chi Hsuan 5ace137bf4
[dotsub] Support vimeo embed (closes #10964) 2016-10-24 15:13:33 +08:00
Yen Chi Hsuan 9dde0e04e6
[litv] Fix extraction (#11006) 2016-10-23 23:23:40 +08:00
Sergey M․ f16f8505b1
[vimeo] Delegate ondemand redirects to ondemand extractor (closes #10994) 2016-10-23 18:48:50 +07:00
Sergey M․ 9dc13a6780
[vivo] Fix extraction (closes #11003) 2016-10-23 18:07:56 +07:00
Sergey M․ 9aa929d337
[twitch:stream] Add support for rebroadcasts (closes #10995) 2016-10-23 17:20:45 +07:00
Sergey M․ 425f3fdfcb
[pluralsight] Fix subtitles conversion (closes #10990) 2016-10-22 21:15:39 +07:00
Yen Chi Hsuan b64d04c119
[utils] Clarify for redirecting STDIN in get_exe_version() 2016-10-22 13:04:05 +08:00
John Hawkinson 00ca755231 [get_exe_version] Do version probes with <&-
When doing version probes for ffmpeg, do the
equivalent of calling it as:

    ffmpeg -version <&-

Where <&- is shell syntax for closing stdin before calling the
program. This is roughly equivalent to </dev/null without actually
opening /dev/null.

This prevents ffmpeg -version from hanging when run in the background.
Fixes #955.

The reason is that ffmpeg tries to manipulate stdin to set up terminal
characteristic, and that causes the kernel to suspend the parent
process (youtube-dl).

Note that closing stdin is achieved by calling subprocess.Popen() with
stdin set to subprocess.PIPE and without passing any input to
Popen.communicate(). This is somewhat subtle.
2016-10-22 00:34:08 -04:00
Sergey M․ 69c2d42bd7
release 2016.10.21.1 2016-10-21 04:57:28 +07:00
Sergey M․ 859447a28d
[adobepass] PEP 8 2016-10-21 04:38:14 +07:00
Sergey M․ f8ae2c7f30
[pluralsight] Process all clip URLs (closes #10984) 2016-10-21 04:35:32 +07:00
Sergey M․ 9ce0077485
release 2016.10.21 2016-10-21 03:08:42 +07:00
Sergey M․ 9df6b03caf
[pluralsight] Adapt to new API (closes #10972) 2016-10-21 03:00:03 +07:00
Yen Chi Hsuan 8e2915d70b
Revert "[postprocessor/embedthumbnail] Allow mkv to embed thumbnails"
This reverts commit 7360db05b4.

This commit was added as an attempt to fix #6046. Unfortunately, the fix
is completely wrong. As reported on #10359, embedded thumbnails are not
displayed in VLC, and Se7en on IRC reports that the embedded thumbnail
misleads mpv as well.

The correct way is using -attachment of ffmpeg, while the current
run_ffmpeg_multiple_files API can't handle it cleanly.
2016-10-20 15:07:19 +08:00
Kacper Michajłow 60633ae9a0 [openload] Fix extraction.
Fixes #10408
2016-10-19 22:00:29 +02:00
remitamine 9218a6b4f5 Merge pull request #10819 from raleeper/adobepass
[adobepass] Add Comcast
2016-10-19 20:16:24 +01:00
Remita Amine 02af6ec707 [natgeo] extract m3u8 formats(closes #10959) 2016-10-19 19:39:41 +01:00
raleeper 46f6052950 [adobepass] Add Comcast with fixed _download_webpage calls 2016-10-19 09:56:26 -07:00
Sergey M․ c8802041dd
release 2016.10.19 2016-10-19 23:55:16 +07:00
Sergey M․ 2b96b06bf0
[vidzi] Fix extraction (closes #10908, closes #10952) 2016-10-19 23:31:58 +07:00
Sergey M․ 06b3fe2926
[utils] Expose PACKED_CODES_RE 2016-10-19 23:28:49 +07:00
Remita Amine efb6242916 [urplay] add supprt for urskola.se and fix subtitle extraction(closes #10915) 2016-10-19 15:05:39 +01:00
Remita Amine 0384932e3d [extractor/common] try to extract non smil wowza mpd manifests 2016-10-19 14:57:12 +01:00
Remita Amine edd6074cea [extractor/common] detect f4m audio only formats 2016-10-19 14:42:48 +01:00
Remita Amine 791d29dbf8 [orf] add subtitles support(closes #10939) 2016-10-19 11:34:46 +01:00
Sergey M․ 481cc7335c
[youtube] Fix --no-playlist behavior for youtu.be/id URLs (closes #10896) 2016-10-19 03:27:18 +07:00
Sergey M․ 853a71b628
[nrk] Improve _VALID_URL 2016-10-19 03:02:14 +07:00
Sergey M․ e2628fb6a0
[nrk] Relax _VALID_URL (closes #10928) 2016-10-19 02:59:44 +07:00
Sergey M․ df4939b1cd
[nytimes] Fix typo 2016-10-17 22:16:23 +07:00
Sergey M․ 0b94dbb115
[postprocessor/ffmpeg] PEP 8 2016-10-16 19:16:47 +07:00
Sergey M․ 8d76bdf12b
[extractor/common] Mention podcast in series fields section 2016-10-16 18:37:17 +07:00
Sergey M․ 47da782337
[nytimes] Improve (closes #10926) 2016-10-16 18:21:02 +07:00
John Hawkinson 74324a7ac2
[nytimes] Add support for podcasts 2016-10-16 17:31:55 +07:00
Sergey M․ b0dfcab60a
[pluralsight] Relax _VALID_URL (closes #10941) 2016-10-16 17:20:32 +07:00
Sergey M․ bbd7706898
release 2016.10.16 2016-10-16 03:23:05 +07:00
Sergey M․ c0b1e88895
[huajiao] Improve feed regex 2016-10-16 03:02:41 +07:00
Sergey M․ 7cdfbbf9b8
[extractors] Change import for theoperaplatform extractor 2016-10-16 02:55:38 +07:00
Déstin Reed ac943d48d3 [Beatport] Update extractor name and tests 2016-10-16 02:33:43 +07:00
arza 73498a8921 [ruutu] Add support for supla.fi 2016-10-16 02:31:56 +07:00
Pierre Mdawar 2273e2c530 [postprocessor/ffmpeg] Return correct filepath and ext in updated information in FFmpegExtractAudioPP
Return correct audio's filepath and ext instead of the video's when extracting audio and audio file already exists.
2016-10-16 02:12:03 +07:00
Sergey M․ 4b492e3579
[theoperaplatform] Rename, fix _VALID_URL and fix test 2016-10-16 00:24:06 +07:00
Juanjo Benages 9c4258bcec
[theoperaplatform] Add extractor 2016-10-16 00:21:15 +07:00
Sergey M․ ea8aefd1d7
[lynda] Fix height for prioritized streams 2016-10-16 00:08:46 +07:00
Sergey M․ 6edfc40a0e
[lynda] Add fallback extraction scenario 2016-10-16 00:07:40 +07:00
Sergey M․ 68d9561ca1
[lynda] Switch to https (closes #10916) 2016-10-15 23:56:09 +07:00
Yen Chi Hsuan d32fa0f12c
[huajiao] Coding style 2016-10-15 14:53:53 +08:00
Yen Chi Hsuan a347a0d088
Merge branch 'huajiao' of https://github.com/pyx/youtube-dl into pyx-huajiao 2016-10-15 14:53:05 +08:00
Yen Chi Hsuan 77c5b98dcd
[crunchyroll] Skip an invalid _TEST 2016-10-15 14:36:07 +08:00
Yen Chi Hsuan 88ebefc054
[cmt] Fix mgid extraction (closes #10813)
The example in #10813 requires TV provider authentication in Firefox,
while youtube-dl can download it directly with an US proxy.

I'm not sure whether the mgid fix is cmt-specific or it applies to all
mtv-based sites. I keep it in cmt.py until similar patterns are found in
other websites.
2016-10-15 14:27:15 +08:00
Philip Xu 2e638d7bca Made optional fields optional 2016-10-14 14:12:06 -04:00
Sergey M․ a26b174c61
[safari:course] Add support for techbus.safaribooksonline.com 2016-10-15 00:29:33 +07:00
Sergey M․ 73c801d660
[orf:tvthek] Fix extraction and modernize (closes #10898) 2016-10-14 23:43:09 +07:00
Yen Chi Hsuan 8c3e448e80
[clipfish] Update _TEST; the old one is gone 2016-10-15 00:12:21 +08:00
Yen Chi Hsuan 2ecbd2ad6f
[chirbit:profile] Fix extraction 2016-10-15 00:01:46 +08:00
Yen Chi Hsuan 62a0b86e4f
[carambatv] Fix extraction
The video requested in #9815 now has videomore embeds.
2016-10-14 23:43:18 +08:00
Yen Chi Hsuan 146969e05b
[videomore] Support <iframe> embed videos
Seen in CarambaTVPage
2016-10-14 23:42:11 +08:00
Yen Chi Hsuan e2004ccaf7
[canalplus] Fix video_id and update _TESTS
Some tests are gone, and some redirect to different videos
2016-10-14 20:26:12 +08:00
Yen Chi Hsuan a5f8473145
[cbsinteractive] Fix extraction for cnet.com 2016-10-14 18:20:01 +08:00
Philip Xu b7f59a3bf6 [huajiao] Add new extractor 2016-10-13 21:51:26 -04:00
Yen Chi Hsuan 580d411931
[parliamentliveuk] Recognize lower case URLs
Closes #10912

Seems parliamentliveuk matches URLs case-insentive. For example this URL
also works:
http://parliamentlive.tv/EvEnt/Index/3F24936f-130f-40bf-9a5d-b3d6479da6a4
2016-10-14 00:44:28 +08:00
Sergey M․ 5c4bfd4da5
release 2016.10.12 2016-10-12 21:30:05 +07:00
Sergey M․ bcd6276520
[downloader/common] Remove debug output 2016-10-12 21:22:33 +07:00
Sergey M․ 591e384552
[streamable] Remove debug output 2016-10-12 21:22:12 +07:00
Yen Chi Hsuan 9feb1c9731
[dailymotion] Fix extraction and update _TESTS
Closes #10901

Seems all videos use player V5 syntax now
2016-10-12 21:45:49 +08:00
Yen Chi Hsuan a093cfc78b
[vimeo:review] Fix extraction (#10900)
Now Vimeo Review videos uses React. Thanks @davekaro for analyzing the
problem!
2016-10-12 01:48:06 +08:00
Yen Chi Hsuan cea364f70c
[extractor/common] Support HTML media elements without child nodes 2016-10-12 01:40:28 +08:00