618c71dc64
[cloudy] New domain name for the test_cloudy_1
...
I'm sure whether videoraj.ch still works or not, so keep it.
2016-04-28 15:46:00 +08:00
52af8f222b
[cwtv] Relax _VALID_URL ( Closes #9327 )
2016-04-28 04:01:21 +06:00
3cc8649c9d
[20min] Detect embedded YouTube videos
...
Fixes #9331
2016-04-28 02:58:11 +08:00
dcf094d626
[theplatform] Fix for Python 3.2
...
test_AENetworks{,_1} fails as in Python < 3.3, binascii.a2b_* functions
accepts only bytes-like objects
2016-04-27 18:35:33 +08:00
5b5d7cc11e
[mwave] Add Mwave Meet & Greet extractor
2016-04-27 15:57:17 +09:00
2ac2cbc0a3
[malemotion] Remove the extractor
...
Announcement from their homepage:
```
MaleMotion is closed
After another system crash, I'm forced to close the site
This week all content will be erased
Don't forget to cancel your subscription if any !
```
Closes #9311 .
2016-04-27 13:55:32 +08:00
a7e03861e8
[scivee] Skip the test
...
Not accessible from either Travis CI or my machine.
Closes #9315
2016-04-27 13:52:04 +08:00
175c2e9ec3
[youtube:search_url] Reimplement in terms of youtube:playlistbase
2016-04-26 22:29:29 +06:00
f1f879098a
[viewster] extract more metadata for http formats
2016-04-26 13:40:40 +01:00
c9fd530670
[ok] Extract start time
2016-04-25 22:15:15 +06:00
749b0046a8
[ok] Allow embeds without title ( Closes #9303 )
2016-04-25 22:05:47 +06:00
e3de3d6f2f
[normalboots] Fix extraction
...
Now it's using ScreenwaveMedia
2016-04-25 23:49:12 +08:00
ad58942d57
[muzu] Remove extractor
...
MUZU is shutting down in October 2015. [1]
[1] http://www.musicbusinessworldwide.com/youtube-rival-muzu-is-heading-into-liquidation/
2016-04-25 23:35:05 +08:00
4645432d7a
[eagleplatform] Checking direct HTTP links
...
Sometimes they fail with 404
2016-04-25 22:48:17 +08:00
6bdc2d5358
[mitele] Comment out unstable MD5
...
Also Akamai f4f fragments
2016-04-25 22:27:25 +08:00
2beff95da5
[nrk] Comment out unstable MD5 checksums
...
Both are Akamai f4f fragments.
2016-04-25 22:26:19 +08:00
abc1723edd
[unistra] Sort formats
...
Originally URLs are passed to set() and not sorted, so the result is not
deterministic, causing occasional FAILs on Travis CI.
2016-04-25 22:24:40 +08:00
d6712378e7
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv
2016-04-25 21:02:02 +08:00
fb72ec58ae
[extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge
2016-04-25 13:37:03 +01:00
c83a352227
[openload] Make thumbnail optional
2016-04-25 00:26:06 +06:00
e9063b5de9
[openload] Add test
2016-04-25 00:22:55 +06:00
594b0c4c69
[openload] Fix ext extraction
2016-04-25 00:03:29 +06:00
eb9ee19422
[utils] Allow None mimetypes in mimetype2ext
2016-04-25 00:03:12 +06:00
a1394b820d
[openload] Fix title extraction ( Closes #9298 )
2016-04-25 00:01:37 +06:00
aa9dc24f5a
[douyutv] Improve extraction and update tests
...
The JSON API sometimes return HTML pages with errors
2016-04-24 23:52:17 +08:00
51762e1a31
[xminus] Fix extraction ( closes #9228 )
2016-04-24 23:21:45 +08:00
8b38f2ac40
release 2016.04.24
2016-04-24 17:06:46 +02:00
a82398bd72
[kwuo:song] Fix extraction and update the test
2016-04-24 22:20:45 +08:00
c14dc00df3
[viewster] improve http formats extraction
2016-04-24 14:34:28 +01:00
03dd60ca41
[kuwo:category] Fix the test
...
Sometimes there are 24 songs and sometimes 30 lol
2016-04-24 21:16:06 +08:00
0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc
2016-04-24 20:46:06 +08:00
a956cb6306
[onionstudios] Fix description extraction
...
\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537 )
2016-04-24 20:41:17 +08:00
a8062eabcd
[mwave] Skip checking unstable MD5
...
On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081 ) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc
2016-04-24 20:05:24 +08:00
2a7dee8cc5
[yahoo] Improve error detection and update tests
2016-04-24 18:12:16 +08:00
d9ed362116
[yahoo] Extract all <iframe>s
...
Fixes test_yahoo_6
(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html )
2016-04-24 17:46:25 +08:00
4f54958097
[yahoo] Update some tests
...
One has new fields as ThePlatformIE changed, and others have changed
files.
2016-04-24 17:29:01 +08:00
2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
...
Closes #9271
2016-04-24 17:01:18 +08:00
949b6497cc
[generic] Unescape the video URL
...
Fixes #9279
2016-04-24 16:25:37 +08:00
fda9a1ca9e
[viewster] simplify qualities_basename regex
2016-04-24 03:06:46 +01:00
864d5e7231
[viewster] extract all http formats
2016-04-24 02:32:56 +01:00
5448b781f6
[dplay] Sign unsigned final download hls URLs
2016-04-23 17:28:45 +06:00
e239413fbc
[dplay] Extract subtitles ( Closes #9284 )
2016-04-23 16:50:31 +06:00
fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests
2016-04-23 16:36:17 +06:00
397ec446f3
[dplay] Try secure api for no tld ( Closes #9282 )
2016-04-23 15:59:30 +06:00
14f7a2b8af
[WDRMaus] switch current show to new WDR extractor ( fixes #8562 )
...
It seems that the "current show" already uses the new WDR video-player,
while all the others videos still use the old player.
I just added the current show URL to the normal WDR-extractor, which
works fine. This commit needs my changes from PR #8842 that fix the
support for WDR.
2016-04-23 11:53:22 +02:00
c0837a12c8
[WDR] complete overhaul after relaunch of the site
...
The WDR relaunched their site on 2016-02-23 which not only changed the
URL-schema completely but also the layout of their pages.
Apparently the whole "mediathek" now runs on the wdr-domain, so no
separate URL for funkhauseuropa anymore.
There seems to be no explicit handling of video-sizes on the page or in
the URLs anymore. There seems to be only one size for HTML5, but still
several sizes for flash. The extractor adds all to the list of formats.
There is no metadata for the HTML5-stream, so that the best flash-stream
will always be considered as the "best" format. At least in my tests
this seemed to be true anyway.
2016-04-23 11:42:18 +02:00
29a7e8f6f8
[nhl] Add new extractor( closes #8419 )( closes #8798 )
2016-04-22 20:18:27 +01:00
eb01e97e10
[youku] Skip streams with channel_type=tail
...
Fixes #9275
These video segments look like ads and they don't appear in the web
player.
2016-04-23 02:54:09 +08:00
cb7d4d0efd
[nbc] add support for today.com( closes #2909 )
2016-04-22 18:08:20 +01:00
c80037918b
[iqiyi] Improve error detection ( #9276 )
2016-04-23 00:06:49 +08:00
237a41108a
[eagleplatform] extract all http formats
2016-04-22 14:32:38 +01:00
e962ae15d3
[newstube] extract http formats( closes #9253 )
2016-04-22 11:26:43 +01:00
7c36ea7d54
[rtbf] improve extraction( fixes #9267 )
2016-04-21 22:52:49 +01:00
9260cf1d97
[tubitv] fix extraction( closes #8741 )
2016-04-21 20:30:19 +01:00
bdbb8530c7
[vimeo] Pass Referer for check-password request
2016-04-22 00:02:39 +06:00
09a9fadb84
[dump] Remove extractor
2016-04-21 23:31:34 +06:00
bf09af3acb
Add --hls-prefer-ffmpeg
2016-04-21 23:02:17 +06:00
88296ac326
[planetaplay] Remove remainings of extractor
2016-04-21 22:57:38 +06:00
870d525848
[options] Remove experimental mark for --hls-prefer-native
2016-04-21 22:44:01 +06:00
6577112890
[planetaplay] Remove extractor ( Closes #9256 )
2016-04-21 22:33:54 +06:00
1988647dda
[tvigle] Skip hls completely ( #9259 )
2016-04-21 22:15:20 +06:00
a292cba256
[mgtv] Fix _VALID_URL and add localized name
2016-04-22 00:07:43 +08:00
982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking
2016-04-22 00:07:43 +08:00
748e730099
[dispeak] Several fixes
2016-04-22 00:07:43 +08:00
b6c0d4f431
Merge pull request #9110 from remitamine/parse_duration
...
[utils] imporove parse_duration to handle more formats
2016-04-21 22:53:16 +07:00
acaff49575
[utils] imporove parse_duration to handle more formats
2016-04-21 16:34:54 +01:00
1da19488f9
[mgtv] Add new extractor ( closes #9212 )
2016-04-21 23:29:51 +08:00
442c4d361f
[dispeak/gdcvault] Add the test case from #5784
2016-04-21 19:47:10 +08:00
ec59d657e7
[dispeak] Add new extractor
...
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
2016-04-21 19:36:33 +08:00
99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
...
Fixes #9248
2016-04-21 18:07:03 +08:00
4dccea8ad0
[streetvoice] Fix extraction
...
The old API results in URLs with HTTP 403 from time to time.
Hopefully fixes #9219 .
2016-04-21 13:07:53 +08:00
2c0d9c6217
[extractor/common] Allow empty post data
2016-04-21 13:06:06 +08:00
12a5134596
[tvigle] Fix extraction ( Closes #9259 )
2016-04-20 23:52:41 +06:00
16e633a5d7
[quickvid] Remove extractor ( Closes #9258 )
2016-04-20 23:29:02 +06:00
494ab6db73
[youtube] Capture and output login error message
2016-04-20 22:14:32 +06:00
107701fcfc
[people] Remove bogus comment
2016-04-20 03:40:02 +06:00
f77970765a
[people] Add extractor
2016-04-20 03:37:23 +06:00
81215d5652
release 2016.04.19
2016-04-19 03:03:52 +02:00
241a318f27
[vimeo] Improve _VALID_URL ( Closes #9229 )
2016-04-18 21:40:28 +06:00
4fdf082375
[theonion] Remove extractor ( Closes #9220 )
...
It now uses generic onionstudios embed
2016-04-17 23:12:23 +06:00
1b6182d8f7
[youtube:playlist] Fetch all the videos in a mix ( fixes #3837 )
...
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
2016-04-17 17:07:57 +02:00
7bab22a402
[vice] remove unused import and variable
2016-04-17 14:06:19 +01:00
0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
...
In r'pl=\d+&play=\d+' pages, several metadata items are missing
Closes #9222 .
2016-04-17 17:24:33 +08:00
b1cf58f48f
[musicplayon] Fix extraction ( closes #9222 )
2016-04-17 15:08:51 +08:00
3014b0ae83
Merge pull request #9195 from remitamine/ffmpeg-pipe
...
[downloader/external] enable piping for FFmpegFD(closes #2124 )
2016-04-16 22:00:49 +01:00
b9f2fdd37f
[ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument
2016-04-16 21:50:13 +01:00
bbb3f730bb
[onionstudios] extract m3u8 formats
2016-04-16 20:53:13 +01:00
d868f43c58
[ffmpeg] check for - file name in _ffmpeg_filename_argument
2016-04-16 19:45:56 +01:00
21525bb8ca
[kuwo:category] Update the test
...
Now the webpage says there are 24 songs.
2016-04-17 02:38:05 +08:00
d8f103159f
[nerdist] Remove extractor
...
It now uses brightcove
2016-04-17 00:16:31 +06:00
663ee5f0a9
[vice] extract youtube embed
2016-04-16 17:49:39 +01:00
b6b950bf58
[cbs] Remove unused import
2016-04-16 22:47:10 +06:00
11e60fcad8
[extractor/generic] Improve instagram embeds ( Closes #9213 )
2016-04-16 22:39:20 +06:00
c23533a100
[instagram] Add support for iframe embeds
2016-04-16 22:31:05 +06:00
0dafea02e6
[instagram] Add support for embed URLs
2016-04-16 22:23:08 +06:00
5d6360c3b7
[mooshare] Remove extractor
2016-04-16 21:31:50 +06:00
5e5c30c3fd
[mdr] Fix extraction and update tests
...
It's strange that the date is changed. Anyway, new data matches what the
webpage says.
2016-04-16 21:57:28 +08:00
9154c87fc4
[huffpost] Fix a typo
2016-04-16 21:41:22 +08:00
ef0e4e7bc0
[generic] Fix test_Generic_2
...
Now a HEAD request returns 400 Bad Request
2016-04-16 19:44:45 +08:00
67d46a3f90
[ustream] Fix /embed/ URLs and add a test
2016-04-16 19:39:25 +08:00
bec47a0748
[tudou] Improve error detection ( closes #9175 )
2016-04-16 19:11:25 +08:00
36b7d9dbfa
[twitter] Don't check /cards/ URLs
...
Fixes #9181
In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
This is the real video and can be handled by TwitterCardIE
In all current test_Twitter* tests, /videos/tweet/ approach works fine.
2016-04-16 18:57:50 +08:00
8c65e4a527
[bbc] Fix a test
2016-04-16 18:00:19 +08:00
6ad2ef8b7c
[audiomack] Update the test
...
The original test raises 404
2016-04-16 17:54:39 +08:00
00b426d66d
[varzesh3] Add md5 to the test
2016-04-16 17:41:56 +08:00
0de968b584
[newgrounds] Support videos ( closes #9138 )
2016-04-16 17:41:56 +08:00
0841d5013c
[cbs] do not catch Exceptions raised by by _extract_theplatform_smil
2016-04-16 10:25:59 +01:00
a71fca8577
[theplatform] remove _sort_formats from _extract_theplatform_smil
2016-04-16 10:23:56 +01:00
ee94e7e66d
[varzesh3] Fix metadata extraction ( closes #9197 )
2016-04-16 17:13:22 +08:00
759e37c9e6
[gazeta] Relax _VALID_URL and update tests
...
Closes #9196
2016-04-16 16:48:47 +08:00
ae65567102
[eagleplatform] Fix error handling
2016-04-16 16:47:16 +08:00
c394b4f4cb
[puls4] Fix error detection ( #9194 )
2016-04-16 16:22:44 +08:00
260c7036ba
[sportbox] Fix SportBoxEmbedIE
...
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753 )
2016-04-16 16:13:14 +08:00
f74197a074
[cbs] extract rtmp formats
2016-04-15 22:38:37 +01:00
f3a58d46bf
[youtube:user] check if the url didn't match only the other youtube extractors
2016-04-15 19:06:13 +01:00
b6612c9b11
[karaoketv] Fix extraction
2016-04-15 21:26:54 +06:00
7e176effb2
[iqiyi] Also suuport pps.tv URLs
...
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.
[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
2016-04-15 22:39:18 +08:00
4a252cc2d2
[karaoketv] Update and mark as not _WORKING
2016-04-15 21:49:17 +08:00
f0ec61b525
[huffpost] Fix extraction
2016-04-15 20:55:56 +08:00
66d40ae3a5
Merge pull request #9041 from kasper93/master
...
[generic] Add support for LiveLeak embeds
2016-04-15 17:23:55 +08:00
e6da9240d4
[mixcloud:stream] Add new extractor
...
Closes #7633
2016-04-15 17:14:17 +08:00
dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
...
Fixes #7521
2016-04-15 15:48:22 +08:00
c773082692
Merge branch 'Phaeilo-mixcloud'
2016-04-15 14:33:04 +08:00
9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist
2016-04-15 14:32:02 +08:00
56f1750049
[tdslifeway] Use the new Brightcove API
...
Thanks for @remitamine's suggestion.
2016-04-15 04:28:54 +08:00
f2159c9815
[wayofthemaster] Remove extractor
...
Now it's using YouTube embeds.
2016-04-15 04:02:23 +08:00
b0cf2e7c1b
[ubu] Remove extractor
...
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
(For example http://ubu.com/film/hammons_king.html )
2016-04-15 03:48:23 +08:00
74b47d00c3
[xboxclips] Use http:// URL
...
xboxclips has misconfigured certificates
2016-04-15 03:30:38 +08:00
8cb57bab8e
[ministrygrid] Fix extraction and modernize
2016-04-15 02:48:12 +08:00
e1bf277e19
[tdslifeway] Add TDSLifewayIE
...
Used by MinistryGridIE
2016-04-15 02:48:12 +08:00
ce599d5a7e
[downloader/external] enable piping for FFmpegFD( closes #2124 )
2016-04-14 18:49:02 +01:00
9e28538726
[arte:creative] Improve _VALID_URL
2016-04-14 21:54:41 +06:00
404284132c
[arte:info] Add extractor ( Closes #9182 )
2016-04-14 21:52:05 +06:00
5565be9dd9
[aol] relex _VALID_URL regex
2016-04-14 08:47:55 +01:00
b3a9474ad1
Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud
2016-04-14 15:31:58 +08:00
86475d59b1
[metacritic] Add a new valid test case
2016-04-14 15:12:59 +08:00
73d93f948e
[lecture2go] Fix extraction
...
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:
$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
2016-04-14 15:08:01 +08:00
f5d8743e0a
[downloader/rtsp] Print the command
2016-04-14 15:07:31 +08:00
d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test
2016-04-14 14:11:28 +08:00
f141fefab7
[karrierevideos] Fix extraction
...
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
2016-04-14 14:06:05 +08:00
8334637f4a
Make tbr field 'int' rather than 'tuple'
...
Closes #9180 .
2016-04-13 14:29:34 +02:00
b0ba11cc64
release 2016.04.13
2016-04-13 08:02:03 +02:00
b8f67449ec
[generic] Add support for LiveLeak embeds
2016-04-13 01:54:19 +02:00
75af5d59ae
[netease] Skip all tests: completely georestricted
2016-04-13 04:52:07 +08:00
6d67169509
[mixcloud] improved extraction of user description
2016-04-12 21:18:13 +02:00
dcaf00fb3e
[mixcloud] support older urllib versions
2016-04-12 21:18:13 +02:00
f896e1ccef
[mixcloud] fixed some tests
2016-04-12 21:18:13 +02:00
c96eca426b
[mixcloud] Added support for user uploads, playlists, favorites and listens.
...
Fixes #3750 and #5272
2016-04-12 21:18:13 +02:00
466a614537
[youtube:playlist] Recognize popular uploads playlist as mix ( Closes #9170 )
2016-04-12 21:38:31 +06:00
ffa2cecf72
[ard] Change subtitles extension to ttml ( Closes #9169 )
...
ttml is now served instead of srt
2016-04-12 21:20:31 +06:00
a837416025
[jadorecettepub] Remove extractor: website gone
2016-04-12 18:30:53 +08:00
c9d448876f
[izlesene] Fix extraction
...
description may be absent
2016-04-12 18:29:28 +08:00
8865b8abfd
[howstuffworks] Skip a broken test case
2016-04-12 17:30:14 +08:00
c77a0c01cb
[groupon] Fix extraction
2016-04-12 17:26:09 +08:00
12355ac473
[goshgay] Fix extraction
...
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
2016-04-12 17:23:00 +08:00
49f523ca50
[mixcloud] Capture error message ( #9156 )
2016-04-11 20:45:58 +06:00
4a903b93a9
Revert "[openclassroom] Add new extractor( closes #9147 )"
...
This reverts commit 13267a2be3
2016-04-11 14:44:35 +01:00
13267a2be3
[openclassroom] Add new extractor( closes #9147 )
2016-04-11 14:24:08 +01:00
134c207e3f
[arte.tv:embed] Extended support ( #2620 )
2016-04-11 19:32:27 +08:00
0f56bd2178
Merge branch 'Phaeilo-presstv'
2016-04-11 16:17:05 +08:00
dfbc7f7f3f
[presstv] Improve and simplify
2016-04-11 16:14:07 +08:00
7d58ea7c5b
Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv
2016-04-11 15:48:10 +08:00
452908b257
[telebruxelles] Fix extraction ( Closes #9142 )
2016-04-11 00:06:05 +06:00
5899e988d5
[glide] Improve extraction and extract upload info
2016-04-10 23:56:23 +06:00
4a121d29bb
[glide] Fix extraction ( Closes #9141 )
2016-04-10 23:45:17 +06:00
7ebc36900d
[jwplatform:base] Improve subtitles extraction
2016-04-10 22:55:07 +06:00
d7eb052fa2
[screencastomatic] Add duration to test
2016-04-10 22:48:04 +06:00
a6d6722c8f
[jwplatform:base] Extract duration
2016-04-10 22:47:38 +06:00
66fa495868
[screencastomatic] Fix extraction ( Closes #9136 )
2016-04-10 22:37:14 +06:00
443285aabe
[ebaumsworlds] Update _VALID_URL ( Closes #9135 )
2016-04-10 22:15:11 +06:00
de728757ad
[presstv] Refactored extractor.
2016-04-10 16:36:44 +02:00
f44c276842
[extractor/extractors] Remove non-existant imports
2016-04-10 19:21:58 +06:00
a1fa60a934
[cliprs] Add extractor ( Closes #9099 )
2016-04-10 18:43:40 +06:00
49caf3307f
[extractor/common] Remove irrelevant comment
2016-04-10 17:10:27 +06:00
61dd350a04
[1tv] Fix extraction ( Closes #9103 )
2016-04-10 03:02:35 +06:00
95153a960d
[presstv] updated extractor and tests to work with current PressTV website
2016-04-09 16:14:05 +02:00
c991106706
[videodetective] Adapt to InternetVideoArchiveIE
2016-04-09 21:47:35 +08:00
dae2a058de
[rottentomatoes] Adapt to InternetVideoArchiveIE
2016-04-09 21:47:12 +08:00
c05025fdd7
[internetvideoarchive] Fix extraction and support json URLs
2016-04-09 21:46:51 +08:00
bfe96d7bea
[presstv] Added extractor PressTV.
...
Fixes #7060
2016-04-09 14:55:54 +02:00
ab481b48e5
[funnyordie] Relax M3U8 URL matching
...
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.
This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
2016-04-09 20:17:35 +08:00
92c7f3157a
[aol] Add coding cookie
2016-04-09 17:32:23 +06:00
cacd996662
[utils] Don't touch URLs if not necessary
...
Fix test_Generic_15 (Google redirect)
2016-04-09 19:27:54 +08:00
bffb245a48
[aol] add support for videos with vidible IDs( closes #9124 )
2016-04-09 10:51:23 +01:00
e0986e31cf
lazy extractors: Output if it's enabled in the verbose log
2016-04-08 21:50:54 +02:00
779822d945
Add experimental support for lazy loading the info extractors
...
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
2016-04-08 21:50:07 +02:00
1b3d5e05a8
Move the extreactors import to youtube_dl/extractor/extractors.py
2016-04-08 21:47:51 +02:00
e52d7f85f2
Delay initialization of InfoExtractors until they are needed
2016-04-08 21:43:24 +02:00
568d2f78d6
[tnaflix] Fix metadata extraction
2016-04-09 00:27:24 +06:00
2f2fcf1a33
[tnaflix] Fix extraction ( Closes #9074 )
2016-04-08 23:34:59 +06:00
bacec0397f
[extractor/common] Relax _hidden_inputs
2016-04-08 23:33:45 +06:00
3c6c7e7d7e
[gdcvault] Fix extraction ( Closes #9107 , closes #9114 )
2016-04-08 23:16:02 +06:00
fb38aa8b53
[extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests ( Closes #9119 , closes #9120 )
2016-04-08 22:48:08 +06:00
18da24634c
[democracynow] Improve extraction
2016-04-08 22:27:27 +06:00
a134426d61
[democracynow] Fix tests
2016-04-08 22:21:14 +06:00
a64c0c9b06
[democracynow] Make description optional ( Closes #9115 )
2016-04-08 22:15:36 +06:00
56019444cb
[novamov] Improve _VALID_URL template ( Closes #9116 )
2016-04-08 21:26:42 +06:00
a1ff3cd5f9
[acast] fix channel extraction( closes #9117 )
2016-04-08 15:15:34 +01:00
9a32e80477
[acast] fix extraction( #9117 )
2016-04-08 14:51:00 +01:00
536a55dabd
[YoutubeDL] Sanitize single thumbnail URL
2016-04-08 00:17:47 +06:00
ed6fb8b804
[vrt] Add support for direct hls playlists and YouTube ( Closes #9108 )
2016-04-07 23:22:43 +06:00
3afef2e3fc
[beeg] Improve extraction
2016-04-07 22:40:35 +06:00
e90d175436
[yandexmusic] Extract music album metafields ( Closes #7354 )
2016-04-07 02:56:13 +06:00
7a93ab5f3f
[extractor/common] Introduce music album metafields
2016-04-07 02:53:53 +06:00
c41cf65d4a
release 2016.04.06
2016-04-06 15:13:08 +02:00
92d5477d84
[compat] Handle tuples properly in urlencode()
...
Fixes #9055
2016-04-06 18:29:54 +08:00
8790249c68
[iqiyi] Improve error detection for VIP-only videos
...
Closes #9071
2016-04-06 16:12:16 +08:00
416930d450
release 2016.04.05
2016-04-05 18:36:24 +02:00
65150b41bb
[deezer] Fix extraction ( Closes #9086 )
2016-04-05 22:27:33 +06:00
e42f413716
[rte] Improve thumbnail extraction ( Closes #9085 )
2016-04-05 22:23:20 +06:00
40a056d85d
[extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically
2016-04-05 21:54:09 +06:00
e7d77efb9d
[auroravid] Add extractor ( Closes #9070 )
2016-04-05 21:52:07 +06:00
995cf05c96
[novamov] Make title fatal
2016-04-05 21:40:43 +06:00
5bf28d7864
[utils] dfxp2srt: add additional namespace
...
Used by the ZDF subtitles (#9081 ).
2016-04-04 20:46:35 +02:00
8c7d6e8e22
[zdf] Extract subtitles ( closes #9081 )
2016-04-04 20:44:06 +02:00
6d4fc66bfc
[youtube] Add support for zwearz ( Closes #9062 )
2016-04-04 02:26:20 +06:00
23576edbfc
[brightcove:legacy] skip None value for uploader_id
2016-04-02 21:31:21 +01:00
4d4cd35f48
[brightcove:legacy] extract uploader_id as a string
2016-04-02 20:55:44 +01:00
3aac9b2fb1
[nowness] update tests
2016-04-02 18:57:15 +01:00
e47d19e991
[brightcove:new] extract subtitles and strip video title
2016-04-02 18:57:15 +01:00
41f5492fbc
[brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp
2016-04-02 18:57:15 +01:00
2defa7d75a
[instagram:user] Fix extraction ( fixes #9059 )
...
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
2016-04-02 18:03:56 +02:00
bbc26c8a01
[bbc] Set vcodec to none for audio formats
2016-04-02 19:00:38 +06:00
b507cc925b
[extractor/common] Carry long line
2016-04-02 18:49:58 +06:00
db8ee7ec05
[extractor/common] Fix numeric identifiers conversion in DASH URL templates
2016-04-02 18:48:05 +06:00
08136dc138
[brightcove] fix format sorting
2016-04-02 10:57:57 +01:00
fe7ef95e91
[cbsinteractive] Add support for ZDNet videos
2016-04-01 23:53:32 +01:00
5f705baf5e
[cnet] extract more formats
2016-04-01 20:42:15 +01:00
0750b2491f
[ffmpeg] try to convert tt subtitles usng dfxp2srt
2016-04-01 19:47:49 +01:00
df634be2ed
[common] prefer using mime type over ext for smil subtitle extraction
...
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
2016-04-01 19:47:49 +01:00
6d628fafca
[camwithher] Remove extra blank line
2016-04-01 20:45:21 +02:00
0f28777f58
[cbsnews] Remove unused import
2016-04-01 20:43:14 +02:00
329c1eae54
[aenetworks] Make pep8 happy
2016-04-01 20:42:19 +02:00
9aaaf8e8e8
[camwithher] Improve extraction ( Closes #8989 )
2016-04-01 23:47:27 +06:00
04819db58e
[camwithher] Add extractor
...
Corrected unnecessary test
Sane variable naming
RTMP all .flv & url_id for _download_webpage()
Corrected all outstanding issues, next up is a squash!
2016-04-01 23:44:25 +06:00
79ba9140dc
[theplatform] extract timestamp and uploader
2016-04-01 18:07:17 +01:00
75d572e9fb
[screencast] Improve title regexes ( Closes #9025 )
2016-04-01 23:01:55 +06:00
791d6aaecc
screencast.com: fallback on page title
...
When determining the title of the page, use the <title> tag of the page
2016-04-01 23:00:52 +06:00
81de73e5b4
[screencast] Add test
2016-04-01 23:00:45 +06:00
83cedc1cf2
screencast.com: support missing www
...
The "www." part of the URL is not mandatory
2016-04-01 22:58:16 +06:00
244cd04237
[pluralsight] Remove unnecessary login/password encode
2016-04-01 22:46:46 +06:00
fbdaced256
[lynda] Remove unnecessary login/password encode
2016-04-01 22:45:20 +06:00
a3373823e1
[udemy] Remove unnecessary login/password encode
...
This is now covered by compat_urllib_parse_urlencode
2016-04-01 22:42:09 +06:00
03caa463e7
[udemy:course] Skip non-video lectures
2016-04-01 22:38:56 +06:00
3f64379eda
[movieclips] fix extraction
2016-04-01 16:22:06 +01:00
3e0c3d14d9
[cbs] add base extractor
2016-04-01 10:12:29 +01:00
d8873d4def
[aenetworks] improve format extraction
2016-04-01 09:58:02 +01:00
db1c969da5
[theplatform] sign https urls
2016-04-01 09:58:02 +01:00
1e02bc7ba2
release 2016.04.01
2016-04-01 09:07:40 +02:00
63c55e9f22
[cbs] improve extraction( closes #6321 )
2016-04-01 07:33:37 +01:00
f9b1529af8
[generic] remove sbnation test(handled by VoxMediaIE)
2016-03-31 23:50:45 +01:00
961fc024d2
[voxmedia] improve sbnation support
2016-03-31 23:33:36 +01:00
b53a06e3b9
[udemy:course] Use new URL format
2016-04-01 02:24:22 +06:00
4ecc1fc638
[howstuffworks] improve extraction
2016-03-31 21:11:58 +01:00
5b012dfce8
[tudou] Improve error handling ( closes #8988 )
2016-04-01 01:42:16 +08:00
8369942773
[voxmedia] Add new extractor( closes #3182 )
2016-03-31 18:36:41 +01:00
86f3b66cec
[udemy] Remove unused import
2016-03-31 23:00:11 +06:00
6bb4600717
[udemy:course] Simplify course curriculum downloading
2016-03-31 22:59:19 +06:00
41d06b0424
[extractor/common] Improve _request_webpage
...
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
2016-03-31 22:58:38 +06:00
15d260ebaa
[utils] Use update_Request in http_request
2016-03-31 22:55:49 +06:00
ed0291d153
[utils] Add update_Request
2016-03-31 22:55:01 +06:00
81da8cbc45
[udemy] Switch to api 2.0 ( Closes #9035 )
2016-03-31 22:05:25 +06:00
5299bc3f91
[beeg] Switch to api v6 ( Closes #9036 )
2016-03-31 20:42:41 +06:00
c9c39c22c5
[nationalgeographic] add support for channel.nationalgeographic.com urls
2016-03-31 13:47:38 +01:00
d84b48e3f1
[nationalgeographic] improve extraction
2016-03-31 13:44:55 +01:00
dd17041c82
[tenplay] remove extractor( fixes #6927 )
2016-03-31 12:02:04 +01:00
fea7295b14
[brightcove] relax embed_in_page regex
2016-03-31 10:48:22 +01:00
9cf01f7f30
[nbc] add new extractor for csnne.com( #5432 )
2016-03-31 00:26:42 +01:00
ce548296fe
[cnbc] fix test
2016-03-31 00:25:11 +01:00
c02ec7d430
[cnbc] Add new extractor( closes #8012 )
2016-03-30 23:18:31 +01:00
6b820a2376
[myspace] improve extraction
2016-03-30 21:18:07 +01:00
e621a344e6
[kwuo] Port to new API and enable --cn-verification-proxy
2016-03-31 02:27:52 +08:00
3ae6f8fec1
[kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
...
Following the idea proposed in 19dbaeece3
2016-03-31 02:11:21 +08:00
597d52fadb
[kuwo:song] Correct song ID extraction ( fixes #9033 )
...
Bug introduced in daef04a4e7
2016-03-31 02:00:50 +08:00
afca767d19
[tumblr] Improve _VALID_URL ( Closes #9027 )
2016-03-30 22:26:43 +06:00
6e359a1534
[comcarcoff] don not depend on crackle extractor( closes #8995 )
...
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995 .
2016-03-30 12:27:00 +01:00
33f3040a3e
[YoutubeDL] Fix sanitizing subtitles' url
2016-03-28 03:13:39 +06:00
03442072c0
[pornhub] Fix typo ( Closes #9008 )
2016-03-28 01:21:44 +06:00
c8b13fec02
[foxnews] Restore upload time fields in test
2016-03-28 01:14:12 +06:00
87d105ac6c
[amp] Fix upload timestamp extraction ( Closes #9007 )
2016-03-28 01:13:47 +06:00
3454139576
[pornhub:uservideos] Add support for multipage videos ( Closes #9006 )
2016-03-28 00:50:46 +06:00
3a23bae9cc
[pornhub:playlistbase] Do not include videos not from playlist
2016-03-28 00:32:57 +06:00
8f9a477e7f
[pornhub:playlistbase] Use orderedSet
2016-03-28 00:21:08 +06:00
a1cf3e38a3
[bbc] Extend vpid regex ( Closes #9003 )
2016-03-27 23:22:51 +06:00
a122e7080b
release 2016.03.27
2016-03-27 16:56:33 +02:00
b22ca76204
[extractor/common] Filter out unsupported encrypted media for f4m formats ( Closes #8573 )
2016-03-27 07:42:38 +06:00
f7df343b4a
[downloader/f4m] Extract routine for removing unsupported encrypted media
2016-03-27 07:41:19 +06:00
19dbaeece3
Remove _sort_formats from _extract_*_formats methods
...
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.
Closes #8051
2016-03-27 07:03:08 +06:00
395fd4b08a
[twitter] Handle another form of embedded Vine
...
Fixes #8996
2016-03-27 04:36:02 +08:00
8018028d0f
[pluralsight] Extract chapter metadata ( Closes #8993 )
2016-03-27 02:10:52 +06:00
00322ad4fd
[lynda] Extract chapter metadata ( #8993 )
2016-03-27 02:00:36 +06:00
4cf3489c6e
[vevo] Update videoservice API URL ( Closes #8900 )
2016-03-27 01:11:11 +06:00
b24ab3e341
[udemy] Improve paid course detection
2016-03-27 00:09:12 +06:00
af4116f4f0
[udemy] Improve format_id
2016-03-27 00:02:52 +06:00
f973e5d54e
[udemy] Drop outputs' formats
...
Always results in 403
2016-03-26 23:55:07 +06:00
62f55aa68a
[udemy] Add outputs metadata to view_html formats
2016-03-26 23:54:12 +06:00
02d7634d24
[udemy] Fix outputs' formats format_id
2016-03-26 23:43:25 +06:00
48dce58ca9
[udemy] Use custom sorting
2016-03-26 23:42:46 +06:00
efcba804f6
[udemy] Extract formats from view_html ( Closes #8979 )
2016-03-26 23:42:34 +06:00
6dee688e6d
[youtube:playlistsbase] Restrict playlist regex ( Closes #8986 )
2016-03-26 20:42:18 +06:00
eedb7ba536
[YoutubeDL] Sort imports
2016-03-26 19:40:33 +06:00
dcf77cf1a7
[YoutubeDL] Sanitize final URLs ( Closes #8991 )
2016-03-26 19:37:41 +06:00
17bcc626bf
[utils] Extract sanitize_url routine
2016-03-26 19:33:57 +06:00
b5a5bbf376
[mailru] Extend _VALID_URL ( Closes #8990 )
2016-03-26 19:15:32 +06:00
e68d3a010f
[twitter] Fix extraction ( closes #8966 )
...
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
2016-03-26 18:34:51 +08:00
d10fe8358c
[generic] Add a test case for brightcove embed
...
Closes #8862
2016-03-26 18:30:43 +08:00
d6c340cae5
[brightcove] Extract more formats ( #8862 )
2016-03-26 18:21:07 +08:00
5964b598ff
[brightcove] Support alternative BrightcoveExperience layout
...
The full URL lays in the `data` attribute of <object> (#8862 )
2016-03-26 17:47:32 +08:00
62cdb96f51
release 2016.03.26
2016-03-26 08:58:03 +01:00
6e6bc8dae5
Use urlencode_postdata across the codebase
2016-03-26 02:19:24 +06:00
15707c7e02
[compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
...
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode
Closes #8974
2016-03-26 01:46:57 +06:00
2156f16ca7
[thescene] Fix extraction and improve style ( Closes #8978 )
2016-03-25 20:14:34 +06:00
4db441de72
[once] Relax _VALID_URL ( Closes #8976 )
2016-03-25 19:51:28 +06:00
0be8314dc8
release 2016.03.25
2016-03-25 09:27:18 +01:00
d7f62b049a
[iqiyi] Update enc_key
2016-03-25 15:45:40 +08:00
3bb3356812
[douyutv] Extend _VALID_URL
2016-03-25 15:43:29 +08:00
98e68806fb
[mnet] Improve ( Closes #8958 )
2016-03-25 03:26:29 +06:00
e031768666
[mnet] Add new extractor
2016-03-25 02:32:06 +06:00
5eb7db4ee9
[udemy] Add support for new URL schema
2016-03-25 02:28:39 +06:00
f0e83681d9
[udemy] Extract formats from outputs
2016-03-25 02:27:13 +06:00
ff9d5d0938
[udemy] Improve course enrolling
2016-03-25 02:26:46 +06:00
d041a73674
[extractor/__init__] Add youtube:live and sort youtube extractors alphabetically
2016-03-25 01:39:25 +06:00
f07e276a04
[youtube:live] Add extractor ( Closes #8959 )
2016-03-25 01:18:14 +06:00
993271da0a
[nytimes] Tolerate missing metadata ( Closes #8952 )
2016-03-24 23:28:24 +06:00
369e7e3ff0
[iprima] Fix extraction ( Closes #8953 )
2016-03-24 22:54:26 +06:00
5767b4eeae
[mtv] Fix description extraction ( Closes #8962 )
2016-03-24 22:23:31 +06:00
622d19160b
[utils] Clarify Python versions affected by buggy struct module
2016-03-24 18:06:15 +08:00
32d88410eb
[tumblr] Add a test with Instagram embed
...
Closes #8817
2016-03-24 16:32:53 +08:00
5a51775a58
[generic] Extract Instagram embeds ( #8817 )
2016-03-24 16:32:27 +08:00
87696e78d7
[instagram] Unescape description ( #8817 )
2016-03-24 16:30:01 +08:00
c4096e8aea
[instagram] Extract embed videos ( #8817 )
2016-03-24 16:29:33 +08:00
fc27ea9464
[tumblr] Support Vine embeds ( #8817 )
2016-03-23 23:55:52 +08:00
088e1aac59
[generic] Support Vine embeds ( #8817 )
2016-03-23 23:55:08 +08:00
4333d56494
Merge pull request #8898 from dstftw/fragment-retries
...
Add --fragment-retries option (Fixes #8466 )
2016-03-23 20:12:32 +05:00
882c699296
[tunein] Fix stream data extraction ( Closes #8899 , closes #8924 )
2016-03-23 20:45:39 +06:00
efbed08dc2
[utils] Encode hostnames before passing to urllib
...
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError
Fixes #8890
2016-03-23 22:24:52 +08:00
7da2c87119
Add extractor for thescene.com ( closes #8929 )
2016-03-22 22:17:59 +01:00
c6ca11f1b3
[once] Prevent ads from embedding into m3u8 playlists ( Closes #8893 )
2016-03-22 23:48:05 +06:00
2beeb286e1
[laola1tv] Add support for livestreams ( Closes #8934 )
2016-03-22 22:32:59 +06:00
cc7397b04d
[ceskatelevize] Make m3u8 formats extraction non fatal ( Closes #8933 )
2016-03-22 21:12:29 +06:00
bc5d16b302
[animeondemand] Skip dash for now
2016-03-21 23:37:39 +06:00
85c637b737
[animeondemand] Extract teaser when no full episode available ( #8923 )
2016-03-21 23:35:50 +06:00
5c69f7a479
[animeondemand] Respect startvideo ( Closes #8923 )
2016-03-21 23:31:40 +06:00
ff5873b72d
[motherless] Detect friends only videos
2016-03-21 22:24:42 +06:00
065c4b27bf
[xhamster:embed] Extract vars ( Closes #8912 )
2016-03-21 22:07:34 +06:00
1600ed1ff9
[rutv] Improve flash version pattern ( Closes #8911 )
2016-03-21 21:46:49 +06:00
5886b38d73
Add support for https for all extractors as preventive and future-proof measure
2016-03-21 21:36:32 +06:00
0cef27ad25
Add missing r prefix for _VALID_URLs
2016-03-21 21:22:37 +06:00
12af4beb3e
[mailru] Add support for https ( Closes #8920 )
2016-03-21 21:17:29 +06:00
9016d76f71
[YoutubeDL] Improve _format_note
2016-03-20 22:01:45 +06:00
3c5d183c19
[animeondemand] Extract all formats ( Closes #8906 )
2016-03-20 21:51:22 +06:00
3e8bb9a972
[animeondemand] Detect geo restriction
2016-03-20 20:39:00 +06:00
daef04a4e7
[kwuo] Fix KuwoChartIE and KuwoSingerIE and accept new URL forms
2016-03-20 20:17:56 +08:00
2648918c81
[vlive] Fix creator extraction ( closes #8814 )
2016-03-20 18:15:53 +08:00
9e3c2f1d74
[openload] Misc improvements
...
* Add thumbnail
* Detect errors (#6469 )
* Match more (#6469 , #8489 )
2016-03-20 16:49:44 +08:00
2bfeee69b9
[openload] Add new extractor ( closes #8489 )
2016-03-20 15:54:58 +08:00
664bcd80b9
[tudou] Use InAdvancePagedList ( closes #8884 )
2016-03-20 15:45:31 +08:00
3c20208eff
[francetv] Improve formats extraction
2016-03-20 13:00:46 +06:00
db264e3cc3
[francetvinfo] Add support for france3-regions and strip title ( Closes #7673 )
2016-03-20 12:44:04 +06:00
96a9f22d98
[discovery] Relax _VALID_URL ( Closes #8903 )
2016-03-20 10:26:58 +06:00
40025ee2a3
[postprocessort/ffmpeg] Allow embedding webvtt into webm ( Closes #8874 )
2016-03-20 04:12:34 +06:00
298c04b464
[91porn] Use common messages' wording
2016-03-20 02:35:48 +06:00
d95114dd83
[91porn] Unquote final URL ( Closes #8881 )
2016-03-20 02:34:02 +06:00
fa023ccb2c
[biobiochiletv] Fix extraction, extract m3u8 formats and overall improve ( Closes #7314 )
2016-03-20 01:31:55 +06:00
e36f4aa72b
[biobiotv] Add extractor
2016-03-20 01:29:08 +06:00
f1ced6df51
[cda] Improve and simplify ( Closes #8805 )
2016-03-19 23:17:14 +06:00
8b0d7a66ef
[cda] Add new extractor for cda.pl
...
Fixes #8760
2016-03-19 22:42:40 +06:00
3aec71766d
[safari:api] Separate extractor ( Closes #8871 )
2016-03-19 22:30:48 +06:00
16a8b7986b
[downloader/fragment] Document fragment_retries
2016-03-19 20:54:21 +06:00
617e58d850
[downloader/{common,fragment}] Fix total retries reporting on python 2.6
2016-03-19 20:51:30 +06:00
e33baba0dd
[downloader/dash] Add fragment retry capability
...
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
2016-03-19 20:42:23 +06:00
721f26b821
[downloader/fragment] Add report_retry_fragment
2016-03-19 20:41:24 +06:00
52bb437e41
[options] Add --fragment-retries option
2016-03-19 20:40:36 +06:00
782b1b5bd1
[utils] lookup_unit_table: Match word boundary instead of end of string
2016-03-19 11:44:49 +01:00
0d769bcb78
[extractor/generic] Fix missing byte literal prefix
2016-03-19 05:43:43 +06:00
4cd70099ea
[hbo] Add new extractor
2016-03-18 21:18:18 +01:00
09fc33198a
utils: lookup_unit_table: Use a stricter regex
...
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
2016-03-18 19:23:06 +01:00
d5aacf9a90
Added format_id to the filers on -f.
2016-03-18 23:59:24 +06:00
19e2617a6f
[commonprotocols] Add generic support for rtmp URLs ( Closes #8488 )
2016-03-18 23:42:15 +06:00
edd9b71c2c
[extractor/generic] Add a test for m3u playlist served without proper Content-Type
2016-03-18 22:49:11 +06:00
5940862d5a
[extractor/generic] Detect m3u playlists served without proper Content-Type
2016-03-18 22:45:28 +06:00
de6c51e88e
[extractor/generic] Fix direct link semantics
2016-03-18 22:43:07 +06:00
303dcdb995
[extractor/generic] Simplify upload_date extraction
2016-03-18 22:41:16 +06:00
20938f768b
[extractor/generic] Add another test for generic m3u8
2016-03-18 21:54:33 +06:00
955737b2d4
[extractor/generic] Force Content-Type to lowecase
2016-03-18 21:50:44 +06:00
263eff9537
[extractor/generic] Properly extract format id from Content-Type
...
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
2016-03-18 21:50:10 +06:00
cae21032ab
[theplatform] Improve geo restriction detection
2016-03-18 21:08:25 +06:00
6187091532
[once] check http formats availability
2016-03-18 11:51:34 +01:00
0d33166ec5
release 2016.03.18
2016-03-18 11:43:48 +01:00
87c03c6bd2
[theplatform] remove unnecessary import
2016-03-18 09:43:28 +01:00
4c92fd2e83
[theplatform] always force theplatform to return a smil for _extract_theplatform_smil
2016-03-18 09:22:10 +01:00
e3d17b3c07
[noz] Fix extraction on python 2.6 by means of using compat_xpath
2016-03-18 02:54:27 +06:00
810c10baa1
[utils] Use compat_xpath
2016-03-18 02:52:23 +06:00
57f7e3c62d
[compat] Add compat_xpath
2016-03-18 02:51:38 +06:00
0d0e282912
[animeondemand] Fix typo and improve
2016-03-18 00:13:50 +06:00
85e8f26b82
[animeondemand] Improve extraction
2016-03-18 00:02:34 +06:00
b57fecfddd
[animeondemand] Add test
2016-03-17 23:50:10 +06:00
8c97e7efb6
[animeondemand] Expand episode title regex ( Closes #8875 )
2016-03-17 23:43:14 +06:00
cc162f6a0a
[crunchyroll] Fix custom _download_webpage ( Closes #8883 )
2016-03-17 22:55:04 +06:00
cf45ed786e
[wistia] extract more metadata
2016-03-17 17:48:17 +01:00
574b2a7393
[nbc:nbcnews] improve extraction( fixes #6922 )
...
- extract more metadata and formats
- relax regex
2016-03-17 16:11:29 +01:00
9f02ff537c
[theplatform] extract brightcove once formats
2016-03-17 16:11:29 +01:00
0436ec0e7a
[once] Add new format extractor
2016-03-17 16:11:29 +01:00
11f12195af
[youtube] Added itag 91
...
Seen in https://www.youtube.com/watch?v=jMN4cxyhJjk
2016-03-17 19:25:37 +08:00
a646a8cf98
[sbs] improve extraction( fixes #3811 )
...
- extract error messages
- force the platform smil url(previously the manifest param
in the query is not respected which make theplatform return non working
mp4 files for some videos)
2016-03-17 02:07:06 +01:00
63f41d3821
[bravotv] Add new extractor( #4657 )
2016-03-16 21:26:25 +01:00
c5229f3926
[utils] PEP 8
2016-03-16 21:50:04 +06:00
96f4f796fb
[brightcover] Remove unused import
2016-03-16 21:47:51 +06:00
70cab344c4
[udemy] Improve course id v4 regex
2016-03-16 21:46:09 +06:00
a7ba57dc17
[udemy] Update course id regex to cover v4 layout ( Closes #8753 , closes #8868 , closes #8870 )
2016-03-16 21:45:01 +06:00
83548824c2
Merge pull request #8092 from bpfoley/twitter-thumbnail
...
[utils] Add extract_attributes for extracting html tag attributes
2016-03-16 13:16:27 +01:00
354dbbd880
[brightcove:new] extract protocol-less embed URLs( closes #2914 )
2016-03-16 11:46:53 +01:00
23edc49509
[tv3] Add new extractor( closes #8059 )
2016-03-16 10:47:39 +01:00
48254c3f2c
[brightcove] some improvements and fixes
...
- use FFmpeg downloader to download m3u8 formats extracted
from BrightcoveNew(some of the m3u8 media playlists use AES-128)
- update comment and update_url_query to handle url query
2016-03-16 09:21:07 +01:00
2cab48704c
[thestar] Add new extractor( closes #5955 )
2016-03-15 23:10:31 +01:00
64d4f31d78
[brightcove:new] update embed_in_page embeds regex to match non numeric ref id
2016-03-15 22:50:43 +01:00
0c9ff24041
[noz] fix extraction in python 2.6
2016-03-15 21:00:39 +01:00
3ff8279e80
[kuwo:mv] Fix the test and extraction of georestricted MVs
2016-03-16 02:41:18 +08:00
cb6e477dfe
[aljazeera] update the extractor to use BrightcoveNewIE
2016-03-15 19:38:10 +01:00
edfd93518e
[svt] extract dashhbbtv formats( #8867 )
2016-03-15 19:33:09 +01:00
89807d6a82
[brightcove] extract dash formats and detect audio formats
2016-03-15 18:48:21 +01:00
49dea4913b
Merge pull request #8513 from remitamine/dash-sort
...
[extractor/common] fix dash formats sorting
2016-03-15 18:39:50 +01:00
dec2cae0a7
[twitch:playlistbase] Clarify pagination bug
...
Pagination bug has been fixed by twitch on 15.03.2016.
2016-03-15 21:45:43 +06:00
cf6cd07396
[noz] extract f4m and m3u8 formats
2016-03-15 15:24:12 +01:00
975b9c9ab0
[brightcove:new] detect m3u8 manifests by M2TS container
2016-03-15 10:06:53 +01:00
8ac73bdbe4
[brightcove:new] Add support for non numeric ref: preffixed video ids
2016-03-15 10:03:08 +01:00
877f440f7b
[rice] Add new extractor( closes #1736 )
2016-03-15 00:49:23 +01:00
d13bdc3824
[brightcove] raise ExtractorError on 403 errors and fix regex to work with tenplay
2016-03-14 22:24:52 +01:00
744daf9418
[gameinformer] remove unused imports
2016-03-14 21:57:26 +01:00
bf475e1990
[tlc] fix extraction and update extractor to use BrightcoveNewIE
2016-03-14 21:53:00 +01:00
203f3d779a
[gameinformer] update the extractor to use BrightcoveNewIE
2016-03-14 18:32:29 +01:00
4230c4894d
[external/downloader] fix rtmp downloading using FFmpegFD
2016-03-14 16:51:01 +01:00
6bb266693f
release 2016.03.14
2016-03-14 10:25:20 +01:00
5d53c32701
[usatoday] Add new extractor( closes #8655 )
2016-03-13 22:36:15 +01:00
2e7e561c1d
Merge pull request #8611 from remitamine/ffmpegfd
...
[downloader/external] Add FFmpegFD
2016-03-13 21:30:27 +01:00
d8515fd41c
[downloader/external] pass configuration args to ffmpeg
2016-03-13 21:28:26 +01:00
694c47b261
[external/downloader] don't pass -t and -ss to ffmpeg
2016-03-13 21:28:16 +01:00
77dea16ac8
[downloader/external] check for ffmpeg availablity when it used for m3u8 download
2016-03-13 20:34:51 +01:00
6ae27bed01
[download/external] move the check for multiple selected formats to get_suitable_downloader
2016-03-13 20:34:38 +01:00
da1973a038
[extractor/__init__] disable time range downloading
2016-03-13 16:16:26 +01:00
be24916a7f
[downloader/rtsp] Add rtsp and mms downloader
2016-03-13 15:24:02 +01:00
2cb99ebbd0
[downloader/external] add can_download mathod for checking downloader availibilty and support
2016-03-13 15:18:51 +01:00
91ee320bfa
[downloader/external] wrap available_opt in a list
2016-03-13 14:37:45 +01:00
8fb754bcd0
Merge pull request #8821 from remitamine/list-thumbnails-order
...
[YoutubeDL] check for --list-thumbnails immediately after processing them
2016-03-13 12:44:50 +01:00
b7b72db9ad
[YoutubeDL] check for --list-thumbnails immediately after processing them
2016-03-13 12:41:15 +01:00
634415ca17
[downloader/external] skip FFmpegFD when requesting multiple formats
2016-03-13 12:23:10 +01:00
2f7ae819ac
[utils] PEP 8
2016-03-13 17:23:08 +06:00
0a477f8731
[vice:show] Add extractor ( Closes #8847 )
2016-03-13 17:22:23 +06:00
a755f82549
[ffmpeg] convert format ext to ffmpeg output formats codes
2016-03-13 12:15:29 +01:00
7f4173ae7c
[mixcloud] Fix view count extraction ( Closes #8831 , closes #8845 )
2016-03-13 16:27:58 +06:00
fb47597b09
[bbc] Generalize unit table lookup and add parse_count
2016-03-13 16:27:20 +06:00
450b233cc2
[bbc] Update test
2016-03-13 15:59:54 +06:00
b7d7674f1e
[bbc] Update test
2016-03-13 15:56:34 +06:00
0e832c2c97
[bbc] Improve title and description extraction ( Closes #8826 , closes #8822 )
2016-03-13 15:54:56 +06:00
8e4aa7bf18
[bbc] Fix BBC Extractor to work with 'School Report'
2016-03-13 15:54:34 +06:00
a42dfa629e
[makerschannel] Add new extractor( closes #8839 )
2016-03-12 22:52:53 +01:00
b970dfddaf
[minoto] Add new extractor
2016-03-12 22:52:53 +01:00
46a4ea8276
[safari] Remove unused imports
2016-03-13 03:48:38 +06:00
3f2f4a94aa
[extractor/generic] Extract f4m formats from final URLs
2016-03-13 03:38:20 +06:00
f930e0c76e
[extractor/generic] Extract f4m formats and refactor common info
2016-03-13 03:17:25 +06:00
0fdbb3322b
[extractor/common] Add _parse_f4m_formats routine
2016-03-13 03:16:08 +06:00
e9c8999ede
[safari] Fix authentication
2016-03-13 02:08:36 +06:00
73cbd709f9
[safari] Respect kaltura session ( Closes #7491 )
2016-03-13 02:03:07 +06:00
9dce3c095b
[kaltura] Respect kaltura session
2016-03-13 02:01:10 +06:00
e5a2e17a9c
[kaltura] optimize url info extraction
2016-03-12 18:43:45 +01:00
0ec589fac3
Merge pull request #8827 from remitamine/safari
...
[safari] extract free and preview videos(#7491 )
2016-03-12 17:28:54 +01:00
36bb63e084
[dw] add support for article pages( closes #8790 )
2016-03-12 08:33:22 +01:00
91d6aafb48
[dw] add support for audio pages
2016-03-11 23:55:26 +01:00
c8868a9d83
[dw] Add new extractor
2016-03-11 22:44:18 +01:00
09f572fbc0
[extractor/common] add transform_source to _download_smil and _extract_smil_formats
2016-03-11 22:37:07 +01:00
58e6d097d8
[googledrive] Relax _VALID_URL ( Closes #8829 )
2016-03-12 00:36:39 +06:00
15bf934de5
Merge pull request #8819 from remitamine/simple-webpage-requests
...
[extractor/common] simplify using data, headers and query params with _download_* methods
2016-03-11 18:19:43 +01:00
cdfee16818
[extractor/common] add data, headers and query params to _request_webpage
2016-03-11 18:12:50 +01:00
bcb668de18
[safari] extract free and preview videos( #7491 )
2016-03-11 16:57:06 +01:00
fac7e79277
[kaltura] add support for videos with reference id
2016-03-11 16:52:07 +01:00
a6c8b75904
[common] Use mimeType to determine file extensions ( #8766 )
2016-03-11 23:51:42 +08:00
25cb05bda9
[utils] Remove codec2ext
...
This function is orignally used for determining file extensions of DASH
formats. Now in DASH, ext is determined by mime_type. See #8766 for more
information.
2016-03-11 23:51:42 +08:00
883c052378
[audioboom] Improve robustness and extract uploader ( Closes #8812 )
2016-03-11 19:44:17 +06:00
61f317c24c
Added extractor for AudioBoom.com
2016-03-11 19:43:01 +06:00
64f08d4ff2
Merge pull request #8766 from yan12125/dash-detect-ext
...
Detect file extensions of DASH formats from their codecs
2016-03-11 21:40:07 +08:00
e738e43358
[facebook] Support videos in groups
...
Viewing/Downloading videos in groups requires logging in, even for
those in public groups.
Fixes #6951 .
2016-03-11 16:20:27 +08:00
f6f6217a98
[facebook] Don't override variable in list comprehension
2016-03-10 15:17:04 +01:00
31db8709bf
[iqiyi] Update enc_key
2016-03-10 21:37:26 +08:00
5080cbf9fd
[facebook] Handle escaped swf params
...
Fixes #8713
2016-03-10 15:26:32 +08:00
9880124196
[facebook] Fix for m.facebook.com URLs
2016-03-10 14:59:30 +08:00
9c7b509b2a
[facebook] Merge FacebookPostIE into FacebookIE
...
Fixes #8713
2016-03-10 14:59:30 +08:00
5d583bdf6c
[YoutubeDL] Improve _format_note
2016-03-10 01:03:18 +06:00
1e501364d5
[vimeo:ondemand] Clarify IE_NAME
2016-03-10 00:52:52 +06:00
74278def2e
[vimeo:ondemand] Separate ondemand extractor ( Closes #8330 , closes #8801 )
2016-03-10 00:51:07 +06:00
e375a149e1
[livestream] Properly build smil URLs ( #8794 )
2016-03-09 23:11:09 +06:00
ac45505528
Added flag for 'allow_audio_only' format in Twitch queries
2016-03-07 21:03:24 -06:00
46c329d6f6
[arte] Improve extraction ( Closes #8768 )
2016-03-07 02:19:54 +06:00
1818e4c2b4
[arte] Fix typo
2016-03-07 02:10:16 +06:00
e7bd17373d
[sexu] Improve extraction ( Closes #8782 )
2016-03-06 18:08:53 +06:00
c58e74062f
[Sexu] fix extractor
2016-03-06 17:53:22 +06:00
6d210f2090
[utils] Add more codecs to codec2ext
...
BBC uses avc3. Here's an example (thanks to @remitamine for this example)
http://rdmedia.bbc.co.uk/dash/ondemand/bbb/2/client_manifest-common_init.mpd
See also https://trac.ffmpeg.org/ticket/5217
2016-03-06 17:57:48 +08:00
af7d5a63b2
[common] Document protocol http_dash_segments
2016-03-06 17:47:07 +08:00
e41acb6364
[safari] Don't pollute std_headers ( #8778 )
2016-03-06 17:38:39 +08:00
bdf7f13954
release 2016.03.06
2016-03-06 10:08:02 +01:00
0f56a4b443
[vimeo] Don't pollute std_headers
...
Fixes #8778
2016-03-06 17:01:05 +08:00
Yen Chi Hsuan
Sergey M․
Peter Rowlands
remitamine
Philipp Hagemeister
Boris Wachtmeister
Jaime Marquínez Ferrándiz
aystroganov@gmail.com
Kacper Michajłow
Philip Huppert
theGeekPirate
Martin Trigaux
Kagami Hiiragi
jjatria
John Peel
Quan Hua
Benjamin Congdon