781a7ef60a
[lynda] Use 'lstrip' for the subtitles
...
The newlines at the end are important, they separate each piece of text.
2015-02-27 16:18:18 +01:00
5b2949ee0b
Merge pull request #5076 from Ftornik/Lynda-subtitles-hotfix
...
[lynda] Fixed subtitles broken file
2015-02-27 20:56:54 +06:00
a0d646135a
[lynda] Extend _VALID_URL
2015-02-27 20:56:06 +06:00
7862ad88b7
puls4 Add new extractor
2015-02-27 15:41:58 +01:00
f3bff94cf9
[rtve] Extract duration
2015-02-27 12:24:51 +01:00
0eba1e1782
[lynda] Fixed subtitles broken file
2015-02-27 00:51:22 +02:00
e3216b82bf
[generic] Support dynamic Kaltura embeds ( #5016 ) ( #5073 )
2015-02-27 00:34:19 +02:00
da419e2332
[musicvault] Use the Kaltura extractor
2015-02-26 23:47:45 +02:00
0d97ef43be
[kaltura] Add new extractor
2015-02-26 23:45:54 +02:00
1a2313a6f2
[TheChiveIE] added support for TheChive.com ( Closes #5016 )
2015-02-27 02:36:45 +10:30
250a9bdfe2
[mpora] Improve _VALID_URL
2015-02-26 21:16:35 +06:00
6317a3e9da
[mpora] Fix extraction
2015-02-26 21:10:49 +06:00
7ab7c9e932
[gamestar] Fix title extraction
2015-02-26 16:22:05 +02:00
e129c5bc0d
[laola1tv] Allow live stream downloads
2015-02-26 14:35:48 +02:00
2e241242a3
Adding subtitles
2015-02-26 03:59:35 -06:00
63a562f95e
[escapist] Detect IP blocking and use another UA ( Fixes #5069 )
2015-02-26 09:19:26 +01:00
72a406e7aa
[extractor/common] Pass in video_id ( #5057 )
2015-02-26 01:35:43 +01:00
feccc3ff37
Merge remote-tracking branch 'aajanki/wdr_live'
2015-02-26 01:34:01 +01:00
265bfa2c79
[letv] Simplify
2015-02-26 01:30:18 +01:00
8faf9b9b41
Merge remote-tracking branch 'yan12125/IE_Letv'
2015-02-26 01:26:55 +01:00
3e675fabe0
[airmozilla] Be more tolerant when nonessential items are missing ( #5030 )
2015-02-26 01:25:00 +01:00
cd5b4b0bc2
Merge remote-tracking branch 'duncankl/airmozilla'
2015-02-26 01:15:08 +01:00
7ef822021b
Merge remote-tracking branch 'mmue/fix-rtlnow'
2015-02-26 01:13:03 +01:00
9a48926a57
[escapist] Add support for advertisements
2015-02-26 00:59:53 +01:00
1c69bca258
[escapist] Fix config URL matching
2015-02-26 00:24:54 +01:00
c10ea454dc
[telecinco] Recognize more urls ( closes #5065 )
2015-02-25 23:52:54 +01:00
9504fc21b5
Fix the RTL extractor for new episodes by using a different hostname
2015-02-25 23:27:19 +01:00
13d8fbef30
[generic] Don't set the 'title' if it's not defined in the entry ( closes #5061 )
...
Some of them may be an 'url' result, which in general don't have the 'title' field.
2015-02-25 17:56:51 +01:00
b8988b63a6
[wdr] Download a live stream
2015-02-24 21:23:59 +02:00
6f4ba54079
[extractor/common] Extract HTTP (possibly f4m) URLs from a .smil file
2015-02-24 21:22:59 +02:00
637570326b
[extractor/common] Extract the first of a seq of videos in a .smil file
2015-02-24 21:22:59 +02:00
37f885650c
[eporner] Simplify and hardcode age limit
2015-02-25 01:08:54 +06:00
e765ed3a9c
[eporner] Fix redirect_code error
2015-02-24 19:41:46 +01:00
677063594e
[Letv] Update testcases
2015-02-25 02:10:55 +08:00
59c7cbd482
Update eporner.py
...
Updated to work. Old version shows an error about being unable to extract "redirect_code"
2015-02-24 18:58:32 +01:00
570311610e
[Letv] Add playlist support
2015-02-25 01:26:44 +08:00
41b264e77c
[nrktv] Workaround subtitles conversion issues on python 2.6 ( Closes #5036 )
2015-02-24 23:06:44 +06:00
7f09a662a0
[Letv] Add new extractor. Single video only
2015-02-24 23:58:21 +08:00
54233c9080
[escapist] Support JavaScript player ( Fixes #5034 )
2015-02-24 16:33:07 +01:00
9c665ab72e
[rtve] PEP8
2015-02-24 11:37:27 +01:00
ec5913b5cd
[bloomberg] Modernize
2015-02-24 11:08:00 +01:00
25ac63ed71
[rtve] Extract subtitles
2015-02-23 23:04:07 +01:00
99209c2916
[youtube] Extract UL playlists as mixes ( Closes #5040 )
2015-02-24 01:35:15 +06:00
1fbaa0a521
[laola1tv] Use raw strings for regular expressions
...
Oops
2015-02-23 20:51:30 +02:00
3037b91e05
[laola1tv] Improve extraction and update test case ( #3742 )
2015-02-23 20:45:52 +02:00
ffdf972b91
[facebook] Extract all the formats ( closes #5037 )
2015-02-23 18:54:15 +01:00
bfc993cc91
Merge branch 'subtitles-rework'
...
(Closes PR #4964 )
2015-02-23 17:13:03 +01:00
4432db35d9
[gdcvault] Restore akamai host for rtmp videos
2015-02-23 21:59:11 +06:00
591ab1dff9
[soundgasm] PEP8
2015-02-23 16:51:21 +01:00
5bca2424bc
[gdcvault] Remove dead code
2015-02-23 16:51:09 +01:00
3438e7acd2
[soundgasm] Remove unused import
2015-02-23 21:40:50 +06:00
409693984f
[soundgasm:profile] Fix _VALID_URL
2015-02-23 21:30:30 +06:00
04e8c11080
[chirbit] Clarify extractors' IE_NAMEs
2015-02-23 21:28:14 +06:00
80af2b73ab
[soundgasm] Clarify extractors' IE_NAMEs
2015-02-23 21:27:56 +06:00
3cc57f9645
[soundgasm:profile] Simplify
2015-02-23 21:27:24 +06:00
a65d4e7f14
[chirbit] Simplify and extract profile from RSS ( #5032 )
2015-02-23 21:15:16 +06:00
543ec2136b
Merge branch 'chirbit' of https://github.com/skypher/youtube-dl into skypher-chirbit
2015-02-23 19:21:25 +06:00
93b5071f73
[soundgasm] add profile IE.
2015-02-23 12:11:19 +01:00
ddc369f073
[chirbit] fix profile downloader regex.
2015-02-23 12:00:43 +01:00
1b40dc92eb
[airmozilla] Add new extractor
2015-02-23 16:10:08 +13:00
fcc3e6138b
[r7] Add extractor ( Closes #4405 , closes #5004 )
2015-02-23 03:32:53 +06:00
9fe6ef7ab2
[extractor/common] Fix preference for m3u8 quality selection URL
2015-02-23 03:30:10 +06:00
c010af6f19
[escapist] Make regexes more robust ( Closes #5028 )
2015-02-22 23:11:33 +06:00
35b7982303
[appletrailers] Add test ( #5027 )
2015-02-22 19:58:39 +06:00
f311cfa231
[appletrailers] Extend _VALID_URL ( Closes #5027 )
2015-02-22 19:53:32 +06:00
03091e372f
[ted] Always extract the subtitles
...
The required info is already in the webpage
2015-02-22 00:27:59 +01:00
314368c822
[teamcoco] Fix extraction
...
Also, use a single style of quotes
2015-02-21 22:19:39 +02:00
c5181ab410
[gdcvault] Fix rtmp streams ( Closes #5024 )
2015-02-22 02:10:26 +06:00
ea5152cae1
[zapiks] Extend _VALID_URL ( #5014 )
2015-02-22 01:42:47 +06:00
255fca5eea
[generic] Add support for Zapiks embeds ( #5014 )
2015-02-22 01:39:26 +06:00
4aeccadf4e
[zapiks] Add extractor ( #5014 )
2015-02-22 01:38:57 +06:00
93540ee10e
[rtve] Fix the video url
...
Changing mvod to mvod1 fixes the url, we don't need to add the query.
2015-02-21 19:31:39 +01:00
8fb3ac3649
PEP8: W503
2015-02-21 14:55:13 +01:00
77b2986b5b
[extractor/common] Recognize Indian censorship ( #5021 )
2015-02-21 14:51:07 +01:00
62b013df0d
[vimeo] Encode password before hash calculation
2015-02-21 18:31:10 +06:00
fad6768bd1
[vimeo] Fix password protected videos ( Closes #5001 )
2015-02-21 18:00:25 +06:00
3da0db62e6
[escapist] Fix extraction ( fixes #5017 )
2015-02-20 23:22:47 +01:00
e14ced7918
Merge branch 'master' of github.com:rg3/youtube-dl
2015-02-20 23:20:14 +01:00
a461a11989
[ted] Improve external video handling and add test
2015-02-21 00:14:38 +06:00
1bd838608f
prefer 'code' to 'uri' if present
2015-02-20 18:24:20 +01:00
365577f567
[chirbit] add profile extractor.
2015-02-20 14:48:12 +01:00
50efb383f0
[tv4] Add new extractor ( Closes #4839 ) ( Closes #2103 )
2015-02-20 14:13:41 +02:00
5da6bd0083
[chirbit] Add new extractor.
2015-02-20 10:49:45 +01:00
5e9a033e6e
[imgur] Allow alternative values
...
Every now and then, imgur.com goes crazy and gives us a generic title and description (otherwise it looks all fine though).
Simply update the test case to allow for that craziness.
2015-02-20 02:52:03 +01:00
fb7cb6823e
Remove the SubtitlesInfoExtractor class
...
No longer needed
2015-02-19 23:24:24 +01:00
dd0a58f5f0
[blinkx] Fix extraction
2015-02-20 01:19:38 +06:00
6140baf4e1
[nationalgeographic] Add extractor ( closes #4960 )
2015-02-19 18:17:31 +01:00
8fc642eb5b
[pornhub] Fix uploader regex
2015-02-19 22:15:49 +06:00
e66e1a0046
[pornhub] Add support for playlists ( Closes #4995 )
2015-02-19 22:15:19 +06:00
d5c69f1da4
[5min] Cover joystiq.com URLs ( Closes #4962 )
2015-02-19 21:47:11 +06:00
f13b1e7d7f
[bbccouk] Convert to new subtitles system
...
I haven't found any video available outside the UK, so I haven't added tests.
I have updated how the srt file is build, because (at least for www.bbc.co.uk/programmes/p02j9b69) the subtitles is inside 'span' elements.
2015-02-19 16:46:41 +01:00
5c8a3f862a
[nbc] Use a test video that works outside the US
2015-02-19 15:00:39 +01:00
8807f1277f
[theplatform] Convert to new subtitles system
2015-02-19 14:54:50 +01:00
a3b9157f49
[cbssports] Add extractor ( closes #4996 )
2015-02-19 13:06:53 +01:00
b88ba05356
[imgur] Simplify
2015-02-19 05:53:09 +01:00
b74d505577
Merge remote-tracking branch 'jbboehr/imgur-gifv-improvements'
2015-02-19 05:16:11 +01:00
9e2d7dca87
[imgur] improve error check for non-video URLs
2015-02-18 19:47:54 -08:00
d236b37ac9
[imgur] improve regex #4998
2015-02-18 19:28:19 -08:00
e880c66bd8
[theonion] Modernize
2015-02-19 04:12:40 +01:00
1a13940c8d
[imgur] support regular URL
2015-02-18 18:12:48 -08:00
3d54788495
[webofstories] Fix extraction
2015-02-19 02:12:08 +01:00
71d53ace2f
[sockshare] Do not require thumbnail anymore
...
Thumbnail is not present on the website anymore.
2015-02-19 02:04:30 +01:00
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
2015-02-19 02:00:52 +01:00
bd03ffc16e
[netzkino] Skip download in test case
...
Works fine from Germany, but fails from everywhere else
2015-02-19 01:58:54 +01:00
3bf5705316
[imgur] Add new extractor
2015-02-19 01:43:20 +01:00
1c2528c8a3
[cbs] Modernize
2015-02-19 01:22:50 +01:00
6b961a85fd
[patreon] Add support for embedlies ( fixes #4969 )
2015-02-19 01:04:19 +01:00
7707004043
[patreon] Modernize
2015-02-19 00:38:05 +01:00
c460bdd56b
[sandia] Add new extractor ( #4974 )
2015-02-19 00:31:01 +01:00
93a16ba238
[vimeo] Raise the ExtractorError with expected=True when no video password is given
2015-02-18 22:00:12 +01:00
4f7cea6c53
[viki] Convert to new subtitles system
2015-02-18 20:37:16 +01:00
afbdd3acc3
[rai] Convert to new subtitles system
2015-02-18 20:14:42 +01:00
85d5866177
[yahoo] Remove md5sum from test case
...
The md5 sum has changed repeatedly, and we check whether it looks like a video anyways nowadays.
2015-02-18 20:03:04 +01:00
9789d7535d
[xtube] Fix test case
2015-02-18 19:58:41 +01:00
d8443cd3f7
[wsj] Correct test case
2015-02-18 19:56:24 +01:00
d47c26e168
[brightcove] Correct keys in playlists
2015-02-18 19:56:10 +01:00
01561da142
[nrk] Convert to new subtitles system
2015-02-18 18:57:01 +01:00
0af25f784b
[mtv] Convert to new subtitles system
2015-02-18 18:27:45 +01:00
b9b42f2ea0
[npo] Convert to new subtitles system
2015-02-18 17:57:10 +01:00
311c393838
[lynda] Convert to new subtitles system
2015-02-18 17:46:33 +01:00
18c1c42405
[drtv] Convert to new subtitles system
2015-02-18 17:20:22 +01:00
37dd5d4629
[mit] Don't set the subtitles field
...
YouTube already provides them in more formats
2015-02-18 17:19:56 +01:00
785521bf4f
[youtube] Remove useless if
2015-02-18 10:42:23 +01:00
6d1a55a521
[youtube] Show entire player URL when -v is given
2015-02-18 10:39:14 +01:00
11e611a7fa
Extend various playlist tests
2015-02-18 00:49:10 +01:00
72c1f8de06
[bandcamp:album] Fix extractor results and associated test
2015-02-18 00:48:52 +01:00
6e99868e4c
[buzzfeed] Fix playlist test case
2015-02-18 00:41:45 +01:00
4d278fde64
[ign] Amend playlist test
2015-02-18 00:38:55 +01:00
1def5f359e
[livestream] Correct playlist ID and add a test for it
2015-02-18 00:34:45 +01:00
15ec669374
[vk] Amend playlist test
2015-02-18 00:33:41 +01:00
a3fa5da496
[vimeo] Amend playlist tests
2015-02-18 00:33:31 +01:00
30965ac66a
[vimeo] Prevent infinite loops if video password verification fails
...
We're seeing this in the tests¹ right now, which do not terminate.
¹ https://travis-ci.org/jaimeMF/youtube-dl/jobs/51135858
2015-02-18 00:27:58 +01:00
9868ea4936
[extractor/common] Simplify subtitles handling methods
...
Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.
2015-02-17 22:16:29 +01:00
85920dd01d
[bliptv] Convert to new subtitles system
2015-02-17 21:56:25 +01:00
fa15607773
PEP8 fixes
2015-02-17 21:46:20 +01:00
98f000409f
[radio.de] Fix extraction
2015-02-17 21:40:09 +01:00
bd7fe0cf66
[walla] Convert to new subtitles system
2015-02-17 21:23:09 +01:00
48246541da
[ceskatelevize] Convert to new subtitles system
2015-02-17 21:17:47 +01:00
4a8d4a53b1
[videolecturesnet] Fix rtmp stream glitches ( Closes #4968 )
2015-02-18 01:16:49 +06:00
4cd95bcbc3
[twitch:stream] Prefer the 'source' format ( fixes #4972 )
2015-02-17 18:57:01 +01:00
0d93378887
[videolecturesnet] Check http format URLs ( Closes #4968 )
2015-02-17 22:35:27 +06:00
4069766c52
[extractor/common] Test URLs with GET
2015-02-17 22:35:27 +06:00
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
2015-02-16 22:47:39 +01:00
a1f2a06b34
[dailymotion] Convert to new subtitles system
2015-02-16 21:51:08 +01:00
c84dd8a90d
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
...
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
2015-02-16 21:51:08 +01:00
65469a7f8b
[vimeo] Convert to new subtitles system
...
Removed some tests, the behaviour should be checked in a test for the YoutubeDL class
2015-02-16 21:51:07 +01:00
6b597516c1
[atresplayer] Convert to new subtitles system
2015-02-16 21:51:07 +01:00
b5857f62e2
[crunchyroll] Convert to new subtitles system
2015-02-16 21:51:07 +01:00
a504ced097
Improve subtitles support
...
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.
The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.
Currently only the ted extractor has been updated, but the old system still works.
2015-02-16 21:51:03 +01:00
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
2015-02-16 15:45:45 +01:00
85e80f71cd
[yam] Allow faults in optional fields ( #4943 )
2015-02-16 04:50:57 +01:00
bfa6bdcd8b
Merge remote-tracking branch 'yan12125/IE_Yam'
2015-02-16 04:44:28 +01:00
03cd72b007
[extractor/common] Move up filesize
...
filesize and tbr should correlate, so it doesn't make sense to treat them differently.
2015-02-16 04:39:22 +01:00
f813928e4b
[bbccouk] Fix fallback to legacy playlist
2015-02-15 16:32:38 +06:00
b9c7a97318
[history] Add extractor ( Closes #4934 )
2015-02-15 04:57:52 +06:00
9fb2f1cd6d
[theplatform] Add URL sign capability
2015-02-15 04:56:12 +06:00
6ca7732d5e
[extractor/common] Fix link to external documentation
2015-02-14 22:20:24 +01:00
b0ab0fac49
Remove unused imports
2015-02-14 22:19:58 +01:00
a294bce82f
[streamcz] Fix extraction ( Closes #4940 )
2015-02-14 17:48:04 +02:00
76d1466b08
[drtuber] Add one more title regex
2015-02-14 18:50:13 +06:00
1888d3f7b3
Merge pull request #4951 from peugeot/beeg
...
[beeg] fix test
2015-02-14 18:46:49 +06:00
c2787701cc
Merge pull request #4950 from peugeot/drtuber
...
[drtuber] fix extraction
2015-02-14 18:46:43 +06:00
52e1d0ccc4
[beeg] fix test
2015-02-14 13:42:42 +01:00
10e3c4c221
[drtuber] fix extraction
2015-02-14 13:40:35 +01:00
68f2d273bf
[sunporno] Keep old video regex just in case
2015-02-14 18:33:52 +06:00
ae1580d790
[sunporno] fix extraction
2015-02-14 13:29:44 +01:00
a4f3d779db
[nbcnews] Simplify
2015-02-14 17:42:12 +06:00
d9aa2b784d
Support NBC Nightly News broadcasts
2015-02-14 04:10:23 -06:00
9347fddbfc
[1tv] Cover arbitraty URLs
2015-02-14 02:04:28 +06:00
037e9437e4
[camdemy] Fix _VALID_URL
2015-02-13 20:10:42 +06:00
ae6423d704
[bambuser] Fix 'uploader_id' extraction ( fixes #4944 )
2015-02-13 11:36:33 +01:00
7105440cec
[Yam] Add new extractor
2015-02-13 15:14:23 +08:00
171ca612af
[npo:radio] Move to extractor to common npo place and add extractor for fragments
2015-02-13 01:36:54 +06:00
c3d64fc1b3
[nporadio] Edit to confirm to flake8 standards
2015-02-12 19:28:58 +01:00
7c24ce225d
[NPORadio] Added extractor for live radio
2015-02-12 19:19:55 +01:00
08b38d5401
[camdemy] Simplify and make more robust ( #4938 )
...
Do not throw errors if view count or upload date extraction fails.
Dispose of re.MULTILINE, which had absolutely no effect without any ^ or $ in sight.
Follow PEP8 naming conventions.
2015-02-12 08:55:06 +01:00
024c53694d
Merge remote-tracking branch 'yan12125/IE_camdemy'
2015-02-12 08:44:39 +01:00
7e6011101f
[camdemy] Python2 compatibility
2015-02-12 14:23:25 +08:00
c40feaba77
[camdemy] Add support for folders
2015-02-12 14:13:19 +08:00
2d30521ab9
[youtube] Extract average rating ( closes #2362 )
2015-02-11 18:39:31 +01:00
124f3bc67d
[dotsub] Fix extraction and modernize
2015-02-11 22:33:03 +06:00
8367d3f3cb
[camdemy] Detection of external sources
2015-02-12 00:11:33 +08:00
c56d7d899d
[dctptv] Skip rtmp download
2015-02-11 22:10:33 +06:00
ea5db8469e
[canalplus] Add support for itele.fr URLs ( Closes #4931 )
2015-02-11 16:21:52 +02:00
3811c567e7
[teamcoco] Fix video id extraction
2015-02-11 15:47:19 +02:00
8708d76425
[camdemy] Add new extractor
...
Single file download done, while folder extaction in plan
2015-02-11 16:39:15 +08:00
054fe3cc40
[ntvru] Adapt to new direct delivery and modernize ( Closes #4918 )
2015-02-10 21:35:34 +06:00
9650885be9
[escapist] Filter video differently ( Fixes #4919 )
2015-02-10 15:55:51 +01:00
596ac6e31f
[escapist] Modernize
2015-02-10 15:45:36 +01:00
8f84f57183
[ccc] Add new extractor ( Fixes #4890 )
2015-02-10 05:42:41 +01:00
c0e1a415fd
[firstpost] Modernize
2015-02-10 05:28:48 +01:00
bf8f082a90
[vimeo:album] Add support for album passwords ( Fixes #4917 )
2015-02-10 04:53:21 +01:00
7e5db8c930
[options] Add --no-color
2015-02-10 04:22:10 +01:00
f7a211dcc8
[pornhd] Fix extraction ( fixes #4915 )
2015-02-10 03:41:31 +01:00
c73fae1e2e
[commonmistakes] Detect BOMs at the beginning of URLs
...
Reported at https://bugzilla.redhat.com/show_bug.cgi?id=1093517 .
2015-02-10 01:40:55 +01:00
834bf069d2
[bandcamp] Correct variable name
2015-02-10 01:37:14 +01:00
753fad4adc
[commonmistakes] Correct logic error
2015-02-10 01:34:01 +01:00
3a5bcd0326
[extractor/common] Wrap extractor errors ( Fixes #1194 )
...
For now, we just wrap some common errors. More may follow. We do not want to catch actual programming errors in the extractors, such as 1 // 0.
2015-02-10 01:17:23 +01:00
99c2398bc6
[bandcamp] Use our API to get more stable error messages ( #1194 )
2015-02-09 19:08:51 +01:00
28f1272870
[svtplay] Correct test case
2015-02-09 16:05:01 +01:00
Jaime Marquínez Ferrándiz
Sergey M.
HanYOLO
Sergey
Naglis Jonaitis
anovicecodemonkey
PishPosh.McGee
Philipp Hagemeister
Markus Müller
Antti Ajanki
logon84
Yen Chi Hsuan
Leslie P. Polzer
Duncan Keall
minusf
John Boehr
peugeot
Ryan Schmidt
robin