3da0db62e6
[escapist] Fix extraction ( fixes #5017 )
2015-02-20 23:22:47 +01:00
e14ced7918
Merge branch 'master' of github.com:rg3/youtube-dl
2015-02-20 23:20:14 +01:00
a461a11989
[ted] Improve external video handling and add test
2015-02-21 00:14:38 +06:00
1bd838608f
prefer 'code' to 'uri' if present
2015-02-20 18:24:20 +01:00
365577f567
[chirbit] add profile extractor.
2015-02-20 14:48:12 +01:00
50efb383f0
[tv4] Add new extractor ( Closes #4839 ) ( Closes #2103 )
2015-02-20 14:13:41 +02:00
5da6bd0083
[chirbit] Add new extractor.
2015-02-20 10:49:45 +01:00
5e9a033e6e
[imgur] Allow alternative values
...
Every now and then, imgur.com goes crazy and gives us a generic title and description (otherwise it looks all fine though).
Simply update the test case to allow for that craziness.
2015-02-20 02:52:03 +01:00
fb7cb6823e
Remove the SubtitlesInfoExtractor class
...
No longer needed
2015-02-19 23:24:24 +01:00
dd0a58f5f0
[blinkx] Fix extraction
2015-02-20 01:19:38 +06:00
6140baf4e1
[nationalgeographic] Add extractor ( closes #4960 )
2015-02-19 18:17:31 +01:00
8fc642eb5b
[pornhub] Fix uploader regex
2015-02-19 22:15:49 +06:00
e66e1a0046
[pornhub] Add support for playlists ( Closes #4995 )
2015-02-19 22:15:19 +06:00
d5c69f1da4
[5min] Cover joystiq.com URLs ( Closes #4962 )
2015-02-19 21:47:11 +06:00
f13b1e7d7f
[bbccouk] Convert to new subtitles system
...
I haven't found any video available outside the UK, so I haven't added tests.
I have updated how the srt file is build, because (at least for www.bbc.co.uk/programmes/p02j9b69) the subtitles is inside 'span' elements.
2015-02-19 16:46:41 +01:00
5c8a3f862a
[nbc] Use a test video that works outside the US
2015-02-19 15:00:39 +01:00
8807f1277f
[theplatform] Convert to new subtitles system
2015-02-19 14:54:50 +01:00
a3b9157f49
[cbssports] Add extractor ( closes #4996 )
2015-02-19 13:06:53 +01:00
b88ba05356
[imgur] Simplify
2015-02-19 05:53:09 +01:00
b74d505577
Merge remote-tracking branch 'jbboehr/imgur-gifv-improvements'
2015-02-19 05:16:11 +01:00
9e2d7dca87
[imgur] improve error check for non-video URLs
2015-02-18 19:47:54 -08:00
d236b37ac9
[imgur] improve regex #4998
2015-02-18 19:28:19 -08:00
e880c66bd8
[theonion] Modernize
2015-02-19 04:12:40 +01:00
1a13940c8d
[imgur] support regular URL
2015-02-18 18:12:48 -08:00
3d54788495
[webofstories] Fix extraction
2015-02-19 02:12:08 +01:00
71d53ace2f
[sockshare] Do not require thumbnail anymore
...
Thumbnail is not present on the website anymore.
2015-02-19 02:04:30 +01:00
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
2015-02-19 02:00:52 +01:00
bd03ffc16e
[netzkino] Skip download in test case
...
Works fine from Germany, but fails from everywhere else
2015-02-19 01:58:54 +01:00
3bf5705316
[imgur] Add new extractor
2015-02-19 01:43:20 +01:00
1c2528c8a3
[cbs] Modernize
2015-02-19 01:22:50 +01:00
6b961a85fd
[patreon] Add support for embedlies ( fixes #4969 )
2015-02-19 01:04:19 +01:00
7707004043
[patreon] Modernize
2015-02-19 00:38:05 +01:00
c460bdd56b
[sandia] Add new extractor ( #4974 )
2015-02-19 00:31:01 +01:00
93a16ba238
[vimeo] Raise the ExtractorError with expected=True when no video password is given
2015-02-18 22:00:12 +01:00
4f7cea6c53
[viki] Convert to new subtitles system
2015-02-18 20:37:16 +01:00
afbdd3acc3
[rai] Convert to new subtitles system
2015-02-18 20:14:42 +01:00
85d5866177
[yahoo] Remove md5sum from test case
...
The md5 sum has changed repeatedly, and we check whether it looks like a video anyways nowadays.
2015-02-18 20:03:04 +01:00
9789d7535d
[xtube] Fix test case
2015-02-18 19:58:41 +01:00
d8443cd3f7
[wsj] Correct test case
2015-02-18 19:56:24 +01:00
d47c26e168
[brightcove] Correct keys in playlists
2015-02-18 19:56:10 +01:00
01561da142
[nrk] Convert to new subtitles system
2015-02-18 18:57:01 +01:00
0af25f784b
[mtv] Convert to new subtitles system
2015-02-18 18:27:45 +01:00
b9b42f2ea0
[npo] Convert to new subtitles system
2015-02-18 17:57:10 +01:00
311c393838
[lynda] Convert to new subtitles system
2015-02-18 17:46:33 +01:00
18c1c42405
[drtv] Convert to new subtitles system
2015-02-18 17:20:22 +01:00
37dd5d4629
[mit] Don't set the subtitles field
...
YouTube already provides them in more formats
2015-02-18 17:19:56 +01:00
785521bf4f
[youtube] Remove useless if
2015-02-18 10:42:23 +01:00
6d1a55a521
[youtube] Show entire player URL when -v is given
2015-02-18 10:39:14 +01:00
11e611a7fa
Extend various playlist tests
2015-02-18 00:49:10 +01:00
72c1f8de06
[bandcamp:album] Fix extractor results and associated test
2015-02-18 00:48:52 +01:00
6e99868e4c
[buzzfeed] Fix playlist test case
2015-02-18 00:41:45 +01:00
4d278fde64
[ign] Amend playlist test
2015-02-18 00:38:55 +01:00
1def5f359e
[livestream] Correct playlist ID and add a test for it
2015-02-18 00:34:45 +01:00
15ec669374
[vk] Amend playlist test
2015-02-18 00:33:41 +01:00
a3fa5da496
[vimeo] Amend playlist tests
2015-02-18 00:33:31 +01:00
30965ac66a
[vimeo] Prevent infinite loops if video password verification fails
...
We're seeing this in the tests¹ right now, which do not terminate.
¹ https://travis-ci.org/jaimeMF/youtube-dl/jobs/51135858
2015-02-18 00:27:58 +01:00
9868ea4936
[extractor/common] Simplify subtitles handling methods
...
Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.
2015-02-17 22:16:29 +01:00
85920dd01d
[bliptv] Convert to new subtitles system
2015-02-17 21:56:25 +01:00
fa15607773
PEP8 fixes
2015-02-17 21:46:20 +01:00
98f000409f
[radio.de] Fix extraction
2015-02-17 21:40:09 +01:00
bd7fe0cf66
[walla] Convert to new subtitles system
2015-02-17 21:23:09 +01:00
48246541da
[ceskatelevize] Convert to new subtitles system
2015-02-17 21:17:47 +01:00
4a8d4a53b1
[videolecturesnet] Fix rtmp stream glitches ( Closes #4968 )
2015-02-18 01:16:49 +06:00
4cd95bcbc3
[twitch:stream] Prefer the 'source' format ( fixes #4972 )
2015-02-17 18:57:01 +01:00
0d93378887
[videolecturesnet] Check http format URLs ( Closes #4968 )
2015-02-17 22:35:27 +06:00
4069766c52
[extractor/common] Test URLs with GET
2015-02-17 22:35:27 +06:00
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
2015-02-16 22:47:39 +01:00
a1f2a06b34
[dailymotion] Convert to new subtitles system
2015-02-16 21:51:08 +01:00
c84dd8a90d
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
...
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
2015-02-16 21:51:08 +01:00
65469a7f8b
[vimeo] Convert to new subtitles system
...
Removed some tests, the behaviour should be checked in a test for the YoutubeDL class
2015-02-16 21:51:07 +01:00
6b597516c1
[atresplayer] Convert to new subtitles system
2015-02-16 21:51:07 +01:00
b5857f62e2
[crunchyroll] Convert to new subtitles system
2015-02-16 21:51:07 +01:00
a504ced097
Improve subtitles support
...
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.
The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.
Currently only the ted extractor has been updated, but the old system still works.
2015-02-16 21:51:03 +01:00
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
2015-02-16 15:45:45 +01:00
85e80f71cd
[yam] Allow faults in optional fields ( #4943 )
2015-02-16 04:50:57 +01:00
bfa6bdcd8b
Merge remote-tracking branch 'yan12125/IE_Yam'
2015-02-16 04:44:28 +01:00
03cd72b007
[extractor/common] Move up filesize
...
filesize and tbr should correlate, so it doesn't make sense to treat them differently.
2015-02-16 04:39:22 +01:00
f813928e4b
[bbccouk] Fix fallback to legacy playlist
2015-02-15 16:32:38 +06:00
b9c7a97318
[history] Add extractor ( Closes #4934 )
2015-02-15 04:57:52 +06:00
9fb2f1cd6d
[theplatform] Add URL sign capability
2015-02-15 04:56:12 +06:00
6ca7732d5e
[extractor/common] Fix link to external documentation
2015-02-14 22:20:24 +01:00
b0ab0fac49
Remove unused imports
2015-02-14 22:19:58 +01:00
a294bce82f
[streamcz] Fix extraction ( Closes #4940 )
2015-02-14 17:48:04 +02:00
76d1466b08
[drtuber] Add one more title regex
2015-02-14 18:50:13 +06:00
1888d3f7b3
Merge pull request #4951 from peugeot/beeg
...
[beeg] fix test
2015-02-14 18:46:49 +06:00
c2787701cc
Merge pull request #4950 from peugeot/drtuber
...
[drtuber] fix extraction
2015-02-14 18:46:43 +06:00
52e1d0ccc4
[beeg] fix test
2015-02-14 13:42:42 +01:00
10e3c4c221
[drtuber] fix extraction
2015-02-14 13:40:35 +01:00
68f2d273bf
[sunporno] Keep old video regex just in case
2015-02-14 18:33:52 +06:00
ae1580d790
[sunporno] fix extraction
2015-02-14 13:29:44 +01:00
a4f3d779db
[nbcnews] Simplify
2015-02-14 17:42:12 +06:00
d9aa2b784d
Support NBC Nightly News broadcasts
2015-02-14 04:10:23 -06:00
9347fddbfc
[1tv] Cover arbitraty URLs
2015-02-14 02:04:28 +06:00
037e9437e4
[camdemy] Fix _VALID_URL
2015-02-13 20:10:42 +06:00
ae6423d704
[bambuser] Fix 'uploader_id' extraction ( fixes #4944 )
2015-02-13 11:36:33 +01:00
7105440cec
[Yam] Add new extractor
2015-02-13 15:14:23 +08:00
171ca612af
[npo:radio] Move to extractor to common npo place and add extractor for fragments
2015-02-13 01:36:54 +06:00
c3d64fc1b3
[nporadio] Edit to confirm to flake8 standards
2015-02-12 19:28:58 +01:00
7c24ce225d
[NPORadio] Added extractor for live radio
2015-02-12 19:19:55 +01:00
08b38d5401
[camdemy] Simplify and make more robust ( #4938 )
...
Do not throw errors if view count or upload date extraction fails.
Dispose of re.MULTILINE, which had absolutely no effect without any ^ or $ in sight.
Follow PEP8 naming conventions.
2015-02-12 08:55:06 +01:00
024c53694d
Merge remote-tracking branch 'yan12125/IE_camdemy'
2015-02-12 08:44:39 +01:00
7e6011101f
[camdemy] Python2 compatibility
2015-02-12 14:23:25 +08:00
c40feaba77
[camdemy] Add support for folders
2015-02-12 14:13:19 +08:00
2d30521ab9
[youtube] Extract average rating ( closes #2362 )
2015-02-11 18:39:31 +01:00
124f3bc67d
[dotsub] Fix extraction and modernize
2015-02-11 22:33:03 +06:00
8367d3f3cb
[camdemy] Detection of external sources
2015-02-12 00:11:33 +08:00
c56d7d899d
[dctptv] Skip rtmp download
2015-02-11 22:10:33 +06:00
ea5db8469e
[canalplus] Add support for itele.fr URLs ( Closes #4931 )
2015-02-11 16:21:52 +02:00
3811c567e7
[teamcoco] Fix video id extraction
2015-02-11 15:47:19 +02:00
8708d76425
[camdemy] Add new extractor
...
Single file download done, while folder extaction in plan
2015-02-11 16:39:15 +08:00
054fe3cc40
[ntvru] Adapt to new direct delivery and modernize ( Closes #4918 )
2015-02-10 21:35:34 +06:00
9650885be9
[escapist] Filter video differently ( Fixes #4919 )
2015-02-10 15:55:51 +01:00
596ac6e31f
[escapist] Modernize
2015-02-10 15:45:36 +01:00
8f84f57183
[ccc] Add new extractor ( Fixes #4890 )
2015-02-10 05:42:41 +01:00
c0e1a415fd
[firstpost] Modernize
2015-02-10 05:28:48 +01:00
bf8f082a90
[vimeo:album] Add support for album passwords ( Fixes #4917 )
2015-02-10 04:53:21 +01:00
7e5db8c930
[options] Add --no-color
2015-02-10 04:22:10 +01:00
f7a211dcc8
[pornhd] Fix extraction ( fixes #4915 )
2015-02-10 03:41:31 +01:00
c73fae1e2e
[commonmistakes] Detect BOMs at the beginning of URLs
...
Reported at https://bugzilla.redhat.com/show_bug.cgi?id=1093517 .
2015-02-10 01:40:55 +01:00
834bf069d2
[bandcamp] Correct variable name
2015-02-10 01:37:14 +01:00
753fad4adc
[commonmistakes] Correct logic error
2015-02-10 01:34:01 +01:00
3a5bcd0326
[extractor/common] Wrap extractor errors ( Fixes #1194 )
...
For now, we just wrap some common errors. More may follow. We do not want to catch actual programming errors in the extractors, such as 1 // 0.
2015-02-10 01:17:23 +01:00
99c2398bc6
[bandcamp] Use our API to get more stable error messages ( #1194 )
2015-02-09 19:08:51 +01:00
28f1272870
[svtplay] Correct test case
2015-02-09 16:05:01 +01:00
c4c5dc27cb
Merge branch 'master' of github.com:rg3/youtube-dl
2015-02-09 15:59:14 +01:00
2caf182f37
[trilulilu] Add support for videos without category in the URL ( Closes #4067 )
...
Also, update the testcase, detect private/country restricted videos and modernize a bit.
2015-02-09 17:00:05 +02:00
1309b396d0
[svtplay] Add new extractor ( Fixes #4914 )
2015-02-09 15:56:59 +01:00
ba61796458
[youtube] Don't override format info from the dash manifest ( fixes #4911 )
2015-02-09 15:04:22 +01:00
e98b8e79ea
[generic] Improve SBS detection ( Fixes #4899 )
2015-02-09 14:46:10 +01:00
5269028951
[rtlnow] Add test for @mmue's extension ( #4908 )
2015-02-09 10:47:19 +01:00
f7bc056b5a
Merge remote-tracking branch 'mmue/fix-rtlnow'
2015-02-09 10:44:55 +01:00
a0f7198544
[generic] Add support for jwPlayer YouTube videos
...
This makes nationalarchives.gov.uk work (Fixes #4907 , fixes #4876 )
2015-02-09 10:43:01 +01:00
bdb186f3b0
fix rtlnow for newer series like "Der Bachelor" season 5
2015-02-08 21:55:39 +01:00
41c23b0da5
[gamekings] Support videos from news pages
2015-02-08 23:12:59 +06:00
d87ec897e9
[gamekings] Improve extraction
2015-02-08 23:03:12 +06:00
3bd4bffb1c
Merge branch 'gamekings' of https://github.com/robin007bond/youtube-dl into robin007bond-gamekings
2015-02-08 22:46:43 +06:00
c36b09a502
[Gamekings] Use thumbnail in return statement
2015-02-08 16:46:13 +01:00
641eb10d34
Use _family_friendly_search for determining age_limit
2015-02-08 17:45:38 +02:00
955c5505e7
[Gamekings] Use xpath
...
XPath is used for extracting the video url and the thumbnail
2015-02-08 16:44:25 +01:00
69319969de
[extractor/common] Add new helper method _family_friendly_search
2015-02-08 17:39:00 +02:00
a14292e848
[soulanime] Remove extractor ( #4554 )
...
Was supposed to be deleted by 67c2bcd
2015-02-08 16:57:07 +02:00
5d678df64a
[Gamekings] Download playlist
...
Todo: URL and Thumbnail should be extracted with XPath
2015-02-08 15:34:37 +01:00
8ca8cbe2bd
[Gamekings] Check string for vimeo, fix test
...
The test now doesn't fail anymore. It just checks the string for having
"vimeo" in it, instead of using the method for URL-checking, since it's
returns an error.
The tests don't fail, and the extractor works fine now.
2015-02-08 14:41:14 +01:00
ba322d8209
[Gamekings] Added test and replaced video_url
...
Quick and dirty fix for the Gamekings extractor. It gives an error about
the video_url, but it downloads it now instead of giving a 404 error on
newer Gamekings videos
2015-02-08 14:23:37 +01:00
2f38289b79
[Gamekings] Fix order of replacement string
...
Oops.
2015-02-08 13:49:32 +01:00
f23a3ca699
[Gamekings] Fixed typo in URL replacement
2015-02-08 13:47:27 +01:00
77d2b106cc
[Gamekings] Fix 404 when large isn't available
...
When trying to download some GameKings videos, not all worked. This was
because not all videos had a "/large"-URL available. The extractor
checks now if the /large URL is available, if it isn't, it tries to get
the normal URL.
2015-02-08 13:42:41 +01:00
c0e46412e9
[aparat] Fix extraction ( Closes #4897 )
2015-02-08 17:30:29 +06:00
ad5747bad1
[rtp] Construct regular HTTP download URLs ( #4882 )
2015-02-06 23:00:54 +02:00
d6eb66ed3c
[aftenposten] Add extractor ( Closes #4863 )
2015-02-07 01:46:54 +06:00
Philipp Hagemeister
Sergey M․
minusf
Leslie P. Polzer
Naglis Jonaitis
Jaime Marquínez Ferrándiz
John Boehr
peugeot
Ryan Schmidt
Yen Chi Hsuan
robin
Markus Müller