69545c2aff
[d8] inherit from CanalplusIE
...
it reuses the same extraction process
2013-11-19 20:44:20 +01:00
495da337ae
Merge pull request #1758 from migbac/master
...
Add support for d8.tv
2013-11-19 20:43:14 +01:00
cb7dfeeac4
[youtube] only allow domain name to be upper-case ( #1786 )
2013-11-18 16:42:35 +01:00
4113e6ab56
[auengine] Do not return unnecessary ext
2013-11-18 14:36:01 +01:00
9906d397a0
[auengine] Simplify
2013-11-18 13:56:45 +01:00
887c6acdf2
Support multiple embedded YouTube URLs ( Fixes #1787 )
2013-11-18 13:28:26 +01:00
83aa529330
Support protocol-independent URLs ( #1787 )
2013-11-18 13:18:17 +01:00
fccd377198
Suppor embed-only videos ( Fixes #1746 )
2013-11-18 13:05:18 +01:00
63b7b7224a
[MTVIE] Try with RTMP URL if download fails
...
This fixes youtube-dl http://www.southpark.de/clips/155251/cartman-vs-the-dog-whisperer
2013-11-17 22:11:40 +01:00
746f491f82
Add support for southpark.de
2013-11-17 17:54:47 +01:00
1672647ade
[SouthParkStudiosIE] Move from _TEST to _TESTS
2013-11-17 17:43:58 +01:00
90b6bbc38c
[SouthParkStudiosIE] Also detect urls without http:// or www
2013-11-17 17:42:24 +01:00
1d699755e0
[youtube] Add view_count ( Fixes #1781 )
2013-11-17 11:06:16 +01:00
ddf49c6344
[arte] remove two typos
2013-11-17 11:05:49 +01:00
ba3881dffd
Add support for anitube.se ( #1417 )
2013-11-16 18:26:34 +04:00
d1c252048b
[redtube] Do not test md5, seems to vary
2013-11-16 10:30:09 +01:00
eab2724138
[gamekings] Do not test md5 sum, precise file changes regularly
2013-11-16 02:32:23 +01:00
21ea3e06c9
[gamekings] remove unnecessary import
2013-11-16 02:31:02 +01:00
52d703d3d1
[tvp] Skip tests
2013-11-16 02:09:30 +01:00
ce152341a1
[bambuser] Do not test for MD5, seems to be flaky
2013-11-16 01:59:28 +01:00
f058e34011
[dailymotion] Fix playlists
2013-11-16 01:56:23 +01:00
7150858d49
[spiegel] Implement format selection
2013-11-16 01:33:12 +01:00
91c7271aab
Add automatic generation of format note based on bitrate and codecs
2013-11-16 01:08:43 +01:00
fc2ef392be
[ted] Fix playlists ( Fixes #1770 )
2013-11-15 14:33:51 +01:00
463a908705
[ted] simplify
2013-11-15 14:06:38 +01:00
d24ffe1cfa
[rtlnow] Remove the test for nitro
...
The videos expire.
2013-11-15 12:57:59 +01:00
78fb87b283
Don't accept '>' inside the content attribute in OpenGraph regexes
2013-11-15 12:54:13 +01:00
ab2d524780
Improve the OpenGraph regex
...
* Do not accept '>' between the property and content attributes.
* Recognize the properties if the content attribute is before the property attribute using two regexes (fixes the extraction of the description for SlideshareIE).
2013-11-15 12:24:54 +01:00
85d61685f1
[tvp] Update the title and the description of the test video
2013-11-15 12:10:22 +01:00
b9643eed7c
[youtube:channel] Fix the extraction of autogenerated channels
...
The ajax pages are empty, now it looks directly in the channel's /videos page
2013-11-15 11:51:45 +01:00
0e145dd541
Merge branch 'master' of github.com:rg3/youtube-dl
2013-11-15 01:46:50 +01:00
9f9be844fc
[youtube] Fix protocol-independent URLs ( Fixes #1768 )
2013-11-15 01:45:39 +01:00
e3b9ab5e18
[soundlcoud] Set the correct extension for the tracks ( fixes #1766 )
...
Some tracks are not in mp3 format, they can be wav files.
2013-11-14 19:45:39 +01:00
c66d2baa9c
[livestream] Add an extractor for the original version of livestream ( closes #1764 )
...
The two versions use different systems.
2013-11-14 13:16:32 +01:00
ca715127a2
Don't assume the 'subtitlesformat' is set in the params dict ( fixes #1750 )
2013-11-13 17:14:10 +01:00
ea7a7af1d4
[gamekings] Fix the test video checksum
2013-11-13 17:13:06 +01:00
880e1c529d
[youtube:playlist] Login into youtube if requested ( fixes #1757 )
...
Allows to download private playlists
2013-11-13 16:39:11 +01:00
dcbb45803f
[youtube:playlist] Don't use the gdata api ( closes #1508 )
...
Parse the playlist pages instead
2013-11-13 16:26:50 +01:00
c3a3028f9f
[tvp] Minor improvements ( #1730 )
2013-11-13 11:06:53 +01:00
6c5ad80cdc
Merge remote-tracking branch 'saper/tvp'
2013-11-13 11:03:49 +01:00
384b98cd8f
[gamekings] Minor fixes ( #1759 )
2013-11-13 10:51:00 +01:00
eb9b5bffef
Add extractor for gamekings.tv
2013-11-13 10:38:47 +01:00
0bd59f3723
Add support for d8.tv
2013-11-12 23:32:03 +01:00
8b8cbd8f6d
[vine] Fix uploader extraction
2013-11-12 20:50:52 +01:00
eb0a839866
[common] Simplify og_search_property
2013-11-12 10:36:23 +01:00
0ed05a1d2d
Use the 'rtmp_live' field for the live parameter of rtmpdump
2013-11-10 12:45:17 +01:00
1008bebade
Merge remote-tracking branch 'rzhxeo/rtmpdump_live'
2013-11-10 12:38:40 +01:00
be6dfd1b49
[ted] Return a single info_dict for talks urls
...
It failed with the --list-subs option
2013-11-10 12:09:12 +01:00
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
2013-11-10 11:54:18 +01:00
fb53d58dcf
Merge pull request #1726 from saper/escaped
...
Fix AssertionError when og property not found
2013-11-10 02:51:52 -08:00
f470c6c812
[arte] Improve the format sorting
...
Also use the bitrate.
Prefer normal version and sourds/mal version over original version with subtitles.
2013-11-09 19:05:19 +01:00
566d4e0425
[arte] Make sure the format_id is unique ( closes #1739 )
...
Include the bitrate and use the height instead of the quality field.
2013-11-09 19:01:23 +01:00
81be02d2f9
[cnn] Accept www.cnn.com urls ( fixes #1740 )
2013-11-09 18:16:32 +01:00
c2b6a482d5
[brightcove] the format function requires to specify the index in python2.6
2013-11-09 18:10:11 +01:00
12c167c881
[soundcloud] Allow to download tracks marked as not 'streamable'
...
They use the rtmp protocol but if the are marked as 'downloadable' it can use the direct download link.
2013-11-09 18:08:03 +01:00
20aafee7fa
[kankan] Fix the video url
...
It now requires two additional parameters, one is a timestamp we get from the getCdnresource_flv page and the other is a key we have to build.
2013-11-09 16:51:11 +01:00
c8434e8316
Add support for crunchyroll.com
2013-11-09 11:25:12 +01:00
dd5bcdc4c9
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter ( fixes #1553 )
2013-11-07 21:06:48 +01:00
b1a80ec1a9
[xnxx] Accept urls that start with 'www' ( fixes #1734 )
2013-11-06 23:45:01 +01:00
51040b72ed
[brightcove] Support redirected urls from bcove.me ( fixes #1732 )
...
'bctid' needs to be changed to '@videoPlayer', and 'bckey' to 'playerKey'.
2013-11-06 22:03:00 +01:00
4f045eef8f
[youtube:channel] Fix the extraction
...
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
2013-11-06 21:42:33 +01:00
5d7b253ea0
Add an extractor for eitb.tv ( fixes #1608 )
...
The BrighcoveExperience object doesn't contain the video id, the extractor adds it and passes the url to BrightcoveIE.
2013-11-06 20:06:14 +01:00
b0759f0c19
[brightcove] Extract all the available formats
2013-11-06 19:05:41 +01:00
065472936a
Add an extractor for space.com ( fixes #1718 )
...
It uses Brightcove, but requires some special process for getting a url with the playerKey field in some videos
2013-11-06 17:37:39 +01:00
fc4a0c2aec
[brightcove] Change the 'videoId' or 'videoID' field to '@videoPlayer' ( fixes #1697 )
...
It seems to be needed when using the htmlFederated page
2013-11-06 17:31:47 +01:00
eeb165e674
[brightcove] Add the extraction of the url from generic
2013-11-06 16:58:03 +01:00
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
2013-11-06 16:43:26 +01:00
5137ebac0b
[tvp] Telewizja Polska: new extractor for tvp.pl, fixes #1719
...
Thanks-To: mplonski
https://github.com/mplonski/linux/blob/master/tvp-dl.py
2013-11-05 23:47:40 +01:00
a8eeb0597b
Fix AssertionError when og property not found
...
On tvp.pl some webpages contain OpenGraph
metadata and some don't.
If og property is not found, _og_search_description
fails with
WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug
Traceback (most recent call last):
File "/usr/home/saper/bin/youtube-dl", line 18, in <module>
youtube_dl.main()
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main
_real_main(argv)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main
retcode = ydl.download(all_urls)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download
videos = self.extract_info(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info
ie_result = ie.extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract
return self._real_extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract
info['description'] = self._og_search_description(webpage)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description
return self._og_search_property('description', html, fatal=False, **kargs)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property
return unescapeHTML(escaped)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML
assert type(s) == type(u'')
AssertionError
The patch allows me to use:
try:
info['description'] = self._og_search_description(webpage)
info['thumbnail'] = self._og_search_thumbnail(webpage)
except RegexNotFoundError:
pass
2013-11-05 23:19:29 +01:00
4ed3e51080
[ted] fixed error in case of no subtitles present
...
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
2013-11-05 12:00:13 +01:00
2dcf7d8f99
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
2013-11-05 02:08:02 +01:00
19b0668251
[canal2c] Accept more urls ( fixes #1723 )
...
The url only needs to have the 'idVideo' field in the query, in any position.
We have to set the 'void=oui' in the webpage url, so that we get the file name.
2013-11-04 22:26:19 +01:00
e7e6b54d8a
[teamcoco] Parse the xml file and extract all the formats
2013-11-03 17:48:12 +01:00
2a1a8ffe41
Merge pull request #1693 from alexvh/teamcoco_fix
...
[teamcoco] Fix video url extraction for some videos
2013-11-03 17:19:51 +01:00
08fb86c49b
[youtube] Add description for YoutubeSearchDateIE ( #1710 )
2013-11-03 15:59:10 +01:00
3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
2013-11-03 15:56:55 +01:00
12ebdd1506
[viddler] Support non-digit IDs ( Fixes #1714 )
2013-11-03 15:49:59 +01:00
1baf9a5938
Merge pull request #1698 from rzhxeo/cinemassacre
...
[CinemassacreIE] Support more embed urls
2013-11-03 05:17:12 -08:00
a56f9de156
Style fixes for extractors: remove spaces around (,),{ and }
2013-11-03 14:06:47 +01:00
fa5d47af4b
Merge pull request #1679 from rzhxeo/mofosex
...
Add support for http://www.mofosex.com
2013-11-03 05:04:14 -08:00
d607038753
Merge pull request #1677 from rzhxeo/xtube
...
Add support for http://www.xtube.com
2013-11-03 03:28:02 -08:00
9ac6a01aaf
Merge pull request #1676 from rzhxeo/extremetube
...
Add support for http://www.extremetube.com
2013-11-03 03:25:46 -08:00
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
2013-11-03 12:11:13 +01:00
a3dd924871
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
2013-11-02 22:40:48 -04:00
137bbb3e37
[XTubeIE] Add description to TEST
2013-11-02 22:45:48 +01:00
86ad94bb2e
[ExtremeTubeIE] Set age_limit to 18 and fix uploader extraction
2013-11-02 22:33:49 +01:00
3e56add7c9
Merge pull request #1678 from rzhxeo/keezmovies
...
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
2013-11-02 14:15:52 -07:00
f52f01b5d2
[brightcove] Don't set the extension
...
If the video only has the 'FLVFullLengthURL' key, it can still be an mp4 file.
2013-11-02 21:20:46 +01:00
98d7efb537
[exfm] skip tests
...
The site is down too often.
2013-11-02 20:51:09 +01:00
cf51923545
[youtube] Remove vevo test
...
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
2013-11-02 20:46:26 +01:00
38fcd4597a
Merge remote-tracking branch 'iemejia/master'
2013-11-02 19:56:06 +01:00
165e3bb67a
[bambuser] Add an extractor for channels ( closes #1702 )
2013-11-02 19:50:57 +01:00
38db46794f
Merge branch 'ted_subtitles'
2013-11-02 19:50:45 +01:00
a9a3876d55
[ted] Added support for subtitle download
2013-11-02 19:48:39 +01:00
1f343eaabb
[subtitles] refactor to support websites with subtitle information the
...
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
2013-11-02 19:29:25 +01:00
72a5b4f702
Add an extractor for bambuser.com ( #1702 )
2013-11-02 19:01:01 +01:00
0a43ddf320
[CinemassacreIE] Add live paramter to extracted info as a workaround
2013-11-02 18:08:35 +01:00
8eddf3e91d
[youtube] Encode subtitle track name in request ( Fixes #1700 )
2013-11-02 11:21:05 +01:00
60d142aa8d
Add an extractor for vk.com ( closes #1635 )
2013-11-01 22:34:18 +01:00
66cf3ac342
[metacafe] Fix support for age-restricted videos ( fixes #1696 )
...
The 'Content-Type' header must be set for disabling the family filter.
The 'flashversion' cookie is only needed for AnyClip videos.
Added tests for standard metacafe videos and for age-restricted videos.
Also set the 'age_limit' field.
2013-11-01 11:56:15 +01:00
ab4e151347
[CinemassacreIE] Support more embed urls
2013-11-01 01:24:23 +01:00
ac2547f5ff
[teamcoco] Fix video url extraction for some videos
...
Video url extraction failed for some videos,
e.g. http://teamcoco.com/video/old-time-baseball
The url extracted was also occasionally suboptimal quality,
e.g. http://teamcoco.com/video/louis-ck-interview-george-w-bush
2013-10-31 15:41:14 -04:00
5f1ea943ab
[livestream] fix the extraction of events
...
It now uses a json dictionary from the webpage.
2013-10-31 08:07:26 +01:00
9f1109a564
[dailymotion] Fix support for age-restricted videos ( Fixes #1688 )
2013-10-31 00:20:49 +01:00
72321ead7b
[vevo] Readd support for SMIL ( Fixes #1683 )
2013-10-30 01:14:17 +01:00
b5d0d817bc
Remove superfluous space
2013-10-30 01:09:44 +01:00
b9a836515f
Update the Vimeo test vector md5
...
confirmed that this is indeed the first 10241 (we went off by one with
byte range 0-10240) of the full, playing mp4, so they probably
reencoded or something
2013-10-29 16:44:35 -04:00
21c924f406
[arte] Download the 'Originalversion' version if it's the only one available ( fixes #1682 )
2013-10-29 20:58:49 +01:00
e54fd4b23b
[vevo] Add more format details
2013-10-29 15:10:09 +01:00
912cbf5d4e
[vevo] Fix timestamp handling
...
( / 1000 is implicit float division )
2013-10-29 14:00:23 +01:00
f7ff55aa78
Merge remote-tracking branch 'origin/master'
2013-10-29 06:48:18 +01:00
795f28f871
[youtube] Fix login ( Fixes #1681 )
2013-10-29 06:45:54 +01:00
321a01f971
[mtv] Remove the templates from the mediagen url
2013-10-28 23:37:01 +01:00
2563bcc85c
Add an extractor for MySpace ( closes #1666 )
2013-10-28 22:02:17 +01:00
dcc2a706ef
Add support for http://www.xtube.com
2013-10-28 19:23:48 +01:00
2bc67c35ac
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
2013-10-28 18:22:55 +01:00
77ae65877e
Add support for http://www.mofosex.com
2013-10-28 18:18:58 +01:00
32a35e4418
Add support for http://www.extremetube.com
2013-10-28 17:35:01 +01:00
1003d108d5
[vimeo] Support hash in URL ( Fixes #1669 )
2013-10-28 11:32:22 +01:00
c1002e96e9
Let extractors omit ext in formats
2013-10-28 11:28:02 +01:00
77d0a82fef
[addanime] Use new formats system
2013-10-28 11:24:47 +01:00
ebc14f251c
Merge remote-tracking branch 'origin/master'
2013-10-28 10:44:13 +01:00
d41e6efc85
New debug option --write-pages
2013-10-28 10:44:02 +01:00
8ffa13e03e
[Instagram] get the non-https link, as they are serving Akamai cert from a instagram.com domain
2013-10-28 02:34:29 -04:00
750e9833b8
Add the missing age_limit tags; added a devscript to do a superficial check for porn sites without the age_limit tag in the test
2013-10-28 01:50:17 -04:00
82f0ac657c
Merge pull request #1657 by @rzhxeo
...
[YouPornIE] Extract all encrypted links and remove doubles at the end
2013-10-28 01:45:52 -04:00
eb6a2277a2
Merge pull request #1659 by @rzhxeo
...
Add support for http://www.tube8.com
2013-10-28 01:38:28 -04:00
f8778fb0fa
Merge pull request #1663 by @rzhxeo
...
Add support for http://www.spankwire.com
2013-10-28 01:35:11 -04:00
e2f9de207c
Merge pull request #1664 by @rzhxeo
...
Add support for http://www.keezmovies.com
2013-10-28 01:25:46 -04:00
a93cc0d943
Merge pull request #1661 by @rzhxeo
...
Add support for http://www.pornhub.com
2013-10-28 00:50:39 -04:00
7d8c2e07f2
[Exfm] replace the failing Soundcloud test vector (broken also in browser)
2013-10-28 00:33:43 -04:00
efb4c36b18
Merge pull request #1660 from pyed/master
...
[addanime] try to download HQ before normal
2013-10-27 21:14:19 -07:00
29526d0d2b
Merge pull request #1656 from rzhxeo/xhamster
...
[XHamsterIE] Extract SD and HD video
2013-10-27 10:12:59 -07:00
198e370f23
[addanime] better regex.
2013-10-27 19:48:02 +03:00
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
2013-10-27 14:40:25 +01:00
bc63d9d329
[rtlnow] Change the test for rtlnitronow
2013-10-27 14:26:19 +01:00
aa929c37d5
[generic] Fix test video's checksum
2013-10-27 14:21:37 +01:00
af4d506eb3
[faz] Use a regex for getting the description
...
The page cannot be parsed in python2.6 with the html parser.
2013-10-27 14:18:55 +01:00
5da0549581
[KeezMoviesIE] Correct return value for embedded videos
2013-10-27 12:48:09 +01:00
749a4fd2fd
[facebook] Don't recommend to report the issue if the video is private.
2013-10-27 12:13:55 +01:00
6f71ef580c
[facebook] Report a more meaningful message if the video cannot be accessed ( closes #1658 )
2013-10-27 12:09:46 +01:00
67874aeffa
[facebook] Fix the login process ( fixes #1244 )
2013-10-27 12:07:58 +01:00
3e6a330d38
[addanime] fix md5sum
2013-10-27 13:51:26 +03:00
aee5e18c8f
[addanime] catch 'RegexNotFoundError'
2013-10-27 13:36:43 +03:00
5b11143d05
Add support for http://www.keezmovies.com
2013-10-27 10:10:28 +01:00
7b2212e954
Add support for http://www.spankwire.com
2013-10-27 01:59:26 +02:00
71865091ab
[Tube8IE] Fix regex for uploader extraction
2013-10-27 01:08:03 +02:00
125cfd78e8
Add support for http://www.pornhub.com
2013-10-27 01:04:22 +02:00
8cb57d9b91
[Tube8IE] Escape dot in regex
2013-10-27 00:21:27 +02:00
14e10b2b6e
[addanime] try to download HQ before normal
2013-10-27 01:19:38 +03:00
6e76104d66
[YouPornIE] Make webpage download more robust
2013-10-26 23:33:32 +02:00
1d45a23b74
Add support for http://www.tube8.com
2013-10-26 23:27:30 +02:00
7df286540f
[YouPornIE] Extract all encrypted links and remove doubles at the end
2013-10-26 21:57:10 +02:00
5d0c97541a
[XHamsterIE] Extract SD and HD video
2013-10-26 20:38:54 +02:00
49a25557b0
[8tracks] Use track count instead of looking at at_last_track property
...
This fixes the error:
$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
youtube_dl.main()
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
_real_main(argv)
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
retcode = ydl.download(all_urls)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
videos = self.extract_info(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
ie_result = ie.extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
return self._real_extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
'id': track_data['id'],
KeyError: 'id'
2013-10-25 23:46:19 +02:00
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
2013-10-25 17:17:46 +02:00
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
2013-10-25 16:55:37 +02:00
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
2013-10-25 16:52:58 +02:00
fcc28edb2f
[cinemassacre] Simplify
...
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
2013-10-23 20:21:41 +02:00
fac6be2dd5
Merge pull request #1632 from rzhxeo/cinemassacre
...
[Cinemassacre] Download video that is shown in flash player
2013-10-23 20:15:39 +02:00
cdec0190c4
[dailymotion] Extract all the available formats ( closes #1028 )
2013-10-23 17:33:38 +02:00
2450bcb28b
[nowvideo] Fix key extraction
...
Extract it from the embed page
2013-10-23 17:00:33 +02:00
93b22c7828
[vimeo] fix the extraction for videos protected with password
...
Added a test video.
2013-10-23 16:31:53 +02:00
55b3e45bba
[vimeo] Fix pro videos and player.vimeo.com urls
...
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
2013-10-23 14:38:03 +02:00
365bcf6d97
Merge remote-tracking branch 'origin/master'
2013-10-23 11:40:46 +02:00
71907db3ba
[vimeo] Fix normal videos ( Fixes #1642 )
...
Vimeo Pro Videos are still broken
2013-10-23 11:38:53 +02:00
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
2013-10-22 15:16:26 -07:00
b028e96144
[arte.tv:creative] Update the title of the test
2013-10-22 21:06:06 +02:00
ce68b5907c
[nhl:videocenter] Fix playlist title extraction
2013-10-22 21:01:16 +02:00
a6387bfd3c
[vimeo] Implement the new format selection system (closes PR #996 )
...
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
2013-10-21 23:16:11 +02:00
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
2013-10-21 16:28:55 +02:00
cbbd9a9c69
Fix the duration field for the VideoDetective and InternetVideoArchive tests
...
Also remove the use of the old format system and the comment
2013-10-21 15:07:33 +02:00
685a9cd2f1
[googleplus] Fix upload_date extraction
2013-10-21 15:00:21 +02:00
182a107877
[arte] Set the format_note and the format_id fields ( closes #1628 )
2013-10-21 14:42:30 +02:00
8c51aa6506
The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
...
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
2013-10-21 14:42:06 +02:00
f8b45beacc
Merge remote-tracking branch 'rbrito/set-age'
...
Conflicts:
youtube_dl/extractor/xhamster.py
2013-10-19 21:16:14 +02:00
9d92015d43
[xhamster] Add support for age_limit (Instead of #1627 )
2013-10-19 21:09:48 +02:00
50a6150ed9
extractor: Set age limit on some adult-related extractors.
...
More age limit of videos for adult-related sites.
Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.
That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:19:25 -03:00
d5a9bb4ea9
extractor: youtube: Swap video dimensions to match standard practice.
...
While working on this, I thought about simplifying things like changing
480x854 to 480p, and that seemed like a good option, until I realized that
people (me included) usually link the concept of some number followed by a p
with the video being 16:9.
So, we would be losing some information and, as we all know,
[explicit is better than implicit][*].
[*]: http://www.python.org/dev/peps/pep-0020/
This closes #1446 .
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:04:44 -03:00
b0505eb611
[CinemassacreIE] Fix information extraction
2013-10-19 16:46:17 +02:00
8ed6b34477
extractor: Set age limit on some adult-related extractors.
...
This is similar in spirit to what was done in commit 8e590a117f
2013-10-18 19:32:37 -03:00
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 18:53:00 -03:00
8e590a117f
[xnxx] Add age_limit
2013-10-18 23:35:17 +02:00
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 17:50:55 -03:00
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
2013-10-18 11:44:57 +02:00
7c58ef3275
[tudou] Fix title regex ( Fixes #1614 )
2013-10-18 11:16:20 +02:00
416a5efce7
fix typos
2013-10-18 00:49:45 +02:00
d21ab29200
Add an extractor for techtalks.tv ( closes #1606 )
2013-10-17 08:20:58 +02:00
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
2013-10-17 02:19:19 +02:00
591454798d
[brightcove] Raise error if playlist is empty ( #1608 )
2013-10-17 01:02:17 +02:00
38604f1a4f
Merge remote-tracking branch 'origin/master'
2013-10-17 00:55:06 +02:00
2d0efe70a6
[brightcove] Fix more broken XML ( #1608 )
2013-10-17 00:46:11 +02:00
bfd14b1b2f
Add an extractor for rutube.ru ( closes #1136 )
...
It downloads with a m3u8 manifest, requires ffmpeg.
2013-10-16 16:57:40 +02:00
10eaae48ff
Merge branch 'master' of github.com:rg3/youtube-dl
2013-10-15 12:05:24 +02:00
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
2013-10-15 12:05:13 +02:00
9d74e308f7
[sztvhu] Fix the title extraction
2013-10-15 08:22:59 +02:00
8381a92120
[websurg] Skipt the test
...
It needs login information.
2013-10-15 08:12:30 +02:00
4f41664de8
Merge remote-tracking branch 'Rudloff/websurg'
2013-10-15 02:11:33 +02:00
7cf67fbe29
[sztvhu] Simplify
2013-10-15 01:33:20 +02:00
3ddf1a6d01
Merge remote-tracking branch 'Elbandi/master'
2013-10-15 01:26:34 +02:00
850555c484
Merge remote-tracking branch 'origin/master'
2013-10-15 01:25:47 +02:00
9ed3bdc64d
[tudou] Add support for youku links ( Closes #1571 )
2013-10-15 01:20:04 +02:00
c45aa56080
[gamespot] Fix video extraction ( fixes #1587 )
2013-10-14 16:46:07 +02:00
7394b8db3b
Merge remote-tracking branch 'origin/master'
2013-10-14 16:07:53 +02:00
f9b3d7af47
Add an extractor for Szombathelyi TV
2013-10-14 13:07:47 +02:00
ea62a2da46
add VideoPremium.tv RTMP support
2013-10-14 01:32:47 -04:00
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
2013-10-14 16:22:27 +11:00
9378ae6e1d
[youku] Allow shortcut youku:ID and make non-matching groups non-matching ( #1571 )
2013-10-13 15:55:05 +02:00
69a0c470b5
[arte] Add an extractor for future.arte.tv ( closes #1593 )
2013-10-13 14:21:13 +02:00
c40f5cf45c
[arte] add an extractor for creative.arte.tv ( #1593 )
...
The +7 videos now use an independent extractor that is also used for the creative videos
2013-10-13 13:54:31 +02:00
4b7b839f24
Add an extractor for rottentomatoes.com and improve InternetVideoArchiveIE to get the best quality
2013-10-12 22:22:31 +02:00
3d60d33773
Add an extractor for videodetective.com ( closes #262 )
...
It uses the internetvideoarchive.com platform.
2013-10-12 21:36:17 +02:00
d7e66d39a0
Add an extractor for internetvideoarchive.com videos
...
It's used by videodetective.com
2013-10-12 21:34:04 +02:00
f5e54a1fda
add support for NowVideo.ch
2013-10-12 13:11:03 -04:00
3283533149
Fix Brightcove detection when another Flash object is on the page
...
The regex used non-greedy match, but alas it failed on input like this:
<object class="...> ... class="BrightcoveExperience"
It captured two objects and the intervening HTML. This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.
Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
2013-10-11 21:52:33 -04:00
8032e31f2d
Merge pull request #1558 from rzhxeo/cinemassacre
...
Add support for http://cinemassacre.com
2013-10-11 20:38:26 +02:00
d2f9cdb205
Merge branch 'cinemassacre' of github.com:rzhxeo/youtube-dl into rzhxeo-cinemassacre
2013-10-11 19:53:27 +02:00
3823342d9d
[arte] Prepare for generic format support ( #980 )
2013-10-11 16:33:31 +02:00
91dbaef406
[nhl] Add an extractor for videocenter's categories ( #1586 )
...
It downloads the last 12 videos.
2013-10-11 14:33:26 +02:00
cb354c8f62
[yahoo] Download the info from another page
...
The 'meta' field is not always in the video webpage
2013-10-10 21:01:45 +02:00
1cbb27b151
[gamespot] Mark as broken ( #1587 )
2013-10-10 19:55:52 +02:00
0ab4ff6378
[mtv] Strip the description
...
There were some tabs and newlines added around the string.
2013-10-10 19:53:44 +02:00
63da13e829
Add an extractor for faz.net ( closes #1582 )
2013-10-10 19:37:17 +02:00
2e1fa03bf5
Add an extractor for video.nhl.com ( closes #1586 )
2013-10-10 16:16:49 +02:00
57da92b7df
[youtube] Do not recognize attribution link as user ( Fixes #1573 )
2013-10-09 23:50:38 +02:00
a34c2faae4
[youtube] set the 'name' parameter in the subtitles url ( fixes #1577 )
2013-10-09 16:41:36 +02:00
88bd97e34c
[vevo] Some improvements ( fixes #1580 )
...
Extract the info from http://videoplayer.vevo.com/VideoService/AuthenticateVideo?isrc={id}
Some videos don't have an smil manifest, extract the video urls directly from the json and use the last version of the video.
Extract all the available formats and set the 'formats' field of the result
2013-10-08 21:25:38 +02:00
faa6ef6bc8
[jeuxvideo] Improve code quality ( fixes #1567 )
2013-10-07 14:33:23 +02:00
15870e90b0
Restore warning when user forgets to quote URL ( #1396 )
2013-10-07 12:21:24 +02:00
387ae5f30b
[vimeo] Recognize urls ending in a slash ( fixes #1242 )
2013-10-06 21:56:23 +02:00
1310bf2474
[redtube] add age_limit
2013-10-06 16:39:35 +02:00
2a69c6b879
Merge branch 'age_limit'
2013-10-06 16:23:18 +02:00
cfadd183c4
Call extracted property age_limit everywhere
2013-10-06 16:23:06 +02:00
e484c81f0c
[generic] Clarify error messages
2013-10-06 16:03:18 +02:00
41e8bca4d0
[viddler] Add basic support ( Fixes #1520 )
2013-10-06 07:12:47 +02:00
8dbe9899a9
Allow users to specify an age limit ( fixes #1545 )
...
With these changes, users can now restrict what videos are downloaded by the intented audience, by specifying their age with --age-limit YEARS .
Add rudimentary support in youtube, pornotube, and youporn.
2013-10-06 06:08:56 +02:00
e94b783c74
[googleplus] Fix upload_date detection
2013-10-05 16:38:33 +02:00
97dae9ae07
[bliptv] Make sure video ID is a string
2013-10-05 16:12:29 +02:00
ca215e0a4f
[CinemassacreIE] Use MD5 to check in TEST description
2013-10-05 13:42:17 +02:00
91a26ca559
[CinemassacreIE] Remove docstring from class
2013-10-05 13:40:05 +02:00
1ece880d7c
[CinemassacreIE] Add support for other embed methods
2013-10-05 13:36:13 +02:00
400afddaf4
Add CinemassacreIE
2013-10-05 09:37:11 +02:00
c3fef636b5
[dailymotion] Fix playlist extraction
...
The html code has changed, make the video ids extraction more solid.
2013-10-04 14:07:29 +02:00
46e28a84ca
[brightcove] Fix up some broken HTML ( #1553 )
2013-10-04 11:53:49 +02:00
17ad2b3fb1
[yahoo] Switch ext of test
2013-10-04 11:44:56 +02:00
5e2a60db4a
[yahoo] Fix test title
2013-10-04 11:44:02 +02:00
cd214418f6
[redtube] pep8
2013-10-04 11:41:57 +02:00
ba2d9f213e
[jeuxvideo] fix video file md5sum
2013-10-04 11:38:56 +02:00
7f8ae73a5d
Include length in player cache ID
...
Some videos use the same player with IDs of multiple lengths.
See https://travis-ci.org/rg3/youtube-dl/jobs/12126506#L319 for an example.
2013-10-04 11:36:06 +02:00
466880f531
[yahoo] Do not try to run rtmpdump on travis
2013-10-04 11:34:12 +02:00
9f1f6d2437
[rtlnow] Skip test on travis
2013-10-04 11:33:14 +02:00
9e0f897f6b
[francetv] Use common format for ID of generation-quoi subextractor
2013-10-04 11:30:47 +02:00
c0f6aa876f
Merge remote-tracking branch 'origin/master'
2013-10-04 11:14:20 +02:00
d93bdee9a6
[comedycentral] Prepare for generic video extraction ( #980 )
2013-10-04 11:14:10 +02:00
f13d09332d
[mtv] Prepare for #980
2013-10-04 11:10:04 +02:00
2f5865cc6d
Clarify that url and ext are optional when formats is given ( #980 )
2013-10-04 11:09:43 +02:00
deefc05b88
Document formats (for #980 )
2013-10-04 10:40:42 +02:00
0d8cb1cc14
[ted] Prepare #980 merge
2013-10-04 10:32:34 +02:00
829493439a
[FlickrIE] Fix HTTPS url
2013-10-04 07:47:40 +02:00
73b4fafd82
Use self._download_webpage everywhere
2013-10-04 01:12:42 +02:00
b039775057
Unused variable
2013-10-04 01:07:24 +02:00
5c1d63b737
Changes suggested by @phihag
2013-10-04 01:04:38 +02:00
3cd022f6e6
Merge remote-tracking branch 'rzhxeo/rtl_ntv'
2013-10-04 00:59:11 +02:00
abefd1f7c4
Merge remote-tracking branch 'rzhxeo/rtl_upload_date'
2013-10-04 00:58:35 +02:00
c21315f273
[youtube] new static 82 signature
2013-10-04 00:43:01 +02:00
da0a5d2d6e
[france2] Add support for URLs without video IDs ( Fixes #1547 )
2013-10-04 00:34:36 +02:00
ee6adb166c
[ign] Support more urls and detect multiple videos in articles ( fixes #1543 )
2013-10-02 20:59:34 +02:00
c38b1e776d
[youtube] Simplify cache_dir code ( #1529 )
2013-10-02 08:41:14 +02:00
4f8bf17f23
Merge remote-tracking branch 'holomorph/master'
2013-10-02 08:23:53 +02:00
ca40186c75
[youtube] Fix static 82 signature ( Closes #1539 )
2013-10-02 08:20:00 +02:00
a8c6b24155
[youtube] Support videos without a title ( Fixes #1391 , Closes #1542 )
2013-10-02 07:25:35 +02:00
bd8e5c7ca2
Merge pull request #1531 from rg3/no-playlist
...
[youtube] implement --no-playlist to only download current video
2013-10-01 10:08:20 -07:00
7c61bd36bb
[youtube] correct --no-playlist for python3
2013-10-01 11:58:13 -04:00
c54283824c
[dailymotion] Detect vevo videos ( fixes #1532 )
...
All videos from the Vevo user, just embed videos from vevo.com
2013-10-01 15:05:41 +02:00
44d466559e
Properly handle stream meap not being present
2013-10-01 14:44:09 +02:00
f10503db67
Handle videos without url_encoded_fmt_stream_map ( Fixes #1535 )
2013-10-01 11:39:11 +02:00
adfeafe9e1
[RTLnowIE] Allow video description without upload date
...
Some videos (feature films) have no upload date.
2013-10-01 07:22:49 +02:00
4c62a16f4f
[RTLnowIE] Add support for http://n-tvnow.de
2013-10-01 06:55:30 +02:00
fa55675593
Support XDG base directory specification
2013-09-30 18:22:38 -04:00
47192f92d8
implement --no-playlist to only download current video - closes #755
2013-09-30 16:26:25 -04:00
722076a123
[rtlnow] Replace one of the tests
...
The video is no longer available.
2013-09-29 23:07:26 +02:00
bb4aa62cf7
[appletrailers] The request for the settings must have the trailer name in lower case ( fixes #1329 )
2013-09-29 20:59:19 +02:00
843530568f
[appletrailers] Rework extraction ( fixes #1387 )
...
The exraction was broken:
* The includes page contains img elements that need to be fixed.
* Use the 'itunes.inc' page, it contains a json dictionary for each trailer with information.
* Get the formats from 'includes/settings{trailer_name}.json'
* Use urljoin to allow urls with a fragment identifier to work
Removed the thumbnail urls from the tests, they are different now.
2013-09-29 20:49:58 +02:00
70922df8b5
[dailymotion] Disable the family filter in the playlists ( fixes #1524 )
2013-09-29 12:44:02 +02:00
9c15e9de84
[yahoo] Fix video extraction ( fixes #1521 )
...
There's no need to use two different methods.
Now we can also download videos over http if possible.
Also run the test for rtmp videos, but skip the download.
2013-09-28 21:19:52 +02:00
123c10608d
Merge branch 'master' of github.com:rg3/youtube-dl
2013-09-28 15:43:38 +02:00
0b7c2485b6
[zdf] Add support for hash URLs and simplify ( #1518 )
2013-09-28 15:43:34 +02:00
9abb32045a
[youtube] Add hlsvp to the error message if it can't be found and remove the live stream test
...
It's no longer available, other olympics streams have the same problem.
2013-09-27 15:06:27 +02:00
f490e77e77
[youtube] Set the thumbnail to None if it can't be extracted
2013-09-27 14:22:36 +02:00
2dc592991a
[youtube] update description of test
2013-09-27 14:20:52 +02:00
8574862991
Merge remote-tracking branch 'rzhxeo/RTL_T'
2013-09-27 06:25:04 +02:00
2de957c7e1
Merge remote-tracking branch 'rzhxeo/RTL'
2013-09-27 06:23:10 +02:00
920de7a27d
[youtube] Fix 83 signature ( Closes #1511 )
2013-09-27 06:15:21 +02:00
63efc427cd
[RTLnowIE] Clean video title
...
The title of some videos has the following format:
Series - Episode | Series online schauen bei ... NOW
2013-09-27 06:00:37 +02:00
ce65fb6c76
[RTLnowIE] Add support for http://rtlnitronow.de
2013-09-27 05:50:16 +02:00
4de1994b6e
[brightcove] Use direct url for the tests
...
The test_all_urls.py test failed because BrightcoveIE doesn't match them.
2013-09-26 18:59:56 +02:00
592882aa9f
[brightcove] Support videos that only provide flv versions ( fixes #1504 )
...
Moved the test from generic.py to brightcove.py
2013-09-26 13:54:31 +02:00
f426de8460
Merge remote-tracking branch 'origin/master'
2013-09-24 21:40:30 +02:00
695dc094ab
Merge branch 'automatic-signatures'
2013-09-24 21:40:08 +02:00
e80d861064
Revert "[southparkstudios] Fix mgid extraction"
...
This reverts commit 0fd49457f5
2013-09-24 21:39:38 +02:00
f2c327fd39
Fix 86 signature ( #1494 )
2013-09-24 21:20:42 +02:00
e35e4ddc9a
Fix output of --youtube-print-sig-code when counting down to 0
2013-09-24 21:18:03 +02:00
c3c88a2664
Allow opts.cachedir == None to disable cache
2013-09-24 21:04:43 +02:00
bb0eee71e7
[youtube] Update one of the test's description
2013-09-24 21:04:13 +02:00
6f56389b88
[youtube] update algos for length 86 and 84 ( fixes #1494 )
2013-09-24 21:02:00 +02:00
5b333c1ce6
[francetv] Add an extractor for Generation Quoi ( closes #1475 )
2013-09-23 21:41:54 +02:00
a825f33030
[francetv] Add an extractor for France2
2013-09-23 21:28:33 +02:00
81ec7c7901
[facebook] Allow untitled videos ( Fixes #1484 )
2013-09-23 11:24:33 +02:00
c705320f48
Correct test strings
2013-09-22 12:18:16 +02:00
d2d8f89531
Do not warn if fallback is without alternatives (because we did not get the flash player URL)
2013-09-22 12:18:10 +02:00
bdde940e90
[youtube] Improve flash player URL handling
2013-09-22 12:17:42 +02:00
13dc64ce74
[youtube] Remove _decrypt_signature_age_gate
2013-09-22 11:17:21 +02:00
f8061589e6
[youtube] Actually pass in cachedir option
2013-09-22 10:51:33 +02:00
0ca96d48c7
[youtube] Improve source code quality
2013-09-22 10:37:23 +02:00
4ba146f35d
Update static signatures
2013-09-22 10:31:25 +02:00
edf3e38ebd
[youtube] Improve cache and add an option to print the extracted signatures
2013-09-22 10:30:02 +02:00
c4417ddb61
[youtube] Add filesystem signature cache
2013-09-22 00:35:03 +02:00
4a2080e407
[youku] better error handling
...
blocked videos used to cause death by TypeError, now we report what the
server says
2013-09-21 20:50:31 +02:00
2f2ffea9ca
Clarify a couple of calls
2013-09-21 15:34:29 +02:00
ba552f542f
Use reader instead of indexing
2013-09-21 15:32:37 +02:00
8379969834
Prepare signature function caching
2013-09-21 15:19:48 +02:00
95dbd2f990
Change test target (Verified with node.js)
2013-09-21 15:10:38 +02:00
a7177865b1
Implement more opcodes
2013-09-21 14:48:12 +02:00
e0df6211cc
Restore accidentally deleted commits
...
That's what happens if you let Windows machines write :(
2013-09-21 14:40:35 +02:00
b00ca882a4
[livestream] Fix events extraction ( fixes #1467 )
2013-09-21 13:50:52 +02:00
39baacc49f
[dailymotion] Add an extractor for users ( closes #1476 )
2013-09-21 12:45:53 +02:00
3a1d48d6de
[dailymotion] Raise ExtractorError if the dailymotion response reports an error
2013-09-21 12:15:54 +02:00
69b227a9bc
[southparkstudios] add support for http://www.southparkstudios.com/full-episodes/ * urls ( closes #1469 )
2013-09-21 10:58:43 +02:00
0fd49457f5
[southparkstudios] Fix mgid extraction
2013-09-21 10:51:25 +02:00
3d60bb96e1
Add an extractor for ebaumsworld.com ( closes #1462 )
2013-09-20 16:55:50 +02:00
38d025b3f0
[youtube] add algo for length 91
2013-09-20 14:43:16 +02:00
1a810f0d4e
[funnyordie] Fix video url extraction
2013-09-20 13:05:34 +02:00
bc4b900898
Unable to decrypt signature length 93 ( fixes #1461 )
2013-09-19 21:49:06 -07:00
c5e743f66f
[fktv] support videos splitted in any number of parts and some style changes
2013-09-18 23:32:37 +02:00
6c36d8d6fb
Merge pull request #1438 from rzhxeo/fktv
...
Add support for http://fernsehkritik.tv
2013-09-18 23:05:56 +02:00
71c82637e7
[youtube] apply the fix for lists with number of videos multiple of _MAX_RESULTS to user extraction
...
Copied from the playlist extractor.
2013-09-18 23:00:32 +02:00
d0ae9e3a8d
[newgrounds] simplify
2013-09-18 22:14:43 +02:00
a19413c311
Changed file hash.
2013-09-18 17:17:12 +01:00
1ef80b55dd
Fixes test fail
...
Was unaware of --id being passed to test.
2013-09-18 16:23:38 +01:00
eb03f4dad3
Added Newgrounds support
2013-09-18 15:54:45 +01:00
cc6943e86a
Improvements
2013-09-18 00:07:04 +02:00
1237c9a3a5
XHamsterIE: Fix support for new HD video url format and add test (closes PR #1443 )
2013-09-17 23:08:01 +02:00
8f77093262
Merge remote-tracking branch 'upstream/master' into websurg
2013-09-17 23:07:44 +02:00
5d13df79a5
[francetv] Remove Pluzz test
...
Videos expire in 7 days
2013-09-17 22:49:43 +02:00
d79a0e233a
Extractor for websurg.com
2013-09-17 22:13:40 +02:00
6523223a4c
[hotnewhiphop] Fix test case title
2013-09-17 21:10:57 +02:00
4a67aafb7e
[youtube] Don't search the flash player version for videos with age gate activated
2013-09-17 20:59:55 +02:00
6ae8ee3f54
Update 85 signature ( Fixes #1449 )
...
This is the first signature algorithm to have been parsed automatically, although that only works for HTML5 players for now, and is not yet integrated into master.
2013-09-17 16:59:13 +02:00
e8f8e80097
Add an extractor for vice.com ( closes #1051 )
2013-09-16 20:58:36 +02:00
4dc0ff3ecf
[ooyala] prefer ipad url
...
It has better quality with m3u8 manifests
2013-09-16 20:38:54 +02:00
4b6462fc1e
Add an extractor for Bloomberg ( closes #1436 )
2013-09-16 20:38:48 +02:00
c4ece78564
[ooyala] add support for more type of video urls, like m3u8 manifests.
2013-09-16 19:34:10 +02:00
0761d02b0b
Add FKTV extractor
2013-09-16 14:46:19 +02:00
71c107fc57
Add FKTV extractor
...
Support for Fernsehkritik-TV (incl. Postecke)
2013-09-16 14:45:14 +02:00
5a6fecc3de
Add an extractor for southparkstudios.com ( closes #1434 )
...
It uses the MTV system
2013-09-15 23:30:58 +02:00
cdbccafed9
Merge pull request #1422 from rzhxeo/xhamster
...
XHamsterIE: Add support for new URL format (download in hd by default)
2013-09-15 12:18:39 +02:00
e69ae5b9e7
[youtube] support youtube.googleapis.com/v/* urls ( fixes #1425 )
2013-09-15 12:14:59 +02:00
92790f4e54
[soundcloud] Add an extractor for users ( closes #1426 )
2013-09-14 21:41:49 +02:00
471a5ee908
Set the ext field for each format
2013-09-14 14:45:04 +02:00
19e1d35989
[mixcloud] Rewrite extractor ( fixes #278 )
2013-09-14 14:26:42 +02:00
0b7f31184d
Now --all-sub is a modifier to --write-sub and --write-auto-sub ( closes #1412 )
...
For keeping backwards compatibility --all-sub sets --write-sub if --write-auto-sub is not given
2013-09-14 11:14:40 +02:00
fad84d50fe
[googleplus] Fix upload date extraction
2013-09-14 11:10:01 +02:00
9a1c32dc54
XHamsterIE: Add support for new URL format
2013-09-14 05:42:00 +02:00
a921f40799
[ustream] Simplify channel extraction
...
the ChannelParser has been moved to a new function in utils get_meta_content
Instead of the SocialStreamParser now it uses a regex
2013-09-13 22:05:29 +02:00
74ac9bdd82
Merge pull request #1413 from tewe/master
...
Add Ustream channel support
2013-09-13 21:34:31 +02:00
94518f2087
Merge pull request #1409 from JohnyMoSwag/master ( closes #1404 )
...
added kickstarter IE
2013-09-13 19:52:56 +02:00
dd01d6558a
[gamespot] Update test video title
2013-09-12 22:18:39 +02:00
ce85f022d2
[youtube] update algo for length 82 ( fixes #1416 )
2013-09-12 22:04:09 +02:00
ad94a6fe44
[canalplust] accept urls that don't include the video id ( fixes #1415 ), extract more info and update test
2013-09-12 21:56:36 +02:00
bfd5c93af9
Add Ustream channel support
2013-09-12 12:30:14 +02:00
c247d87ef3
[funnyordie] fix video url extraction
2013-09-12 11:31:27 +02:00
6bc520c207
Check for both automatic captions and subtitles with options `--write-sub` and `--write-auto-sub` ( fixes #1224 )
2013-09-12 11:15:25 +02:00
f1d20fa39f
added kickstarter IE
2013-09-11 14:50:38 -07:00
e3dc22ca3a
[youtube] Fix detection of videos with automatic captions
2013-09-11 19:24:56 +02:00
d665f8d3cb
[subtitles] Also list the available automatic captions languages with '--list-sub'
2013-09-11 19:17:30 +02:00
055e6f3657
[youtube] Support automatic captions with original language different from English ( fixes #1225 ) and download in multiple languages.
2013-09-11 19:08:43 +02:00
542cca0e8c
Merge branch 'subtitles_rework' (closes PR #1326 )
2013-09-11 17:41:24 +02:00
6a2449df3b
[howcast] Do not download from http://www.howcast.com/videos/{video_id}
...
It takes too much to follow the redirection.
2013-09-11 17:36:23 +02:00
7fad1c6328
[subtitles] Use self._download_webpage for extracting the subtitles
...
It raises ExtractorError for the same exceptions we have to catch.
2013-09-11 16:24:47 +02:00
d82134c339
[subtitles] Simplify the extraction of subtitles in subclasses and remove NoAutoSubtitlesInfoExtractor
...
Subclasses just need to call the method extract_subtitles, which will call _extract_subtitles and _request_automatic_caption
Now the default implementation of _request_automatic_caption returns {}.
2013-09-11 16:05:49 +02:00
54d39d8b2f
[subtitles] rename SubitlesIE to SubtitlesInfoExtractor
...
Otherwise it can be automatically detected as a IE ready for use.
2013-09-11 15:51:04 +02:00
de7f3446e0
[youtube] move subtitles methods from the base extractor to YoutubeIE
2013-09-11 15:48:23 +02:00
f8e52269c1
[subtitles] made inheritance hierarchy flat as requested
2013-09-11 15:21:09 +02:00
cf1dd0c59e
Merge branch 'master' into subtitles_rework
2013-09-11 14:26:48 +02:00
aa8f2641da
[youtube] update algo for length 85 ( fixes #1408 and fixes #1406 )
2013-09-11 11:24:58 +02:00
648d25d43d
[francetv] Add an extractor for francetvinfo.fr ( closes #1317 )
...
It uses the same system as Pluzz, create a base class for both extractors.
2013-09-10 15:50:34 +02:00
6b361ad5ee
Wrong property name
2013-09-10 12:13:22 +02:00
5d8afe69f7
Add an extractor for pluzz.francetv.fr (closes PR #1399 )
2013-09-10 12:00:00 +02:00
07463ea162
Add an extractor for Slideshare ( closes #1400 )
2013-09-10 11:19:58 +02:00
6d2d21f713
[sohu] add support for my.tv.sohu.com urls ( fixes #1398 )
2013-09-09 19:56:16 +02:00
8963d9c266
[youtube] Modify the regex to match ids of length 11 ( fixes #1396 )
...
In urls like http://www.youtube.com/watch?v=BaW_jenozKcsharePLED17F32AD9753930 you can't split the query string and ids always have that length.
2013-09-09 10:33:12 +02:00
890f62e868
Revert "[youtube] Fix detection of tags from HLS videos."
...
They have undo the change
This reverts commit 0638ad9999
2013-09-08 18:50:07 +02:00
72836fcee4
Merge branch 'master' into subtitles_rework
2013-09-06 23:24:41 +02:00
a7130543fa
[generic] If the url doesn't specify the protocol, then try to extract prepending 'http://'
2013-09-06 18:39:35 +02:00
a490fda746
[daylimotion] accept embed urls ( fixes #1386 )
2013-09-06 18:36:07 +02:00
7e77275293
Add an extractor for Metacritic
2013-09-06 18:08:07 +02:00
d6e203b3dc
[subtitles] fixed multiple subtitles language separated by comma after merge
...
As mentioned in the pull request, I forgot to include this changes.
aa6a10c44a
2013-09-06 16:30:13 +02:00
e3ea479087
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374 )
...
They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable.
Now the url tests check that the urls can only be extracted with an specific extractor.
2013-09-06 16:24:24 +02:00
faab1d3836
[youtube] Fix detection of feeds urls ( fixes #1294 )
...
Urls like https://www.youtube.com/feed/watch_later were being as users (before the last changes to YoutubeUserIE, as videos)
2013-09-06 14:45:49 +02:00
fd9cf73836
[youtube] Users: download from the api in json to simplify extraction ( fixes #1358 )
...
There could be duplicate videos or other videos if the description have links.
2013-09-06 10:43:02 +02:00
0638ad9999
[youtube] Fix detection of tags from HLS videos.
2013-09-06 10:25:31 +02:00
1cf911bc82
Vevo sig changed again, please update for us! Thanks very much! ( fixes #1375 )
2013-09-05 17:38:03 -07:00
f4b052321b
[youtube] Urls like youtube.com/NASA are now interpreted as users ( fixes #1069 )
...
Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-05 22:39:15 +02:00
c215217e39
[youtube] Playlists: extract the videos id from ['media$group']['yt$videoid'] ( fixes #1374 )
...
'media$player' is not defined for private videos.
2013-09-05 21:40:04 +02:00
08e291b54d
[generic] Recognize html5 video in the format '<video src=".+?"' and only unquote the url when extracting the id ( fixes #1372 )
2013-09-05 18:02:17 +02:00
6b95b065be
Add extractor for tvcast.naver.com ( closes #1331 )
2013-09-05 10:53:40 +02:00
9363169b67
[daum] Get the video page from a canonical url to extract the full id ( fixes #1373 ) and extract description.
2013-09-05 10:08:17 +02:00
150f20828b
Add extractor for daum.net ( closes #1330 )
2013-09-04 22:06:50 +02:00
5d5171d26a
Merge pull request #1341 from xanadu/master
...
add support for "-f mp4" for YouTube
2013-09-03 18:52:12 -07:00
96fb5605b2
AHLS -> Apple HTTP Live Streaming
2013-09-03 18:49:35 -07:00
7011de0bc2
Merge pull request #1363 from Rudloff/defense
...
defense.gouv.fr
2013-09-03 18:23:08 -07:00
c3dd69eab4
Merge remote-tracking branch 'upstream/master'
2013-09-03 12:22:29 -07:00
025171c476
Suggested by @phihag
2013-09-03 12:03:19 +02:00
c8dbccde30
[orf] Remove the test video, they seem to expire in one week
2013-09-03 11:51:01 +02:00
4ff7a0f1f6
[dailymotion] improve the regex for extracting the video info
2013-09-03 11:33:59 +02:00
9c2ade40de
[vimeo] Handle Assertions Error when trying to get the description
...
In some pages the html tags are not closed, python 2.6 cannot handle it.
2013-09-03 11:11:36 +02:00
aa32314d09
[vimeo] add support for videos that embed the download url in the player page ( fixes #1364 )
2013-09-03 10:48:56 +02:00
52afe99665
Extractor for defense.gouv.fr
2013-09-03 01:51:17 +02:00
8e4e89f1c2
Add an extractor for VeeHD ( closes #1359 )
2013-09-02 11:54:09 +02:00
6c758d79de
[metacafe] Add more cases for detecting the uploader detection (reported in #1343 )
2013-08-31 22:35:39 +02:00
85f03346eb
Merge remote-tracking branch 'upstream/master'
2013-08-30 17:51:59 -07:00
bdc6b3fc64
add support for "-f mp4" for YouTube
2013-08-30 17:51:50 -07:00
2e756879f1
[youtube] update algo for length 86
2013-08-30 20:49:51 +02:00
c7a7750d3b
[youtube] Fix typo in the _VALID_URL for YoutubeFavouritesIE, it was intended to also match :ytfavourites
2013-08-30 20:13:05 +02:00
23b00bc0e4
[youtube] update algo for length 84
...
Only appears sometimes, nearly identical to length 86.
2013-08-29 22:44:29 +02:00
52e1eea18b
[youtube] update algo for length 86 ( fixes #1349 )
2013-08-29 22:33:58 +02:00
ee80d66727
[ign] update 1up extractor to work with the updated IGNIE
2013-08-29 21:51:09 +02:00
f1fb2d12b3
[ign] extract videos from articles pages
2013-08-29 21:39:36 +02:00
8928491074
Fix orf.at extractor by adding file coding mark
2013-08-29 12:51:38 -05:00
545434670b
Add an extractor for orf.at ( closes #1346 )
...
Make find_xpath_attr also accept numbers in the value
2013-08-29 19:16:07 +02:00
54fda45bac
Merge pull request #1342 from whydoubt/fix_mit_26
...
Fix MIT extractor for Python 2.6
2013-08-29 13:42:08 +02:00
c7bf7366bc
Update descriptions checksum for some test for Unistra and Youtube
2013-08-29 13:41:59 +02:00
0d75ae2ce3
Fix detection of the webpage charset if it's declared using ' instead of "
...
Like in "<meta charset='utf-8'/>"
2013-08-29 11:35:15 +02:00
b5ba7b9dcf
Fix MIT extractor for Python 2.6
...
The HTML for the MIT page does not parse cleanly for Python 2.6 due
to script tags within an actual script element. The offending piece
is inside a comment block, so removing all such comment blocks
fixes the parsing.
2013-08-28 14:24:42 -05:00
c257baff85
Merge remote-tracking branch 'rzhxeo/youporn-hd'
...
Conflicts:
youtube_dl/utils.py
2013-08-28 18:22:28 +02:00
878e83c5a4
YoupornIE: Clean up extraction of hd video
2013-08-28 16:04:48 +02:00
48ea9cea77
Allow changes to run under Python 3
2013-08-28 14:34:49 +02:00
f143d86ad2
[sohu] Handle encoding, and fix tests
2013-08-28 14:00:05 +02:00
f8b362739e
Merge remote-tracking branch 'Huarong/master'
2013-08-28 13:10:59 +02:00
6d69d03bac
Merge remote-tracking branch 'origin/reuse_ies'
2013-08-28 13:05:21 +02:00
67b22dd036
Add extractors for video.mit.edu and techtv.mit.edu ( closes #1327 )
...
video.mit.edu just embeds the videos from techtv.mit.edu
2013-08-28 12:55:42 +02:00
ce6a696e4d
Remove unused imports
2013-08-28 12:47:38 +02:00
a5caba1eb0
[generic] simply use urljoin
2013-08-28 12:47:27 +02:00
ae3531adf9
[generic] Fix URL concatenation
...
When the url is something like http://example.org/foo/bar?x=y and the added is file/video.mp4 , we want http://example.org/foo/file/video.mp4
Fixes #1268 .
2013-08-28 12:08:17 +02:00
4f5f18acb9
[addanime] add file
2013-08-28 10:28:16 +02:00
3e223834d9
[youtube] update algo for length 88, thanks to @Ramhack ( fixes #1328 )
2013-08-28 10:26:44 +02:00
a1bb0f8773
[cnn] remove debug print call.
2013-08-28 10:20:37 +02:00
2eabb80254
[addanime] improve
2013-08-28 04:25:38 +02:00
44586389e4
[appletrailers] Add support
2013-08-28 02:18:44 +02:00
06a401c845
Merge branch 'master' into subtitles_rework
2013-08-28 00:33:12 +02:00
Jaime Marquínez Ferrándiz
Philipp Hagemeister
rzhxeo
Anton Larionov
Jelle van der Waa
migbac
Marcin Cieślak
Ismaël Mejía
Craig Markwardt
Alex Van't Hof
Filippo Valsorda
Abdulelah Alfntokh
rzhxeo
Joshua Elsasser
Rogério Brito
Andras Elso
Jai Grimshaw
Joey Adams
Pierre Rudloff
Mark Oteiza
tewe
patrickslin
Ruirize
Johny Mo Swag
Allan Zhou
Jeff Smith