c9bebed294
[youtube] Add itag 59 and 78 ( Closes #5979 )
2015-06-19 20:52:44 +06:00
02175a7986
[youtube:search] Fix search query ( Closes #5988 )
2015-06-15 21:01:26 +06:00
8a1a26ce4c
[youtube] Add a test for the DASH segment downloader
2015-06-10 14:47:02 +08:00
0c8662d2b6
[youtube] Fix a TypeError caused by 4da31bd566
2015-06-10 13:40:41 +08:00
70219b0f43
[youtube:playlist] Use an iterator for the entries ( closes #5935 )
...
So that '--playlist-end' downloads only the required pages.
2015-06-09 23:49:11 +02:00
e1b9322b09
[youtube] Restricter DASH signature pattern
...
A problematic DASH url is:
https://manifest.googlevideo.com/api/manifest/dash/mm/35/key/yt5/ip/140.112.247.145/ms/pm/mv/s/mt/1433794435/id/o-AD2Od_dsOlAUYPu03ZsVWKSbGEbCJJrMp9vnXGhnyRhd/mn/sn-aigllm7r/sparams/as%2Chfr%2Cid%2Cip%2Cipbits%2Citag%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Cplayback_host%2Crequiressl%2Csource%2Cexpire/fexp/9406009%2C9406821%2C9407575%2C9408142%2C9408420%2C9408710%2C9409121%2C9409208%2C9412514%2C9412780%2C9413208%2C9413426%2C9413476%2C9413503%2C9415304%2C9415753/upn/viDQrs8SnmE/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm_sd_hd_clear%2Cwebm2_sd_hd_clear/playback_host/r4---sn-aigllm7r.googlevideo.com/ipbits/0/requiressl/yes/pl/20/itag/0/source/youtube/expire/1433824806/nh/EAQ/signature/81ABE6391E351BA495F5B041B00FF1257A353318.1A6E48ABB74E8F4AE73CA2CB1F963FC34E33DEE7/sver/3/hfr/1
2015-06-09 14:48:18 +08:00
4da31bd566
[youtube] Fix a FutureWarning from xml.etree.ElementTree
2015-06-06 22:22:26 +08:00
3d8e9573a4
[youtube:channel] Improve channel id extraction ( #5904 )
2015-06-06 06:25:37 +06:00
423d2be5f8
[downloader/dash] Rename the protocol
...
'http_dash_segments' looks more like a protocol name than
'dash_segments'
2015-06-04 22:27:29 +08:00
b9258c6178
[YoutubeDL] Change how DashSegmentsFD is selected
2015-06-04 22:05:33 +08:00
6800d3372f
[YoutubeDL] Support DASH manifest downloading
2015-06-03 23:10:18 +08:00
d2a9de78df
[youtube] Construct a playlist URL in case the page is missing one
...
This fixes jumping from user/channel -> playlist for some users like
https://www.youtube.com/user/BitcoinFoundation
This also removes the superfluous log message
"add --no-playlist to just download video VIDEOID"
when downloading a user/channel.
2015-05-30 20:54:03 +00:00
386bdfa698
[youtube:user] Workaround 35 pages limitation ( Closes #5778 )
2015-05-30 18:29:16 +06:00
04b3b3df05
[youtube] Remove the nondash formats ( fixes #5774 )
...
Since we use fixed values for some fields like width and height they can be wrong, and would get picked by some formats filters.
For example for https://www.youtube.com/watch?v=EQCrhbBxsjA the biggest height is 720 and for nondash formats it's set to 1440, so -f 'bestvideo[height>=1200]+bestaudio' would incorrectly pick the nondash format, instead it should report that the requested format is not available.
2015-05-24 18:26:20 +02:00
62c95fd5fc
[youtube:feed] Check each 'load more' portion for unique video ids
2015-05-15 21:42:34 +06:00
25f14e9f93
[youtube] Separate feed extractor
2015-05-15 21:06:59 +06:00
2bc4330303
[youtube:history] Fix extraction ( fixes #5702 )
...
It uses the same method as YoutubeSubscriptionsIE, if other feed starts using it we should consider using base class.
2015-05-14 23:41:27 +02:00
39b62db116
[youtube] Catch more alert messages ( closes #5074 )
2015-04-28 23:07:56 +08:00
9dd8e46a2d
[youtube:search] Cancel out _TESTS
2015-04-22 20:28:33 +06:00
b4c0806963
[youtube:ytsearch] Use the same system as the search webpage ( fixes #5483 )
...
The gdata api V2 was deprecated and according to http://youtube-eng.blogspot.com.es/2014/03/committing-to-youtube-data-api-v3_4.html remains available until April 20, 2015.
2015-04-21 19:30:31 +02:00
cc38fa6cfb
[youtube] Remove unused import
2015-04-21 22:55:59 +06:00
6de5dbafee
[youtube:channel] Make `extract_videos_from_page` static
2015-04-21 22:42:21 +06:00
60bf45c80d
[youtube:channel] Specify first page download message
2015-04-21 22:37:45 +06:00
eb0f3e7ec0
[youtube:user] Extract in terms of `load_more_widget_html`
2015-04-21 22:36:41 +06:00
ed553379df
[youtube:ytsearch] Temporary workaround ( #5483 )
2015-04-21 20:55:05 +06:00
8f02ad4f12
[youtube] Simplify
2015-04-13 20:28:16 +06:00
7bd930368c
[youtube] Remove unused variable
2015-04-13 00:08:39 +06:00
fb69240ca0
[youtube] Extract video titles for channel playlist if possible ( Closes #4971 )
2015-04-12 23:19:00 +06:00
de5c545648
[youtube] Skip WebVTT in DASH manifest ( #5297 )
2015-04-08 03:47:27 +08:00
e40bd5f06b
[youtube] Simplify url_encoded_fmt_stream_map check
2015-04-06 00:45:57 +06:00
06b491eb7b
[youtube] Add test for #5361
2015-04-06 00:35:55 +06:00
3a9fadd6df
[youtube] Enhance url_encoded_fmt_stream_map checking ( fix #5361 )
2015-04-05 22:29:06 +08:00
157e9e5aa5
[youtube:watchlater] Remove unused properties and fix tests
2015-03-26 20:03:31 +01:00
7e17ec8c71
[youtube] Clarify some IE_NAMEs
2015-03-26 21:42:28 +06:00
448830ce7b
[youtube:watchlater] Extract watchlater as playlist ( Closes #5280 )
2015-03-26 21:41:09 +06:00
98998cded6
[youtube:search_url] Fix extraction ( Closes #5155 )
2015-03-07 18:59:06 +06:00
99209c2916
[youtube] Extract UL playlists as mixes ( Closes #5040 )
2015-02-24 01:35:15 +06:00
bfc993cc91
Merge branch 'subtitles-rework'
...
(Closes PR #4964 )
2015-02-23 17:13:03 +01:00
785521bf4f
[youtube] Remove useless if
2015-02-18 10:42:23 +01:00
6d1a55a521
[youtube] Show entire player URL when -v is given
2015-02-18 10:39:14 +01:00
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
2015-02-16 22:47:39 +01:00
2d30521ab9
[youtube] Extract average rating ( closes #2362 )
2015-02-11 18:39:31 +01:00
ba61796458
[youtube] Don't override format info from the dash manifest ( fixes #4911 )
2015-02-09 15:04:22 +01:00
acf757f42e
[youtube] Complete test definition
2015-02-01 15:33:32 +01:00
70fca8d694
[youtube] Remove unused import
2015-01-30 10:59:19 +01:00
6449cd807e
[youtube] Fall back to embed webpage when content is blocked on main ( Fixes #4717 )
2015-01-30 04:43:50 +01:00
c1708b89c0
[youtube:truncated_url] Add hl= forms ( #4799 )
2015-01-30 03:45:29 +01:00
b95aab8482
[youtube:truncated_url] Add x-yt-cl URLs ( #4773 )
2015-01-24 11:42:39 +01:00
62cd676c74
[youtube] Fixup DASH m4a headers
...
This fixes #2288 , #2506 , #2607 , #3681 , #4741 , #4767 .
2015-01-23 18:39:12 +01:00
aaeb86f682
[youtube] Add test for #4706
2015-01-16 01:25:03 +06:00
a9b6b5cd15
Looks like Google switched to a new JS compiler that includes dollar signs in function names.
2015-01-15 10:23:05 -08:00
6271f1cad9
[youtube|ffmpeg] Automatically correct video with non-square pixels ( Fixes #4674 )
2015-01-10 05:45:51 +01:00
230b2287dd
[youtube] Add acodec information
...
The codec seems to be consistently aac, so state that in our metadata.
2015-01-09 20:44:21 +01:00
9ed99402f5
[youtube] Fix test case
2015-01-08 16:14:50 +01:00
76b3c61012
[youtube] Add formats 308 and 315 ( closes #4650 )
2015-01-06 11:59:41 +01:00
ee61f6f3e2
[youtube] Handle cases where format comes without a preference ( Fixes #4648 )
2015-01-05 22:42:17 +01:00
2f985f4bb4
[youtube:toplist] Remove extractor
...
They use now normal playlists (their id is PL*).
2015-01-05 00:18:43 +01:00
e65566a9cc
[youtube] Correct handling when DASH manifest is not necessary to find all formats
2015-01-03 18:33:38 +01:00
772fd5cc44
[youtube] Add a pseudo-extractor for truncated YouTube video IDs ( #4610 )
2015-01-01 23:44:39 +01:00
60e47a2699
[youtube] Use '_download_xml' for getting the available subtitles
2014-12-31 15:44:15 +01:00
7d900ef1bf
[youtube] Add support for automatically translated subtitles ( fixes #4555 )
...
They have a manually uploaded subtitles track and YouTube can transtale it.
2014-12-31 14:15:16 +01:00
fccae2b911
[youtube] Add test for age-gate video with encrypted signature
2014-12-30 17:26:21 +06:00
beb95e7781
[youtube] Fix videos with age gate and encrypted signatures
...
The `sts` value is available on the embed webpage, get it from there.
Fixes #4108 .
2014-12-29 22:58:14 +01:00
7af808a5ef
Improve code style
2014-12-17 00:06:41 +01:00
84d84211ac
[youtube:feeds] ( Fixes #4486 )
2014-12-16 15:59:31 +01:00
4b7df0d30c
[youtube:playlist] Work around buggy playlists ( fixes #4449 )
...
They show a "Load more" button, but they don't have more videos.
The continuation url in the json file was a link to itself, so we ended up in an infinite loop.
2014-12-15 19:19:15 +01:00
60620368d7
[youtube] Fix player ID detection
2014-12-14 00:43:34 +01:00
26c06f0c51
[youtube:playlist] Remove unused property
2014-12-12 22:26:50 +01:00
23d3608c6b
[youtube:channel] Fix extraction ( fixes #4435 )
...
It uses now the same pagination system as playlists
2014-12-12 22:23:54 +01:00
cbe2bd914d
[youtube] Amend test
2014-12-11 16:34:37 +01:00
75111274ed
[youtube] Do not warn if DASH manifest is missing ( #4442 )
2014-12-11 16:33:28 +01:00
624dcebff6
[youtube] Make category optional ( #4442 )
2014-12-11 16:32:48 +01:00
9684f17cde
Merge remote-tracking branch 'akretz/youtube_fix'
2014-12-11 16:28:10 +01:00
e52a40abf7
[youtube] Add test case for #4431
2014-12-11 16:28:07 +01:00
24270b0301
[youtube] The case that 'url_encoded_fmt_stream_map' or 'adaptive_fmts' is the empty string is handled accordingly ( fixes #4431 )
2014-12-11 16:00:46 +01:00
4bb4a18876
[youtube] Fix imports
2014-12-11 10:08:17 +01:00
da27660014
[youtube] Pass in all variables to DASH manifest ( Fixes #4424 )
2014-12-10 14:39:00 +01:00
774e208f94
[youtube] Handle missing DASH manifest ( Fixes #4421 , fixes #4420 )
2014-12-10 13:21:24 +01:00
b82f815f37
Allow iterators for playlist result entries
2014-12-06 14:02:19 +01:00
9ff6772790
[youtube] Modernize
2014-12-06 12:20:54 +01:00
810fb84d5e
pep8 and minor beautification all around
2014-12-04 08:27:40 +01:00
c41a9650c3
[youtube] Extract framerate from the dash manifest
...
Not all videos have 60 fps, for example they can have 48 fps.
2014-12-01 17:36:12 +01:00
c522adb1f0
[youtube] Add a normal age-gate test video
2014-11-30 21:45:49 +01:00
7160532d41
[youtube] Simplify code for getting the dash manifest url
...
video_info contains now the 'ytplayer.config.args' dictionary
2014-11-30 21:07:50 +01:00
4e62ebe250
[youtube] Try to extract the video_info from the webpage before requesting the 'get_video_info' pages
...
The YouTube player doesn't seem to use them except for embedded videos, so we can skip a network request.
But they still provide better error mesagges (for removed videos for example).
2014-11-30 20:56:32 +01:00
b766eb2707
[youtube] Update test
2014-11-30 19:18:39 +01:00
10a404c335
[youtube] Add format 313 ( fixes #4339 )
2014-11-30 18:56:14 +01:00
42939b6129
[youtube] Use a cookie for seeting the language
...
This way, we don't have to do an aditional request
2014-11-30 00:03:59 +01:00
37ea8164d3
[youtube] Don't confirm age when initializing
...
It seems that all the videos with age restriction use now the age gate method, which doesn't require any confirmation.
2014-11-29 23:46:39 +01:00
0792d5634e
[youtube] Remove useless u prefixes
2014-11-26 12:41:53 +01:00
27f8b0994e
Merge remote-tracking branch 'jtwaleson/master'
2014-11-23 22:10:26 +01:00
9e1a5b8455
PEP8: applied even more rules
2014-11-23 21:39:15 +01:00
784b6d3a9b
Merge remote-tracking branch 'jtwaleson/master'
2014-11-23 21:33:31 +01:00
8bcc875676
PEP8: more applied
2014-11-23 21:20:46 +01:00
5f6a1245ff
PEP8 applied
2014-11-23 20:41:03 +01:00
f3a3407226
[youtube] Clarify keywords
2014-11-23 20:09:10 +01:00
aa79ac0c82
[youtube] Support controversy videos ( Fixes #4275 )
2014-11-23 09:59:02 +01:00
0857baade3
[youtube] Add webm audio formats ( Fixes #4229 )
2014-11-18 11:08:37 +01:00
23ad44b57b
[youtube] Better error message for DASH manifest
2014-11-17 20:12:52 +01:00
894dd8682e
Fix YouTube signature extraction.
2014-11-13 00:33:27 -06:00
a1cf99d03a
[YoutubeDL] Add playlist_id and playlist_title fields ( Fixes #4139 )
2014-11-09 22:32:35 +01:00
20436c30c9
[youtube] Clarify output
2014-11-04 23:35:34 +01:00
94bd361318
[youtube] Skip sts if missing ( Fixes #4095 , fixes #4103 )
2014-11-04 22:45:43 +01:00
0d2c141865
[youtube] Detect formats 298 et al as mp4 ( Fixes #4066 )
2014-10-31 11:13:02 +01:00
7b6de3728a
[youtube] Add format 266 ( Fixes #4055 )
2014-10-30 09:53:43 +01:00
a51d3aa001
[youtube] Add support for formats 302 and 303 ( Fixes #4060 )
2014-10-30 09:43:11 +01:00
fbb21cf528
[youtube] Add formats 298, 299 ( Fixes #4056 )
2014-10-30 09:34:13 +01:00
f46a8702cc
[youtube:playlist] Fix test title
2014-10-27 00:06:47 +01:00
bfc2bedcfc
[youtube] Make confirm_age non-fatal ( #4042 )
2014-10-26 21:49:29 +01:00
6b445558ff
[youtube] Only set language when necessary
...
We only need to set the language when we are using a login; otherwise it will always be English.
2014-10-23 00:44:22 +02:00
1cc887cbf0
[youtube] Add support for format 278
2014-10-13 00:09:19 +02:00
203fb43f36
[youtube] Download DASH manifest by default ( Closes #3887 )
2014-10-13 00:03:08 +02:00
a1f934b171
[youtube] Correct language cookie handling
2014-09-29 02:04:16 +02:00
e2dce53781
[youtube] Always request webpage in English ( Fixes #3844 )
2014-09-29 01:39:26 +02:00
9c44d2429b
[vimeo:likes] Support large like lists ( Fixes #3847 )
2014-09-29 00:36:06 +02:00
6b08cdf626
[youtube] Support for embedded /p players ( Fixes #3821 )
2014-09-25 01:59:02 +02:00
ac7553d031
[youtube] Support embed/videoseries URLs ( #3821 )
2014-09-24 10:34:29 +02:00
cdc628a498
[youtube] Move more tests to extractors
2014-09-24 10:25:47 +02:00
69ea8ca42c
[youtube] Remove superfluous unicode specifiers
2014-09-24 09:51:45 +02:00
4bc3a23ec5
[youtube] Modernize
2014-09-24 09:49:53 +02:00
78caa52aea
[youtube] Modernize
2014-09-13 07:51:06 +02:00
310d75d141
[youtube] Correct description in test case
2014-09-13 07:49:26 +02:00
9291475f7d
[youtube] Move more tests to Playlist IE, and simply suitable.
2014-09-13 07:35:14 +02:00
81127aa55d
[youtube] Move playlist test to extractor
2014-09-13 07:19:20 +02:00
9b583dca4c
Merge remote-tracking branch 'drags/yt-feed-loadmore'
2014-09-13 07:14:19 +02:00
edb53e2dc3
[youtube] Don't make the url protocol optional
...
The generic extractor will add it.
2014-09-11 21:47:25 +02:00
a0e07d3161
[youtube] Move cache into its own module
2014-09-03 17:29:19 +02:00
c9cc0bf57b
[youtube:playlist] PEP8
2014-09-01 01:00:40 +02:00
9ea9b61448
Merge branch 'master' of github.com:rg3/youtube-dl
2014-08-31 23:47:26 +02:00
1ed5b5c9c8
[youtube:subscriptions] Fix extraction ( fixes #2975 )
2014-08-31 23:44:43 +02:00
55f7bd2dcc
[youtube] Fix category extraction
2014-08-31 23:26:19 +02:00
3e7c12240c
[youtube] Test for like_count and dislike_count ( #3633 )
2014-08-31 18:10:05 +02:00
f30a38be8b
[youtube] Fix extraction of like and dislike count ( fixes #3633 )
2014-08-31 12:38:00 +02:00
9480d1a566
Merge remote-tracking branch 'riking/twofactor'
2014-08-24 07:14:23 +02:00
bd9820c937
Merge remote-tracking branch 'liudongmiao/patch-subtitle'
2014-08-22 02:45:21 +02:00
55db73efdf
[youtube] tag 171 is 128KBits ( Fixes #3542 )
2014-08-21 13:13:26 +02:00
55c49908d2
[youtube] Handle incorrectly written cache files ( #3549 )
2014-08-21 12:15:51 +02:00
83317f6938
[youtube] Add two-factor account signin (TOTP only)
...
Additional work is required to prompt the user for the SMS or phone call codes, as there is no framework currently to prompt the user during an extraction operation.
Fixes #3533
2014-08-16 14:48:17 -07:00
62af3a0eb5
[youtube] Use new signature cache ID for in-memory cache as well
2014-08-02 12:23:18 +02:00
60064c53f1
[youtube] Make cache ID a tuple of lengths instead of just the whole length
2014-08-02 12:21:53 +02:00
98eb1c3fa2
[youtube] Clean up -v signature output
2014-08-02 11:55:20 +02:00
201e9eaa0e
[youtube] Show format ID in signature deobfuscation -v output
2014-08-02 06:35:18 +02:00
1a9b9649fb
Check load_more_widget_html for feed paging
2014-07-27 17:19:26 -07:00
b081cebefa
[youtube] Fix player ID display
2014-07-25 06:49:26 +02:00
c084c93402
[youtube] Extract the 'sts' parameter from the webpage ( fixes #3327 )
2014-07-23 12:16:26 +02:00
7e660ac113
if there is more than one subtitle for the language, use the first one
2014-07-23 10:56:09 +08:00
c081b35c27
[youtube] Support new player URLs ( Fixes #3326 )
2014-07-23 02:19:33 +02:00
246168bd72
Remove unused imports
2014-07-20 23:38:44 +02:00
2c57c7fa5a
[youtube] Fix extraction of age gate videos ( closes #3270 )
...
Setting the correct value of the 'sts' paramater in the 'get_video_info' url gives the correct urls.
Removed parameters that are not needed.
2014-07-20 21:05:02 +02:00
b8c74d606a
[youtube] fix display of swf player id
2014-07-20 20:20:42 +02:00
5425626790
[youtube] Move swfinterp into its own file
2014-07-18 10:24:28 +02:00
5dc3552d85
[youtube] Add support for classes in swf parser
2014-07-18 00:54:17 +02:00
3fbd27f73e
[youtube] SWF parser: Add opcode 86
...
Yes, I know we need 96, but an implementation of 86 could help avoid a similar issue.
2014-07-17 23:22:49 +02:00
cf01013161
[youtube] Find more swf players ( Closes #3270 , refer #3271 )
2014-07-17 16:28:36 +02:00
c8bf86d50d
[youtube] Correct signature extraction error detection
2014-07-11 10:44:39 +02:00
b3a8878080
[youtube] Remove static signatures
...
The always fail by now. Instead, use only automatic signature extraction
2014-07-11 10:23:19 +02:00
6feb2d5e80
[youtube:search_url] Update regexes
2014-07-04 19:21:19 +07:00
dc2fc73691
[youtube:truncated_url] Move test to extractor
2014-07-01 15:49:34 +02:00
c4808c6009
[youtube_truncated_url] Add support for truncated watch URLs with annotations ( #3178 )
2014-07-01 15:49:16 +02:00
18061bbab0
[Youtube] add DASH format 272 ( fixes #3128 )
2014-06-21 12:03:27 +02:00
c26e9ac4b2
[youtube] Recognize signature functions that contain '$' ( fixes #3104 )
2014-06-19 16:42:49 +02:00
7d568f5ab8
[Youtube] Recognize playlists with LL
2014-06-14 13:23:28 +02:00
3c80377b69
[Youtube] Add format code 271 (1440p webm)
2014-06-07 14:31:10 +02:00
70e322695d
[youtube:playlist] Fix mixes extraction ( fixes #3051 )
...
The username seems to be empty now.
2014-06-05 21:23:27 +02:00
263bd4ec50
Recognize a third format of the upload_date in the 'watch-uploader-info' element
2014-06-02 13:30:23 +04:00
76e92371ac
[youtube] Recognize a second format of the upload_date in the 'watch-uploader-info' element ( #2911 )
2014-05-16 22:12:52 +02:00
05ee2b6dad
[youtube] Fix extraction of the feed 'paging' values ( fixes #2925 )
2014-05-16 16:01:13 +02:00
beee53de06
[youtube] Look for published-on date if uploaded-on is not found
...
Fixes #2911
2014-05-16 13:21:44 +02:00
01ed5c9be3
[youtube] Fix typo
2014-05-15 13:43:29 +02:00
ad3bc6acd5
Document and test categories ( #2923 )
2014-05-15 12:41:42 +02:00
ec8deefc27
[youtube] Video categories added to metadata
2014-05-15 13:59:27 +07:00
e399853d0c
[youtube:playlist] Improve detection of private lists ( #2840 )
2014-05-12 07:59:33 +02:00
10c0e2d818
[youtube:playlist] Raise an error if the list doesn't exist or is private ( closes #2840 )
2014-05-01 15:40:35 +02:00
e75cafe9fb
Clean up format list for consistency
...
This should make the format list output look a bit nicer.
2014-04-30 01:52:05 +02:00
aa92f06308
[youtube] Don't call 'unquote_plus' on the video title ( fixes #2799 )
...
It's already unquoted after calling 'compat_parse_qs'.
It replaced '+' with spaces, for example in https://www.youtube.com/watch?v=XC0b5YexO-I .
2014-04-25 13:19:03 +02:00
e00c9cf599
[youtube] Update test description field
2014-04-25 13:14:15 +02:00
ba60a3ebe0
[youtube] Update test description field
2014-04-25 12:57:04 +02:00
d11271dd29
[youtube] Include video Id in common error message ( Fixes #2786 )
2014-04-21 20:34:03 +02:00
1db2666916
[youtube:playlist] Correct playlist ID output
...
The ID now starts with PL, so we don't need to output that twice.
2014-04-15 17:55:52 +02:00
b9c76aa1a9
[youtube] Add support for cleanvideosearch.com ( Fixes #2734 )
2014-04-11 13:53:05 +02:00
68eb8e90e6
[youtube:playlist] Fix playlists for logged-in users ( Fixes #2690 )
2014-04-04 02:23:36 +02:00
e45d40b171
[youtube:subscriptions] Add space to the description
2014-04-03 15:13:52 +02:00
f6177462db
[youtube] feeds: Also look for the html in the 'content_html' field ( fixes #2671 )
2014-04-02 14:13:08 +02:00
5912c639df
[youtube] Transform google's JSON dialect ( fixes #2663 )
2014-04-01 05:56:56 +02:00
83d548ef0f
[youtube] Encode ytsearch query
2014-03-30 15:57:35 +02:00
acd213ed6d
Remove unusued imports
2014-03-30 07:16:07 +02:00
2b25cb5d76
[youtube] Move JavaScript interpreter into its own module
2014-03-30 07:02:58 +02:00
43b81eb98a
[youtube] Remove useless resolution fields from format definitions
...
These can be - and are - calculated automatically by the YoutubeDL core.
2014-03-22 14:22:41 +01:00
278229d195
itag 160 is 144p, not 192p
2014-03-22 12:15:45 +01:00
7e8c0af004
Add --prefer-insecure option ( Fixes #2364 )
2014-03-21 00:37:10 +01:00
bc6d597828
Add bestvideo and worstvideo to special format names ( #2163 )
2014-03-14 17:01:47 +01:00
ae7ed92057
[youtube] Fix up invalid JSON
2014-03-10 13:35:45 +01:00
c9ae7b9565
[youtube] Add support for search result URLs ( Fixes #2495 )
2014-03-04 03:32:28 +01:00
60d3a2e0f8
Fix incorrect format codes
...
Corrects the descriptions for the DASH video format codes 264 and 138
(1440p and 2160p, respectively).
2014-02-24 21:29:37 -05:00
a2dafe2887
[youtube] Fix mix video regex
...
Attributes' order in <li> is arbitrary and changes every time playlist
page is fetched, so we can't rely on `data-index` to be before
`data-video-username`.
2014-02-24 12:52:02 +07:00
bc2f773b4f
[youtube:playlist] Fix mixes extraction ( fixes #2444 )
2014-02-23 17:17:36 +01:00
521ee82334
Fix imports
2014-02-22 23:03:12 +01:00
3489b7d26c
[youtube] Simplify the decryption process for the manifest urls and add a test ( closes #2422 )
2014-02-21 15:15:58 +01:00
acd2bcc384
Merge branch 'youtube-dash' of github.com:m0vie/youtube-dl
2014-02-21 15:02:47 +01:00
dbb94fb044
[youtube] Fix playlist extraction ( Closes #2423 , #2424 , #2425 )
2014-02-21 17:19:55 +07:00
d68f0cdb23
[youtube] decrypt signature when downloading dash manifest
2014-02-21 03:24:56 +01:00
f7000f3a1b
[youtube] Add support for yourepeat.com URLs ( Closes #2397 )
2014-02-19 02:00:54 +07:00
2eb5d315d4
[youtube] Match more truncated URLs ( Closes #2402 )
2014-02-17 14:56:21 +01:00
07ad22b8af
[youtube:search] Mark "no results found" error as expected
2014-02-15 16:30:11 +01:00
e70dc1d14b
[youtube] Correct a minor regex typo
2014-02-10 01:30:47 +01:00
81c2f20b53
[youtube] Correct invalid JSON ( Fixes #2353 )
2014-02-09 17:56:10 +01:00
9766538124
[jadorecettepub] Add extractor ( Fixes #2148 )
2014-02-08 19:20:23 +01:00
d67cc9fa7c
[youtube:playlist] Recognize ‘top tracks’ urls ( closes #2332 )
...
The list parameter starts with ‘MC’ and can have more characters after it, including dots
2014-02-06 19:46:26 +01:00
20650c8654
[youtube] signatures: Recognize javascript functions that contain “$” ( fixes #2304 )
2014-02-04 21:38:50 +01:00
b11cec4162
[youtube:user] Fix id key ( Fixes #1745 )
2014-01-29 11:16:12 +01:00
5700e7792a
[youtube] Encode the data when submitting the form for confirming the age
...
Needed on python 3
2014-01-25 17:22:41 +01:00
38c2e5b8d5
[youtube] Use https: in more urls
2014-01-25 17:11:55 +01:00
beddbc2ad1
[youtube:toplist] Make the regex for finding the playlist link more flexible
...
`title={foo}` may not be at the end of the `href` string.
2014-01-25 15:47:03 +01:00
2c5bae429a
[youtube] Fix new formats
2014-01-24 00:06:26 +01:00
1394ce65b4
[youtube] Add new formats ( Fixes #2221 )
2014-01-23 23:54:06 +01:00
0b65e5d40f
[youtube] Do not break upon unknown formats
2014-01-23 23:21:42 +01:00
975d35dbab
[youtube:truncated_url] Also match mail subscription links ( #2214 )
2014-01-23 16:14:54 +01:00
4919603f66
[youtube] Make DASH manifest download conditional for now
...
DASH download fails on many videos (all with encrypted signatures? not sure yet), for example 07FYdnEawAQ, with a 403.
2014-01-22 21:56:38 +01:00
65697b3bf3
Merge branch 'paged-lists'
...
Conflicts:
test/test_utils.py
youtube_dl/extractor/youtube.py
2014-01-22 20:00:16 +01:00
50317b111d
Merge branch 'youtube-dash-manifest'
...
Conflicts:
youtube_dl/extractor/youtube.py
2014-01-22 19:58:31 +01:00
b7ab059084
Add infrastructure for paged lists
...
This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175
2014-01-20 11:36:47 +01:00
c91778f8c0
[youtube] Fall back to header if playlist title is not available
...
Sometimes (in about 10% of requests), the og:title is missing for a weird reason.
See #2170 for an example
2014-01-20 02:45:51 +01:00
dd27fd1739
[youtube] Download DASH manifest
...
If given, download and parse the DASH manifest file, in order to get ultra-HQ formats.
Fixes #2166
2014-01-19 05:47:20 +01:00
484aaeb204
[everyonesmixtape] Add support ( Fixes #2161 )
2014-01-17 02:56:13 +01:00
ce6b9a2dba
[youtube] Add a pseudo format for rtmp videos ( #2123 )
2014-01-09 02:38:50 +01:00
c3197e3e5c
[youtube] Correct subtitle URL ( Fixes #2120 )
2014-01-09 01:36:21 +01:00
b4622a328b
Use double quotes in error message ( #2112 )
...
On Windows, double quotes are required, because single quotes get served to youtube-dl. (Yes, cmd.exe is crazy like that).
On other system, both double and single quotes are fine, unless the string contains a dollar sign (then you need single quotes).
Since virtually no URLs contain dollar signs, double quotes should do.
2014-01-08 00:05:11 +01:00
8fa8a6299b
[youtube] Add itag 264 ( closes #2063 )
...
It has a better bitrate than 137 but the same resolution
2014-01-01 13:45:33 +01:00
2c62dc26c8
[youtube] Simplify format specification
2013-12-24 12:34:09 +01:00
4bcc7bd1f2
Add temporary _sort_formats helper function
2013-12-24 12:31:42 +01:00
d80044c235
[youtube] Prefer videos with sound
2013-12-23 04:51:42 +01:00
f82b18efc1
Merge remote-tracking branch 'rzhxeo/youtube'
2013-12-23 04:37:40 +01:00
e302f9ce32
[youtube:user] Speed up --match-title
2013-12-22 03:57:42 +01:00
e56f22ae20
[YoutubeIE] Sort formats by resolution
2013-12-18 21:22:37 +01:00
dbd1988ed9
[YoutubeIE] Add width and height to format dict
2013-12-18 21:21:25 +01:00
4ea3be0a5c
[YoutubeIE] Externalize format selection
2013-12-18 03:30:55 +01:00
46374a56b2
[youtube] Do not warn for videos with allow_rating=0
...
This fixes #1982
Test video: http://www.youtube.com/watch?v=gi2uH3YxohU
2013-12-17 02:49:56 +01:00
b466b7029d
[youtube] Make duration an integer or None
2013-12-16 04:09:05 +01:00
ffa8f0df0a
Merge remote-tracking branch 'jaimeMF/yt-toplists'
2013-12-09 04:49:32 +01:00
7cc3570e53
Add fatal=False parameter to _download_* functions.
...
This allows us to simplify the calls in the youtube extractor even further.
2013-12-09 01:49:03 +01:00
baa7b1978b
Remove the calls to 'compat_urllib_request.urlopen' in a few extractors
2013-12-08 22:24:55 +01:00
31812a9e0e
[youtube:channel] Fix automated channel detection
2013-12-08 07:30:42 +01:00
715c8e7bdb
[youtube:playlist] Recognize mix ids for direct use ( fixes #1295 )
2013-12-06 19:52:41 +01:00
7d4afc557f
[youtube:playlist] Support mix ids longer than 13 ( #1295 )
2013-12-06 19:48:54 +01:00
336c3a69bd
[youtube] Extract like and dislike count ( #1895 )
2013-12-06 13:22:27 +01:00
27dcce1904
[youtube] Resolve URLs in comments
2013-12-04 14:18:49 +01:00
cb7fb54600
Change the ie_name of YoutubeSearchDateIE
...
It produced a duplicate entry when listing the extractors with '--list-extractors' and generates noise in the commit log when generating the supported sites webpage (like in 09f355f73b
2013-12-03 13:55:25 +01:00
0a688bc0b2
[youtube] Add support for downloading top lists ( fixes #1868 )
...
It needs to know the channel and the title of the list, because the ids change every time you browse the channels and are attached to a 'VISITOR_INFO1_LIVE' cookie.
2013-11-30 14:56:51 +01:00
0e44d8381a
[youtube:feeds] Use the 'paging' value from the downloaded json information ( fixes #1845 )
2013-11-28 00:33:27 +01:00
76d1700b28
[youtube:playlist] Fix the extraction of the title for some mixes ( #1844 )
...
Like https://www.youtube.com/watch?v=g8jDB5xOiuE&list=RDIh2gxLqR7HM
2013-11-27 20:01:51 +01:00
652cdaa269
[youtube:playlist] Add support for YouTube mixes ( fixes #1839 )
2013-11-26 21:35:03 +01:00
e26f871228
Use the new '_download_xml' helper in more extractors
2013-11-26 19:17:25 +01:00
6e47b51eef
[youtube:playlist] Remove the link with index 0
...
It's not the first video of the playlist, it appears in the 'Play all' button (see the test course for an example)
2013-11-26 19:09:14 +01:00
ea36cbac5e
Merge remote-tracking branch 'rbrito/swap-dimensions'
2013-11-25 06:19:15 +01:00
f459d17018
[youtube] Add an extractor for downloading the watch history ( closes #1821 )
2013-11-24 14:33:50 +01:00
66ec019240
[youtube] do not use variable name twice
2013-11-24 06:54:26 +01:00
7012b23c94
Match --download-archive during playlist processing ( Fixes #1745 )
2013-11-22 22:46:46 +01:00
3f8ced5144
Merge remote-tracking branch 'jaimeMF/yt-playlists'
2013-11-22 20:11:54 +01:00
cb7dfeeac4
[youtube] only allow domain name to be upper-case ( #1786 )
2013-11-18 16:42:35 +01:00
83aa529330
Support protocol-independent URLs ( #1787 )
2013-11-18 13:18:17 +01:00
fccd377198
Suppor embed-only videos ( Fixes #1746 )
2013-11-18 13:05:18 +01:00
1d699755e0
[youtube] Add view_count ( Fixes #1781 )
2013-11-17 11:06:16 +01:00
b9643eed7c
[youtube:channel] Fix the extraction of autogenerated channels
...
The ajax pages are empty, now it looks directly in the channel's /videos page
2013-11-15 11:51:45 +01:00
0e145dd541
Merge branch 'master' of github.com:rg3/youtube-dl
2013-11-15 01:46:50 +01:00
9f9be844fc
[youtube] Fix protocol-independent URLs ( Fixes #1768 )
2013-11-15 01:45:39 +01:00
ca715127a2
Don't assume the 'subtitlesformat' is set in the params dict ( fixes #1750 )
2013-11-13 17:14:10 +01:00
880e1c529d
[youtube:playlist] Login into youtube if requested ( fixes #1757 )
...
Allows to download private playlists
2013-11-13 16:39:11 +01:00
dcbb45803f
[youtube:playlist] Don't use the gdata api ( closes #1508 )
...
Parse the playlist pages instead
2013-11-13 16:26:50 +01:00
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
2013-11-10 11:54:18 +01:00
4f045eef8f
[youtube:channel] Fix the extraction
...
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
2013-11-06 21:42:33 +01:00
08fb86c49b
[youtube] Add description for YoutubeSearchDateIE ( #1710 )
2013-11-03 15:59:10 +01:00
3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
2013-11-03 15:56:55 +01:00
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
2013-11-03 12:11:13 +01:00
a3dd924871
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
2013-11-02 22:40:48 -04:00
cf51923545
[youtube] Remove vevo test
...
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
2013-11-02 20:46:26 +01:00
38db46794f
Merge branch 'ted_subtitles'
2013-11-02 19:50:45 +01:00
1f343eaabb
[subtitles] refactor to support websites with subtitle information the
...
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
2013-11-02 19:29:25 +01:00
8eddf3e91d
[youtube] Encode subtitle track name in request ( Fixes #1700 )
2013-11-02 11:21:05 +01:00
795f28f871
[youtube] Fix login ( Fixes #1681 )
2013-10-29 06:45:54 +01:00
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
2013-10-25 17:17:46 +02:00
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
2013-10-25 16:55:37 +02:00
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
2013-10-25 16:52:58 +02:00
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
2013-10-22 15:16:26 -07:00
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
2013-10-21 16:28:55 +02:00
d5a9bb4ea9
extractor: youtube: Swap video dimensions to match standard practice.
...
While working on this, I thought about simplifying things like changing
480x854 to 480p, and that seemed like a good option, until I realized that
people (me included) usually link the concept of some number followed by a p
with the video being 16:9.
So, we would be losing some information and, as we all know,
[explicit is better than implicit][*].
[*]: http://www.python.org/dev/peps/pep-0020/
This closes #1446 .
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:04:44 -03:00
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 18:53:00 -03:00
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 17:50:55 -03:00
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
2013-10-17 02:19:19 +02:00
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
2013-10-14 16:22:27 +11:00
57da92b7df
[youtube] Do not recognize attribution link as user ( Fixes #1573 )
2013-10-09 23:50:38 +02:00
a34c2faae4
[youtube] set the 'name' parameter in the subtitles url ( fixes #1577 )
2013-10-09 16:41:36 +02:00
15870e90b0
Restore warning when user forgets to quote URL ( #1396 )
2013-10-07 12:21:24 +02:00
cfadd183c4
Call extracted property age_limit everywhere
2013-10-06 16:23:06 +02:00
8dbe9899a9
Allow users to specify an age limit ( fixes #1545 )
...
With these changes, users can now restrict what videos are downloaded by the intented audience, by specifying their age with --age-limit YEARS .
Add rudimentary support in youtube, pornotube, and youporn.
2013-10-06 06:08:56 +02:00
7f8ae73a5d
Include length in player cache ID
...
Some videos use the same player with IDs of multiple lengths.
See https://travis-ci.org/rg3/youtube-dl/jobs/12126506#L319 for an example.
2013-10-04 11:36:06 +02:00
c21315f273
[youtube] new static 82 signature
2013-10-04 00:43:01 +02:00
c38b1e776d
[youtube] Simplify cache_dir code ( #1529 )
2013-10-02 08:41:14 +02:00
4f8bf17f23
Merge remote-tracking branch 'holomorph/master'
2013-10-02 08:23:53 +02:00
ca40186c75
[youtube] Fix static 82 signature ( Closes #1539 )
2013-10-02 08:20:00 +02:00
a8c6b24155
[youtube] Support videos without a title ( Fixes #1391 , Closes #1542 )
2013-10-02 07:25:35 +02:00
Sergey M․
Yen Chi Hsuan
Jaime Marquínez Ferrándiz
Ivan Kozik
Philipp Hagemeister
Phil Kulak
Cédric Luthi
Adrian Kretz
Jouke Waleson
Aaron Wojnowski
riking
Tim Sogard
Liu DongMiao
Petr Půlpán
Anton Novosyolov
Dario Guarascio
AGSPhoenix
hurda
m0viefreak
Filippo Valsorda
rzhxeo
Craig Markwardt
Ismaël Mejía
Rogério Brito
Jai Grimshaw