9291475f7d
[youtube] Move more tests to Playlist IE, and simply suitable.
2014-09-13 07:35:14 +02:00
81127aa55d
[youtube] Move playlist test to extractor
2014-09-13 07:19:20 +02:00
9b583dca4c
Merge remote-tracking branch 'drags/yt-feed-loadmore'
2014-09-13 07:14:19 +02:00
edb53e2dc3
[youtube] Don't make the url protocol optional
...
The generic extractor will add it.
2014-09-11 21:47:25 +02:00
a0e07d3161
[youtube] Move cache into its own module
2014-09-03 17:29:19 +02:00
c9cc0bf57b
[youtube:playlist] PEP8
2014-09-01 01:00:40 +02:00
9ea9b61448
Merge branch 'master' of github.com:rg3/youtube-dl
2014-08-31 23:47:26 +02:00
1ed5b5c9c8
[youtube:subscriptions] Fix extraction ( fixes #2975 )
2014-08-31 23:44:43 +02:00
55f7bd2dcc
[youtube] Fix category extraction
2014-08-31 23:26:19 +02:00
3e7c12240c
[youtube] Test for like_count and dislike_count ( #3633 )
2014-08-31 18:10:05 +02:00
f30a38be8b
[youtube] Fix extraction of like and dislike count ( fixes #3633 )
2014-08-31 12:38:00 +02:00
9480d1a566
Merge remote-tracking branch 'riking/twofactor'
2014-08-24 07:14:23 +02:00
bd9820c937
Merge remote-tracking branch 'liudongmiao/patch-subtitle'
2014-08-22 02:45:21 +02:00
55db73efdf
[youtube] tag 171 is 128KBits ( Fixes #3542 )
2014-08-21 13:13:26 +02:00
55c49908d2
[youtube] Handle incorrectly written cache files ( #3549 )
2014-08-21 12:15:51 +02:00
83317f6938
[youtube] Add two-factor account signin (TOTP only)
...
Additional work is required to prompt the user for the SMS or phone call codes, as there is no framework currently to prompt the user during an extraction operation.
Fixes #3533
2014-08-16 14:48:17 -07:00
62af3a0eb5
[youtube] Use new signature cache ID for in-memory cache as well
2014-08-02 12:23:18 +02:00
60064c53f1
[youtube] Make cache ID a tuple of lengths instead of just the whole length
2014-08-02 12:21:53 +02:00
98eb1c3fa2
[youtube] Clean up -v signature output
2014-08-02 11:55:20 +02:00
201e9eaa0e
[youtube] Show format ID in signature deobfuscation -v output
2014-08-02 06:35:18 +02:00
1a9b9649fb
Check load_more_widget_html for feed paging
2014-07-27 17:19:26 -07:00
b081cebefa
[youtube] Fix player ID display
2014-07-25 06:49:26 +02:00
c084c93402
[youtube] Extract the 'sts' parameter from the webpage ( fixes #3327 )
2014-07-23 12:16:26 +02:00
7e660ac113
if there is more than one subtitle for the language, use the first one
2014-07-23 10:56:09 +08:00
c081b35c27
[youtube] Support new player URLs ( Fixes #3326 )
2014-07-23 02:19:33 +02:00
246168bd72
Remove unused imports
2014-07-20 23:38:44 +02:00
2c57c7fa5a
[youtube] Fix extraction of age gate videos ( closes #3270 )
...
Setting the correct value of the 'sts' paramater in the 'get_video_info' url gives the correct urls.
Removed parameters that are not needed.
2014-07-20 21:05:02 +02:00
b8c74d606a
[youtube] fix display of swf player id
2014-07-20 20:20:42 +02:00
5425626790
[youtube] Move swfinterp into its own file
2014-07-18 10:24:28 +02:00
5dc3552d85
[youtube] Add support for classes in swf parser
2014-07-18 00:54:17 +02:00
3fbd27f73e
[youtube] SWF parser: Add opcode 86
...
Yes, I know we need 96, but an implementation of 86 could help avoid a similar issue.
2014-07-17 23:22:49 +02:00
cf01013161
[youtube] Find more swf players ( Closes #3270 , refer #3271 )
2014-07-17 16:28:36 +02:00
c8bf86d50d
[youtube] Correct signature extraction error detection
2014-07-11 10:44:39 +02:00
b3a8878080
[youtube] Remove static signatures
...
The always fail by now. Instead, use only automatic signature extraction
2014-07-11 10:23:19 +02:00
6feb2d5e80
[youtube:search_url] Update regexes
2014-07-04 19:21:19 +07:00
dc2fc73691
[youtube:truncated_url] Move test to extractor
2014-07-01 15:49:34 +02:00
c4808c6009
[youtube_truncated_url] Add support for truncated watch URLs with annotations ( #3178 )
2014-07-01 15:49:16 +02:00
18061bbab0
[Youtube] add DASH format 272 ( fixes #3128 )
2014-06-21 12:03:27 +02:00
c26e9ac4b2
[youtube] Recognize signature functions that contain '$' ( fixes #3104 )
2014-06-19 16:42:49 +02:00
7d568f5ab8
[Youtube] Recognize playlists with LL
2014-06-14 13:23:28 +02:00
3c80377b69
[Youtube] Add format code 271 (1440p webm)
2014-06-07 14:31:10 +02:00
70e322695d
[youtube:playlist] Fix mixes extraction ( fixes #3051 )
...
The username seems to be empty now.
2014-06-05 21:23:27 +02:00
263bd4ec50
Recognize a third format of the upload_date in the 'watch-uploader-info' element
2014-06-02 13:30:23 +04:00
76e92371ac
[youtube] Recognize a second format of the upload_date in the 'watch-uploader-info' element ( #2911 )
2014-05-16 22:12:52 +02:00
05ee2b6dad
[youtube] Fix extraction of the feed 'paging' values ( fixes #2925 )
2014-05-16 16:01:13 +02:00
beee53de06
[youtube] Look for published-on date if uploaded-on is not found
...
Fixes #2911
2014-05-16 13:21:44 +02:00
01ed5c9be3
[youtube] Fix typo
2014-05-15 13:43:29 +02:00
ad3bc6acd5
Document and test categories ( #2923 )
2014-05-15 12:41:42 +02:00
ec8deefc27
[youtube] Video categories added to metadata
2014-05-15 13:59:27 +07:00
e399853d0c
[youtube:playlist] Improve detection of private lists ( #2840 )
2014-05-12 07:59:33 +02:00
10c0e2d818
[youtube:playlist] Raise an error if the list doesn't exist or is private ( closes #2840 )
2014-05-01 15:40:35 +02:00
e75cafe9fb
Clean up format list for consistency
...
This should make the format list output look a bit nicer.
2014-04-30 01:52:05 +02:00
aa92f06308
[youtube] Don't call 'unquote_plus' on the video title ( fixes #2799 )
...
It's already unquoted after calling 'compat_parse_qs'.
It replaced '+' with spaces, for example in https://www.youtube.com/watch?v=XC0b5YexO-I .
2014-04-25 13:19:03 +02:00
e00c9cf599
[youtube] Update test description field
2014-04-25 13:14:15 +02:00
ba60a3ebe0
[youtube] Update test description field
2014-04-25 12:57:04 +02:00
d11271dd29
[youtube] Include video Id in common error message ( Fixes #2786 )
2014-04-21 20:34:03 +02:00
1db2666916
[youtube:playlist] Correct playlist ID output
...
The ID now starts with PL, so we don't need to output that twice.
2014-04-15 17:55:52 +02:00
b9c76aa1a9
[youtube] Add support for cleanvideosearch.com ( Fixes #2734 )
2014-04-11 13:53:05 +02:00
68eb8e90e6
[youtube:playlist] Fix playlists for logged-in users ( Fixes #2690 )
2014-04-04 02:23:36 +02:00
e45d40b171
[youtube:subscriptions] Add space to the description
2014-04-03 15:13:52 +02:00
f6177462db
[youtube] feeds: Also look for the html in the 'content_html' field ( fixes #2671 )
2014-04-02 14:13:08 +02:00
5912c639df
[youtube] Transform google's JSON dialect ( fixes #2663 )
2014-04-01 05:56:56 +02:00
83d548ef0f
[youtube] Encode ytsearch query
2014-03-30 15:57:35 +02:00
acd213ed6d
Remove unusued imports
2014-03-30 07:16:07 +02:00
2b25cb5d76
[youtube] Move JavaScript interpreter into its own module
2014-03-30 07:02:58 +02:00
43b81eb98a
[youtube] Remove useless resolution fields from format definitions
...
These can be - and are - calculated automatically by the YoutubeDL core.
2014-03-22 14:22:41 +01:00
278229d195
itag 160 is 144p, not 192p
2014-03-22 12:15:45 +01:00
7e8c0af004
Add --prefer-insecure option ( Fixes #2364 )
2014-03-21 00:37:10 +01:00
bc6d597828
Add bestvideo and worstvideo to special format names ( #2163 )
2014-03-14 17:01:47 +01:00
ae7ed92057
[youtube] Fix up invalid JSON
2014-03-10 13:35:45 +01:00
c9ae7b9565
[youtube] Add support for search result URLs ( Fixes #2495 )
2014-03-04 03:32:28 +01:00
60d3a2e0f8
Fix incorrect format codes
...
Corrects the descriptions for the DASH video format codes 264 and 138
(1440p and 2160p, respectively).
2014-02-24 21:29:37 -05:00
a2dafe2887
[youtube] Fix mix video regex
...
Attributes' order in <li> is arbitrary and changes every time playlist
page is fetched, so we can't rely on `data-index` to be before
`data-video-username`.
2014-02-24 12:52:02 +07:00
bc2f773b4f
[youtube:playlist] Fix mixes extraction ( fixes #2444 )
2014-02-23 17:17:36 +01:00
521ee82334
Fix imports
2014-02-22 23:03:12 +01:00
3489b7d26c
[youtube] Simplify the decryption process for the manifest urls and add a test ( closes #2422 )
2014-02-21 15:15:58 +01:00
acd2bcc384
Merge branch 'youtube-dash' of github.com:m0vie/youtube-dl
2014-02-21 15:02:47 +01:00
dbb94fb044
[youtube] Fix playlist extraction ( Closes #2423 , #2424 , #2425 )
2014-02-21 17:19:55 +07:00
d68f0cdb23
[youtube] decrypt signature when downloading dash manifest
2014-02-21 03:24:56 +01:00
f7000f3a1b
[youtube] Add support for yourepeat.com URLs ( Closes #2397 )
2014-02-19 02:00:54 +07:00
2eb5d315d4
[youtube] Match more truncated URLs ( Closes #2402 )
2014-02-17 14:56:21 +01:00
07ad22b8af
[youtube:search] Mark "no results found" error as expected
2014-02-15 16:30:11 +01:00
e70dc1d14b
[youtube] Correct a minor regex typo
2014-02-10 01:30:47 +01:00
81c2f20b53
[youtube] Correct invalid JSON ( Fixes #2353 )
2014-02-09 17:56:10 +01:00
9766538124
[jadorecettepub] Add extractor ( Fixes #2148 )
2014-02-08 19:20:23 +01:00
d67cc9fa7c
[youtube:playlist] Recognize ‘top tracks’ urls ( closes #2332 )
...
The list parameter starts with ‘MC’ and can have more characters after it, including dots
2014-02-06 19:46:26 +01:00
20650c8654
[youtube] signatures: Recognize javascript functions that contain “$” ( fixes #2304 )
2014-02-04 21:38:50 +01:00
b11cec4162
[youtube:user] Fix id key ( Fixes #1745 )
2014-01-29 11:16:12 +01:00
5700e7792a
[youtube] Encode the data when submitting the form for confirming the age
...
Needed on python 3
2014-01-25 17:22:41 +01:00
38c2e5b8d5
[youtube] Use https: in more urls
2014-01-25 17:11:55 +01:00
beddbc2ad1
[youtube:toplist] Make the regex for finding the playlist link more flexible
...
`title={foo}` may not be at the end of the `href` string.
2014-01-25 15:47:03 +01:00
2c5bae429a
[youtube] Fix new formats
2014-01-24 00:06:26 +01:00
1394ce65b4
[youtube] Add new formats ( Fixes #2221 )
2014-01-23 23:54:06 +01:00
0b65e5d40f
[youtube] Do not break upon unknown formats
2014-01-23 23:21:42 +01:00
975d35dbab
[youtube:truncated_url] Also match mail subscription links ( #2214 )
2014-01-23 16:14:54 +01:00
4919603f66
[youtube] Make DASH manifest download conditional for now
...
DASH download fails on many videos (all with encrypted signatures? not sure yet), for example 07FYdnEawAQ, with a 403.
2014-01-22 21:56:38 +01:00
65697b3bf3
Merge branch 'paged-lists'
...
Conflicts:
test/test_utils.py
youtube_dl/extractor/youtube.py
2014-01-22 20:00:16 +01:00
50317b111d
Merge branch 'youtube-dash-manifest'
...
Conflicts:
youtube_dl/extractor/youtube.py
2014-01-22 19:58:31 +01:00
b7ab059084
Add infrastructure for paged lists
...
This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175
2014-01-20 11:36:47 +01:00
c91778f8c0
[youtube] Fall back to header if playlist title is not available
...
Sometimes (in about 10% of requests), the og:title is missing for a weird reason.
See #2170 for an example
2014-01-20 02:45:51 +01:00
dd27fd1739
[youtube] Download DASH manifest
...
If given, download and parse the DASH manifest file, in order to get ultra-HQ formats.
Fixes #2166
2014-01-19 05:47:20 +01:00
484aaeb204
[everyonesmixtape] Add support ( Fixes #2161 )
2014-01-17 02:56:13 +01:00
ce6b9a2dba
[youtube] Add a pseudo format for rtmp videos ( #2123 )
2014-01-09 02:38:50 +01:00
c3197e3e5c
[youtube] Correct subtitle URL ( Fixes #2120 )
2014-01-09 01:36:21 +01:00
b4622a328b
Use double quotes in error message ( #2112 )
...
On Windows, double quotes are required, because single quotes get served to youtube-dl. (Yes, cmd.exe is crazy like that).
On other system, both double and single quotes are fine, unless the string contains a dollar sign (then you need single quotes).
Since virtually no URLs contain dollar signs, double quotes should do.
2014-01-08 00:05:11 +01:00
8fa8a6299b
[youtube] Add itag 264 ( closes #2063 )
...
It has a better bitrate than 137 but the same resolution
2014-01-01 13:45:33 +01:00
2c62dc26c8
[youtube] Simplify format specification
2013-12-24 12:34:09 +01:00
4bcc7bd1f2
Add temporary _sort_formats helper function
2013-12-24 12:31:42 +01:00
d80044c235
[youtube] Prefer videos with sound
2013-12-23 04:51:42 +01:00
f82b18efc1
Merge remote-tracking branch 'rzhxeo/youtube'
2013-12-23 04:37:40 +01:00
e302f9ce32
[youtube:user] Speed up --match-title
2013-12-22 03:57:42 +01:00
e56f22ae20
[YoutubeIE] Sort formats by resolution
2013-12-18 21:22:37 +01:00
dbd1988ed9
[YoutubeIE] Add width and height to format dict
2013-12-18 21:21:25 +01:00
4ea3be0a5c
[YoutubeIE] Externalize format selection
2013-12-18 03:30:55 +01:00
46374a56b2
[youtube] Do not warn for videos with allow_rating=0
...
This fixes #1982
Test video: http://www.youtube.com/watch?v=gi2uH3YxohU
2013-12-17 02:49:56 +01:00
b466b7029d
[youtube] Make duration an integer or None
2013-12-16 04:09:05 +01:00
ffa8f0df0a
Merge remote-tracking branch 'jaimeMF/yt-toplists'
2013-12-09 04:49:32 +01:00
7cc3570e53
Add fatal=False parameter to _download_* functions.
...
This allows us to simplify the calls in the youtube extractor even further.
2013-12-09 01:49:03 +01:00
baa7b1978b
Remove the calls to 'compat_urllib_request.urlopen' in a few extractors
2013-12-08 22:24:55 +01:00
31812a9e0e
[youtube:channel] Fix automated channel detection
2013-12-08 07:30:42 +01:00
715c8e7bdb
[youtube:playlist] Recognize mix ids for direct use ( fixes #1295 )
2013-12-06 19:52:41 +01:00
7d4afc557f
[youtube:playlist] Support mix ids longer than 13 ( #1295 )
2013-12-06 19:48:54 +01:00
336c3a69bd
[youtube] Extract like and dislike count ( #1895 )
2013-12-06 13:22:27 +01:00
27dcce1904
[youtube] Resolve URLs in comments
2013-12-04 14:18:49 +01:00
cb7fb54600
Change the ie_name of YoutubeSearchDateIE
...
It produced a duplicate entry when listing the extractors with '--list-extractors' and generates noise in the commit log when generating the supported sites webpage (like in 09f355f73b
2013-12-03 13:55:25 +01:00
0a688bc0b2
[youtube] Add support for downloading top lists ( fixes #1868 )
...
It needs to know the channel and the title of the list, because the ids change every time you browse the channels and are attached to a 'VISITOR_INFO1_LIVE' cookie.
2013-11-30 14:56:51 +01:00
0e44d8381a
[youtube:feeds] Use the 'paging' value from the downloaded json information ( fixes #1845 )
2013-11-28 00:33:27 +01:00
76d1700b28
[youtube:playlist] Fix the extraction of the title for some mixes ( #1844 )
...
Like https://www.youtube.com/watch?v=g8jDB5xOiuE&list=RDIh2gxLqR7HM
2013-11-27 20:01:51 +01:00
652cdaa269
[youtube:playlist] Add support for YouTube mixes ( fixes #1839 )
2013-11-26 21:35:03 +01:00
e26f871228
Use the new '_download_xml' helper in more extractors
2013-11-26 19:17:25 +01:00
6e47b51eef
[youtube:playlist] Remove the link with index 0
...
It's not the first video of the playlist, it appears in the 'Play all' button (see the test course for an example)
2013-11-26 19:09:14 +01:00
ea36cbac5e
Merge remote-tracking branch 'rbrito/swap-dimensions'
2013-11-25 06:19:15 +01:00
f459d17018
[youtube] Add an extractor for downloading the watch history ( closes #1821 )
2013-11-24 14:33:50 +01:00
66ec019240
[youtube] do not use variable name twice
2013-11-24 06:54:26 +01:00
7012b23c94
Match --download-archive during playlist processing ( Fixes #1745 )
2013-11-22 22:46:46 +01:00
3f8ced5144
Merge remote-tracking branch 'jaimeMF/yt-playlists'
2013-11-22 20:11:54 +01:00
cb7dfeeac4
[youtube] only allow domain name to be upper-case ( #1786 )
2013-11-18 16:42:35 +01:00
83aa529330
Support protocol-independent URLs ( #1787 )
2013-11-18 13:18:17 +01:00
fccd377198
Suppor embed-only videos ( Fixes #1746 )
2013-11-18 13:05:18 +01:00
1d699755e0
[youtube] Add view_count ( Fixes #1781 )
2013-11-17 11:06:16 +01:00
b9643eed7c
[youtube:channel] Fix the extraction of autogenerated channels
...
The ajax pages are empty, now it looks directly in the channel's /videos page
2013-11-15 11:51:45 +01:00
0e145dd541
Merge branch 'master' of github.com:rg3/youtube-dl
2013-11-15 01:46:50 +01:00
9f9be844fc
[youtube] Fix protocol-independent URLs ( Fixes #1768 )
2013-11-15 01:45:39 +01:00
ca715127a2
Don't assume the 'subtitlesformat' is set in the params dict ( fixes #1750 )
2013-11-13 17:14:10 +01:00
880e1c529d
[youtube:playlist] Login into youtube if requested ( fixes #1757 )
...
Allows to download private playlists
2013-11-13 16:39:11 +01:00
dcbb45803f
[youtube:playlist] Don't use the gdata api ( closes #1508 )
...
Parse the playlist pages instead
2013-11-13 16:26:50 +01:00
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
2013-11-10 11:54:18 +01:00
4f045eef8f
[youtube:channel] Fix the extraction
...
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
2013-11-06 21:42:33 +01:00
08fb86c49b
[youtube] Add description for YoutubeSearchDateIE ( #1710 )
2013-11-03 15:59:10 +01:00
3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
2013-11-03 15:56:55 +01:00
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
2013-11-03 12:11:13 +01:00
a3dd924871
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
2013-11-02 22:40:48 -04:00
cf51923545
[youtube] Remove vevo test
...
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
2013-11-02 20:46:26 +01:00
38db46794f
Merge branch 'ted_subtitles'
2013-11-02 19:50:45 +01:00
1f343eaabb
[subtitles] refactor to support websites with subtitle information the
...
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
2013-11-02 19:29:25 +01:00
8eddf3e91d
[youtube] Encode subtitle track name in request ( Fixes #1700 )
2013-11-02 11:21:05 +01:00
795f28f871
[youtube] Fix login ( Fixes #1681 )
2013-10-29 06:45:54 +01:00
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
2013-10-25 17:17:46 +02:00
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
2013-10-25 16:55:37 +02:00
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
2013-10-25 16:52:58 +02:00
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
2013-10-22 15:16:26 -07:00
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
2013-10-21 16:28:55 +02:00
d5a9bb4ea9
extractor: youtube: Swap video dimensions to match standard practice.
...
While working on this, I thought about simplifying things like changing
480x854 to 480p, and that seemed like a good option, until I realized that
people (me included) usually link the concept of some number followed by a p
with the video being 16:9.
So, we would be losing some information and, as we all know,
[explicit is better than implicit][*].
[*]: http://www.python.org/dev/peps/pep-0020/
This closes #1446 .
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:04:44 -03:00
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 18:53:00 -03:00
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 17:50:55 -03:00
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
2013-10-17 02:19:19 +02:00
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
2013-10-14 16:22:27 +11:00
57da92b7df
[youtube] Do not recognize attribution link as user ( Fixes #1573 )
2013-10-09 23:50:38 +02:00
a34c2faae4
[youtube] set the 'name' parameter in the subtitles url ( fixes #1577 )
2013-10-09 16:41:36 +02:00
15870e90b0
Restore warning when user forgets to quote URL ( #1396 )
2013-10-07 12:21:24 +02:00
cfadd183c4
Call extracted property age_limit everywhere
2013-10-06 16:23:06 +02:00
8dbe9899a9
Allow users to specify an age limit ( fixes #1545 )
...
With these changes, users can now restrict what videos are downloaded by the intented audience, by specifying their age with --age-limit YEARS .
Add rudimentary support in youtube, pornotube, and youporn.
2013-10-06 06:08:56 +02:00
7f8ae73a5d
Include length in player cache ID
...
Some videos use the same player with IDs of multiple lengths.
See https://travis-ci.org/rg3/youtube-dl/jobs/12126506#L319 for an example.
2013-10-04 11:36:06 +02:00
c21315f273
[youtube] new static 82 signature
2013-10-04 00:43:01 +02:00
c38b1e776d
[youtube] Simplify cache_dir code ( #1529 )
2013-10-02 08:41:14 +02:00
4f8bf17f23
Merge remote-tracking branch 'holomorph/master'
2013-10-02 08:23:53 +02:00
ca40186c75
[youtube] Fix static 82 signature ( Closes #1539 )
2013-10-02 08:20:00 +02:00
a8c6b24155
[youtube] Support videos without a title ( Fixes #1391 , Closes #1542 )
2013-10-02 07:25:35 +02:00
bd8e5c7ca2
Merge pull request #1531 from rg3/no-playlist
...
[youtube] implement --no-playlist to only download current video
2013-10-01 10:08:20 -07:00
7c61bd36bb
[youtube] correct --no-playlist for python3
2013-10-01 11:58:13 -04:00
44d466559e
Properly handle stream meap not being present
2013-10-01 14:44:09 +02:00
f10503db67
Handle videos without url_encoded_fmt_stream_map ( Fixes #1535 )
2013-10-01 11:39:11 +02:00
fa55675593
Support XDG base directory specification
2013-09-30 18:22:38 -04:00
47192f92d8
implement --no-playlist to only download current video - closes #755
2013-09-30 16:26:25 -04:00
9abb32045a
[youtube] Add hlsvp to the error message if it can't be found and remove the live stream test
...
It's no longer available, other olympics streams have the same problem.
2013-09-27 15:06:27 +02:00
f490e77e77
[youtube] Set the thumbnail to None if it can't be extracted
2013-09-27 14:22:36 +02:00
2dc592991a
[youtube] update description of test
2013-09-27 14:20:52 +02:00
920de7a27d
[youtube] Fix 83 signature ( Closes #1511 )
2013-09-27 06:15:21 +02:00
695dc094ab
Merge branch 'automatic-signatures'
2013-09-24 21:40:08 +02:00
f2c327fd39
Fix 86 signature ( #1494 )
2013-09-24 21:20:42 +02:00
e35e4ddc9a
Fix output of --youtube-print-sig-code when counting down to 0
2013-09-24 21:18:03 +02:00
c3c88a2664
Allow opts.cachedir == None to disable cache
2013-09-24 21:04:43 +02:00
bb0eee71e7
[youtube] Update one of the test's description
2013-09-24 21:04:13 +02:00
6f56389b88
[youtube] update algos for length 86 and 84 ( fixes #1494 )
2013-09-24 21:02:00 +02:00
c705320f48
Correct test strings
2013-09-22 12:18:16 +02:00
d2d8f89531
Do not warn if fallback is without alternatives (because we did not get the flash player URL)
2013-09-22 12:18:10 +02:00
bdde940e90
[youtube] Improve flash player URL handling
2013-09-22 12:17:42 +02:00
13dc64ce74
[youtube] Remove _decrypt_signature_age_gate
2013-09-22 11:17:21 +02:00
f8061589e6
[youtube] Actually pass in cachedir option
2013-09-22 10:51:33 +02:00
0ca96d48c7
[youtube] Improve source code quality
2013-09-22 10:37:23 +02:00
4ba146f35d
Update static signatures
2013-09-22 10:31:25 +02:00
edf3e38ebd
[youtube] Improve cache and add an option to print the extracted signatures
2013-09-22 10:30:02 +02:00
c4417ddb61
[youtube] Add filesystem signature cache
2013-09-22 00:35:03 +02:00
2f2ffea9ca
Clarify a couple of calls
2013-09-21 15:34:29 +02:00
ba552f542f
Use reader instead of indexing
2013-09-21 15:32:37 +02:00
8379969834
Prepare signature function caching
2013-09-21 15:19:48 +02:00
95dbd2f990
Change test target (Verified with node.js)
2013-09-21 15:10:38 +02:00
a7177865b1
Implement more opcodes
2013-09-21 14:48:12 +02:00
e0df6211cc
Restore accidentally deleted commits
...
That's what happens if you let Windows machines write :(
2013-09-21 14:40:35 +02:00
38d025b3f0
[youtube] add algo for length 91
2013-09-20 14:43:16 +02:00
bc4b900898
Unable to decrypt signature length 93 ( fixes #1461 )
2013-09-19 21:49:06 -07:00
71c82637e7
[youtube] apply the fix for lists with number of videos multiple of _MAX_RESULTS to user extraction
...
Copied from the playlist extractor.
2013-09-18 23:00:32 +02:00
4a67aafb7e
[youtube] Don't search the flash player version for videos with age gate activated
2013-09-17 20:59:55 +02:00
6ae8ee3f54
Update 85 signature ( Fixes #1449 )
...
This is the first signature algorithm to have been parsed automatically, although that only works for HTML5 players for now, and is not yet integrated into master.
2013-09-17 16:59:13 +02:00
e69ae5b9e7
[youtube] support youtube.googleapis.com/v/* urls ( fixes #1425 )
2013-09-15 12:14:59 +02:00
ce85f022d2
[youtube] update algo for length 82 ( fixes #1416 )
2013-09-12 22:04:09 +02:00
e3dc22ca3a
[youtube] Fix detection of videos with automatic captions
2013-09-11 19:24:56 +02:00
d665f8d3cb
[subtitles] Also list the available automatic captions languages with '--list-sub'
2013-09-11 19:17:30 +02:00
055e6f3657
[youtube] Support automatic captions with original language different from English ( fixes #1225 ) and download in multiple languages.
2013-09-11 19:08:43 +02:00
7fad1c6328
[subtitles] Use self._download_webpage for extracting the subtitles
...
It raises ExtractorError for the same exceptions we have to catch.
2013-09-11 16:24:47 +02:00
d82134c339
[subtitles] Simplify the extraction of subtitles in subclasses and remove NoAutoSubtitlesInfoExtractor
...
Subclasses just need to call the method extract_subtitles, which will call _extract_subtitles and _request_automatic_caption
Now the default implementation of _request_automatic_caption returns {}.
2013-09-11 16:05:49 +02:00
54d39d8b2f
[subtitles] rename SubitlesIE to SubtitlesInfoExtractor
...
Otherwise it can be automatically detected as a IE ready for use.
2013-09-11 15:51:04 +02:00
de7f3446e0
[youtube] move subtitles methods from the base extractor to YoutubeIE
2013-09-11 15:48:23 +02:00
f8e52269c1
[subtitles] made inheritance hierarchy flat as requested
2013-09-11 15:21:09 +02:00
cf1dd0c59e
Merge branch 'master' into subtitles_rework
2013-09-11 14:26:48 +02:00
aa8f2641da
[youtube] update algo for length 85 ( fixes #1408 and fixes #1406 )
2013-09-11 11:24:58 +02:00
8963d9c266
[youtube] Modify the regex to match ids of length 11 ( fixes #1396 )
...
In urls like http://www.youtube.com/watch?v=BaW_jenozKcsharePLED17F32AD9753930 you can't split the query string and ids always have that length.
2013-09-09 10:33:12 +02:00
890f62e868
Revert "[youtube] Fix detection of tags from HLS videos."
...
They have undo the change
This reverts commit 0638ad9999
2013-09-08 18:50:07 +02:00
72836fcee4
Merge branch 'master' into subtitles_rework
2013-09-06 23:24:41 +02:00
d6e203b3dc
[subtitles] fixed multiple subtitles language separated by comma after merge
...
As mentioned in the pull request, I forgot to include this changes.
aa6a10c44a
2013-09-06 16:30:13 +02:00
e3ea479087
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374 )
...
They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable.
Now the url tests check that the urls can only be extracted with an specific extractor.
2013-09-06 16:24:24 +02:00
faab1d3836
[youtube] Fix detection of feeds urls ( fixes #1294 )
...
Urls like https://www.youtube.com/feed/watch_later were being as users (before the last changes to YoutubeUserIE, as videos)
2013-09-06 14:45:49 +02:00
fd9cf73836
[youtube] Users: download from the api in json to simplify extraction ( fixes #1358 )
...
There could be duplicate videos or other videos if the description have links.
2013-09-06 10:43:02 +02:00
0638ad9999
[youtube] Fix detection of tags from HLS videos.
2013-09-06 10:25:31 +02:00
1cf911bc82
Vevo sig changed again, please update for us! Thanks very much! ( fixes #1375 )
2013-09-05 17:38:03 -07:00
f4b052321b
[youtube] Urls like youtube.com/NASA are now interpreted as users ( fixes #1069 )
...
Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-05 22:39:15 +02:00
c215217e39
[youtube] Playlists: extract the videos id from ['media$group']['yt$videoid'] ( fixes #1374 )
...
'media$player' is not defined for private videos.
2013-09-05 21:40:04 +02:00
96fb5605b2
AHLS -> Apple HTTP Live Streaming
2013-09-03 18:49:35 -07:00
85f03346eb
Merge remote-tracking branch 'upstream/master'
2013-08-30 17:51:59 -07:00
bdc6b3fc64
add support for "-f mp4" for YouTube
2013-08-30 17:51:50 -07:00
2e756879f1
[youtube] update algo for length 86
2013-08-30 20:49:51 +02:00
c7a7750d3b
[youtube] Fix typo in the _VALID_URL for YoutubeFavouritesIE, it was intended to also match :ytfavourites
2013-08-30 20:13:05 +02:00
23b00bc0e4
[youtube] update algo for length 84
...
Only appears sometimes, nearly identical to length 86.
2013-08-29 22:44:29 +02:00
52e1eea18b
[youtube] update algo for length 86 ( fixes #1349 )
2013-08-29 22:33:58 +02:00
c7bf7366bc
Update descriptions checksum for some test for Unistra and Youtube
2013-08-29 13:41:59 +02:00
3e223834d9
[youtube] update algo for length 88, thanks to @Ramhack ( fixes #1328 )
2013-08-28 10:26:44 +02:00
06a401c845
Merge branch 'master' into subtitles_rework
2013-08-28 00:33:12 +02:00
f2aeefe29c
[youtube] update algo for length 84
2013-08-24 10:48:12 +02:00
306170518f
[youtube] update algo for length 86 ( fixes #1302 )
2013-08-23 22:36:59 +02:00
aa6a10c44a
Allow to specify multiple subtitles languages separated by commas ( closes #518 )
2013-08-23 18:34:57 +02:00
df3df7fb64
[youtube] Fix download of subtitles with '--all-subs'
...
If _extract_subtitles is called the option 'write subtitles' is always true.
2013-08-23 13:14:22 +02:00
9e9c164052
Merge pull request #937 from jaimeMF/subtitles_rework
...
Subtitles rework
2013-08-23 02:40:25 -07:00
066090dd3f
[youtube] add algo for length 80 and update player info
2013-08-23 11:33:56 +02:00
bd2dee6c67
Merge branch 'master' into subtitles_rework
2013-08-23 01:47:10 +02:00
18b4e04f1c
Merge branch 'master' into subtitles_rework
2013-08-22 23:29:36 +02:00
3669cdba10
[youtube] update algo for length 82 ( fixes #1296 )
2013-08-22 22:35:15 +02:00
939fbd26ac
[youtube] fix the order of DASH formats
2013-08-22 19:45:24 +02:00
e6ddb4e7af
Merge pull request #1279 from xanadu/master
...
Add YouTube DASH formats to YouTubeIE
2013-08-22 19:33:34 +02:00
45ed795cb0
[youtube] update uploader name for a test video: 'IconaPop' has changed to 'Icona Pop'
2013-08-21 19:28:48 +02:00
37b6d5f684
fix hls test
2013-08-20 23:51:05 -07:00
b7a6838407
address review comment
2013-08-20 21:57:32 -07:00
cde846b3d3
fix code style
2013-08-20 21:42:49 -07:00
211fbc1328
fix failed tests
2013-08-19 18:57:55 -07:00
836a086ce9
Add YouTube DASH formats to YouTubeIE
2013-08-19 18:22:25 -07:00
d741e55a42
[youtube] Support watch_popup URLs ( Fixes #1275 )
2013-08-19 10:27:42 +02:00
f9c3c90ca8
Length 85 changed again? ( fixes #1254 )
2013-08-16 08:54:01 -07:00
3a7256697e
Unable to Download Video ( fixes #1247 )
2013-08-15 13:00:20 -07:00
e1842025d0
Updated Vevo Signature Length ( fixes #1237 )
2013-08-13 17:57:35 -07:00
8a9d86a2a7
New sig len 89 algo
...
Fixes new YT encrypted sig len 89.
2013-08-08 21:48:12 -07:00
02cf62e240
Invalid signature again ( fixes #1215 )
2013-08-08 11:28:50 -07:00
8377574c9c
[internal] Improved subtitle architecture + (update in
...
youtube/dailymotion)
The structure of subtitles was refined, you only need to implement one
method that returns a dictionnary of the available subtitles (lang, url) to
support all the subtitle options in a website. I updated the subtitle
downloaders for youtube/dailymotion to show how it works.
2013-08-08 08:54:10 +02:00
356e067390
Merge remote-tracking branch 'patrickslin/patch-4'
2013-08-07 20:19:51 +02:00
b513a251f8
Merge commit '7a4c6cc92f9ffec9135652a49153caffa5520c29'
2013-08-07 20:11:04 +02:00
36cb11f068
Encrypted sig 87 broken again ( fixes #1200 )
2013-08-06 21:35:37 -07:00
7a4c6cc92f
Updated the 84 length signature decryption
...
Updated the right 84 length signature decryption 06.08.2013
2013-08-06 15:41:13 +03:00
ed27d35674
[youtube] don't crash in verbose mode if 'ad3_module' is not defined in age protected videos ( fixes #1159 )
2013-08-02 14:17:01 +02:00
04bca64bde
[youtube]: new algo for length 83 ( fixes #1164 )
2013-08-02 12:38:17 +02:00
03cc7c20c1
[youtube] show which formats are in 3D with "-F" and in the format field
2013-08-02 12:21:28 +02:00
86fe61c8f9
add support for download YouTube 3d format of 3d content
2013-08-01 10:47:48 -07:00
1d043b93cf
[youtube] Add support for downloading videos with hlsvp ( fixes #1083 )
...
They are downloaded with a m3u8 manifest, they seem to be encrypted, but ffmpeg can handle them.
2013-07-31 23:41:05 +02:00
b072a9defd
YoutubeIE: with age protected videos, add a missing "return" to return the signature decrypted with _decrypt_signature
2013-07-31 10:51:00 +02:00
75952c6e3d
YoutubeIE: new algo for length 86 ( fixes #1156 )
...
Now is using the same length as the flash player used for age protected videos, but the algorithm is different, so now for age protected videos it first tries to use the old algo.
2013-07-31 10:45:13 +02:00
5c468ca8a8
YoutubeIE: add algo for length 79 ( fixes #1126 )
2013-07-25 22:50:24 +02:00
aedd6bb97d
YoutubeIE: new algo for length 81 ( fixes #1127 )
2013-07-25 22:06:53 +02:00
755eb0320e
[youtube] use itertools.count instead of a "while True" loop and a manual counter
2013-07-24 22:27:33 +02:00
43ba5456b1
[youtube] add an extractor for the "Watch Later" list
2013-07-24 22:13:39 +02:00
c626a3d9fa
Add an extractor for downloading the Youtube favorite videos( closes #127 )
2013-07-24 20:45:19 +02:00
b2e8bc1b20
YoutubeIE: Move the code from _real_initialize to a base class
...
This allows to reuse the code in other IEs without having to overwrite some parts.
2013-07-24 20:40:12 +02:00
771822ebb8
YoutubePlaylistIE: break only if there's no entry field in the response
...
Otherwise the Favorite videos playlist cannot be downloaded complete.
Also break if it reach the maximum value of the start-index.
2013-07-24 20:14:55 +02:00
239e3e0cca
YoutubeIE: new algo for length 87 ( fixes #1105 )
...
Squashed commit from the pull requests #1107 , #1109 and #1110 .
2013-07-24 10:20:52 +02:00
252580c561
YoutubeChannelE: switch ajax query from channel_ajax to c4_browse_ajax
...
It wasn't detecting when there aren't more videos
2013-07-23 14:58:01 +02:00
d7ae0639b4
[youtube] Add an extractor for Youtube recommended videos (":ytrec" keyword) ( closes #476 )
...
The new extractor and YoutubeSubscriptionsIE are subclasses of YoutubeFeedsInfoExtractor, which allows to fetch videos from http://www.youtube.com/feed_ajax
2013-07-20 19:33:40 +02:00
2f799533ae
YoutubeIE: don't crash when trying to get automatic captions if the videos has standard subtitles.
2013-07-20 12:56:10 +02:00
88ae5991cd
YoutubeIE: use the same function for getting the subtitles for the "--write-sub" and "--all-sub" options
2013-07-20 12:56:06 +02:00
5d51a883c2
Use a dictionary for storing the subtitles
...
The errors while getting the subtitles are reported as warnings, if no subtitles are found return and empty dict.
2013-07-20 12:52:25 +02:00
a4358cbabd
YoutubeIE: new algo for length 85 ( closes #1080 ), thanks to @patrickslin
2013-07-19 17:12:40 +02:00
444b116597
YoutubeIE: add algo for length 90 ( closes #1064 )
...
Order the cases from higher to lower length.
2013-07-18 12:25:41 +02:00
5a76c6517e
YoutubeIE: some encrypted signatures have more than two parts, print the size of all the parts
2013-07-17 12:08:10 +02:00
88d4111cfa
[youtube] Add code for signature 92 ( Closes #1060 )
2013-07-17 11:06:34 +02:00
be547e1d3b
Revert "[youtube] improved decrypt_signature, closes #1060 "
...
This reverts commit fe6fad1242closes #1066 .
2013-07-17 11:01:40 +02:00
fe6fad1242
[youtube] improved decrypt_signature, closes #1060
2013-07-17 10:41:43 +04:00
606d7e67fd
YoutubeIE: add algo for length 81 ( closes #1026 )
2013-07-11 23:47:54 +02:00
85347e1cb6
YoutubeIE: a new algo for length 83
2013-07-11 20:21:45 +02:00
a7055eb956
YoutubeIE: show a more meaningful error when it founds a rtmpe download (related #343 )
2013-07-10 14:35:11 +02:00
c93898dae9
YoutubeIE: new algo for length 83 ( closes #1017 and closes #1016 )
2013-07-10 10:44:04 +02:00
c108eb73cc
YoutubeIE: Fix vevo explicit videos ( closes #956 )
...
When an age restricted video is detected it simulates accessing the video from www.youtube.com/v/{video_id}
2013-07-09 15:43:44 +02:00
81f0259b9e
YoutubeSubscriptionsIE: raise an error if there's no login information.
2013-07-08 11:24:11 +02:00
fefcb5d314
YoutubeIE: use the new method in the base IE for getting the login info
2013-07-08 11:24:11 +02:00
20c3893f0e
Do not redefine variables in list comprehensions
2013-07-08 02:12:20 +02:00
7763b04e5f
YoutubeIE: extract the thumbnail in the best possible quality
2013-07-07 21:21:15 +02:00
897f36d179
[youtube:subscriptions] Use colon for differentiation of shortcuts
2013-07-07 17:13:26 +02:00
04cc96173c
[youtube] Add and extractor for the subscriptions feed ( closes #498 )
...
It can be downloaded using the ytsubscriptions keyword.
It needs the login information.
2013-07-07 13:58:23 +02:00
9a82b2389f
Do not show bug report for errors that are to be expected ( Closes #973 )
2013-07-02 08:40:21 +02:00
0f81866329
Add --list-extractor-descriptions (human-readable list of IEs)
2013-07-01 18:52:19 +02:00
75dff0eef7
[youtube]: add YoutubeShowIE ( closes #14 )
...
It just extracts the playlists urls for each season
2013-07-01 17:59:28 +02:00
d828f3a550
YoutubeIE: use a negative index when accessing the last element of the format list
2013-07-01 17:19:33 +02:00
bcd6e4bd07
YoutubeIE: extract the correct video id for movie URLs ( closes #597 )
2013-07-01 16:51:18 +02:00
d7f44b5bdb
[youtube] Warn if URL is most likely wrong ( #969 )
2013-07-01 02:29:29 +02:00
257a2501fa
keep track of the dates and html5player versions of working YT signature algos
2013-06-29 01:05:36 +02:00
0e853ca4c4
[youtube] Fix tests in 2.x
2013-06-27 19:55:39 +02:00
2eb88d953f
Allow _TESTS attribute for IEs with multiple tests
...
This also improves the numbering of duplicate tests
2013-06-27 19:13:11 +02:00
c90f13d106
YoutubeIE: update the docstrings and the error message of _decrypt_signature
...
Now it doesn't check the size of the two parts of the key.
2013-06-27 14:37:45 +02:00
769fda3c5a
print more encrypted signature info on -v (rel: #948 )
2013-06-27 12:54:07 +02:00
23300d7149
a new day, a new s algo - fix #946
2013-06-27 12:24:46 +02:00
ee313cdcbf
simplify youtube signature generation
2013-06-27 11:15:01 +02:00
6b37f0be55
Add a clean-room implementation for youtube signatures
2013-06-27 01:51:10 +02:00
b004821fa9
Add the option "--write-auto-sub" to download automatic subtitles from Youtube
...
Now automatic subtitles are only downloaded if the option is given.
(closes #903 )
2013-06-25 23:46:24 +02:00
98bcd2834a
improve generic and encrypted signature error messages
2013-06-25 16:47:16 +02:00
50be92c11c
Handle video pages without vevo IDs ( Fixes #923 )
2013-06-25 12:28:17 +02:00
7ce7e39476
YoutubeIE: Extend decryption of signatures to all videos that have the 's' field in the url_encoded_fmt_stream_map (related #920 )
2013-06-24 21:25:12 +02:00
c7253e2e8c
[youtube] fix condition always being evaluated to true
2013-06-24 09:42:46 +02:00
d69cf69a6a
[youtube] Use mp4 as extension for format 38 ( Fixes #892 )
2013-06-24 01:22:59 +02:00
b05654f0e3
Move YoutubeSearchIE to the other youtube IEs
2013-06-23 20:28:15 +02:00
38cbc40a64
Move Metacafe and Statigram into their own files, and remove absolute import
2013-06-23 20:07:51 +02:00
93d3a642a9
[youtube] remove dead code
2013-06-23 19:59:40 +02:00
c5e8d7af0e
Move youtube extractors to youtube_dl.extractor.youtube
2013-06-23 19:58:33 +02:00
Philipp Hagemeister
Jaime Marquínez Ferrándiz
riking
Tim Sogard
Liu DongMiao
Sergey M․
Petr Půlpán
Anton Novosyolov
Dario Guarascio
AGSPhoenix
hurda
m0viefreak
Filippo Valsorda
rzhxeo
Craig Markwardt
Ismaël Mejía
Rogério Brito
Jai Grimshaw
Filippo Valsorda
Mark Oteiza
patrickslin
Allan Zhou
AndreiArba