e33baba0dd
[downloader/dash] Add fragment retry capability
...
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
2016-03-19 20:42:23 +06:00
721f26b821
[downloader/fragment] Add report_retry_fragment
2016-03-19 20:41:24 +06:00
52bb437e41
[options] Add --fragment-retries option
2016-03-19 20:40:36 +06:00
782b1b5bd1
[utils] lookup_unit_table: Match word boundary instead of end of string
2016-03-19 11:44:49 +01:00
0d769bcb78
[extractor/generic] Fix missing byte literal prefix
2016-03-19 05:43:43 +06:00
4cd70099ea
[hbo] Add new extractor
2016-03-18 21:18:18 +01:00
09fc33198a
utils: lookup_unit_table: Use a stricter regex
...
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
2016-03-18 19:23:06 +01:00
d5aacf9a90
Added format_id to the filers on -f.
2016-03-18 23:59:24 +06:00
19e2617a6f
[commonprotocols] Add generic support for rtmp URLs ( Closes #8488 )
2016-03-18 23:42:15 +06:00
edd9b71c2c
[extractor/generic] Add a test for m3u playlist served without proper Content-Type
2016-03-18 22:49:11 +06:00
5940862d5a
[extractor/generic] Detect m3u playlists served without proper Content-Type
2016-03-18 22:45:28 +06:00
de6c51e88e
[extractor/generic] Fix direct link semantics
2016-03-18 22:43:07 +06:00
303dcdb995
[extractor/generic] Simplify upload_date extraction
2016-03-18 22:41:16 +06:00
20938f768b
[extractor/generic] Add another test for generic m3u8
2016-03-18 21:54:33 +06:00
955737b2d4
[extractor/generic] Force Content-Type to lowecase
2016-03-18 21:50:44 +06:00
263eff9537
[extractor/generic] Properly extract format id from Content-Type
...
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
2016-03-18 21:50:10 +06:00
cae21032ab
[theplatform] Improve geo restriction detection
2016-03-18 21:08:25 +06:00
6187091532
[once] check http formats availability
2016-03-18 11:51:34 +01:00
0d33166ec5
release 2016.03.18
2016-03-18 11:43:48 +01:00
87c03c6bd2
[theplatform] remove unnecessary import
2016-03-18 09:43:28 +01:00
4c92fd2e83
[theplatform] always force theplatform to return a smil for _extract_theplatform_smil
2016-03-18 09:22:10 +01:00
e3d17b3c07
[noz] Fix extraction on python 2.6 by means of using compat_xpath
2016-03-18 02:54:27 +06:00
810c10baa1
[utils] Use compat_xpath
2016-03-18 02:52:23 +06:00
57f7e3c62d
[compat] Add compat_xpath
2016-03-18 02:51:38 +06:00
0d0e282912
[animeondemand] Fix typo and improve
2016-03-18 00:13:50 +06:00
85e8f26b82
[animeondemand] Improve extraction
2016-03-18 00:02:34 +06:00
b57fecfddd
[animeondemand] Add test
2016-03-17 23:50:10 +06:00
8c97e7efb6
[animeondemand] Expand episode title regex ( Closes #8875 )
2016-03-17 23:43:14 +06:00
cc162f6a0a
[crunchyroll] Fix custom _download_webpage ( Closes #8883 )
2016-03-17 22:55:04 +06:00
cf45ed786e
[wistia] extract more metadata
2016-03-17 17:48:17 +01:00
574b2a7393
[nbc:nbcnews] improve extraction( fixes #6922 )
...
- extract more metadata and formats
- relax regex
2016-03-17 16:11:29 +01:00
9f02ff537c
[theplatform] extract brightcove once formats
2016-03-17 16:11:29 +01:00
0436ec0e7a
[once] Add new format extractor
2016-03-17 16:11:29 +01:00
11f12195af
[youtube] Added itag 91
...
Seen in https://www.youtube.com/watch?v=jMN4cxyhJjk
2016-03-17 19:25:37 +08:00
a646a8cf98
[sbs] improve extraction( fixes #3811 )
...
- extract error messages
- force the platform smil url(previously the manifest param
in the query is not respected which make theplatform return non working
mp4 files for some videos)
2016-03-17 02:07:06 +01:00
63f41d3821
[bravotv] Add new extractor( #4657 )
2016-03-16 21:26:25 +01:00
c5229f3926
[utils] PEP 8
2016-03-16 21:50:04 +06:00
96f4f796fb
[brightcover] Remove unused import
2016-03-16 21:47:51 +06:00
70cab344c4
[udemy] Improve course id v4 regex
2016-03-16 21:46:09 +06:00
a7ba57dc17
[udemy] Update course id regex to cover v4 layout ( Closes #8753 , closes #8868 , closes #8870 )
2016-03-16 21:45:01 +06:00
83548824c2
Merge pull request #8092 from bpfoley/twitter-thumbnail
...
[utils] Add extract_attributes for extracting html tag attributes
2016-03-16 13:16:27 +01:00
354dbbd880
[brightcove:new] extract protocol-less embed URLs( closes #2914 )
2016-03-16 11:46:53 +01:00
23edc49509
[tv3] Add new extractor( closes #8059 )
2016-03-16 10:47:39 +01:00
48254c3f2c
[brightcove] some improvements and fixes
...
- use FFmpeg downloader to download m3u8 formats extracted
from BrightcoveNew(some of the m3u8 media playlists use AES-128)
- update comment and update_url_query to handle url query
2016-03-16 09:21:07 +01:00
2cab48704c
[thestar] Add new extractor( closes #5955 )
2016-03-15 23:10:31 +01:00
64d4f31d78
[brightcove:new] update embed_in_page embeds regex to match non numeric ref id
2016-03-15 22:50:43 +01:00
0c9ff24041
[noz] fix extraction in python 2.6
2016-03-15 21:00:39 +01:00
3ff8279e80
[kuwo:mv] Fix the test and extraction of georestricted MVs
2016-03-16 02:41:18 +08:00
cb6e477dfe
[aljazeera] update the extractor to use BrightcoveNewIE
2016-03-15 19:38:10 +01:00
edfd93518e
[svt] extract dashhbbtv formats( #8867 )
2016-03-15 19:33:09 +01:00
89807d6a82
[brightcove] extract dash formats and detect audio formats
2016-03-15 18:48:21 +01:00
49dea4913b
Merge pull request #8513 from remitamine/dash-sort
...
[extractor/common] fix dash formats sorting
2016-03-15 18:39:50 +01:00
dec2cae0a7
[twitch:playlistbase] Clarify pagination bug
...
Pagination bug has been fixed by twitch on 15.03.2016.
2016-03-15 21:45:43 +06:00
cf6cd07396
[noz] extract f4m and m3u8 formats
2016-03-15 15:24:12 +01:00
975b9c9ab0
[brightcove:new] detect m3u8 manifests by M2TS container
2016-03-15 10:06:53 +01:00
8ac73bdbe4
[brightcove:new] Add support for non numeric ref: preffixed video ids
2016-03-15 10:03:08 +01:00
877f440f7b
[rice] Add new extractor( closes #1736 )
2016-03-15 00:49:23 +01:00
d13bdc3824
[brightcove] raise ExtractorError on 403 errors and fix regex to work with tenplay
2016-03-14 22:24:52 +01:00
744daf9418
[gameinformer] remove unused imports
2016-03-14 21:57:26 +01:00
bf475e1990
[tlc] fix extraction and update extractor to use BrightcoveNewIE
2016-03-14 21:53:00 +01:00
203f3d779a
[gameinformer] update the extractor to use BrightcoveNewIE
2016-03-14 18:32:29 +01:00
4230c4894d
[external/downloader] fix rtmp downloading using FFmpegFD
2016-03-14 16:51:01 +01:00
6bb266693f
release 2016.03.14
2016-03-14 10:25:20 +01:00
5d53c32701
[usatoday] Add new extractor( closes #8655 )
2016-03-13 22:36:15 +01:00
2e7e561c1d
Merge pull request #8611 from remitamine/ffmpegfd
...
[downloader/external] Add FFmpegFD
2016-03-13 21:30:27 +01:00
d8515fd41c
[downloader/external] pass configuration args to ffmpeg
2016-03-13 21:28:26 +01:00
694c47b261
[external/downloader] don't pass -t and -ss to ffmpeg
2016-03-13 21:28:16 +01:00
77dea16ac8
[downloader/external] check for ffmpeg availablity when it used for m3u8 download
2016-03-13 20:34:51 +01:00
6ae27bed01
[download/external] move the check for multiple selected formats to get_suitable_downloader
2016-03-13 20:34:38 +01:00
da1973a038
[extractor/__init__] disable time range downloading
2016-03-13 16:16:26 +01:00
be24916a7f
[downloader/rtsp] Add rtsp and mms downloader
2016-03-13 15:24:02 +01:00
2cb99ebbd0
[downloader/external] add can_download mathod for checking downloader availibilty and support
2016-03-13 15:18:51 +01:00
91ee320bfa
[downloader/external] wrap available_opt in a list
2016-03-13 14:37:45 +01:00
8fb754bcd0
Merge pull request #8821 from remitamine/list-thumbnails-order
...
[YoutubeDL] check for --list-thumbnails immediately after processing them
2016-03-13 12:44:50 +01:00
b7b72db9ad
[YoutubeDL] check for --list-thumbnails immediately after processing them
2016-03-13 12:41:15 +01:00
634415ca17
[downloader/external] skip FFmpegFD when requesting multiple formats
2016-03-13 12:23:10 +01:00
2f7ae819ac
[utils] PEP 8
2016-03-13 17:23:08 +06:00
0a477f8731
[vice:show] Add extractor ( Closes #8847 )
2016-03-13 17:22:23 +06:00
a755f82549
[ffmpeg] convert format ext to ffmpeg output formats codes
2016-03-13 12:15:29 +01:00
7f4173ae7c
[mixcloud] Fix view count extraction ( Closes #8831 , closes #8845 )
2016-03-13 16:27:58 +06:00
fb47597b09
[bbc] Generalize unit table lookup and add parse_count
2016-03-13 16:27:20 +06:00
450b233cc2
[bbc] Update test
2016-03-13 15:59:54 +06:00
b7d7674f1e
[bbc] Update test
2016-03-13 15:56:34 +06:00
0e832c2c97
[bbc] Improve title and description extraction ( Closes #8826 , closes #8822 )
2016-03-13 15:54:56 +06:00
8e4aa7bf18
[bbc] Fix BBC Extractor to work with 'School Report'
2016-03-13 15:54:34 +06:00
a42dfa629e
[makerschannel] Add new extractor( closes #8839 )
2016-03-12 22:52:53 +01:00
b970dfddaf
[minoto] Add new extractor
2016-03-12 22:52:53 +01:00
46a4ea8276
[safari] Remove unused imports
2016-03-13 03:48:38 +06:00
3f2f4a94aa
[extractor/generic] Extract f4m formats from final URLs
2016-03-13 03:38:20 +06:00
f930e0c76e
[extractor/generic] Extract f4m formats and refactor common info
2016-03-13 03:17:25 +06:00
0fdbb3322b
[extractor/common] Add _parse_f4m_formats routine
2016-03-13 03:16:08 +06:00
e9c8999ede
[safari] Fix authentication
2016-03-13 02:08:36 +06:00
73cbd709f9
[safari] Respect kaltura session ( Closes #7491 )
2016-03-13 02:03:07 +06:00
9dce3c095b
[kaltura] Respect kaltura session
2016-03-13 02:01:10 +06:00
e5a2e17a9c
[kaltura] optimize url info extraction
2016-03-12 18:43:45 +01:00
0ec589fac3
Merge pull request #8827 from remitamine/safari
...
[safari] extract free and preview videos(#7491 )
2016-03-12 17:28:54 +01:00
36bb63e084
[dw] add support for article pages( closes #8790 )
2016-03-12 08:33:22 +01:00
91d6aafb48
[dw] add support for audio pages
2016-03-11 23:55:26 +01:00
c8868a9d83
[dw] Add new extractor
2016-03-11 22:44:18 +01:00
09f572fbc0
[extractor/common] add transform_source to _download_smil and _extract_smil_formats
2016-03-11 22:37:07 +01:00
58e6d097d8
[googledrive] Relax _VALID_URL ( Closes #8829 )
2016-03-12 00:36:39 +06:00
15bf934de5
Merge pull request #8819 from remitamine/simple-webpage-requests
...
[extractor/common] simplify using data, headers and query params with _download_* methods
2016-03-11 18:19:43 +01:00
cdfee16818
[extractor/common] add data, headers and query params to _request_webpage
2016-03-11 18:12:50 +01:00
bcb668de18
[safari] extract free and preview videos( #7491 )
2016-03-11 16:57:06 +01:00
fac7e79277
[kaltura] add support for videos with reference id
2016-03-11 16:52:07 +01:00
a6c8b75904
[common] Use mimeType to determine file extensions ( #8766 )
2016-03-11 23:51:42 +08:00
25cb05bda9
[utils] Remove codec2ext
...
This function is orignally used for determining file extensions of DASH
formats. Now in DASH, ext is determined by mime_type. See #8766 for more
information.
2016-03-11 23:51:42 +08:00
883c052378
[audioboom] Improve robustness and extract uploader ( Closes #8812 )
2016-03-11 19:44:17 +06:00
61f317c24c
Added extractor for AudioBoom.com
2016-03-11 19:43:01 +06:00
64f08d4ff2
Merge pull request #8766 from yan12125/dash-detect-ext
...
Detect file extensions of DASH formats from their codecs
2016-03-11 21:40:07 +08:00
e738e43358
[facebook] Support videos in groups
...
Viewing/Downloading videos in groups requires logging in, even for
those in public groups.
Fixes #6951 .
2016-03-11 16:20:27 +08:00
f6f6217a98
[facebook] Don't override variable in list comprehension
2016-03-10 15:17:04 +01:00
31db8709bf
[iqiyi] Update enc_key
2016-03-10 21:37:26 +08:00
5080cbf9fd
[facebook] Handle escaped swf params
...
Fixes #8713
2016-03-10 15:26:32 +08:00
9880124196
[facebook] Fix for m.facebook.com URLs
2016-03-10 14:59:30 +08:00
9c7b509b2a
[facebook] Merge FacebookPostIE into FacebookIE
...
Fixes #8713
2016-03-10 14:59:30 +08:00
5d583bdf6c
[YoutubeDL] Improve _format_note
2016-03-10 01:03:18 +06:00
1e501364d5
[vimeo:ondemand] Clarify IE_NAME
2016-03-10 00:52:52 +06:00
74278def2e
[vimeo:ondemand] Separate ondemand extractor ( Closes #8330 , closes #8801 )
2016-03-10 00:51:07 +06:00
e375a149e1
[livestream] Properly build smil URLs ( #8794 )
2016-03-09 23:11:09 +06:00
ac45505528
Added flag for 'allow_audio_only' format in Twitch queries
2016-03-07 21:03:24 -06:00
46c329d6f6
[arte] Improve extraction ( Closes #8768 )
2016-03-07 02:19:54 +06:00
1818e4c2b4
[arte] Fix typo
2016-03-07 02:10:16 +06:00
e7bd17373d
[sexu] Improve extraction ( Closes #8782 )
2016-03-06 18:08:53 +06:00
c58e74062f
[Sexu] fix extractor
2016-03-06 17:53:22 +06:00
6d210f2090
[utils] Add more codecs to codec2ext
...
BBC uses avc3. Here's an example (thanks to @remitamine for this example)
http://rdmedia.bbc.co.uk/dash/ondemand/bbb/2/client_manifest-common_init.mpd
See also https://trac.ffmpeg.org/ticket/5217
2016-03-06 17:57:48 +08:00
af7d5a63b2
[common] Document protocol http_dash_segments
2016-03-06 17:47:07 +08:00
e41acb6364
[safari] Don't pollute std_headers ( #8778 )
2016-03-06 17:38:39 +08:00
bdf7f13954
release 2016.03.06
2016-03-06 10:08:02 +01:00
0f56a4b443
[vimeo] Don't pollute std_headers
...
Fixes #8778
2016-03-06 17:01:05 +08:00
1b5284b13f
[downloader/fragment] Make speed more smooth
...
At the beginning of every segment there was a drop to Unknown speed due to timeslice being too small to calculate speed.
Now last speed from the previous fragment is used.
2016-03-06 05:36:52 +06:00
d1e4a464cd
[YoutubeDL] Carry long lines and improve readability
2016-03-06 04:32:18 +06:00
ff059017c0
[YoutubeDL] Fix typo in m3u8_native fixup
2016-03-06 04:30:19 +06:00
f22ba4bd60
update tests related to the change in youtube http format sorting
...
the change was done in 82156fdbf0
2016-03-05 21:52:24 +01:00
1db772673e
[cinemassacre] update tests
2016-03-05 21:34:34 +01:00
75313f2baa
[cnet] fix info extraction
2016-03-05 21:10:00 +01:00
090eb8e25f
Merge pull request #8718 from remitamine/m3u8-fixup
...
Add fixup for media files produced by HlsNative downloader(fixes #4776 )
2016-03-05 18:37:28 +01:00
a9793f58a1
Merge pull request #8754 from remitamine/5min
...
update 5min related web sites info extraction and add support for Aol features.
2016-03-05 18:35:48 +01:00
7177fd24f8
[vgtv] support ap.vgtv.no and fix old videos extraction( fixes #8719 )
2016-03-05 17:51:46 +01:00
1e501f6c40
[jeuxvideo] Fix config URL extraction ( Closes #8774 )
2016-03-05 21:01:43 +06:00
2629a3802c
[revison3] fix video_id for --download-archive
2016-03-05 15:42:15 +01:00
51ce91174b
[YoutubeDL] Fix resolution with missing height in output template dict
2016-03-05 19:38:58 +06:00
107d0c421a
[revision3] add support for pages of type tag
2016-03-05 13:43:29 +01:00
18b0b23992
[revision3] add support pages of type embed
2016-03-05 12:14:48 +01:00
d1b29d1342
[elpais] Add support for alternative layout ( Closes #8744 )
2016-03-05 16:43:29 +06:00
2def60c5f3
[common] Use codec2ext for DASH formats ( #8764 )
2016-03-05 18:18:39 +08:00
19a17d4623
[utils] Add codec2ext
2016-03-05 18:18:28 +08:00
845817aadf
[twitter] Provide more metadata
2016-03-05 18:14:58 +08:00
3233a68fbb
[utils] update_url_query: Encode the strings in the query dict
...
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
2016-03-04 22:18:40 +01:00
cf074e5ddd
[foxnews] update test
2016-03-04 21:42:04 +01:00
Sergey M․
Jaime Marquínez Ferrándiz
remitamine
John Peel
Philipp Hagemeister
Yen Chi Hsuan
Quan Hua
Benjamin Congdon
aystroganov@gmail.com