ce599d5a7e
[downloader/external] enable piping for FFmpegFD( closes #2124 )
2016-04-14 18:49:02 +01:00
f5d8743e0a
[downloader/rtsp] Print the command
2016-04-14 15:07:31 +08:00
f7df343b4a
[downloader/f4m] Extract routine for removing unsupported encrypted media
2016-03-27 07:41:19 +06:00
16a8b7986b
[downloader/fragment] Document fragment_retries
2016-03-19 20:54:21 +06:00
617e58d850
[downloader/{common,fragment}] Fix total retries reporting on python 2.6
2016-03-19 20:51:30 +06:00
e33baba0dd
[downloader/dash] Add fragment retry capability
...
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
2016-03-19 20:42:23 +06:00
721f26b821
[downloader/fragment] Add report_retry_fragment
2016-03-19 20:41:24 +06:00
4230c4894d
[external/downloader] fix rtmp downloading using FFmpegFD
2016-03-14 16:51:01 +01:00
2e7e561c1d
Merge pull request #8611 from remitamine/ffmpegfd
...
[downloader/external] Add FFmpegFD
2016-03-13 21:30:27 +01:00
d8515fd41c
[downloader/external] pass configuration args to ffmpeg
2016-03-13 21:28:26 +01:00
694c47b261
[external/downloader] don't pass -t and -ss to ffmpeg
2016-03-13 21:28:16 +01:00
77dea16ac8
[downloader/external] check for ffmpeg availablity when it used for m3u8 download
2016-03-13 20:34:51 +01:00
6ae27bed01
[download/external] move the check for multiple selected formats to get_suitable_downloader
2016-03-13 20:34:38 +01:00
da1973a038
[extractor/__init__] disable time range downloading
2016-03-13 16:16:26 +01:00
be24916a7f
[downloader/rtsp] Add rtsp and mms downloader
2016-03-13 15:24:02 +01:00
2cb99ebbd0
[downloader/external] add can_download mathod for checking downloader availibilty and support
2016-03-13 15:18:51 +01:00
91ee320bfa
[downloader/external] wrap available_opt in a list
2016-03-13 14:37:45 +01:00
634415ca17
[downloader/external] skip FFmpegFD when requesting multiple formats
2016-03-13 12:23:10 +01:00
a755f82549
[ffmpeg] convert format ext to ffmpeg output formats codes
2016-03-13 12:15:29 +01:00
1b5284b13f
[downloader/fragment] Make speed more smooth
...
At the beginning of every segment there was a drop to Unknown speed due to timeslice being too small to calculate speed.
Now last speed from the previous fragment is used.
2016-03-06 05:36:52 +06:00
e9c0cdd389
[jython] Introduce compat_os_name
...
os.name is always 'java' on Jython
2016-03-03 19:24:24 +08:00
f34294fa0c
[downloader/external:ffmpegfd] check for None value of start_time
2016-02-20 08:06:12 +01:00
99cbe98ce8
[downloader/external] check for external downloaders availability
2016-02-20 07:58:25 +01:00
12b84ac8c1
[downloader/external] Add FFmpegFD( fixes #622 )
...
- replace HlsFD and RtspFD
- add basic support for downloading part of the video or audio
2016-02-19 19:29:24 +01:00
611c1dd96e
[refactor] Single quotes consistency
2016-02-14 15:37:17 +06:00
d800609c62
[refactor] Do not specify redundant None as second argument in dict.get()
2016-02-14 14:25:04 +06:00
c78c9cd10d
[downloader/dash] PEP 8
2016-02-14 14:13:09 +06:00
c43fe0268c
[downloader/dash] Implement dashsegments fd in terms of fragment fd
2016-02-09 17:25:44 +01:00
56401e1e5f
[downloader/hls] Do not send 'q' to ffmpeg on Windows ( Closes #8300 )
2016-02-06 23:24:22 +06:00
a1a22572fb
[downloader/dash] make initialization_url optional
2016-02-02 18:12:32 +01:00
b8c9926c0a
[downloader/f4m] Do not update fragment list while test
2016-01-30 19:43:25 +06:00
2c2f1efdcd
[downloader/fragment] Remove superfluous whitespace
2016-01-30 19:30:31 +06:00
09104e9930
[downloader/f4m] Add live stream flag to context
...
Now download progress for f4m livestreams is reported correctly
2016-01-30 19:22:15 +06:00
5fa1702ca6
[downloader/fragment] Do not report total bytes estimation and eta for live streams
2016-01-30 19:20:52 +06:00
8ab3fe81d8
[downloader/f4m] Prefer bootstrap url attribute over inline bootstrap info
2016-01-30 18:28:38 +06:00
7d106a65ca
Add --hls-use-mpegts option
...
When using the mpegts container hls vidoes can be played while being downloaded (useful if you are recording a live stream).
VLC and mpv play them file, but QuickTime doesn't.
2016-01-30 12:26:40 +01:00
32d77eeb04
[downloader/common] report_retry: Don't crash when retries is infinite ( fixes #8299 )
2016-01-22 14:49:17 +01:00
9d90e7de03
[downloader/hls] Ask ffmpeg to quit when interrupting youtube-dl with 'Ctrl+C' ( #8252 )
...
Otherwise the mp4 file can't be played.
2016-01-19 22:07:14 +01:00
b83b782dc4
[downloader/fragment] Move helper data to context dict
2016-01-13 00:00:31 +06:00
709185a264
[downloader/fragment] More smooth calculations
...
`downloaded_bytes` is now updated on each fragment progress hook invocation
2016-01-12 23:18:38 +06:00
9cb1a06b6c
[downloader/fragment] Remove unused code and fix zero division error
2016-01-12 22:09:38 +06:00
3c91e41614
[downloader/fragment] Don't fail if the 'Content-Length' header is missing
...
In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156 ) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).
2016-01-10 14:41:38 +01:00
3f17c357d9
[downloader/hls] Don't let ffmpeg read from stdin ( #8139 )
...
If you run 'while read aurl ; do youtube-dl "${aurl}"; done < path_to_batch_file' (batch_file contains one url per line that uses the hls downloader) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url
(This is the same problem that was fixed for the ffmpeg postprocessors in cffcbc02de
2016-01-04 18:35:31 +01:00
9b9c5355e4
Rename error_to_str to error_to_compat_str
2015-12-20 07:00:39 +06:00
7f8b271465
Properly convert errors to strings
2015-12-20 05:27:38 +06:00
4db43567e8
[downloader/f4m] Decode manifest before fixing
2015-12-11 20:28:44 +06:00
17b786ae73
[downloader/f4m] Fix malformed manifests ( Closes #7823 )
2015-12-10 22:59:50 +06:00
94e8c80473
[downloader/hls] Respect Youtubedl-* headers
2015-11-29 12:43:59 +08:00
9d0e366880
[downloader/hls] Remove Accept-encoding from headers passed to ffmpeg
...
Fails for Youtube Gaming live streams (#7671 )
2015-11-27 21:37:45 +08:00
5c2266df4b
Switch codebase to use sanitized_Request instead of
...
compat_urllib_request.Request
[downloader/dash] Use sanitized_Request
[downloader/http] Use sanitized_Request
[atresplayer] Use sanitized_Request
[bambuser] Use sanitized_Request
[bliptv] Use sanitized_Request
[brightcove] Use sanitized_Request
[cbs] Use sanitized_Request
[ceskatelevize] Use sanitized_Request
[collegerama] Use sanitized_Request
[extractor/common] Use sanitized_Request
[crunchyroll] Use sanitized_Request
[dailymotion] Use sanitized_Request
[dcn] Use sanitized_Request
[dramafever] Use sanitized_Request
[dumpert] Use sanitized_Request
[eitb] Use sanitized_Request
[escapist] Use sanitized_Request
[everyonesmixtape] Use sanitized_Request
[extremetube] Use sanitized_Request
[facebook] Use sanitized_Request
[fc2] Use sanitized_Request
[flickr] Use sanitized_Request
[4tube] Use sanitized_Request
[gdcvault] Use sanitized_Request
[extractor/generic] Use sanitized_Request
[hearthisat] Use sanitized_Request
[hotnewhiphop] Use sanitized_Request
[hypem] Use sanitized_Request
[iprima] Use sanitized_Request
[ivi] Use sanitized_Request
[keezmovies] Use sanitized_Request
[letv] Use sanitized_Request
[lynda] Use sanitized_Request
[metacafe] Use sanitized_Request
[minhateca] Use sanitized_Request
[miomio] Use sanitized_Request
[meovideo] Use sanitized_Request
[mofosex] Use sanitized_Request
[moniker] Use sanitized_Request
[mooshare] Use sanitized_Request
[movieclips] Use sanitized_Request
[mtv] Use sanitized_Request
[myvideo] Use sanitized_Request
[neteasemusic] Use sanitized_Request
[nfb] Use sanitized_Request
[niconico] Use sanitized_Request
[noco] Use sanitized_Request
[nosvideo] Use sanitized_Request
[novamov] Use sanitized_Request
[nowness] Use sanitized_Request
[nuvid] Use sanitized_Request
[played] Use sanitized_Request
[pluralsight] Use sanitized_Request
[pornhub] Use sanitized_Request
[pornotube] Use sanitized_Request
[primesharetv] Use sanitized_Request
[promptfile] Use sanitized_Request
[qqmusic] Use sanitized_Request
[rtve] Use sanitized_Request
[safari] Use sanitized_Request
[sandia] Use sanitized_Request
[shared] Use sanitized_Request
[sharesix] Use sanitized_Request
[sina] Use sanitized_Request
[smotri] Use sanitized_Request
[sohu] Use sanitized_Request
[spankwire] Use sanitized_Request
[sportdeutschland] Use sanitized_Request
[streamcloud] Use sanitized_Request
[streamcz] Use sanitized_Request
[tapely] Use sanitized_Request
[tube8] Use sanitized_Request
[tubitv] Use sanitized_Request
[twitch] Use sanitized_Request
[twitter] Use sanitized_Request
[udemy] Use sanitized_Request
[vbox7] Use sanitized_Request
[veoh] Use sanitized_Request
[vessel] Use sanitized_Request
[vevo] Use sanitized_Request
[viddler] Use sanitized_Request
[videomega] Use sanitized_Request
[viewvster] Use sanitized_Request
[viki] Use sanitized_Request
[vk] Use sanitized_Request
[vodlocker] Use sanitized_Request
[voicerepublic] Use sanitized_Request
[wistia] Use sanitized_Request
[xfileshare] Use sanitized_Request
[xtube] Use sanitized_Request
[xvideos] Use sanitized_Request
[yandexmusic] Use sanitized_Request
[youku] Use sanitized_Request
[youporn] Use sanitized_Request
[youtube] Use sanitized_Request
[patreon] Use sanitized_Request
[extractor/common] Remove unused import
[nfb] PEP 8
2015-11-23 21:56:23 +06:00
17cc153435
Typo fix, found while going through the code.
2015-11-20 22:51:46 +05:30
36e6f62cd0
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x ( #7178 )
...
Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).
2015-10-25 20:13:16 +01:00
8cd9614abf
[downloader/f4m] More accurate fragment URL construction
2015-10-24 21:02:31 +06:00
324ac0a243
[downloader/f4m] get the redirected f4m_url and handle url query string properly
2015-10-24 20:05:46 +06:00
985e4fdc07
[downloader/hls] Add headers only for http(s) URLs
...
ffmpeg 2.8.1 raises an error with -headers and non-http input files.
2015-10-18 13:44:21 +08:00
964e7b2dd0
[downloader/common] Always skip "already downloaded" check when outputting to stdout
2015-10-12 00:43:54 +06:00
f101079ae0
[downloader/rtmp] Respect --no-continue option
...
now when downloading a "rtmp-file" the --no-continue option works!
2015-10-12 00:40:37 +06:00
f102819463
[downloader/hls] Pass http headers to downloader
2015-09-23 02:46:24 +06:00
8a7bbd1606
[postprocessor/ffmpeg] Always use the 'file:' protocol for filenames ( fixes #6874 )
...
If the filename contains ':' it is interpreted as a protocol.
It also handles filenames starting with '-'.
2015-09-18 14:38:35 +02:00
133a2b4ac2
[downloader/hls] Properly close stream
2015-09-10 02:41:30 +06:00
1195a38f46
[downloader/external] Use generalized cli option converters
2015-09-05 03:06:28 +06:00
dc534b674f
[downloader/external] change _argless_option function to _valueless_option
2015-09-04 21:12:13 +01:00
f30c2e8e98
[downloader/external] add _argless_option for option without arguments
2015-09-04 20:57:19 +01:00
266b0ad676
[downloader/external] add _bool_option to pass value to bool option
2015-09-04 20:07:36 +01:00
e7a8c3032d
[downloader/external] Respect --no-check-certificate for curl and aria2c and --proxy for curl
2015-09-03 22:25:33 +01:00
fcd9e423ec
[hls] Properly encode fragment filename
2015-08-31 02:28:36 +06:00
db8f2bfd99
[f4m] Add missing imports
2015-08-31 02:20:29 +06:00
55801fc76e
Merge pull request #5588 from aajanki/encode_frag_filenames
...
[f4m] Fix encode error by sanitizing fragment filenames
2015-08-31 02:18:15 +06:00
7393746da2
[downloader/hls] Add _debug_cmd
2015-08-13 21:10:11 +06:00
6828c809e4
[downloader/fragment] Respect --retries for fragment based downloaders ( Closes #6549 )
2015-08-13 21:07:14 +06:00
9f3da13860
[downloader/external] Use generic _option
2015-08-11 23:05:04 +06:00
bf812ef714
[downloader/external] Forward --proxy to wget and aria2c
2015-08-11 23:00:45 +06:00
154655a85a
[downloader/external] Respect --no-check-certificate for wget
2015-08-08 19:21:05 +06:00
e0ac521438
adding support for axel download manager
2015-08-08 02:39:05 +06:00
84bc4dcb0f
[downloader/http] Clarify rationale for Content-Range check ( #6426 )
2015-08-03 02:27:47 +06:00
10eaa8ef1d
[downloader/http] Report unable to resume
2015-08-03 02:25:40 +06:00
c3124c3085
[downloader/http] Simplify
2015-08-03 02:25:08 +06:00
8d5b8b477e
[utils] import re
2015-08-03 02:23:35 +06:00
d7d2a9a3db
[utils] restart download if server does not support byte ranges
2015-08-03 02:23:31 +06:00
f9a5affad9
[hls] Implement hlsnative fd in terms of fragment fd
2015-07-29 02:28:30 +06:00
ab81ef8fa7
[f4m] Implement f4m fd in terms of fragment fd
2015-07-29 02:27:50 +06:00
95d8f7ea12
[fragment] Generalize fragmented media file downloader
2015-07-29 02:26:16 +06:00
59db9f8018
[downloader/dash] Improve 'combine_url' ( fixes #6341 )
...
In some videos the base_url already ends with '/'.
2015-07-23 12:09:30 +02:00
2ee8f5d80f
Merge remote-tracking branch 'yan12125/download-dash-segments' ( #5886 )
2015-07-20 19:34:24 +02:00
6c4d20cd6f
[downloader/external] Fix externals downloaders specified with extension on Windows
2015-06-28 00:08:52 +06:00
906e2f0eac
[downloader/external] Add downloader for httpie ( closes #6079 )
2015-06-25 15:48:04 +02:00
5bf3276e8d
[downloader/dash] Add testing facility
2015-06-10 14:45:54 +08:00
93dfcb9357
[downloader/dash] Do not pollute ```self```
2015-06-10 13:44:54 +08:00
423d2be5f8
[downloader/dash] Rename the protocol
...
'http_dash_segments' looks more like a protocol name than
'dash_segments'
2015-06-04 22:27:29 +08:00
453a1617aa
[downloader/dash] Reorder imports
2015-06-04 22:12:05 +08:00
b9258c6178
[YoutubeDL] Change how DashSegmentsFD is selected
2015-06-04 22:05:33 +08:00
6800d3372f
[YoutubeDL] Support DASH manifest downloading
2015-06-03 23:10:18 +08:00
156fc83a55
[downloader/rtmp] Fix a typo
2015-05-08 03:11:24 +08:00
233c1c0e76
[downloader/f4m] Fragment filenames must be sanitized
...
because the fragment was written to a file with a sanitized name by
http_dl.download()
2015-05-03 11:31:42 +03:00
2ddcd88129
Remove code that was only used by the Grooveshark extractor
2015-05-02 17:29:56 +02:00
74f8654a53
[downloader/external] Use encodeArgument
2015-04-26 04:33:43 +06:00
9e105a858c
[downloader/rtmp] Fix arguments encoding and simplify retry logic ( Closes #5528 )
2015-04-26 04:32:54 +06:00
cd8a07a764
[downloader/common] Use decodeArgument
2015-04-26 04:30:45 +06:00
a5ebf77d87
[mplayer] Rename to RTSP
2015-04-26 00:25:51 +06:00
b874495b1f
[mplayer] Simplify
2015-04-26 00:23:16 +06:00
b860f5dfd4
[mplayer] Clarify error message
2015-04-26 00:22:13 +06:00
db37e0c273
Added support for mpv if mplayer is not available
2015-04-24 20:50:34 +02:00
c6391cd587
[Senate] Add new extractor ( #5302 )
2015-04-21 02:29:56 +08:00
c59e701e35
Default to continuedl=True
...
We already do this in the CLI interface, so it should be just fine.
2015-03-28 08:11:39 +01:00
70a1165b32
Don't use bare 'except:'
...
They catch any exception, including KeyboardInterrupt, we don't want to catch it.
2015-03-27 13:02:20 +01:00
43d6280d0a
[downloader/f4m] Fix use of base64 in python 3.2 ( fixes #5132 )
...
b64decode needs a byte string, but on 3.4 it also accepts strings.
2015-03-08 18:25:11 +01:00
f28fe66970
[downloader/http] Add missing fields for _hook_progress call
...
It would fail if you run 'youtube-dl --no-part URL' a second time when the file has already been downloaded.
(Reported in Fedora: https://bugzilla.redhat.com/show_bug.cgi?id=1195779 )
2015-03-04 12:14:38 +01:00
123397317c
[downloader/http] Remove wrong '_hook_progress' call ( fixes #5117 )
2015-03-03 18:45:56 +01:00
c75f0b361a
[downloader/external] Add support for custom options ( Fixes #4885 , closes #5098 )
2015-03-02 18:21:31 +01:00
2a15a98a6a
[rmtp] Encode filename before invoking subprocess
...
This fixes #5066 .
Reproducible with
LC_ALL=C youtube-dl "http://www.prosieben.de/tv/germanys-next-topmodel/video/playlist/ganze-folge-episode-2-das-casting-in-muenchen "
2015-02-26 01:44:20 +01:00
5eaaeb7c31
[f4m] Tolerate missed fragments on live streams
2015-02-24 21:22:59 +02:00
c4f8c453ae
[f4m] Refresh fragment list periodically on live streams
2015-02-24 21:22:59 +02:00
8fb3ac3649
PEP8: W503
2015-02-21 14:55:13 +01:00
09ab40b7d1
Merge branch 'progress-as-hook2'
2015-02-17 23:41:48 +01:00
a91a2c1a83
[downloader] Remove various unneeded assignments and imports
2015-02-17 21:44:41 +01:00
16e7711e22
[downloader/http] Remove gruesome import
2015-02-17 21:42:31 +01:00
5cda4eda72
[YoutubeDL] Use a progress hook for progress reporting
...
Instead of every downloader calling two helper functions, let our progress report be an ordinary progress hook like everyone else's.
Closes #4875 .
2015-02-17 21:40:35 +01:00
8ac27a68e6
[hls] Switch to available as a property
2015-02-17 17:35:03 +01:00
fbc503d696
[downloader/hls] Fix detection of ffmpeg/avconv (reported in #4966 )
2015-02-17 16:40:42 +01:00
163d966707
[downloader/external] curl: Add the '--location' flag
...
curl doesn't follow redirections by default
2015-02-17 16:21:02 +01:00
85729c51af
[downloader] Add --hls-prefer-native to use the native HLS downloader ( #4966 )
2015-02-17 12:09:12 +01:00
73fac4e911
[ffmpeg] Add --ffmpeg-location
2015-02-16 04:05:53 +01:00
cc9ca3ba6e
[downloader/external] Simplify source_address
...
'' might actually be passed in, so check for None.
2015-02-02 20:33:25 +01:00
ae7773942e
[downloader/external] Simplify
2015-02-02 21:51:38 +06:00
469a64cebf
[downloader/external] Simplify
2015-02-02 21:40:52 +06:00
6a66904f8e
passing source address option to external downloaders
2015-02-02 20:51:40 +05:30
1283204917
[http] PEP8 ( #4831 )
2015-02-02 12:05:39 +01:00
6789defea9
Merge pull request #4831 from light94/master
...
Handling Connection Reset by Peer Error
2015-02-02 12:03:28 +01:00
4a3da4ebdb
[hls] Simplify
2015-02-01 23:54:38 +06:00
027008b14e
[hls] Fix encode issues on python2 @ Windows
2015-02-01 23:49:23 +06:00
e77d2975af
Handling Connection Reset by Peer Error
2015-02-01 00:10:58 +05:30
e41b1f7385
Fix flake8 errors
2015-01-31 10:51:39 +01:00
d543bdc351
[downloader/f4m] Clarify that we should eventually just implement the DRM scheme ( #3000 )
2015-01-30 16:06:55 +01:00
c7ff0c6422
Merge remote-tracking branch 'rzhxeo/f4m-drm'
2015-01-30 16:00:47 +01:00
7bb3ceb4c7
[dctp] prefix real_time parameter with rtmp_
2015-01-30 00:47:43 +01:00
0865f397ae
added extractor for dctp.tv
2015-01-28 08:21:04 +01:00
6ca85be6f8
Filter DRM protected media in f4m downloader
2015-01-26 20:44:48 +01:00
3dee7826e7
[rtl2] PEP8, simplify, make rtmp tests run ( #470 )
2015-01-25 18:09:48 +01:00
d4f64cabf4
Merge remote-tracking branch 'David-Development/rtl2.py'
2015-01-25 17:55:31 +01:00
881e6a1f5c
Add --xattr-set-filesize option ( Fixes #1348 )
2015-01-25 04:49:44 +01:00
7906d199a1
[rtl2] Add new extractor
2015-01-25 00:07:15 +01:00
e5660ee6ae
[YoutubeDL] Fill the info dict 'http_headers' field with all the headers available
...
Useful for external tools using the json output.
The methods '_calc_headers' and '_calc_cookies' have been copied from the downloader/external, now they just use "info_dict['http_headers']".
2015-01-24 18:56:04 +01:00
587a9c2749
[downloader/external] Use the 'http_headers' field
2015-01-24 18:25:09 +01:00
e1554a407d
[extractors] Use http_headers for setting the User-Agent and the Referer
2015-01-24 18:23:53 +01:00
3fcfb8e9fa
[utils] YoutubeDLHandler: don't use 'Youtubedl-user-agent' for overriding the default user agent
...
Setting the 'User-Agent' header is enough
2015-01-24 18:07:21 +01:00
384b62028a
[downloader/external] Add curl and aria2c ( Closes #182 )
2015-01-24 13:33:45 +01:00
222516d97d
[downloader] Lay groundwork for external downloaders.
...
This comes with a very simply implementation for wget; the real work is in setting up the infrastructure.
2015-01-24 01:38:48 +01:00
a055469faf
[downloader] Improve downloader selection
2015-01-23 23:50:31 +01:00
bf7fa94ec7
[downloader/f4m] build_fragments_list: Support videos with more than 1 segment
2015-01-23 16:31:52 +01:00
5f0d813d93
Merge remote-tracking branch 'rupertbaxter2/master'
...
Conflicts:
youtube_dl/__init__.py
youtube_dl/downloader/common.py
2015-01-23 12:05:01 +01:00
remitamine
Yen Chi Hsuan
Sergey M․
Jaime Marquínez Ferrándiz
ashutosh-mishra
AndroKev
vijayanand nandam
Antti Ajanki
mrkrossxdx
Philipp Hagemeister
light94
Paul Hartmann
rzhxeo
David-Development