cb655f34fb
[utils] Add more date formats
2017-01-12 22:39:45 +07:00
7fe1592073
[common] fix dash codec information for mixed videos and fragment url construction( #11490 )
2016-12-20 12:35:03 +01:00
b0c65c677f
[utils] Improve urljoin
2016-12-17 18:49:55 +07:00
e34c33614d
[utils] Add convenience urljoin
2016-12-13 02:23:49 +07:00
582be35847
Update coding style after pycodestyle 2.1.0
...
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.
See https://github.com/PyCQA/pycodestyle/issues/400
See also #10689 ; thanks @stepshal for first mentioning this issue and
initial patches
2016-11-17 19:45:42 +08:00
189935f159
[jsinterp] Fix function calls without arguments.
2016-11-11 15:36:57 +01:00
02dc0a36b7
[utils] Introduce base_url
2016-11-02 02:30:18 +07:00
e5a088dc4b
[utils] Fix --match-filter for int-like strings ( closes #11082 )
2016-10-31 23:32:08 +07:00
6f20b65e72
[test/test_http] Update tests
...
After switching to HTML5 extraction helpers in generic.py, the result
info_dict is always a playlist.
2016-10-12 01:41:41 +08:00
c6eed6b8c0
[utils] Lower priority for rare date formats and add tests
2016-09-29 23:52:29 +07:00
3e4185c396
[utils] Use native french month names
2016-09-14 23:59:38 +07:00
f6717dec8a
[utils] Improve month_by_name and add tests
2016-09-14 23:59:38 +07:00
6562d34a8c
[utils] Improve mimetype2ext
2016-09-02 22:57:48 +07:00
70852b47ca
[utils] Recognize units with full names in parse_filename
...
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
2016-08-20 00:17:26 +08:00
e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json
2016-08-19 20:37:17 +08:00
13585d7682
[utils] Recognize lowercase units in parse_filesize
2016-08-18 23:32:00 +07:00
52aa7e7476
[test_verbose_output] Fix tests under Python 3
2016-08-13 17:36:14 +08:00
5f2c2b7936
[test_utils] add test for option with not str value
2016-08-13 09:54:12 +01:00
a8795327ca
[utils] Add support TV Parental Guidelines ratings in parse_age_limit
2016-08-07 20:45:18 +07:00
7dc2a74e0a
[utils] Fix unified_timestamp for formats parsed by parsedate_tz()
2016-08-05 11:41:55 +08:00
b070564efb
[extractor/common] Support multiple properties in _og_search_property
2016-08-02 22:55:14 +07:00
ce28252c48
[options] Add test that checks that --password=secret is hidden in verbose output
2016-08-02 17:03:46 +02:00
14a28e705b
[test/test_all_urls] Remove *.cc.com tests
2016-07-26 11:08:09 +08:00
317f7ab634
[YoutubeDL] Fix format selection with filters ( Closes #10083 )
2016-07-16 00:55:43 +07:00
0b68de3cc1
Merge pull request #8876 from remitamine/html5_media
...
[extractor/common] add helper method to extract html5 media entries
2016-07-10 23:40:45 +08:00
dfe5fa49ae
[compat] Fix compat_shlex_split for non-ASCII input
...
Closes #9871
2016-07-07 17:37:29 +08:00
84c237fb8a
[utils] Add get_element_by_class
...
For #9950
2016-07-06 20:02:52 +08:00
dfaa86b75e
[test_utils] add test for smuggling a smuggled url
2016-07-04 21:36:32 +01:00
40f3666f6b
[test/test_http] Update tests for 38cce791c7
2016-07-03 23:50:55 +08:00
a9eede3913
[test/compat] compat_shlex_split: test with newlines
2016-07-01 03:30:35 +07:00
fd7a7498a4
[test_all_urls] PEP 8 and change wording
2016-06-27 22:11:45 +07:00
e3a6747d8f
New test-case: extractor names are supposed to be unique
...
@dstftw explained in
https://github.com/rg3/youtube-dl/pull/9918#issuecomment-228625878 that
extractor names are supposed to be unique. @dstftw has fixed the two
offending extractors, and here I add a test to ensure this does not
happen in the future.
2016-06-27 22:09:29 +07:00
4f3c5e0627
[utils] add helper function for parsing codecs
2016-06-26 14:03:58 +01:00
88d9f6c0c4
[utils] Add support for name list in _html_search_meta
2016-06-26 16:57:14 +07:00
1143535d76
[utils] Add urshift()
...
Used in IqiyiIE and LeIE
2016-06-26 15:16:49 +08:00
46f59e89ea
[utils] Add unified_timestamp
2016-06-25 23:19:18 +07:00
47212f7bcb
[utils] Don't transform numbers not starting with a zero
...
Fix test_Viidea and maybe others
2016-06-16 11:00:54 +08:00
55b2f099c0
[utils] Decode HTML5 entities
...
Used in test_Vporn_1. Also related to #9270
2016-06-10 15:11:55 +08:00
b96f007eeb
Added sanitization support for Hungarian letters Ő and Ű
2016-06-02 11:39:32 +02:00
54fb199681
[test/test_http] Fix getsockname() on Jython
2016-06-02 15:00:49 +08:00
8c32e5dc32
[test/test_utils] Add test for #9588
2016-06-02 15:00:49 +08:00
eb7941e3e6
[compat] Fix for XML with <!DOCTYPE> in Python 2.7 and 3.2
...
Such XML documents cause DeprecationWarning if python is run
with `-W error`
2016-05-23 01:40:11 +08:00
46bc9b7d7c
[utils] Allow None in remove_{start,end}
2016-05-19 04:31:30 +06:00
364cf465dd
[test_utils] PEP 8
2016-05-14 20:46:33 +06:00
89ac4a19e6
[utils] Process non-base 10 integers in js_to_json
2016-05-14 20:39:58 +06:00
bd1e484448
[utils] js_to_json: various improvements
...
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
2016-05-14 20:12:39 +06:00
98d560f205
[test/test_socks] Skip SOCKS tests
...
They occasional trigger errors or blocks
(https://travis-ci.org/rg3/youtube-dl/jobs/130184883 )
2016-05-14 18:48:36 +08:00
778a1ccca7
[utils] Add Œ and œ found in French to ACCENT_CHARS
...
Fixes #9463
2016-05-12 19:48:48 +08:00
c2876afafe
[test/test_socks] Use a different port range
...
Seems on Travis CI, ports in the original range are often used.
2016-05-10 14:51:38 +08:00
e21f17fc86
[test/test_socks] Test with local SOCKS servers
2016-05-10 14:51:38 +08:00
edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack
2016-05-10 14:51:38 +08:00
72f3289ac4
[test/test_socks] Add tests for SOCKS proxies
2016-05-10 14:51:38 +08:00
dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py
2016-05-10 14:51:38 +08:00
fad7bbec3a
[test_compat] Remove unused import
2016-05-09 22:15:55 +06:00
20cfdcc910
[test_compat] Avoid None values for compat_setenv
2016-05-09 22:00:14 +06:00
1292638754
[test_compat] Use compat_setenv
2016-05-09 21:58:38 +06:00
fe40f9eef2
[compat] Add compat_setenv
2016-05-09 21:55:03 +06:00
31c4448f6e
Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347
2016-05-02 13:25:12 +10:00
79a2e94e79
Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347
2016-05-02 13:21:39 +10:00
b6c0d4f431
Merge pull request #9110 from remitamine/parse_duration
...
[utils] imporove parse_duration to handle more formats
2016-04-21 22:53:16 +07:00
acaff49575
[utils] imporove parse_duration to handle more formats
2016-04-21 16:34:54 +01:00
1b6182d8f7
[youtube:playlist] Fetch all the videos in a mix ( fixes #3837 )
...
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
2016-04-17 17:07:57 +02:00
6a801f4470
[test/InfoExtractors] add test for _download_json
2016-04-09 23:18:41 +02:00
eb9c3edd5e
[test/utils] Add test for date_from_str
2016-04-09 22:40:05 +02:00
6c4c7539f2
[test/helper] Check got values to be strings for md5: fields
...
Seen in PBSIE tests
2016-04-09 22:04:48 +08:00
92d5477d84
[compat] Handle tuples properly in urlencode()
...
Fixes #9055
2016-04-06 18:29:54 +08:00
e289d6d62c
[test_compat] Add tests for compat_urllib_parse_urlencode
2016-03-26 02:38:33 +06:00
81f36eba88
[test/test_utils] Update for escape_url change (again)
2016-03-23 23:23:26 +08:00
2d60465e44
[test/test_utils] Update for escape_url change
2016-03-23 23:20:28 +08:00
efbed08dc2
[utils] Encode hostnames before passing to urllib
...
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError
Fixes #8890
2016-03-23 22:24:52 +08:00
782b1b5bd1
[utils] lookup_unit_table: Match word boundary instead of end of string
2016-03-19 11:44:49 +01:00
4c3b16d5d1
[test_YoutubeDL] Add test for format_id format selection
2016-03-19 00:04:26 +06:00
c5229f3926
[utils] PEP 8
2016-03-16 21:50:04 +06:00
83548824c2
Merge pull request #8092 from bpfoley/twitter-thumbnail
...
[utils] Add extract_attributes for extracting html tag attributes
2016-03-16 13:16:27 +01:00
fb47597b09
[bbc] Generalize unit table lookup and add parse_count
2016-03-13 16:27:20 +06:00
e0dccdd398
[test_YoutubeDL] PEP 8
2016-03-10 09:04:48 +06:00
5d583bdf6c
[YoutubeDL] Improve _format_note
2016-03-10 01:03:18 +06:00
1255733945
Merge pull request #8739 from remitamine/update_url_params
...
[utils] add update_url_query function to create or update query string params
2016-03-03 19:24:04 +01:00
3201a67f61
[test/test_utils] add more tests for update_url_query
2016-03-03 19:18:57 +01:00
fb640d0a3d
[test/test_utils] add tests for update_url_query
2016-03-03 18:40:05 +01:00
429491f531
[test/http] Fix failure in Jython
...
make offlinetest passed on the latest Jython hg version with patched
lib-python/2.7/urllib2.py pulled from CPython 2.7.11
2016-03-03 21:55:17 +08:00
e9c0cdd389
[jython] Introduce compat_os_name
...
os.name is always 'java' on Jython
2016-03-03 19:24:24 +08:00
8bb56eeeea
[utils] Add extract_attributes for extracting html tag attributes
...
This is much more robust than just using regexps, and handles all
the common scenarios, such as empty/no values, repeated attributes,
entity decoding, mixed case names, and the different possible value
quoting schemes.
2016-03-03 10:11:37 +00:00
5eb6bdced4
[utils] Multiple changes to base_n()
...
1. Renamed to encode_base_n()
2. Allow tables longer than 62 characters
3. Raise ValueError instead of AssertionError for invalid input data
4. Return the first character in the table instead of '0' for number 0
5. Add tests
2016-02-27 03:22:52 +08:00
f160785c5c
[utils] Remove AM/PM from unified_strdate patterns
2016-02-25 00:52:49 +06:00
a4e4d7dfcd
[test_iqiyi_sdk_interpreter] Add test for iQiyi login
2016-02-20 23:10:39 +08:00
5bc880b988
[utils] Add OHDave's RSA encryption function
2016-02-20 19:54:58 +08:00
86bf29050e
[test_YoutubeDL] Make test pass until more intelligent sort formats ( Closes #8462 )
2016-02-20 03:36:03 +06:00
8411229bd5
[utils] Allow dot in strip_jsonp
2016-02-07 19:47:09 +06:00
86296ad2cd
[utils] Add ability to control skipping false values in dict_get
2016-02-07 08:13:04 +06:00
cbecc9b903
[utils] Add dict_get convenience method
2016-02-07 06:12:53 +06:00
91cb6b5065
rename _parse_mpd to _parse_mpd_formats and add default value for mpd namespace
2016-02-06 14:03:48 +01:00
920d21b9d3
[test_subtitles] update youtube subtitles tests
2016-02-04 08:50:55 +01:00
1df4141196
[test_YoutubeDL] Fix test_youtube_format_selection
...
Broken since a6c2c24479
2016-02-03 03:42:37 +08:00
b286f201a8
[YoutubeDL] Do not override ie_key in url_transparent
2016-02-01 17:05:48 +08:00
189d72d5fd
[test_subtitles] Fix TestRaiSubtitles
...
RaiIE is renamed to RaiTVIE in 06d5556dfa
2016-01-31 20:12:43 +08:00
a7aab0c23e
[test_youtube_lists] Fix TestYoutubeLists.test_youtube_course
...
Youtube entries are now generators
2016-01-31 20:12:43 +08:00
70029bc348
[youtube:user] Require 'https?://' in the url ( fixes #8356 )
...
It was matching www.youtube.com/embed/WpfukLMe1TM.
The generic extractor automatically adds http:// if it's missing.
2016-01-29 11:27:11 +01:00
b913348d5f
Test codec with a dot '.' in name selection.
2016-01-28 15:07:33 +01:00
4d318be195
[update] fix (unexploitable) BB'06 vulnerability in rsa_verify
...
The rsa_verify code was vulnerable to a BB'06 attack, allowing to forge
signatures for arbitrary messages if and only if the public key exponent is
3. Since the updates key is hardcoded to 65537, there is no risk for
youtube-dl, but I don't want vulnerable code in the wild.
The new function adopts a way safer approach of encoding-and-comparing to
replace the dangerous parsing code.
2016-01-21 20:12:17 +00:00
Sergey M․
Remita Amine
Yen Chi Hsuan
Kacper Michajłow
Philipp Hagemeister
Jaime Marquínez Ferrándiz
Matthieu Muffato
bzc6p
felix
Adam Thalhammer
Brian Foley
dyn888
Filippo Valsorda