Commit Graph

10041 Commits

Author SHA1 Message Date
Yen Chi Hsuan e8f20ffa03
[vine] Make sure the title won't be empty
And fix a relevant TwitterCard test case
2017-07-11 16:05:15 +08:00
Yen Chi Hsuan 9be31e771c
[twitter] Support HLS streams in vmap URLs 2017-07-11 15:48:48 +08:00
Yen Chi Hsuan 7f176ac477
[periscope] Support pscp.tv URLs in embedded frames
And fix a relevant twitter test
2017-07-11 15:35:19 +08:00
Yen Chi Hsuan 2edfd745df [twitter] Extract mp4 urls via mobile API (closes #12726) 2017-07-11 15:19:36 +08:00
Yen Chi Hsuan bb13949197 [niconico] Check login errors (#12486) 2017-07-11 15:03:11 +08:00
Yen Chi Hsuan c3c94ca4a4
[giantbomb] Extract m3u8 formats (closes #13626) 2017-07-10 21:34:27 +08:00
Sergey M․ e3cd1fcdd1
[vlive:playlist] Relax and simplify 2017-07-10 04:32:24 +07:00
coreynicholson b71c18b434 [vlive:playlist] Add extractor 2017-07-10 04:24:04 +07:00
Sergey M․ 7bf539edcc
[eagleplatform] Fix test 2017-07-10 00:14:41 +07:00
Sergey M․ 71a1db8919
[dailymail] Add support for embeds 2017-07-09 20:06:24 +07:00
Sergey M․ 6e925598d6
[csjw] Add coding cookie 2017-07-09 19:18:12 +07:00
Sergey M․ 73cf76a93f
[joj] Rewrite and add support for generic embeds (closes #13268) 2017-07-09 19:17:54 +07:00
luboss 256a746d21
[joj] Add extractor 2017-07-09 19:17:38 +07:00
Sergey M․ 58179eb7d9
[abc.net.au:iview] Extract more formats (closes #13492, closes #13489) 2017-07-09 17:55:40 +07:00
Sergey M․ 485cb37576
[egghead:course] Improve (closes #13370) 2017-07-09 17:30:49 +07:00
Santiago Calcagno ed84454d35
[egghead:course] Fix extraction 2017-07-09 17:30:25 +07:00
Sergey M․ 0d2f0b0357
[csjw] Make description optional 2017-07-09 17:05:11 +07:00
Sergey M․ c319d1c483
[csjw] Fix issues and improve extraction (closes #13525) 2017-07-09 17:01:05 +07:00
Christopher Smith d2b9f362fa
[cjsw] Add extractor 2017-07-09 17:01:00 +07:00
Sergey M․ 4328ddf82b
[extractor/common] Add support for AMP tags in _parse_html5_media_entries 2017-07-09 16:29:52 +07:00
Sergey M․ 250b042c7e
[generic] Add tests for #13557 2017-07-09 16:02:38 +07:00
Sergey M․ 665e945246
[eagleplatform] Add support for referrer protected videos (closes #13557) 2017-07-09 15:57:58 +07:00
Sergey M․ 5af2fd7fa0
[eagleplatform] Add support for another embed pattern (#13557) 2017-07-09 15:55:04 +07:00
mlindner 15237fcd51 [veoh] Extend _VALID_URL 2017-07-09 14:54:52 +07:00
rrooij 7a57730907 [npo:live] Fix live stream id extraction (closes #13568) 2017-07-09 14:21:40 +07:00
Sergey M․ 8b347a389e
[googledrive] Fix height extraction (closes #13603) 2017-07-09 00:26:13 +07:00
Sergey M․ a49804816c
[dailymotion] Add support for new layout (close #13580) 2017-07-08 18:12:15 +07:00
Yen Chi Hsuan eadd313321
[yam] Remove extractor
mymedia.yam.com is dead. An wikipedia user also pointed out that Yam's
blog service is no longer available. [1]

[1] https://zh.wikipedia.org/zh-tw/%E5%A4%A9%E7%A9%BA%E9%83%A8%E8%90%BD
2017-07-08 15:48:05 +08:00
Sergey M․ d852c6bc59
[xhamster] Extract all formats and fix duration extraction (#13593) 2017-07-07 22:49:11 +07:00
Sergey M․ 00e5c36315
[xhamster] Add support for new URL schema (closes #13593) 2017-07-07 22:27:34 +07:00
Parmjit Virk 60d4401c5e [espn] Extend _VALID_URL (fixes #13244) 2017-07-06 22:55:59 +07:00
Sergey M․ 6554708252
[kaltura] Fix typo in subtitles extraction (closes #13569) 2017-07-05 23:20:50 +07:00
Sergey M․ 0a2e1b2e30
[vier] Adapt extraction to redesign (#13575) 2017-07-05 22:52:47 +07:00
Yen Chi Hsuan babbc04d45 [xuite] Move to the new HTML5 API and reduce # of requests 2017-07-05 23:27:12 +08:00
Sergey M․ 50ae3f646e
[thisoldhouse] Add more fallbacks for video id (closes #13541) 2017-07-02 20:06:15 +07:00
Parmjit Virk 99a7e76240
[thisoldhouse] Update test 2017-07-02 20:05:11 +07:00
Parmjit Virk a3a6d01a96
[thisoldhouse] Fix video id extraction (closes #13540) 2017-07-02 20:04:51 +07:00
Sergey M․ 02d61a65e2
[xfileshare] Extend format regex (closes #13536) 2017-07-02 08:00:22 +07:00
Sergey M․ 9b35297be1
[extractors] Add import for tastytrade 2017-07-01 18:39:29 +07:00
Sergey M․ 4917478803
[ted] Fix extraction (closes #13535)) 2017-07-01 18:39:01 +07:00
Sergey M․ 54faac2235
[tastytrade] Add extractor (closes #13521) 2017-06-30 22:20:30 +07:00
Sergey M․ c69701c6ab
[extractor/common] Improve _json_ld 2017-06-30 22:19:06 +07:00
Sergey M․ d4f8ce6e91
[dplayit] Relax video id regex (closes #13524) 2017-06-30 21:55:45 +07:00
Sergey M․ b311b0ead2
[generic] Extract more generic metadata (closes #13527) 2017-06-30 21:42:04 +07:00
Sergey M․ 72d256c434
[bbccouk] Extend _VALID_URL 2017-06-29 22:29:28 +07:00
Sergey M․ b2ed954fc6
[bbccouk] Capture and output error message (closes #13518) 2017-06-29 22:27:53 +07:00
Sergey M․ a919ca0ad6
[cbsnews] Actualize test 2017-06-28 22:30:12 +07:00
Parmjit Virk 88d6b7c2bd [cbsnews] Relax video info regex (fixes #13284) 2017-06-28 22:21:35 +07:00
Sergey M․ fd1c5fba6b
[facebook] Add test for plugin video embed (#13493) 2017-06-27 22:38:59 +07:00
Sergey M․ 0646e34c7d
[facebook] Add support for plugin video embeds and multiple embeds (closes #13493) 2017-06-27 22:38:54 +07:00
Sergey M․ bf2dc9cc6e
[soundcloud] Fix tests 2017-06-27 21:26:46 +07:00
Viktor Szakats f1c051009b [soundcloud] Switch to https for API requests 2017-06-27 21:20:18 +07:00
Sergey M․ 33ffb645a6
[pandatv] Switch to https for API and download URLs 2017-06-26 22:11:09 +07:00
Xuan Hu (Sean) 35544690e4 [pandatv] Add support for https URLs 2017-06-26 22:00:31 +07:00
Luca Steeb 4a87de72df [niconico] fix sp subdomain links 2017-06-25 21:30:05 +02:00
Sergey M․ 0c7a631b61
[adobepass] Add support for ATTOTT MSO (DIRECTV NOW) (closes #13472) 2017-06-25 05:03:17 +07:00
Sergey M․ fd9ee4de8c
[wsj] Add support for barrons.com (closes #13470) 2017-06-25 02:15:35 +07:00
Argn0 5744cf6c03 [ign] Add another video id pattern (closes #13328) 2017-06-25 01:59:15 +07:00
Sergey M․ 9c48b5a193
[raiplay:live] Improve and add test (closes #13414) 2017-06-25 01:49:27 +07:00
james 449c665776
[raiplay:live] Add extractor 2017-06-25 01:48:54 +07:00
Sergey M․ 23aec3d623
[redbulltv] Restore hls format prefix 2017-06-25 01:10:31 +07:00
Sergey M․ 27449ad894
[redbulltv] Add support for lives and segments (closes #13486)) 2017-06-25 01:09:12 +07:00
Sergey M․ bd65f18153
[onetpl] Add support for videos embedded via pulsembed (closes #13482) 2017-06-24 18:33:31 +07:00
Sergey M․ b5f523ed62
[ooyala] Add test for missing stream['url']['data'] 2017-06-23 20:56:48 +07:00
Sergey M․ 4f4dd8d797
[ooyala] Make more robust 2017-06-23 20:56:21 +07:00
Sergey M․ 4cb18ab1b9
[ooyala] Skip empty format URLs (closes #13471, closes #13476) 2017-06-23 20:50:48 +07:00
Sergey M․ ac7409eec5
[hgtv.com:show] Fix typo 2017-06-23 02:54:12 +07:00
Sergey M․ ddbb4c5c3e
[youtube] Adapt to new automatic captions rendition (closes #13467) 2017-06-23 02:00:19 +07:00
Sergey M․ fa3ea7223a
[hgtv.com:show] Relax video config regex and update test (closes #13279, closes #13461) 2017-06-23 00:42:42 +07:00
Parmjit Virk 0f4a5a73e7 [drtuber] Fix formats extraction (fixes 12058) 2017-06-23 00:08:36 +07:00
Sergey M․ 18166bb8e8
[youporn] Fix upload date extraction 2017-06-22 00:47:02 +07:00
Sergey M․ d4893e764b
[youporn] Improve formats extraction 2017-06-22 00:40:15 +07:00
Sergey M․ 97b6e30113
[youporn] Fix title extraction (closes #13456) 2017-06-22 00:20:45 +07:00
Sergey M․ 9be9ec5980
[googledrive] Fix formats' sorting (closes #13443) 2017-06-20 22:58:33 +07:00
Giuseppe Fabiano 048b55804d [watchindianporn] Fix extraction (closes #13411) 2017-06-20 04:30:45 +07:00
Giuseppe Fabiano 6ce79d7ac0 [abcotvs] Fix test md5 2017-06-20 04:07:00 +07:00
Sergey M․ 1641ca402d
[vimeo] Add fallback mp4 extension for original format 2017-06-20 01:27:59 +07:00
Sergey M․ 85cbcede5b
[ruv] Improve, extract all formats and metadata (closes #13396) 2017-06-19 23:46:03 +07:00
Orn a1de83e5f0
[ruv] Add extractor 2017-06-19 23:45:45 +07:00
Sergey M․ fee00b3884
[viu] Fix extraction on older python 2.6 2017-06-19 22:57:37 +07:00
Sergey M․ 2d2132ac6e
[adobepass] Fix extraction on older python 2.6 2017-06-19 22:54:53 +07:00
Yen Chi Hsuan cc2ffe5afe
[pandora.tv] Fix upload_date extraction (closes #12846) 2017-06-19 16:20:36 +08:00
Sergey M․ 560050669b
[asiancrush] Add extractor (closes #13420) 2017-06-18 20:18:51 +07:00
Jakub Adam Wieczorek b230fefc3c [polskieradio] Fix extraction 2017-06-16 04:57:56 +07:00
Sergey M․ 96a2daa1ee
[extractor/common] Improve jwplayer subtitles extraction 2017-06-15 23:40:39 +07:00
gfabiano 0ea6efbb7a [xfileshare] Add support for fastvideo.me 2017-06-15 21:41:49 +07:00
Yen Chi Hsuan 6a9cb29509
[extractor/common] Fix json dumping with --geo-bypass
The line "[debug] Using fake IP %s (%s) as X-Forwarded-For." was printed
to stdout even with -j/-J, which breaks the resultant JSON.
2017-06-15 13:04:36 +08:00
Yen Chi Hsuan ca27037171
[bilibili] Fix extraction of videos with double quotes in titles
Closes #13387
2017-06-15 11:19:03 +08:00
gfabiano 0bf4b71b75 [4tube] Fix extraction (closes #13381) 2017-06-15 04:16:50 +07:00
Marcin Cieślak 5215f45327 [disney] Add support for disneychannel.de 2017-06-15 04:13:04 +07:00
Sergey M․ 0a268c6e11
[extractor/common] Improve jwplayer formats extraction (closes #13379) 2017-06-14 22:02:15 +07:00
Sergey M․ 7dd5415cd0
[npo] Improve _VALID_URL (closes #13376) 2017-06-14 21:33:40 +07:00
Sergey M․ b5dc33daa9
[corus] Add support for showcase.ca 2017-06-13 23:27:27 +07:00
Sergey M․ 97fa1f8dc4
[corus] Add support for history.ca (closes #13359) 2017-06-13 23:16:21 +07:00
Sergey M․ bf87c36c93
[xfileshare] PEP 8 2017-06-12 02:01:12 +07:00
Sergey M․ 534863e057
[xfileshare] Add support for rapidvideo (closes #13348) 2017-06-12 00:16:47 +07:00
Sergey M․ 16bc958287
[xfileshare] Modernize and pass referrer 2017-06-12 00:14:04 +07:00
Sergey M․ 624bd0104c
[rutv] Add support for testplayer.vgtrk.com (closes #13347) 2017-06-11 21:36:19 +07:00
Sergey M․ 28a4d6cce8
[newgrounds] Extract more metadata (closes #13232) 2017-06-11 21:30:06 +07:00
Sergey M․ 70e7967202
[newgrounds:playlist] Add extractor (closes #10611) 2017-06-11 20:50:55 +07:00
Sergey M․ 6e999fbc12
[newgrounds] Improve formats and uploader extraction (closes #13346) 2017-06-11 19:44:44 +07:00
Sergey M․ 7409af9eb3
[msn] Fix formats extraction 2017-06-11 08:56:53 +07:00
Sergey M․ 4e3637034c
[extractor/generic] Ensure format id is unicode string 2017-06-10 23:56:20 +07:00
Sergey M․ 1afd0b0da7
[extractor/common] Return unicode string from _match_id 2017-06-09 00:40:03 +07:00
Sergey M․ 7515830422
[turbo] Ensure format id is string 2017-06-09 00:31:56 +07:00
Sergey M․ f5521ea209
[sexu] Ensure height is int 2017-06-09 00:30:23 +07:00
Sergey M․ 34646967ba
[jove] Ensure comment count is int 2017-06-09 00:29:20 +07:00
Sergey M․ e4d2e76d8e
[golem] Ensure format id is string 2017-06-09 00:27:11 +07:00
Sergey M․ 87f5646937
[gfycat] Ensure filesize is int 2017-06-09 00:24:23 +07:00
Sergey M․ cc69a3de1b
[foxgay] Ensure height is int 2017-06-09 00:22:14 +07:00
Sergey M․ 15aeeb1188
[flickr] Ensure format id is string 2017-06-09 00:20:07 +07:00
Sergey M․ 1693bebe4d
[sohu] Fix numeric fields 2017-06-09 00:16:42 +07:00
Sergey M․ 4244a13a1d
[safari] Improve authentication detection (closes #13319) 2017-06-08 23:20:48 +07:00
Sergey M․ 931adf8cc1
[liveleak] Ensure height is int (closes #13313) 2017-06-08 22:54:30 +07:00
Sergey M․ 1508da30c2
[streamango] Skip download for test (closes #13292) 2017-06-07 21:53:40 +07:00
Luca Steeb eb703e5380
[streamango] Make title optional 2017-06-07 21:53:33 +07:00
Sergey M․ 0a3924e746
[rtlnl] Improve _VALID_URL (closes #13295) 2017-06-06 21:21:44 +07:00
Sergey M․ e1db730d86
[tvplayer] Fix extraction (closes #13291) 2017-06-06 00:13:57 +07:00
Sergey M․ 6d923aab35
[bandcamp:weekly] Improve and extract more metadata (closes #12758) 2017-06-04 23:21:30 +07:00
Adam Voss 62bafabc09
[bandcamp:weekly] Add extractor 2017-06-04 23:21:07 +07:00
Sergey M․ 9edcdac90c
[pornhub:uservideos] Add missing raise 2017-06-04 20:39:55 +07:00
Sergey M․ cd138d8bd4
[pornhub:playlist] Fix extraction (closes #13281) 2017-06-04 15:54:19 +07:00
Sergey M․ cd750b731c
[godtv] Remove extractor (closes #13175) 2017-06-03 22:08:12 +07:00
Sergey M․ f129c3f349
[safari] Fix typo (closes #13252) 2017-06-02 01:03:51 +07:00
Sergey M․ 39d4c1be4d
[youtube] Improve chapters extraction (closes #13247) 2017-06-01 23:29:45 +07:00
Sergey M․ f7a747ce59
[1tv] Lower preference for http formats (closes #13246) 2017-06-01 22:19:52 +07:00
Sergey M․ 4489d41816
[francetv] Relax _VALID_URL 2017-06-01 00:15:15 +07:00
Sergey M․ 87b5184a0d
[drbonanza] Fix extraction (closes #13231) 2017-05-31 23:56:32 +07:00
Remita Amine c56ad5c975 [packtpub] Fix authentication(closes #13240) 2017-05-31 15:44:29 +01:00
Yen Chi Hsuan a49eccdfa7
[youtube] Parse player_url if format URLs are encrypted or DASH MPDs are requested
Fixes #13211
2017-05-28 20:20:20 +08:00
Sergey M․ a846173d93
[xhamster] Simplify (closes #13216) 2017-05-28 07:55:56 +07:00
fiocfun 78e210dea5
[xhamster] Fix author and like/dislike count extraction 2017-05-28 07:55:07 +07:00
Sergey M․ 8555204274
[xhamster] Extract categories (closes #11728) 2017-05-28 07:50:15 +07:00
Sergey M․ 164fcbfeb7
[abcnews] Improve and remove duplicate test (closes #12851) 2017-05-28 07:06:56 +07:00
Tithen-Firion bc22df29c4
[abcnews] Add support for embed URLs 2017-05-28 07:06:29 +07:00
Sergey M․ 7e688d2f6a
[gaskrank] Improve (closes #12493) 2017-05-28 06:47:38 +07:00
motophil 5a6d1da442
[gaskrank] Fix extraction 2017-05-28 06:47:30 +07:00
Sergey M․ 703751add4
[medialaan] PEP 8 (closes #12774) 2017-05-28 06:27:57 +07:00
midas02 4050be78e5
[medialaan] Fix videos with missing videoUrl
A rough trick to get around the two different json styles medialaan seems to be using.
Fix for these example videos:
https://vtmkzoom.be/video?aid=45724
https://vtmkzoom.be/video?aid=45425
2017-05-28 06:27:52 +07:00
Sergey M․ 4d9fc40100
[dvtv] Improve and fix playlists support (closes #13063) 2017-05-28 06:19:54 +07:00
Jan Kundrát 765522345f
[dvtv] Parse adaptive formats as well
The old code hit an error when it attempted to parse the string
"adaptive" for video height. Actually parsing the returned playlists is
a good idea because it adds more output formats, including some
audio-only-ones.
2017-05-28 06:19:46 +07:00
Sergey M․ 6bceb36b99
[beam] Improve and add support for mixer.com (closes #13032) 2017-05-28 05:43:04 +07:00
Mike Fährmann 1e0d65f0bd
[beam:vod] Add extractor 2017-05-28 05:42:23 +07:00
Sergey M․ 03327bc9a6
[cbsinteractive] Relax _VALID_URL (closes #13213) 2017-05-27 22:37:24 +07:00
Remita Amine 20e2c9de04 [adn] fix formats extraction 2017-05-26 20:00:44 +01:00
Yen Chi Hsuan d16c0121b9
[youku] Extract more metadata (closes #10433) 2017-05-27 00:08:37 +08:00
Sergey M․ 7f4c3a7439
[cbsnews] Fix extraction (closes #13205) 2017-05-26 22:42:27 +07:00
Yen Chi Hsuan fd545fc6d1
Revert "[youtube] Don't use the DASH manifest from 'get_video_info' if 'use_cipher_signature' is True (#5118)"
This reverts commit 87dc451108.
2017-05-26 23:22:54 +08:00
Sergey M․ 97067db2ae
[bbc] Add support for authentication 2017-05-26 22:12:24 +07:00
Yen Chi Hsuan c130f0a37b
[tudou] Merge into youku extractor (fixes #12214)
Also, there are no tudou playlists anymore. All playlist URLs points to youku
playlists.
2017-05-26 23:04:42 +08:00