Commit Graph

14207 Commits

Author SHA1 Message Date
Sergey M․ 3052a30d42
Improve URL extraction 2018-07-21 19:08:28 +07:00
Sergey M․ 4ecf300d13
[iwara] Improve extraction 2018-07-21 18:03:58 +07:00
Sergey M․ af03000ad5
[utils] Introduce url_or_none 2018-07-21 18:03:58 +07:00
Remita Amine b96b4be461 [bbc] add support for BBC Radio Play pages(closes #17022) 2018-07-21 11:50:14 +01:00
Kazuma Takahara edb0e17188 [iwara] Fix download URLs (closes #17026) 2018-07-21 17:41:33 +07:00
Sergey M․ e9c671d5e8
[utils] Allow JSONP with empty func name (closes #17028) 2018-07-21 12:30:18 +07:00
Sergey M․ fd62b36680
[vrtnu] Relax title extraction and extract JSON-LD (closes #17018) 2018-07-20 02:39:20 +07:00
Sergey M․ 25586c601c
[theplatform] PEP 8
[ci skip]
2018-07-20 00:49:14 +07:00
Sergey M․ ecb6b6ae2d
[viu] Pass area id 2018-07-20 00:46:50 +07:00
Sergey M․ c258570edd
[viu] Pass Referer and Origin headers (closes #16992) 2018-07-20 00:01:43 +07:00
Sergey M․ 6fc09f0155
[vimeo] Add another config regex (closes #17013) 2018-07-19 23:15:27 +07:00
Sergey M․ 11330f5121
[facebook] Extract view count and update tests (closes #16942) 2018-07-19 02:26:05 +07:00
bato3 8da17f9680 [dailymotion] Improve description extraction (closes #16984) 2018-07-19 02:04:05 +07:00
Sergey M․ c63f5fb863
[slutload] Fix and improve extraction (closes #17001) 2018-07-19 01:59:00 +07:00
Remita Amine 38f1eb0ac3 [mediaset] fix extraction(closes #16977) 2018-07-18 18:34:04 +01:00
Remita Amine 371dcc1dd4 [theplatform] add support for theplatform Top-level domain customization(#16977) 2018-07-18 18:34:04 +01:00
Remita Amine bd21ead2a2 [extractor/common] add support for DASH and MSS formats extraction in SMIL manifests 2018-07-18 18:34:04 +01:00
Jakub Wilk 905eef2b06 [imgur] Allow digits in filename extension 2018-07-18 23:47:26 +07:00
Sergey M․ 79367a9820
[pornhub] Improve extraction and extract all formats (closes #12166, closes #15891, closes #16262, closes #16959) 2018-07-14 18:05:06 +07:00
Sergey M․ 40a051fa9f
release 2018.07.10 2018-07-10 02:09:51 +07:00
Sergey M․ 4b3ee09886
[nrktv] Add support for new season and serie URL schema 2018-07-10 00:27:24 +07:00
Sergey M․ 79fd7320e2
[nrktv] Add support for new episode URL schema (closes #16909) 2018-07-09 23:44:05 +07:00
Sergey M․ 0685d9727b
[utils] Share JSON-LD regex 2018-07-09 23:43:05 +07:00
Sergey M․ e06632e3fe
[downloader/dash] Improve error handling (#16927) 2018-07-08 08:22:56 +07:00
Sergey M․ 69fcdb845b
[frontendmasters] Fix issues and improve extraction (closes #3661, closes #16328) 2018-07-08 00:55:49 +07:00
Luca Cherubin 6868d272e5
[frontendmasters] Add extractor 2018-07-08 00:49:15 +07:00
Sergey M․ 4742150788
[funk] Fix extraction (closes #16918) 2018-07-06 23:50:02 +07:00
Sergey M․ 1ed0b2f74d
[watchbox] Fix extraction (closes #16904) 2018-07-05 02:22:15 +07:00
Sergey M․ e15141adae
[dplayit] Sort formats 2018-07-05 02:14:50 +07:00
Sergey M․ 94fef94d9c
[dplayit] Fix extraction (closes #16901) 2018-07-05 02:14:06 +07:00
Sergey M․ 9a6628aaf9
[youtube] Improve login error handling (closes #13822) 2018-07-05 00:37:32 +07:00
Sergey M․ 689af4960e
release 2018.07.04 2018-07-04 04:59:21 +07:00
Sergey M․ 24d26ab380
[lynda] PEP 8 2018-07-04 04:49:03 +07:00
Sergey M․ 836ef4840f
[pluralsight] Switch to graphql (closes #16889, closes #16899) 2018-07-04 04:48:40 +07:00
Sergey M․ 5621c3222e
[lynda] Simplify login and improve error capturing (#16891) 2018-07-03 02:47:09 +07:00
Remita Amine db5debf313 [go90] add support for embed urls(closes #16873) 2018-07-01 22:41:32 +01:00
Remita Amine 8cee692b8b [go90] detect geo restriction error and pass geo verification headers(closes #16874) 2018-07-01 22:41:32 +01:00
coreynicholson 973b6ceebb [vlive] Fix live streams extraction 2018-07-01 21:19:17 +07:00
Sergey M․ eca1f0d115
[extractor/common] Properly escape % in MPD templates (closes #16867) 2018-07-01 02:11:36 +07:00
Sergey M․ 2160768a21
[npo] Fix typo (closes #16872) 2018-06-30 23:39:56 +07:00
Sergey M․ 267d81962a
[mediaset] Fix issues and extract all formats (closes #16568) 2018-06-30 02:19:02 +07:00
Timendum 9cf648c92b
[mediaset] Add support for new videos 2018-06-30 02:17:51 +07:00
Sergey M․ 5e8e2fa51f
[extractor/common] Use source URL as Referer for HTML5 entries (closes #16849) 2018-06-29 01:25:05 +07:00
Sergey M․ d4a24f4091
Prefer ffmpeg over avconv by default (closes #8622) 2018-06-29 01:09:14 +07:00
Sergey M․ acbd0ff5df
[dctptv] Restore extraction based on REST API (closes #16850) 2018-06-29 00:35:05 +07:00
Sergey M․ 7b393f9cc5
[svt] Improve extraction and add support for pages (closes #16802) 2018-06-28 04:29:11 +07:00
Sergey M․ c3bcd206eb
[porncom] Fix extraction (closes #16808) 2018-06-26 00:01:06 +07:00
Sergey M․ 1f6cc5807e
release 2018.06.25 2018-06-25 02:26:02 +07:00
Sergey M․ a0949fec08
[joj] Relax _VALID_URL (closes #16771) 2018-06-24 23:57:22 +07:00
Remita Amine 74caf528bc [brightcove] workaround sonyliv DRM protected videos(closes #16807) 2018-06-24 12:02:32 +01:00
Sergey M․ 9fb62e35f6
[motherless:group] Fix _VALID_URL 2018-06-21 23:39:13 +07:00
Sergey M․ b71cc71910
[motherless] Fix extraction (closes #16786) 2018-06-21 23:38:32 +07:00
Sergey M․ a4ec45179e
[itv] Sort imports 2018-06-21 23:12:40 +07:00
Sergey M․ 30374f4d40
[itv] Make SOAP request non fatal and extract metadata from a webpage (closes #16780) 2018-06-21 23:06:58 +07:00
Sergey M․ 91aa502d91
[foxnews:insider] Remove extractor (#15810)
Now covered by foxnews:article
2018-06-20 23:59:37 +07:00
Sergey M․ f51f526b0a
[foxnews] Add support for iframe embeds (closes #15810, closes #16711) 2018-06-20 23:53:37 +07:00
Sergey M․ c9b983ff82
release 2018.06.19 2018-06-19 23:16:04 +07:00
Sergey M․ 8b4b400aef
[peertube] Improve generic support (closes #16733) 2018-06-19 23:00:36 +07:00
Remita Amine e12b4b8bcc [6play] use geo verfication headers 2018-06-19 10:35:57 +01:00
Remita Amine 18806e3b6b [rtbf] fix extraction for python 3.2 and older 2018-06-18 19:10:43 +01:00
Sergey M․ 713afa705c
[vgtv] Improve HLS formats extraction 2018-06-18 23:15:38 +07:00
Sergey M․ 721a877d2f
[vgtv] Add support for www.aftonbladet.se/tv/ URLs 2018-06-18 23:08:35 +07:00
Sergey M․ 9283d4ea03
[bbccouk] Use expected_status 2018-06-18 04:54:59 +07:00
Sergey M․ 00a429bea3
[markiza] Expect 500 status code 2018-06-18 04:54:52 +07:00
Sergey M․ d391b7e23d
[extractor/common] Introduce expected_status for convenient accept of failed HTTP requests
Useful when some non-success (2xx) HTTP status codes should be considered normal. Previously this required to manually catch corresponding exceptions and read the response.
2018-06-18 04:54:08 +07:00
Sergey M․ 075a13d3e9
[compat] Introduce compat_integer_types 2018-06-18 04:52:58 +07:00
Remita Amine 8ba84e4600 [tvnow] try all clear manifest urls(closes #15361) 2018-06-17 20:41:09 +01:00
Sergey M․ 858cf4dc29
release 2018.06.18 2018-06-18 01:34:36 +07:00
Sergey M․ ce0edda0f9
[markiza] Add extractors (closes #16750) 2018-06-18 01:17:47 +07:00
Remita Amine 0adf213d8c [wat] try all supported adaptive urls 2018-06-17 15:56:52 +01:00
Remita Amine 8b183bd5f8 [tf1] try all supported adaptive urls 2018-06-17 15:53:29 +01:00
Remita Amine 1882511754 [6play] add support for rtlplay.be and extract hd usp formats 2018-06-17 12:01:14 +01:00
Remita Amine 764cd4e6f3 [rtbf] improve extraction
- add support for audio and live streams(closes #11923)(closes #9638)
- extract HLS, DASH and all HTTP formats
- extract subtitles
- fixup specific http urls(fixes #16101)
2018-06-17 03:13:41 +01:00
Sergey M․ 734d461ca0
[expressen] Add extractor 2018-06-16 21:15:06 +07:00
Urgau 81c5df4f2c [vidzi] Fix extraction (closes #16678) 2018-06-16 05:08:44 +07:00
Sergey M․ 87f89dacdd
[pbs] Improve extraction (closes #16623, closes #16684) 2018-06-16 02:55:20 +07:00
Sergey M․ 9b0b627534
[downloader/rtmp] Fix downloading in verbose mode (closes #16736) 2018-06-15 02:59:15 +07:00
Sergey M․ 61cb66830f
[bilibili] Restrict cid regex (closes #16638, closes #16734) 2018-06-14 22:40:30 +07:00
Sergey M․ c797db4a2f
release 2018.06.14 2018-06-14 01:24:53 +07:00
Remita Amine aa56061627 [discoverynetworks] Add support for disco-api videos(closes #16724) 2018-06-13 16:46:59 +01:00
Remita Amine 18d66f0410 [dailymotion] use compat_struct_pack 2018-06-13 15:12:42 +01:00
Remita Amine f15f7a674b [dailymotion] add support for password protected videos(closes #9789) 2018-06-13 14:51:19 +01:00
Sergey M․ 9aca7fe6a3
[abc:iview] Extract more series metadata 2018-06-12 20:25:50 +07:00
Remita Amine e0671819e7 [abc] fix ABC IView extraction and add support for livestreams(closes #16704)(closes #12354) 2018-06-12 13:07:57 +01:00
Sergey M․ 5d6c81b63f
[downloader/http] Fix resume when writing ot stdout (closes #16699) 2018-06-12 03:12:29 +07:00
Sergey M․ dc53c78634
[crackle] Add support for sonycrackle.com (closes #16698) 2018-06-12 02:06:30 +07:00
Sergey M․ 7dc9c60b4b
[tvnet] Fix _VALID_URL 2018-06-12 02:05:58 +07:00
Sergey M․ e51752754d
[tvnet] Improve video id extraction 2018-06-12 01:50:43 +07:00
Sergey M․ 0645be49cb
[inc] PEP 8 2018-06-12 01:41:23 +07:00
Sergey M․ a572ae6114
[tvnet] Improve and fix issues (closes #15462) 2018-06-12 01:37:34 +07:00
Thomas van der Berg b2df66aeca
[tvnet] Add extractor 2018-06-12 01:37:29 +07:00
Sergey M․ 93cffb1444
[nrk] Update API hosts and try all previously known ones (closes #16690) 2018-06-11 03:08:36 +07:00
Sergey M․ d253df2f65
[wimp] Fix Youtube embeds extraction 2018-06-11 02:40:17 +07:00
Sergey M․ e8c6afc168
release 2018.06.11 2018-06-11 01:57:30 +07:00
Sergey M․ 9d581efe05
[npo] Extend _VALID_URL (closes #16682) 2018-06-10 00:26:16 +07:00
Sergey M․ ff2e486221
[inc] Add support for another embed schema (closes #16666) 2018-06-09 02:53:04 +07:00
Remita Amine 6ae36035d9 [tv4] fix format extraction(closes #16650) 2018-06-06 00:41:08 +01:00
Remita Amine 9afd74d705 [nexx] extract free cdn http formats 2018-06-05 01:02:46 +01:00
Sergey M․ 2e6975306a
[nexx] Update tests 2018-06-05 02:59:25 +07:00
Sergey M․ 06ea7bdd99
[nexx] Add support for free cdn (closes #16538) 2018-06-05 02:55:54 +07:00
Sergey M․ d7be705308
[pbs] Add another cove id pattern (closes #15373) 2018-06-05 00:17:26 +07:00
Sergey M․ 2e190c2ad9
[rbmaradio] Add support for 192k format (closes #16631) 2018-06-04 23:51:25 +07:00
Sergey M․ 94418c8eb3
release 2018.06.04 2018-06-04 02:41:53 +07:00
Sergey M․ c3023e9f2e
[camtube] Add extractor 2018-06-03 17:09:20 +07:00
Sergey M․ 77053237c5
[twitter:card] Generalize base API URL 2018-06-03 15:58:12 +07:00
Sergey M․ b6b2ccb72f
[twitter:card] Extract guest token (closes #16609) 2018-06-03 15:57:45 +07:00
Sergey M․ 0a10f50e2f
[chaturbate] Use geo verification headers 2018-06-03 04:30:33 +07:00
Sergey M․ 6d155707e6
[bbc] Add support for bbcthree (closes #16612) 2018-06-03 04:07:59 +07:00
Sergey M․ eb6793ba97
[youtube] Update tests 2018-06-03 02:23:45 +07:00
Sergey M․ 7e72694b5e
[youtube] Move metadata extraction after video availability check 2018-06-03 02:08:38 +07:00
Sergey M․ 936784b272
[youtube] Extract track and artist 2018-06-03 02:05:14 +07:00
Sergey M․ 003fe73ccf
[safari] Add support for new URL schema (closes #16614) 2018-06-03 00:53:11 +07:00
Remita Amine 1ea559c445 [adn] fix extraction 2018-06-02 18:14:22 +01:00
Sergey M․ 19e42ead9b
release 2018.06.02 2018-06-02 01:51:31 +07:00
Sergey M․ 9b89daefa6
[facebook] Improve extraction (closes #16554) 2018-06-02 01:42:05 +07:00
Nathan Rossi 9d082e7cb8
[facebook] Add support for tahoe player videos (closes #15441)
Specific videos appear to use a newer/different player, this requires a
second request for the video data as the initial request is missing the
specified data.

Additionally these videos have different page content for the uploader
value, which is stored in the `<meta property="og:title"...>` element of
the initial request.
2018-06-02 01:32:53 +07:00
Sergey M․ f20f636596
[cbc] Improve extraction (closes #16583, closes #16593) 2018-06-02 00:35:07 +07:00
Enes 85750f8972 [openload] Improve ext extraction 2018-06-02 00:16:22 +07:00
Sergey M․ 926d97fc6b
[9c9media] PEP 8 2018-06-01 05:17:49 +07:00
Sergey M․ 2593725a9b
[twitter:card] Add support for another endpoint (closes #16586) 2018-06-01 05:16:00 +07:00
DroidFreak32 0bfdcc1495 [openload] Add support for oload.win and oload.download 2018-05-31 22:01:44 +07:00
Remita Amine c3f75e2454 [audimedia] fix extraction(closes #15309) 2018-05-31 12:39:45 +01:00
Remita Amine 3a8e3730c1 [francetv] add support for sport.francetvinfo.fr(closes #15645) 2018-05-31 11:40:37 +01:00
Remita Amine acca2ac7f3 [mlb] improve extraction(closes #16587) 2018-05-31 02:50:14 +01:00
Remita Amine 128b58ad13 [nhl] remove old extractors 2018-05-31 02:49:35 +01:00
Remita Amine 4fd1437d9d [rbmaradio] check formats availability(closes #16585) 2018-05-30 17:08:32 +01:00
Sergey M․ e425710554
release 2018.05.30 2018-05-30 21:54:30 +07:00
Remita Amine e0d42dd4b2 [teamcoco] Fix extraction for full episodes(closes #16573) 2018-05-30 13:21:07 +01:00
Remita Amine a07879d6b2 [spiegel] fix info extraction(#16538) 2018-05-28 00:10:46 +01:00
Sergey M․ cfd7f2a636
[apa] Add extractor (closes #15041, closes #15672) 2018-05-27 18:24:54 +07:00
Remita Amine 9c65c4a6cd [bellmedia] add support for bnnbloomberg.ca(#16560) 2018-05-27 12:11:53 +01:00
Remita Amine c9e12a618c [9c9media] extract mpd formats and subtitles 2018-05-27 12:10:12 +01:00
Sergey M․ 8882840ec5
[cammodels] Use geo verification headers 2018-05-26 22:22:58 +07:00
Sergey M․ 2ce35d9f43
[cammodels] Add another error pattern 2018-05-26 22:22:58 +07:00
Sergey M․ f16f48779c
[downloader/rtmp] Generalize download messages and report time elapsed on finish 2018-05-26 22:22:58 +07:00
Sergey M․ ddd8486a44
[downloader/rtmp] Gracefully handle live streams interrupted by user 2018-05-26 22:22:58 +07:00
Remita Amine 68217024e8 remove unnecessary assignment parenthesis 2018-05-26 16:13:54 +01:00
Remita Amine ec2f3d2800 [ufctv] add support for authentication(closes #16542) 2018-05-26 16:13:54 +01:00
Sergey M․ 8b1da46e8f
[cammodels] Improve and simplify (closes #14499) 2018-05-26 21:25:30 +07:00
mars67857 2a49d01992
[cammodels] Add extractor 2018-05-26 21:25:21 +07:00
Remita Amine 261f47306c [utils] fix style id extraction for namespaced id attribute(closes #16551) 2018-05-26 14:38:24 +01:00
Remita Amine c0fd20abca [soundcloud] detect format extension(closes #16549) 2018-05-26 14:38:24 +01:00
Parmjit Virk 986c0b0215 [cbc] Fix playlist title extraction (closes #16502) 2018-05-26 20:05:54 +07:00
Sergey M․ 97b01144bd
[tumblr] Detect and report sensitive media (closes #13829) 2018-05-26 20:00:00 +07:00
Sergey M․ 56cd31f320
[tumblr] Improve authentication (closes #15133) 2018-05-26 19:59:35 +07:00
Zack Fernandes c678192af3
[tumblr] Add support for authentication 2018-05-26 19:56:01 +07:00
Sergey M․ 0934c9d4fa
release 2018.05.26 2018-05-26 13:02:21 +07:00
Remita Amine 5a16c9d9d3 [utils] keep the original TV_PARENTAL_GUIDELINES dict 2018-05-25 23:12:50 +01:00
Petr Novák bdbcc8eecb [dvtv] Remove dead test 2018-05-26 02:15:50 +07:00
rhhayward 9ef5cdb5cb [audiomack] Stringify video id (closes #15310) 2018-05-26 02:13:29 +07:00