Commit Graph

11282 Commits

Author SHA1 Message Date
Sergey M․ 46933a15d6
[extractor/common] Support root JSON-LD lists (Closes #10203) 2016-08-05 23:14:32 +07:00
Sergey M․ 3859ebeee6
[tvplay] Capture and output native error message 2016-08-05 22:50:42 +07:00
Remita Amine d50aca41f8 [archiveorg] improve format extraction(closes #10219) 2016-08-05 16:42:15 +01:00
Remita Amine 0ca057b965 [jwplatform] add support for playlist extraction and relative urls and improve audio detection 2016-08-05 16:42:15 +01:00
Sergey M․ 5ca968d0a6
[tvplay] Extract series metadata 2016-08-05 22:37:38 +07:00
Sergey M․ f0d31c624e
[tvplay] Add support for subtitles (Closes #10194) 2016-08-05 22:17:32 +07:00
Remita Amine 08c655906c [5min] fix _VALID_URL(closes #10228) 2016-08-05 10:22:33 +01:00
Remita Amine 5a993e1692 [natgeo] fix tests(closes #10229) 2016-08-05 10:13:26 +01:00
Remita Amine a7d2953073 [extractors] add tvp:embed import 2016-08-05 10:11:59 +01:00
Remita Amine fdd0b8f8e0 [tvp] extract video id from the webpage(fixes #7799) 2016-08-05 09:44:15 +01:00
Remita Amine f65dc41b72 [naver] extract upload date 2016-08-05 08:12:25 +01:00
Yen Chi Hsuan 962250f7ea
[cbslocal] Fix timestamp parsing (closes #10213) 2016-08-05 11:44:50 +08:00
Yen Chi Hsuan 7dc2a74e0a
[utils] Fix unified_timestamp for formats parsed by parsedate_tz() 2016-08-05 11:41:55 +08:00
Remita Amine b02b960c6b [naver] improve extraction(closes #8096) 2016-08-04 21:42:22 +01:00
Remita Amine 4f427c4be8 [condenast] improve extraction 2016-08-04 18:30:56 +01:00
Sergey M․ 8a00ea567b
[natgeo:episodeguide] Do not shadow url from outer scope 2016-08-04 23:21:04 +07:00
Remita Amine 8895be01fc [5min] fix _VALID_URL 2016-08-04 16:55:12 +01:00
Remita Amine 52e7fcfeb7 [engadget] Relax _VALID_URL 2016-08-04 16:34:47 +01:00
Remita Amine 2396062c74 [5min] delegate extraction to AolIE
recently the 5min SenseHandler request return
HTTP Error 503: Service Unavailable error
2016-08-04 16:21:27 +01:00
Remita Amine 14704aeff6 [kaltura] remove debugging line 2016-08-04 14:54:34 +01:00
Remita Amine 3c2c3af059 [extractors] change imports for national geographic extractors 2016-08-04 12:20:56 +01:00
Remita Amine 1891ea2d76 [nationalgeographic] Add support for National Geographic Episode Guide 2016-08-04 12:18:10 +01:00
Remita Amine 1094074c04 [kaltura] extract subtitles and reduce requests 2016-08-04 09:39:06 +01:00
Remita Amine 217d5ae013 [vodplatform] Add new extractor 2016-08-04 09:39:06 +01:00
Remita Amine 8b40854529 [common] lower proto_preference of rtsp formats
Most of the time the RtspFD fail to download videos but it report
success of the download with this output:
[mpv] 0 bytes
[download] 100% of 0.00B
2016-08-04 09:39:06 +01:00
Sergey M․ 8d3b226b83
[gamekings] Remove extractor
Now covered by generic jwplayer
2016-08-03 22:06:10 +07:00
Remita Amine 42b7a5afe0 [limelight] extract http formats 2016-08-03 13:12:51 +01:00
Sergey M․ 9cb0e65d7e
[ntvru] Fix extraction 2016-08-02 22:56:48 +07:00
Sergey M․ b070564efb
[extractor/common] Support multiple properties in _og_search_property 2016-08-02 22:55:14 +07:00
Philipp Hagemeister 3aa9a73554 [options] Hide --password=secret in verbose output 2016-08-02 17:03:26 +02:00
Philipp Hagemeister 6a9b3b61ea [comedycentral] Re-add shortnames
In cc99d4f826, the shortname feature got deleted by accident. Re-add it as a separate IE.
2016-08-02 14:02:31 +02:00
Sergey M․ 45408eb075
release 2016.08.01 2016-08-01 22:59:23 +07:00
Sergey M․ e03d3e6453
[cwtv] Add support for cwtvpr.com (Closes #10196) 2016-08-01 22:51:01 +07:00
Remita Amine a70e45f80a [limelight] keep videos marked as previewStream
e382b953f0 (commitcomment-18472915)
2016-08-01 16:25:41 +01:00
Sergey M․ 697655a7c0
[safari] Relax url regexes (Closes #10202) 2016-08-01 21:48:48 +07:00
Remita Amine e382b953f0 [limelight] skip preview and drm protected videos 2016-08-01 00:33:30 +01:00
Yen Chi Hsuan 116e7e0d04
[bloomberg] Support BPlayer() players (closes #10187) 2016-07-31 14:47:19 +08:00
Sergey M․ cf03e34ad3
[yandexmusic:track] Fix extraction (Closes #10193) 2016-07-31 07:56:18 +07:00
Sergey M․ 2903137292
release 2016.07.30 2016-07-30 14:45:07 +07:00
Sergey M․ fa9f1d16b8
[dailymotion:playlist] Carry long line 2016-07-29 22:47:34 +07:00
Dave 485fedf6fd
[dailymotion:playlist] Optimize download archive processing 2016-07-29 22:45:41 +07:00
Jaime Marquínez Ferrándiz da0baba5c8 [rtve] Fix extraction for some videos
For example http://www.rtve.es/alacarta/videos/documentos-tv/documentos-tv-descredito/3574098/.
2016-07-29 17:20:27 +02:00
Jaime Marquínez Ferrándiz bb9f3bfedf Revert "[rtve] Fix extraction (#10076)"
This reverts commit c39b2ed990.

Apparently outside of Spain using 'auth/resources' is required (#10097).
2016-07-29 17:14:04 +02:00
Sergey M․ dbc0b39b91
[tv2] Improve extraction 2016-07-29 22:01:34 +07:00
Sergey M․ 481c5c5137
[tv2:article] Fix extraction (Closes #10188) 2016-07-29 21:43:17 +07:00
Sergey M․ 0cacae2807
[twitch:clips] Sort formats 2016-07-29 09:01:53 +07:00
Sergey M․ d9d56deadf
release 2016.07.28 2016-07-28 02:42:57 +07:00
Sergey M․ 74ba450a81
[twitch:clips] Fix extraction (Closes #9767) 2016-07-28 22:30:09 +07:00
Sergey M․ db19df6ca0
[extractor/generic] Add test for #10179 2016-07-28 22:20:08 +07:00
Sergey M․ fbdf8d15d1
[soundcloud] Add _extract_urls (#10179) 2016-07-28 22:16:05 +07:00
Sergey M․ 94aae01548
[extractor/generic] Extract all soundcloud embeds (Closes #10179) 2016-07-28 22:15:15 +07:00
Sergey M․ 39eef54cf0
[ard:mediathek] Skip unavailable test 2016-07-28 21:38:23 +07:00
Sergey M․ 05c8268c81
[shared] Modernize and make more robust 2016-07-27 23:39:02 +07:00
Sergey M․ 289a16b4f3
[shared] Respect redirect URL (Closes #10170) 2016-07-27 23:28:01 +07:00
Sergey M․ dcbb07c35a
release 2016.07.26.2 2016-07-26 23:56:53 +07:00
Sergey M․ 40090e8d51
[extractor/common] Improve is_suitable
In order to fix breakage introduced by a3aa814b77
2016-07-26 23:54:06 +07:00
Sergey M․ 3e050d51d4
[orf:oe1] Relax _VALID_URL 2016-07-26 23:14:04 +07:00
Sergey M․ ced70c8640
[cbc] PEP 8 2016-07-26 23:08:08 +07:00
Sergey M․ 9a700deea4
[instagram] Remove duplicate field in test 2016-07-26 23:07:16 +07:00
Sergey M․ dc35ba0eba
[mgtv] Fix typo 2016-07-26 23:06:21 +07:00
Sergey M․ 88bd486b9a
[cbc] Improve extraction for videos embedded with clipId 2016-07-26 22:58:50 +07:00
Sergey M․ 7f8b92e3cf
[bigflix] Update tests 2016-07-26 21:44:53 +07:00
Yen Chi Hsuan 35f6e0ff36
[mtv.de] Skip 2 geo-restricted tests 2016-07-26 13:19:47 +08:00
Yen Chi Hsuan 326fa4e6e5
[generic] Skip an invalid test 2016-07-26 13:16:04 +08:00
Yen Chi Hsuan c74299a72c
[cmt] Detect unavailable videos and update _TESTS 2016-07-26 13:13:14 +08:00
Yen Chi Hsuan 10a1bb3a78
[mtv] Fix for videos with missing bitrates 2016-07-26 13:12:24 +08:00
Yen Chi Hsuan 4d3e543c73
Update extractors.py 2016-07-26 11:17:28 +08:00
Yen Chi Hsuan 05d1e7aaa9
[generic] Fix an MTV test and another test that breaks nosetests 2016-07-26 11:11:36 +08:00
Yen Chi Hsuan a3aa814b77
Update _TESTS for MTV sites 2016-07-26 11:10:41 +08:00
Yen Chi Hsuan 5c32a77cad
[nextmovie] Remove extractor
This domain name now redirects to mtv.com
2016-07-26 11:08:55 +08:00
Yen Chi Hsuan cc99d4f826
[comedycentral] Remove IEs for *.cc.com except tosh.cc.com
All other subdomains now redirects to cc.com/* URLs
2016-07-26 11:06:50 +08:00
Yen Chi Hsuan 712c7530ff
[mtv] Extract more metadata and more
1. Remove MTVIggyIE. All www.mtviggy.com URLs now redirects to
   www.mtv.com
2. Fix MTVDEIE
3. Return multiple URLs from _transform_rtmp_url. This is for
   tosh.cc.com
2016-07-26 11:03:43 +08:00
Sergey M․ 0a147785e8
[camdemy] Extract duration properly 2016-07-25 23:03:58 +07:00
Sergey M․ 59eaf69e33
[camdemy] Fix camdemy 2016-07-25 23:03:43 +07:00
Sergey M․ e8be2943a7
[smotri] Modernize, make more robust and fix tests 2016-07-24 18:38:18 +07:00
Sergey M․ 8fdc538b46
release 2016.07.24 2016-07-24 11:39:50 +07:00
Sergey M․ 9513c1eb17
[tvp] Update dash format comment 2016-07-24 11:03:39 +07:00
Sergey M․ ae6fff4e64
[onet] Enable dash formats 2016-07-24 10:43:05 +07:00
Sergey M․ 5a65668e25
[dcn] Enable dash formats 2016-07-24 10:35:55 +07:00
Sergey M․ f75e6890db
[telegraaf] Make hls non fatal 2016-07-24 10:29:26 +07:00
Sergey M․ d9cb92c840
[telegraaf] Enable dash formats 2016-07-24 10:29:09 +07:00
Sergey M․ 94c04a3c79
[arkena] Enable dash formats 2016-07-24 10:28:11 +07:00
Sergey M․ f094834857
[extractor/common] Add support for $ in SegmentTemplate in MPD manifests 2016-07-24 10:27:16 +07:00
Déstin Reed 111de00289
[DailyMail] Improve title and description extraction 2016-07-24 05:37:13 +07:00
Sergey M․ b4a131e1a5
[facebook] Relax _VALID_URL (Closes #10151) 2016-07-24 04:36:49 +07:00
Sergey M․ f1991ce928
[arkena] Skip dash formats 2016-07-23 18:07:55 +07:00
Sergey M․ 3a8947650b
[arkenaplay] Remove extractor 2016-07-23 17:57:55 +07:00
Sergey M․ 1979969f91
[extractor/generic] Add support for arkena embeds 2016-07-23 17:56:48 +07:00
Sergey M․ 0673741af3
[extractors] Add imports for arkena and lcp 2016-07-23 17:56:29 +07:00
Sergey M․ c8e170b209
[lcp] Improve extraction 2016-07-23 17:56:11 +07:00
Sergey M․ bbe1f3634a
[arkena] Improve extraction (Closes #8682) 2016-07-23 17:55:54 +07:00
Rob van Bekkum 4671dd41b2
[arkena:lcp] Add extractors 2016-07-23 17:01:09 +07:00
Sergey M․ f164b97123
[utils] Add another f4m mimetype to mimetype2ext 2016-07-23 16:48:59 +07:00
Sergey M․ 5275efe30d
release 2016.07.22 2016-07-22 23:11:28 +07:00
Sergey M․ b13647cf3c
[eporner] Fix extraction (Closes #10139) 2016-07-22 23:04:13 +07:00
Sergey M․ add7d2a0e2
[pornhub] Make error regex less ambiguous (Closes #10138) 2016-07-22 21:24:09 +07:00
Sergey M․ e298d3a08c
[youtube] Fix authentication (Closes #10140) 2016-07-22 21:05:39 +07:00
Sergey M․ fd8c8c7dcd
[youtube:shared] Relax _VALID_URL 2016-07-21 22:58:34 +07:00
Sergey M․ 9158af16cc
[bbc.co.uk:iplayer:playlist] Add support for group URLs 2016-07-21 22:37:36 +07:00
Sergey M․ c6668e4ad1
[bbc.co.uk:iplayer:playlist] Skip unavailable test 2016-07-21 22:34:55 +07:00
Sergey M․ 84e8cca48b
[youjizz] Relax _VALID_URL (Closes #10131) 2016-07-20 22:41:13 +07:00
Sergey M․ 790b06b7d4
[odatv] Improve (Closes #9285) 2016-07-20 21:43:22 +07:00
skacurt 740d7c49c2
[odatv] Add extractor 2016-07-20 21:42:05 +07:00
Sergey M․ 4e51ec5f57
[extractors] Add import for comedycentral.tv 2016-07-19 22:50:37 +07:00
Sergey M․ 05087d1b4c
[bbc] Improve extraction from sxml playlists 2016-07-19 22:49:38 +07:00
Sergey M․ a66a73ee90
[ard] Add test for rbb-online 2016-07-18 02:25:31 +07:00
Sergey M․ 8188b923db
release 2016.07.17 2016-07-17 19:04:29 +07:00
Sergey M․ e8882e7043
[spike] Relax _VALID_URL and improve extraction (Closes #10106) 2016-07-17 18:34:25 +07:00
Sergey M․ 1056821799
[viki] Fix tests (Closes #10098) 2016-07-17 18:13:54 +07:00
Sergey M․ 890e6d3309
[viki] Lower m3u8 preference
http URLs are always provde the same or better quality
2016-07-17 18:12:03 +07:00
Sergey M․ 246080d378
[viki] Override m3u8 formats acodec 2016-07-17 18:10:16 +07:00
Sergey M․ b1ea680270
Revert "[bbc] extract more and better qulities from Unified Streaming Platform m3u8 manifests"
This reverts commit 0385aa6199.
2016-07-17 17:29:36 +07:00
Sergey M․ 45550d1039
[comedycentraltv] Add extractor (Closes #10101) 2016-07-17 16:58:58 +07:00
Sergey M․ 7cdfc4c90f
[mtvservices] Strip description 2016-07-17 16:56:39 +07:00
Sergey M․ af21f56f98
[ard] Add support for rbb-online (Closes #10095) 2016-07-17 03:40:58 +07:00
Sergey M․ 1a8f0773b6
[streamable] Fix title extraction and improve (Closes #9122) 2016-07-17 02:01:00 +07:00
Zach Bruggeman 59cc5bd8bf
[streamable] Add extractor 2016-07-17 01:35:09 +07:00
Sergey M․ 49bc16b95e
[nintendo] Improve playlist extraction (Closes #9986) 2016-07-17 00:01:25 +07:00
TRox1972 a2f9ca1e67
[nintendo] Add extractor 2016-07-16 23:58:53 +07:00
Sergey M․ 371ddb14fe
[extractor/generic] Change twitter:player embeds priority to lowest (Closes #10090) 2016-07-16 15:59:43 +07:00
Yen Chi Hsuan 998895dffa
[cloudy] Drop videoraj.to
videoraj.ch is now a shoe-selling website, and videoraj.to domain name
is gone.
2016-07-16 15:37:54 +08:00
Yen Chi Hsuan aadd3ce21f
[cliphunter] Update _TESTS 2016-07-16 15:37:54 +08:00
Yen Chi Hsuan ae7b846203
[cbsnews] Update _TESTS of CBSNewsLiveVideoIE 2016-07-16 15:37:54 +08:00
Yen Chi Hsuan 21ba7d0981
[cbc] Skip geo-restricted test case 2016-07-16 15:37:54 +08:00
Sergey M․ 691fbe7f98
release 2016.07.16 2016-07-16 02:20:00 +07:00
Sergey M․ 2e221ca3a8
[YoutubeDL] Fix incomplete formats check 2016-07-16 01:18:05 +07:00
Sergey M․ 317f7ab634
[YoutubeDL] Fix format selection with filters (Closes #10083) 2016-07-16 00:55:43 +07:00
Yen Chi Hsuan 23495d6a39
Revert "[ffmpeg] Fix embedding subtitles (#9063)"
This reverts commit ccff2c404d.

Fixes #10081.

The new approach breaks embedding subtitles into video-only or
audio-only files. FFMpeg provides a trick: add '?' after the argument of
'-map' so that a missing stream is ignored. For example:

opts = [
    '-map', '0:v?',
    '-c:v', 'copy',
    '-map', '0:a?',
    '-c:a', 'copy',
    # other options...
]

Unfortunately, such a format is not implemented in avconv, either.
I guess adding '-ignore_unknown' if self.basename == 'ffmpeg' is the
best solution. However, the example mentioned in #9063 no longer serves
problematic files, so I can't test it. I'll reopen #9063 and wait for
another example so that I can test '-ignore_unknown'.
2016-07-15 20:02:36 +08:00
Remita Amine 224db034ab [syfy] fix extraction(closes #9087)(closes #3820)(closes #2388) 2016-07-14 23:59:47 +01:00
Sergey M․ ad27649be3
[3qsdn] Restrict src JS regex 2016-07-15 03:36:50 +07:00
Sergey M․ 84571be645
[orf:tvthek] Remove test md5 2016-07-15 03:17:29 +07:00
Nehal Patel 7b0d333a7e
Fix unit tests for m3u8 and RTSP extractors that require ffmpeg or mplayer 2016-07-15 03:06:23 +07:00
Remita Amine 342f0c3682 [ninenow] correct test url 2016-07-14 14:19:18 +01:00
Remita Amine 38e0f16a94 [ninenow] Add new extractor(closes #5181) 2016-07-14 14:16:11 +01:00
Remita Amine e910fe2fe4 [brightcove] skip ism manifests 2016-07-14 14:13:57 +01:00
Jaime Marquínez Ferrándiz 233b58dec7 Add extractor for rtve.es/television (fixes #10076) 2016-07-13 21:02:34 +02:00
Jaime Marquínez Ferrándiz c39b2ed990 [rtve] Fix extraction (#10076)
For http://www.rtve.es/alacarta/videos/documentos-tv/documentos-tv-revolucion-del-movil/3069778/ using 'auth/resources' fails, and other URLs seem to work fine.
2016-07-13 20:23:27 +02:00
Remita Amine 35ec86689c [bbc] extract only the original Unified Streaming Platform m3u8 manifests
0385aa6199 (commitcomment-18233275)
manifests with higher birate require more time to check formats
2016-07-13 18:01:14 +01:00
Sergey M․ c485959034
release 2016.07.13 2016-07-13 23:58:01 +07:00
Sergey M․ a0560d8ab8
[ellentv] Improve extraction (Closes #10067) 2016-07-13 22:42:53 +07:00
Remita Amine 0385aa6199 [bbc] extract more and better qulities from Unified Streaming Platform m3u8 manifests 2016-07-13 15:58:24 +01:00
Remita Amine 00f4764cb7 [common] extract vbr, abr and fps for Unified Streaming Platform m3u8 manifests 2016-07-13 15:58:24 +01:00
Sergey M․ 51c2cd0b83
[extractors] Add vk:wallpost extractor import 2016-07-13 21:53:23 +07:00
Sergey M․ 5f5a9d6158
[vk] Improve login 2016-07-13 21:52:52 +07:00
Sergey M․ 2d19fb5072
[vk:wallpost] Add extractor 2016-07-13 21:51:44 +07:00
Remita Amine 41aa44259d [shahid] try to bypass geo restriction and extract more metadata(closes #10062) 2016-07-12 23:15:38 +01:00
Sergey M․ 7f29cf545a
[youtube] Add YouTube Red paid video reference test (#10059) 2016-07-12 02:10:35 +07:00
Remita Amine 7d1219f3e0 [tmz] delegate extraction to KalturaIE 2016-07-11 19:08:22 +01:00
Remita Amine f1b4af7d79 [beightcove:new] remove html tags from description 2016-07-11 19:06:50 +01:00
Remita Amine 8a8590a617 [dbtv] delegate extraction to BrightcoveNewIE 2016-07-11 16:30:24 +01:00