e8e4cc5a6a
[generic] Replace LazyYT test with skiplagged
...
discourse.ubuntu.com has gone away, repalce with skiplagged.com.
Be nice to have a non-frontpage URL that might be more stable,
though I don't have one. Maybe this should move to html
in test/test_InfoExtractor.py?
2017-03-25 19:53:32 +07:00
54b960f340
[generic] Do not follow redirects to the same URL
2017-03-24 00:45:24 +07:00
97952bdb78
[generic] Add test for Senate ISVP iframe embed
2017-03-22 01:12:14 +08:00
46b18f2349
[BostonGlobe] New. Nonstandard version of Brightcove.
...
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.
Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.
History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
2017-03-19 20:40:31 +08:00
a309684285
[extractor/generic] Add forgotten return for jwplayer formats
2017-03-16 03:28:01 +07:00
c2ee861c6d
[extractor/generic] Make title optional for jwplayer embeds ( closes #12410 )
2017-03-10 23:16:53 +07:00
b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer
2017-03-07 23:00:21 +07:00
eb3079b6ce
[generic] Add support for rutube embeds
2017-03-04 00:46:33 +07:00
fef51645d6
[theplatform] Recognize URLs with whitespaces ( closes #12044 )
2017-02-17 23:13:51 +08:00
a4a554a793
[generic] Try parsing JWPlayer embedded videos ( closes #12030 )
2017-02-16 23:44:03 +08:00
454e5cdb17
[limelight] add support referer protected videos
2017-02-13 14:29:05 +01:00
9dad941853
[disney] improve extraction
...
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos
closes #4975
closes #11000
closes #11882
closes #11936
2017-02-13 11:43:20 +01:00
5620f840f6
[extractor/generic] Add test for #11993 and more metadata for rtmp
2017-02-06 23:31:58 +07:00
b7a8c1bcfa
[extractor/generic] Improve rtmp support ( closes #11993 )
2017-02-06 23:23:40 +07:00
6ef3e65a7b
[videopress] Add extractor
2017-02-05 13:37:27 +07:00
17f8deeb48
[extractor/generic] Add support for openload embeds ( closes #11536 , closes #11812 )
2017-01-25 23:27:22 +07:00
972efe60c3
[generic] Remove a dead test
...
The web page does not contain a video anymore
Ref: #2694 , #2696
2017-01-20 22:27:13 +08:00
d77ac73790
[ustream] Add UstreamIE._extract_url()
...
Ref: #11547
2017-01-20 22:27:13 +08:00
b687c85eab
[extractor/generic] Add support for 20 minuten embeds ( closes #11683 , closes #11751 )
2017-01-18 22:17:47 +07:00
16e2c8f771
[brightcove] Recognize another player ID
...
Closes #11688
2017-01-16 00:06:52 +08:00
9837cb7507
[ooyala] add support for videos with embedToken( #11684 )
2017-01-13 23:06:59 +01:00
ec85ded83c
Fix "invalid escape sequences" error on Python 3.6
2017-01-06 00:58:56 +08:00
027e231295
[tunein] Add support for embeds ( closes #11579 )
2017-01-03 01:45:59 +07:00
e186a9ec03
[videa] Add support for videa embeds
2016-12-31 22:05:32 +07:00
53a664edf4
[brightcove:legacy] Improve embeds detection ( closes #11523 )
2016-12-24 22:46:27 +07:00
b1c357975d
[piksel] Add new extractor( closes #11246 )
2016-12-20 12:35:03 +01:00
8ab7e6c4cc
[kaltura] Improve widget ID extraction ( closes #11480 )
2016-12-20 18:45:52 +08:00
8953319916
[screenwavemedia] Remove extractor
...
Rewrite TeamFourStar and Normalboots extractors in terms of JWPlatform
2016-11-28 23:17:56 +07:00
83f1481baa
[extractor/generic] Add support for webcaster.pro embeds
2016-11-27 19:56:32 +07:00
8f8f182d0b
[extractor/generic] Improve limelight embeds support
2016-11-20 02:13:21 +07:00
b52c9ef165
[extractor/generic] Improve support for pornhub embeds ( closes #11100 )
2016-11-06 21:52:00 +07:00
e28ed498e6
[extractor/generic] Add support for redtube embds ( closes #11099 )
2016-11-06 21:42:41 +07:00
37e7a71c6c
[extractor/generic] Add support for drtuber embds ( closes #11098 )
2016-11-06 21:33:51 +07:00
4119a96ce5
[extractor/generic] Skip URLs we came from when delegating ISM extraction
2016-11-02 23:43:41 +07:00
26aae56690
[extractor/generic] Improve ISM extraction
2016-11-02 23:34:37 +07:00
cc99a77ac1
[extractor/generic] Add support for ISM manifests
2016-11-02 03:01:13 +07:00
773017c648
[rentv] Move rentv test from generic extractor and add only matching tests
2016-10-26 19:52:43 +07:00
9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
...
And use _generic_* helpers in those extractors
2016-10-07 19:24:22 +08:00
3d83a1ae92
[generic] Support direct MMS links ( closes #10838 )
2016-10-07 17:50:45 +08:00
09b9c45e24
[generic] Add support for multiple vimeo embeds ( Closes #10862 )
2016-10-06 23:22:52 +07:00
dcdb292fdd
Unify coding cookie
2016-10-03 23:44:29 +07:00
bd26441205
[utils] Fix xattr error handling
2016-10-02 03:03:41 +08:00
86f4d14f81
Refactor fragments interface and dash segments downloader
...
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
2016-09-17 20:35:22 +07:00
d05ef09d9d
[mangomolo] fix domain regex
2016-09-17 08:11:01 +01:00
7d273a387a
[mangomolo] add support for Mangomolo embeds
2016-09-16 19:31:39 +01:00
a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed
2016-09-12 21:49:31 +07:00
93b8404599
[generic,vodplatform] improve embed regex
2016-08-29 07:57:20 +01:00
39efc6e3e0
[generic] Update some _TESTS
2016-08-28 15:46:11 +08:00
fd3ec986a4
[generic] Fix dbtv test ( Closes #10364 )
2016-08-18 21:35:41 +07:00
b0c8f2e9c8
[DBTV:generic] Add support for embeds
2016-08-18 21:29:27 +07:00
2a1321a272
[vbox7:generic] Add support for vbox7 embeds
2016-08-17 01:02:59 +07:00
082395d0a0
[extractor/generic] Add proper default to _search_json_ld call
2016-08-08 22:48:33 +07:00
395c74615c
Revert "[extractor/generic] Make _search_json_ld non fatal"
...
This reverts commit 958849275f
2016-08-08 21:49:27 +07:00
958849275f
[extractor/generic] Make _search_json_ld non fatal
2016-08-07 19:04:22 +07:00
217d5ae013
[vodplatform] Add new extractor
2016-08-04 09:39:06 +01:00
db19df6ca0
[extractor/generic] Add test for #10179
2016-07-28 22:20:08 +07:00
94aae01548
[extractor/generic] Extract all soundcloud embeds ( Closes #10179 )
2016-07-28 22:15:15 +07:00
326fa4e6e5
[generic] Skip an invalid test
2016-07-26 13:16:04 +08:00
05d1e7aaa9
[generic] Fix an MTV test and another test that breaks nosetests
2016-07-26 11:11:36 +08:00
1979969f91
[extractor/generic] Add support for arkena embeds
2016-07-23 17:56:48 +07:00
371ddb14fe
[extractor/generic] Change twitter:player embeds priority to lowest ( Closes #10090 )
2016-07-16 15:59:43 +07:00
c03adf90bd
[generic] Add the test. Closes #1638
2016-07-09 14:39:01 +08:00
6e6b70d65f
[extractor/generic] Properly comment out a test
2016-07-09 08:37:19 +07:00
0de168f7ed
[extractor/generic] Detect schema.org/VideoObject embeds
2016-07-09 03:29:07 +07:00
ad213a1d74
[francetv] Recognize more Dailymotion embedded videos
...
Closes #9955
2016-07-06 23:37:54 +08:00
81953d1ae5
[kaltura] add support videos stored on custom kaltura servers( closes #5557 )
2016-07-04 17:59:58 +01:00
dbf0157a26
[generic] Add MD5 checksums
2016-07-02 21:58:07 +08:00
7deef1ba67
[generic] Support Wordpress "YouTube Video Importer" plugin
...
Closes #9938
2016-07-02 21:58:07 +08:00
fd6ca38262
[facebook] Improve Facebook embedded detection
...
Related to #9938 .
Another example comes from 9834872bf6
2016-07-02 21:58:07 +08:00
7dbeee7e22
[generic] make twitter:player extraction non fatal
2016-06-30 14:11:55 +01:00
329179073b
[generic] add generic support for twitter:player embeds
2016-06-30 12:01:30 +01:00
06a96da15b
[eagleplatform] Improve embed detection and extract in separate routine ( Closes #9926 )
2016-06-29 23:01:34 +07:00
c287f2bc60
[extractor/generic] Use _extract_url for kaltura embeds ( Closes #9922 )
2016-06-27 22:45:26 +07:00
427cd050a3
[extractor/generic] Improve kaltura embed detection ( Closes #9911 )
2016-06-27 04:11:53 +07:00
7d52c052ef
[generic] Fix test_Generic_76
...
Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658
2016-06-26 11:56:27 +08:00
c5edd147d1
[generic] Remove an invalid test
...
Now handled by telewebion.py
2016-06-11 18:39:58 +08:00
1fa309da40
[generic] Update test_Generic_40
...
The original link now redirects to an YouTube user channel.
2016-06-10 16:39:31 +08:00
cc4444662c
[generic] Remove Vulture embed detection
...
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
2016-06-10 13:40:57 +08:00
de3eb07ed6
[generic] Detect NBC News embeds
2016-06-10 13:32:59 +08:00
48a5eabc48
[extractor/generic] Add support vessel embeds ( Closes #7083 )
2016-06-09 04:02:27 +07:00
811586ebcf
[generic] Update the UDNEmbed test case
2016-06-01 19:23:44 +08:00
28bab13348
[generic,viewlift] Move a test case to the specialized extractor
2016-06-01 19:18:01 +08:00
877032314f
[generic] Improve Kaltura detection
...
Closes #4004
2016-06-01 18:37:34 +08:00
78d3b3e213
[generic] Improve Livestream detection ( closes #2234 )
2016-05-23 01:40:11 +08:00
4a12077855
[genric] Eliminate duplicated video URLs ( closes #6562 )
2016-05-22 22:23:20 +08:00
4d8819d249
[extractor/generic] Add support for theplatform embeds ( Closes #8636 , closes #9476 )
2016-05-22 06:52:39 +06:00
6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests
2016-05-20 21:55:35 +06:00
7ded6545ed
[extractor/generic] Add test for wistia standard embed
2016-05-20 21:43:36 +06:00
aa5957ac49
[extractor/generic] Add support for async wistia embeds ( Closes #9549 )
2016-05-20 21:33:31 +06:00
6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support ( Closes #9453 )
2016-05-14 23:58:25 +06:00
5d39176f6d
[extractor/generic:3qsdn] Add support for embeds
2016-05-14 23:40:34 +06:00
67167920db
[viewlift] replace SnagFilms extractors
...
- add support for other sites that use the same logic
- improve format extraction and sorting
2016-04-29 11:24:10 +01:00
4645432d7a
[eagleplatform] Checking direct HTTP links
...
Sometimes they fail with 404
2016-04-25 22:48:17 +08:00
0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc
2016-04-24 20:46:06 +08:00
949b6497cc
[generic] Unescape the video URL
...
Fixes #9279
2016-04-24 16:25:37 +08:00
11e60fcad8
[extractor/generic] Improve instagram embeds ( Closes #9213 )
2016-04-16 22:39:20 +06:00
ef0e4e7bc0
[generic] Fix test_Generic_2
...
Now a HEAD request returns 400 Bad Request
2016-04-16 19:44:45 +08:00
b8f67449ec
[generic] Add support for LiveLeak embeds
2016-04-13 01:54:19 +02:00
134c207e3f
[arte.tv:embed] Extended support ( #2620 )
2016-04-11 19:32:27 +08:00
f9b1529af8
[generic] remove sbnation test(handled by VoxMediaIE)
2016-03-31 23:50:45 +01:00
19dbaeece3
Remove _sort_formats from _extract_*_formats methods
...
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.
Closes #8051
2016-03-27 07:03:08 +06:00
d10fe8358c
[generic] Add a test case for brightcove embed
...
Closes #8862
2016-03-26 18:30:43 +08:00
5a51775a58
[generic] Extract Instagram embeds ( #8817 )
2016-03-24 16:32:27 +08:00
088e1aac59
[generic] Support Vine embeds ( #8817 )
2016-03-23 23:55:08 +08:00
0d769bcb78
[extractor/generic] Fix missing byte literal prefix
2016-03-19 05:43:43 +06:00
edd9b71c2c
[extractor/generic] Add a test for m3u playlist served without proper Content-Type
2016-03-18 22:49:11 +06:00
5940862d5a
[extractor/generic] Detect m3u playlists served without proper Content-Type
2016-03-18 22:45:28 +06:00
de6c51e88e
[extractor/generic] Fix direct link semantics
2016-03-18 22:43:07 +06:00
303dcdb995
[extractor/generic] Simplify upload_date extraction
2016-03-18 22:41:16 +06:00
20938f768b
[extractor/generic] Add another test for generic m3u8
2016-03-18 21:54:33 +06:00
955737b2d4
[extractor/generic] Force Content-Type to lowecase
2016-03-18 21:50:44 +06:00
263eff9537
[extractor/generic] Properly extract format id from Content-Type
...
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
2016-03-18 21:50:10 +06:00
3f2f4a94aa
[extractor/generic] Extract f4m formats from final URLs
2016-03-13 03:38:20 +06:00
f930e0c76e
[extractor/generic] Extract f4m formats and refactor common info
2016-03-13 03:17:25 +06:00
2c9ca78281
[extractor/generic] Add support for tnaflix network embeds ( Closes #7505 )
2016-02-27 17:15:49 +06:00
33d4fdabfa
[extractor/generic] Add support for ok embeds ( #8619 )
2016-02-21 09:51:54 +06:00
9d939cec48
[extractor/generic] Add direct mpd url test
2016-02-13 00:36:47 +06:00
7be747b921
[extractor/generic] Pass mpd base url to _parse_mpd_formats
2016-02-13 00:15:59 +06:00
5a4905924d
[extractor/generic] Improve dailymotion embed detection ( Closes #8521 , closes #8325 )
2016-02-12 22:03:10 +06:00
28ad7df65d
[generic] detect MPD manfiest only from the content
2016-02-06 14:51:45 +01:00
79a3508579
[extractor/generic] Detect DASH manifests in found URLs and extract mpd formats
2016-02-06 19:42:03 +06:00
1b840245bd
[extractor/generic] Detect DASH manifests and extract mpd formats
2016-02-06 19:35:32 +06:00
bcbbb98bfe
[generic] extract dash formats detected using content type
2016-02-06 06:47:38 +01:00
eadc3ccd50
[generic] extract m3u8 formats when mpegurl content type detected
2016-02-04 01:25:36 +01:00
1bf996fa5c
[generic] Add support for Limelight API
2016-01-30 20:45:56 +01:00
aecfcd4e59
[ultimedia] Rename to digiteka
2016-01-19 21:51:46 +06:00
1fa2b9841d
[extractor/generic] Extend dailymotion embed regex
2016-01-19 21:20:45 +06:00
dfb1b1468c
Fix typos
...
Closes #8200 .
2016-01-10 17:24:28 +01:00
ff18735cb2
[extractor/generic] Add support for videomore embeds
2015-12-29 23:58:23 +06:00
06e4874c99
Merge branch 'jukebox' of https://github.com/remitamine/youtube-dl into remitamine-jukebox
2015-12-29 17:31:18 +01:00
7ba71e30fb
Merge branch 'bliptv' of github.com:remitamine/youtube-dl into remitamine-bliptv
2015-12-21 04:31:17 +01:00
7cb0952474
[makertv] improve extraction
2015-12-21 04:24:58 +01:00
a8ae232fa9
Merge branch 'googledrive' of github.com:remitamine/youtube-dl into remitamine-googledrive
2015-12-21 03:15:19 +01:00
5b251628e9
[googledrive] Modernize
2015-12-21 03:05:34 +01:00
45dad7ba1b
[extractor/generic] Use _extract_url for pladform
2015-12-07 22:03:21 +06:00
53e06b2507
[ooyala] fix duration scale
2015-12-04 16:18:02 +01:00
c3d3110f6a
Merge pull request #7185 from remitamine/ooyala
...
[ooyala] extract more formats and metadata
2015-12-04 08:23:21 +01:00
78653a33aa
Merge remote-tracking branch 'upstream/master' into bliptv
2015-12-03 20:33:22 +01:00
5c2266df4b
Switch codebase to use sanitized_Request instead of
...
compat_urllib_request.Request
[downloader/dash] Use sanitized_Request
[downloader/http] Use sanitized_Request
[atresplayer] Use sanitized_Request
[bambuser] Use sanitized_Request
[bliptv] Use sanitized_Request
[brightcove] Use sanitized_Request
[cbs] Use sanitized_Request
[ceskatelevize] Use sanitized_Request
[collegerama] Use sanitized_Request
[extractor/common] Use sanitized_Request
[crunchyroll] Use sanitized_Request
[dailymotion] Use sanitized_Request
[dcn] Use sanitized_Request
[dramafever] Use sanitized_Request
[dumpert] Use sanitized_Request
[eitb] Use sanitized_Request
[escapist] Use sanitized_Request
[everyonesmixtape] Use sanitized_Request
[extremetube] Use sanitized_Request
[facebook] Use sanitized_Request
[fc2] Use sanitized_Request
[flickr] Use sanitized_Request
[4tube] Use sanitized_Request
[gdcvault] Use sanitized_Request
[extractor/generic] Use sanitized_Request
[hearthisat] Use sanitized_Request
[hotnewhiphop] Use sanitized_Request
[hypem] Use sanitized_Request
[iprima] Use sanitized_Request
[ivi] Use sanitized_Request
[keezmovies] Use sanitized_Request
[letv] Use sanitized_Request
[lynda] Use sanitized_Request
[metacafe] Use sanitized_Request
[minhateca] Use sanitized_Request
[miomio] Use sanitized_Request
[meovideo] Use sanitized_Request
[mofosex] Use sanitized_Request
[moniker] Use sanitized_Request
[mooshare] Use sanitized_Request
[movieclips] Use sanitized_Request
[mtv] Use sanitized_Request
[myvideo] Use sanitized_Request
[neteasemusic] Use sanitized_Request
[nfb] Use sanitized_Request
[niconico] Use sanitized_Request
[noco] Use sanitized_Request
[nosvideo] Use sanitized_Request
[novamov] Use sanitized_Request
[nowness] Use sanitized_Request
[nuvid] Use sanitized_Request
[played] Use sanitized_Request
[pluralsight] Use sanitized_Request
[pornhub] Use sanitized_Request
[pornotube] Use sanitized_Request
[primesharetv] Use sanitized_Request
[promptfile] Use sanitized_Request
[qqmusic] Use sanitized_Request
[rtve] Use sanitized_Request
[safari] Use sanitized_Request
[sandia] Use sanitized_Request
[shared] Use sanitized_Request
[sharesix] Use sanitized_Request
[sina] Use sanitized_Request
[smotri] Use sanitized_Request
[sohu] Use sanitized_Request
[spankwire] Use sanitized_Request
[sportdeutschland] Use sanitized_Request
[streamcloud] Use sanitized_Request
[streamcz] Use sanitized_Request
[tapely] Use sanitized_Request
[tube8] Use sanitized_Request
[tubitv] Use sanitized_Request
[twitch] Use sanitized_Request
[twitter] Use sanitized_Request
[udemy] Use sanitized_Request
[vbox7] Use sanitized_Request
[veoh] Use sanitized_Request
[vessel] Use sanitized_Request
[vevo] Use sanitized_Request
[viddler] Use sanitized_Request
[videomega] Use sanitized_Request
[viewvster] Use sanitized_Request
[viki] Use sanitized_Request
[vk] Use sanitized_Request
[vodlocker] Use sanitized_Request
[voicerepublic] Use sanitized_Request
[wistia] Use sanitized_Request
[xfileshare] Use sanitized_Request
[xtube] Use sanitized_Request
[xvideos] Use sanitized_Request
[yandexmusic] Use sanitized_Request
[youku] Use sanitized_Request
[youporn] Use sanitized_Request
[youtube] Use sanitized_Request
[patreon] Use sanitized_Request
[extractor/common] Remove unused import
[nfb] PEP 8
2015-11-23 21:56:23 +06:00
750b9ff032
[generic] Extract M3U8 formats ( closes #7582 )
2015-11-21 16:43:01 +08:00
28602e747c
[generic] Refactor
2015-11-21 16:08:54 +08:00
6cc37c69e2
[generic] Unescape URLs from JWPlayer ( #7582 )
2015-11-21 14:12:34 +08:00
6da620de58
[kaltura] Add test for referrer protected video ( #7409 )
2015-11-21 01:40:28 +06:00
5b5fae5f20
[generic] Use referrer from source kaltura embed URLs ( #7409 )
2015-11-21 01:35:58 +06:00
c39fd7b1ca
[UDNEmbed] Fix generic UDN pages
...
Closes #7547
2015-11-19 22:32:56 +08:00
3b7d9aa487
Rename all references to legacy studio Brightcove extractor
2015-11-14 06:05:46 +06:00
1f4b722b00
[generic] Clarify Brightcove Legacy Studio comment
2015-11-14 06:03:32 +06:00
f6519f89b0
[generic] Extract Brightcove New Studio embeds
2015-11-14 06:03:07 +06:00
5c17f0a67a
[brightcove:embedinpage] Rename extractor to brightcove new
...
It's not actually embed_in_page but "New Studio" and allows both iframe and embed_in_page embeds
2015-11-14 05:55:59 +06:00
4fcaa4f4a5
[brightcove] Rename extractor to brightcove legacy
...
Old embedding approaches are now "Legacy Studio"
2015-11-14 05:54:16 +06:00
John Hawkinson
Sergey M․
Yen Chi Hsuan
Remita Amine
felix
Déstin Reed
Kacper Michajłow
Jakub Wilk