70baa7bfae
[test_youtube_lists] Actualize youtube flat playlist test ( closes #28045 )
4 years ago
99c68db0a8
[youtube] add support phone/tablet JS player( closes #26424 )
4 years ago
b46483a6ec
[youtube/test_youtube_signature] fix test
4 years ago
9c724601ba
[youtube] remove description chapters tests
...
video description no longer contain yt.www.watch.player.seekTo
function
4 years ago
142c584063
Introduce --output-na-placeholder ( closes #27896 )
4 years ago
d81a213cfb
[YoutubeDL] Raise syntax error for format selection expressions with multiple + operators ( closes #27803 )
4 years ago
3a61e6d360
[rai] improve subtitles extraction ( #27705 )
...
closes #27698
4 years ago
e88c9ef62a
[utils] add a function to clean podcast URLs
4 years ago
9dd674e1d2
[utils] accept only supported protocols in url_or_none
4 years ago
af1312bfc3
[youtube:tab] Extend _VALID_URL ( closes #27501 )
4 years ago
03d3af9768
[test_InfoExtractor] PEP 8
4 years ago
1727541315
[extractor/common] Improve JSON-LD interaction statistic extraction (refs #23306 )
4 years ago
5a1fbbf8b7
[extractor/common] Fix inline HTML5 media tags processing and add test ( closes #27345 )
4 years ago
191286265d
[youtube:tab] Fix feeds extraction ( closes #25695 , closes #26452 )
4 years ago
71ddc222ad
Fix typos ( #27084 )
...
* spelling: authorization
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: brightcove
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: creation
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: exceeded
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: exception
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: extension
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: extracting
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: extraction
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: frontline
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: improve
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: length
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: listsubtitles
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: multimedia
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: obfuscated
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: partitioning
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: playlist
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: playlists
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: restriction
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: services
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: split
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: srmediathek
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: support
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: thumbnail
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: verification
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
* spelling: whitespaces
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
4 years ago
ab0eda99e1
[YoutubeDL] Fix --ignore-errors for playlists with generator-based entries of url_transparent ( closes #27064 )
4 years ago
2864179293
[youtube] Improve extraction
...
+ Add support for --no-playlist (closes #27009 )
* Improve playlist and mix extraction (closes #26390 , closes #26509 , closes #26534 , closes #27011 )
+ Extract playlist uploader data
* Update tests
4 years ago
fe07e788bf
[utils] Skip ! prefixed code in js_to_json
4 years ago
2de2ca6659
[youtube] Rework extractors
...
WIP
4 years ago
4eda10499e
[utils] Don't attempt to coerce JS strings to numbers in js_to_json ( #26851 )
...
The current logic in `js_to_json` tries to rewrite octal/hex numbers to
decimal. However, when the logic actually happens the `"` or `'` have
already been trimmed off. This causes what were originally strings, that
happen to look like octal/hex numbers, to get rewritten to decimal and
returned as a number rather than a string.
In practive something like:
```js
{
"0x40": "foo",
"040": "bar",
}
```
would get rewritten as:
```json
{
64: "foo",
32: "bar
}
```
This is problematic since this isn't valid JSON as you cannot have
non-string keys.
4 years ago
1d9bf655e6
[utils] Recognize wav mimetype ( closes #26463 )
4 years ago
84213ea8d4
[youtube] Extract chapters from JSON ( closes #24819 )
4 years ago
c380cc28c4
[utils] Improve cookie files support
...
+ Add support for UTF-8 in cookie files
* Skip malformed cookie file entries instead of crashing (invalid entry len, invalid expires at)
5 years ago
e40c758c2a
[youtube] Improve player id extraction and add tests
5 years ago
042b664933
Revert "[utils] Add support for cookies with spaces used instead of tabs"
...
According to [1] TABs must be used as separators between fields.
Files produces by some tools with spaces as separators are considered
malformed.
1. https://curl.haxx.se/docs/http-cookies.html
This reverts commit cff99c91d1
5 years ago
cff99c91d1
[utils] Add support for cookies with spaces used instead of tabs
5 years ago
ea17979d83
[test_subtitles] Remove obsolete test
5 years ago
4e9e1e240d
[test_YoutubeDL] Add tests for #10591 ( closes #23873 )
5 years ago
e0abaab293
[test_YoutubeDL] Fix get_ids
5 years ago
42db58ec73
[utils] Improve str_to_int
5 years ago
348c6bf1c1
[utils] handle int values passed to str_to_int
5 years ago
1ced222120
[utils] Add generic caesar cipher and rot47
5 years ago
9d30c2132a
[utils] Handle rd-suffixed day parts in unified_strdate ( #23199 )
5 years ago
237513e801
[yahoo] restore support for cbs suffixed URLs
5 years ago
824fa51165
[utils] Improve subtitles_filename ( closes #22753 )
5 years ago
28cc2241e4
[utils] Restrict parse_codecs and add theora as known vcodec ( #21381 )
5 years ago
53cd37bac5
[utils] Improve strip_or_none
6 years ago
3089bc748c
Fix W504 and disable W503 ( closes #20863 )
6 years ago
fd35d8cdfd
[utils] Transliterate "þ" as "th" ( #20897 )
...
Despite visual similarity "þ" is unrelated to "p".
It is normally transliterated as "th":
$ echo þ-Þ | iconv -t ASCII//TRANSLIT
th-TH
6 years ago
5e1271c56d
[utils] Improve int_or_none and float_or_none ( #20403 )
6 years ago
d493f15c11
[extractor/common] Improve HTML5 entries extraction and add some realworld tests
6 years ago
0dc41787af
[utils] Introduce parse_bitrate
6 years ago
2e27421c70
[test_InfoExtractor] Add test for #20346
6 years ago
067aa17edf
Start moving to ytdl-org
6 years ago
fca9baf0da
[test] Fix test_compat_etree_Element
6 years ago
399f76870d
[compat] Introduce compat_etree_Element
6 years ago
e7e62441cd
[utils] strip #HttpOnly_ prefix from cookies files ( #20219 )
6 years ago
22f5f5c6fc
[malltv] Add extractor ( closes #18058 )
6 years ago
e118a8794f
[YoutubeDL] Fix typo in string negation implementation and add more tests ( closes #18961 )
6 years ago
fad4ceb534
[utils] Fix urljoin for paths with non-http(s) schemes
6 years ago
fc746c3fdd
[test/test_InfoExtractor] add test for #18923
6 years ago
2cc779f497
[YoutubeDL] Add negation support for string comparisons in format selection expressions ( closes #18600 , closes #18805 )
6 years ago
a16c7c033a
[test/helper] Add support for maxcount and count collection len test checkers
6 years ago
6e29458f24
[test/testdata/cookies/session_cookies.txt] Fix empty expires test data
6 years ago
9e02c2c704
[YoutubeDLCookieJar] Add test for keeping session cookies
6 years ago
6864855eb1
[tests] Fix invalid escape sequences
6 years ago
95e42d7336
[extractor/common] Ensure response handle is not prematurely closed before it can be read if it matches expected_status ( resolves #17195 , closes #17846 , resolves #17447 )
6 years ago
25d110be30
[utils] Properly recognize AV1 codec ( closes #17506 )
6 years ago
af03000ad5
[utils] Introduce url_or_none
6 years ago
e9c671d5e8
[utils] Allow JSONP with empty func name ( closes #17028 )
6 years ago
85750f8972
[openload] Improve ext extraction
7 years ago
3bb3ff38a1
[test_utils] add tests for b836118724
7 years ago
6cc622327f
[utils] Introduce merge_dicts
7 years ago
1cc47c6674
[utils] Fix match_str for boolean meta fields
7 years ago
518d5ba519
Fix some tests
7 years ago
47a5cb7734
Generalize XML manifest processing code and improve XSPF parsing ( closes #15794 )
7 years ago
96b8b9abae
[extractor/generic] Support relative URIs in _parse_xspf
...
<location> can have relative URIs, not just absolute.
7 years ago
f226880c6d
[tennistv] Add support for tennistv.com
7 years ago
b871d7e954
[utils] Add parse_resolution
7 years ago
befa4708fd
[utils] Fixup some common URL's typos in sanitize_url ( closes #15649 )
7 years ago
6fcc053947
[test_downloader_http] Use try_rm
7 years ago
f19eae429a
[test_http] Use 127.0.0.1 instead of localhost
7 years ago
ba515388b8
Introduce --http-chunk-size
7 years ago
655c410063
[test_download] Fix download tests for lazy extractors ( closes #13554 , closes #13757 )
7 years ago
c707b1d828
[test_utils] Add tests for malformed JSON handling in js_to_json
7 years ago
c384d537f8
[util] Improve scientific notation handling in js_to_json ( closes #14789 )
7 years ago
9d6ac71c27
[extractor/common] Fix extraction of DASH formats with the same representation id ( closes #15111 )
7 years ago
b555ae9bf1
[utils] Add another date format pattern ( #14999 )
7 years ago
78593e294c
Add references for #14844
7 years ago
41bf647e89
[extractor/common] Add support for DASH manifests with SegmentLists with bare SegmentURLs
7 years ago
f58a506044
[test_InfoExtractor] Fix flake8
7 years ago
d08dcd2dbd
[test_YoutubeDL] Fix typo ( closes #14856 )
7 years ago
181e381fda
[test_InfoExtractor] Add test for #14660
7 years ago
056653bbb1
[utils] Add support for zero years and months in parse_duration
7 years ago
af0f74288d
[YoutubeDL] Improve _default_format_spec ( closes #14461 )
7 years ago
cd6fc19ed7
[YoutubeDL] Ignore duplicates in --playlist-items
...
E.g. '--playlist-items 2-4,3-4,3' should result in '[2,3,4]', not '[2,3,4,3,4,3]'
7 years ago
86a15ed64b
[test_YoutubeDL] Add test for #14425
7 years ago
3869028ffb
[utils] Use bytes-like objects in dfxp2srt
...
This fixes handling of non-UTF8 TTML subtitles
Closes #14191
7 years ago
95f3f7c20a
[utils] Fix unescapeHTML for misformed string like "&a"" ( #13935 )
7 years ago
4850478543
[extractor/common] Add support for float durations in _parse_mpd_formats ( closes #13919 )
7 years ago
5b232f46dc
[utils] Skip missing params in cli_bool_option ( closes #13865 )
7 years ago
8cda78ef72
[test_YoutubeDL] Add a test for #10083
7 years ago
73095e013f
[options] Typo
7 years ago
905d18a7aa
[options] Correctly hide login info from debug outputs ( #13696 )
...
Iterate over opts instead of PRIVATE_OPTS for both performance and
correctness
7 years ago
0017d9ad6d
[YoutubeDL] Improve default format specification ( closes #13704 )
7 years ago
0396806f67
[YoutubeDL] Do not override id, extractor and extractor_key in url_transparent
...
All these meta fields must be borrowed from final extractor that actually performs extraction.
This commit fixes extractor id in download archives for url_transparent downloads. Previously, 'transparent' extractor was erroneously
used for extractor archive id, e.g. 'eggheadlesson 4n8ugwwj5t' instead of 'wistia 4n8ugwwj5t'.
7 years ago
15da37c7dc
[YoutubeDL] Don't expand env variables in meta fields ( closes #13637 )
7 years ago
dee2ff1d81
[test_utils] Fix tests under Windows
7 years ago
609ff8ca19
[utils] Support attributes with no values in get_elements_by_attribute()
7 years ago
b4a3d461e4
[utils] Handle HTMLParseError in extract_attributes ( closes #13349 )
8 years ago
2ae2ffda5e
[utils] Improve unified_timestamp
8 years ago
39d4c1be4d
[youtube] Improve chapters extraction ( closes #13247 )
8 years ago
5552c9eb0f
[utils] Recognize more patterns in strip_jsonp()
...
Used in Youku Show pages
8 years ago
e4a75d7932
[test_youtube_chapters] PEP 8
8 years ago
a57a8e9918
[test_youtube_chapters] Add coding cookie
8 years ago
9cafc3fd8b
[youtube] Extract chapters
8 years ago
0c26548601
[cda] Implement birthday verification ( closes #12789 )
8 years ago
deef31955b
[utils] Improve unified_timestamp
...
Seen at http://zaq1.pl/video/xev0e
8 years ago
9222d94510
[test_utils] Add one more clean_html test
8 years ago
30bb6ce1a4
[test_InfoExtractor] Fix test_parse_m3u8_formats
8 years ago
374560f018
[test_download] Fix order when testing file's md5
8 years ago
ff99fe529e
Don't list master m3u8 playlists in format list ( closes #12832 )
8 years ago
538eee7b6a
Add missing test m3u8 file
8 years ago
ddd258f922
[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag
8 years ago
cb2520802d
[extractor/common] Improve m3u8 extraction ( closes #12211 )
...
* Extract m3u8 parsing to separate method
* Improve rendition groups extraction
* Build stream name according stream GROUP-ID
* Ignore reference to AUDIO group without URI when stream has no CODECS
+ Add test coverage for parsing m3u8 from #11507 , #11995 , #12211 and twitch vod
8 years ago
5b995f713b
[utils] add support for ttml styles
8 years ago
51350db5a3
[test_YoutubeDL] Add test for #11163
8 years ago
364a69e8c6
[test_download] Fix testing playlists with single video and add comments
8 years ago
60e5016199
[test_download] Remove unused import
8 years ago
c4d6fc6d65
[test_subtitles] Fix raiplay test
8 years ago
80b2fdf9ac
[test_download] Match info dicts against tests before matching info file
8 years ago
3bef10a50c
[test_download] typo in comment
8 years ago
a84da06f49
[test_download] Improve diagnostic on wrong 'id'
8 years ago
942b44a052
[test_compat] Do not use dash in env variables' names
8 years ago
a426ef6d78
[test_utils] Do not use dash in env variables' names
8 years ago
41c5e60dd5
[test_utils] Fix expand_path tests
8 years ago
51098426b8
[utils] Introduce expand_path
8 years ago
c6c22e984d
[test_download] Print additional IEs in summary output
8 years ago
7f3590c43b
[test_InfoExtractor] Add some realworld tests for _extract_jwplayer_data
8 years ago
4b5de77bdb
[utils] Process bytestrings in urljoin ( closes #12369 )
8 years ago
f48409c7ac
[utils] Add pkcs1pad
...
Used in daisuki.net (#4738 )
8 years ago
c9619f0a17
[aes] Add aes_cbc_encrypt
...
Used in daisuki.net (#4738 )
8 years ago
d0d9ade486
[YoutubeDL] Add support for string formatting operations in output template
8 years ago
8936f68a0b
[travis] Run tests in parallel
...
[test_download] Print test names in case of network errors
[test_download] Add comments for nose parameters
[test_download] Modify outtmpl to prevent info JSON filename conflicts
Thanks @jaimeMF for the idea.
[travis] Only download tests should be run in parallel
8 years ago
398dea3210
[test_YoutubeDL] Fix invalid escape sequences
8 years ago
db13c16ef8
[utils] Add support for quoted string literals in --match-filter ( closes #8050 , closes #12142 , closes #12144 )
8 years ago
2af12ad9d2
Introduce get_elements_by_class and get_elements_by_attribute utility functions
8 years ago
4195096ea8
[utils] Improve comments processing in js_to_json ( closes #11947 )
8 years ago
b3ee552e4b
[utils] Handle single-line comments in js_to_json
8 years ago
15846398ca
[utils] Improve parse_duration
8 years ago
cb655f34fb
[utils] Add more date formats
8 years ago
7fe1592073
[common] fix dash codec information for mixed videos and fragment url construction( #11490 )
8 years ago
b0c65c677f
[utils] Improve urljoin
8 years ago
e34c33614d
[utils] Add convenience urljoin
8 years ago
582be35847
Update coding style after pycodestyle 2.1.0
...
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.
See https://github.com/PyCQA/pycodestyle/issues/400
See also #10689 ; thanks @stepshal for first mentioning this issue and
initial patches
8 years ago
189935f159
[jsinterp] Fix function calls without arguments.
8 years ago
02dc0a36b7
[utils] Introduce base_url
8 years ago
e5a088dc4b
[utils] Fix --match-filter for int-like strings ( closes #11082 )
8 years ago
6f20b65e72
[test/test_http] Update tests
...
After switching to HTML5 extraction helpers in generic.py, the result
info_dict is always a playlist.
8 years ago
c6eed6b8c0
[utils] Lower priority for rare date formats and add tests
8 years ago
PrinceOfPuppers
Remita Amine
Sergey M․
nixxo
Josh Soref
Kevin O'Connor
InfernalUnderling
Jakub Wilk
Ales Jirasek
Xiao Di Guan
Enes
Dan Salmon
Ricardo Constantino
Philipp Hagemeister
squibbysquibby
Mike Fährmann
Petr Novak
Yen Chi Hsuan
Tithen-Firion
John Hawkinson
Thomas Christlieb
Michal Čihař
Kacper Michajłow