22920 Commits (a9ac178eb1c8800bb7bc53cc04ab2027d7287fba)

 

All Branches   

Search

Author	SHA1	Message	Date
Jody Bruchon	a9ac178eb1	Use 64 KiB buffered writes for performance and less fragmentation ... I use yt-dlp on Windows writing to a Linux system via SMB over a 10GbE connection and downloading via 400 Mbps cable internet. I have observed that downloads often seem to start very fast (40+ MiB/sec) but then throttle down to 8-20 MiB/sec. I also observed a large amount of disk thrashing for such a large array and small amount of data that's supposedly being written sequentially. The problem is two-fold. Downloaded fragments are stored using a very short-lived *-FragX file, then immediately appended to the stream upon fragment completion, and deleted. Both operations use small write buffers. When the OS write buffers start to flush, the two sets of writes plus the large number of writes start to force competition to complete the queued writes in different areas of the volume. Python defaults to sending writes at the underlying device's "block size" or a fallback to io.DEFAULT_BUFFER_SIZE. In practical terms, this means a write buffer of 4096 or 8192 bytes. This commit increases most write buffers to 65536 (64 KiB) using the open() buffering=X option, significantly speeding up writes of larger chunks of data and reducing potential fragmentation in low disk space conditions. With these changes, I consistently see fast downloads and the array thrashing is noticeably lessened.	1 month ago
bashonly	d298693b1b	[ie/soundcloud] Various fixes (#11820) ... - Fix original/download formats so that they are considered bestaudio - Raise appropriate error if track is DRM-protected Authored by: bashonly	1 month ago
bashonly	09a6c68712	[ie/youtube] Add age-gate workaround for some embeddable videos (#11821) ... Closes #11296 Authored by: bashonly	1 month ago
bashonly	1a8851b689	[ie/youtube] Fix `uploader_id` extraction (#11818) ... Closes #11816 Authored by: bashonly	1 month ago
bashonly	b91c3925c2	[update] Check 64-bitness when upgrading ARM builds (#11819) ... Closes #11813 Authored by: bashonly	1 month ago
bashonly	3d3ee458c1	[update] Fix endless update loop for `linux_exe` builds (#11827) ... Closes #11808 Authored by: bashonly	1 month ago
github-actions[bot]	2037a6414f	Release 2024.12.13 ... Created by: bashonly :ci skip all	2 months ago
sepro	5421669626	[cleanup] Make more playlist entries lazy (#11763) ... Authored by: seproDev	2 months ago
bashonly	dc3c4fddcc	[ie/youtube] Prioritize original language over auto-dubbed audio (#11803) ... Closes #11753 Authored by: bashonly	2 months ago
bashonly	5460cd9189	[ie/youtube] Fix signature function extraction for `2f1832d2` (#11801) ... Closes #11798 Authored by: bashonly	2 months ago
Crypto90	f6c73aad5f	[ie/youtube:search_url] Fix playlist searches (#11782) ... Closes #11666 Authored by: Crypto90	2 months ago
Pew	d5e2a379f2	[ie/youtube] Fix `release_date` extraction (#11759) ... Authored by: MutantPiggieGolem1	2 months ago
bashonly	bc262bcad4	[ie/patreon:campaign] Support /c/ URLs (#11756) ... Closes #11755 Authored by: bashonly	2 months ago
bashonly	f4d3e9e6dc	[ie/soundcloud] Fix extraction (#11777) ... Authored by: bashonly	2 months ago
github-actions[bot]	6fef824025	Release 2024.12.06 ... Created by: bashonly :ci skip all	2 months ago
bashonly	4bd2655398	[ie/youtube] Raise if `n` function returns input value (#11752) ... Improve a95ee6d880 Authored by: bashonly	2 months ago
bashonly	a95ee6d880	[ie/youtube] Fix `n` sig extraction for player `3bb1f723` (#11750) ... Closes #11744 Authored by: bashonly	2 months ago
bashonly	4c85ccd136	[ie/youtube] Fix signature function extraction (#11751) ... Closes #11748 Authored by: bashonly	2 months ago
bashonly	2feb28028e	[ie/soundcloud] Fix formats extraction (#11742) ... Authored by: bashonly	2 months ago
N/Ame	fca3eb5f8b	[ie/bilibili] Fix HD formats extraction (#11734) ... Fixes dc16876480 Closes #10554 Authored by: grqz	2 months ago
bashonly	2e49c789d3	[ie/youtube] Player client maintenance (#11724) ... Closes #11686 Authored by: bashonly	2 months ago
wesson09	354cb4026c	[cookies] Add `--cookies-from-browser` support for MS Store Firefox (#11731) ... Authored by: wesson09	2 months ago
github-actions[bot]	cfa76f35d2	Release 2024.12.03 ... Created by: bashonly :ci skip all	2 months ago
bashonly	2b67ac300a	[cleanup] Misc (#11716) ... Authored by: bashonly, seproDev Co-authored-by: sepro <sepro@sepr0.com>	2 months ago
bashonly	c038a7b187	[ie/vk] Fix extractors (#11715) ... Closes #5832, Closes #11471, Closes #11646, Closes #11670 Authored by: bashonly	2 months ago
Link	a13a336aa6	[ie/bilibili] Fix subtitles and chapters extraction (#11708) ... Authored by: xiaomac	2 months ago
N/Ame	dc16876480	[ie/bilibili] Always try to extract HD formats (#10559) ... Closes #10554 Authored by: grqz	2 months ago
N/Ame	f05a1cd149	[ie/bilibili] Fix supporter-only video extraction (#11711) ... Fix bug in 239f5f36fe Closes #11702 Authored by: grqz, bashonly Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>	2 months ago
sepro	d8fb349086	[cleanup] Bump ruff to 0.8.x (#11608) ... Authored by: seproDev	2 months ago
sepro	2bea793632	[ie/MicrosoftEmbed] Make format extraction non fatal (#11654) ... Authored by: seproDev	2 months ago
Elan Ruusamäe	62cba8a1be	[ie/duoplay] Fix extractor (#11588) ... Authored by: glensc, bashonly Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>	2 months ago
N/Ame	239f5f36fe	[ie/bilibili] Fix extractor (#11667) ... Closes #11665 Authored by: grqz	2 months ago
bashonly	0d146c1e36	[ie/youtube] Adjust player clients for site changes (#11663) ... Closes #11640 Authored by: bashonly	2 months ago
DarkZeros	cd0f934604	[ie/mitele] Fix extractor (#11683) ... Closes #11690 Authored by: DarkZeros	2 months ago
N/Ame	360aed810a	[ie/instagram] Support `share` URLs (#11677) ... Closes #11630 Authored by: grqz	2 months ago
bashonly	00dcde7286	[ie/dropbox] Fix password-protected video extraction (#11636) ... Closes #11634 Authored by: bashonly	2 months ago
bashonly	910ecc4229	[ie/tiktok] Deprioritize animated thumbnails (#11645) ... Closes #11641 Authored by: bashonly	2 months ago
bashonly	0a0d80800b	[ie/dacast] Fix HLS AES formats extraction (#11644) ... Closes #11643 Authored by: bashonly	2 months ago
Simon Sawicki	e0500cbf79	[ie] Handle fragmented formats in `_remove_duplicate_formats` (#11637) ... Authored by: Grub4K	2 months ago
Jakob Kruse	4b5eec0aaa	[ie/chaturbate] Fix support for non-public streams (#11624) ... Fix bug in 720b3dc453 Closes #11623 Authored by: jkruse	2 months ago
sepro	fe70f20aed	[ie/youtube:tab] Fix playlists tab extraction (#11615) ... Closes #11524 Authored by: seproDev	2 months ago
coletdjnz	c7316373c0	[rh:websockets] Support websockets 14.0+ (#11616) ... Authored by: coletdjnz	2 months ago
N/Ame	e0f1ae813b	[ie/facebook] Support more groups URLs (#11576) ... Authored by: grqz	2 months ago
sepro	7d6c259a03	Add `playlist_webpage_url` field (#11613) ... Closes #10827 Authored by: seproDev	2 months ago
gitninja1234	16336c51d0	[ie/stripchat] Fix extractor (#11596) ... Closes #11587 Authored by: gitninja1234	2 months ago
bashonly	ccf0a6b86b	[cleanup] Misc (#11574) ... Authored by: bashonly, pzhlkj6612 Co-authored-by: Mozi <29089388+pzhlkj6612@users.noreply.github.com>	2 months ago
github-actions[bot]	f919729538	Release 2024.11.18 ... Created by: bashonly :ci skip all	2 months ago
bashonly	7ea2787920	[ie/reddit] Improve error handling (#11573) ... Authored by: bashonly	2 months ago
bashonly	f7257588bd	[ie/digitalconcerthall] Support login with access/refresh tokens (#11571) ... Removes broken support for login with email and password Removes obsolete `prefer_combined_hls` extractor-arg Closes #11404, Closes #11436 Authored by: bashonly	2 months ago
bashonly	da252d9d32	[cleanup] Misc (#11554) ... Closes #6884 Authored by: bashonly, Grub4K, seproDev Co-authored-by: Simon Sawicki <contact@grub4k.xyz> Co-authored-by: sepro <sepro@sepr0.com>	2 months ago