Velum:方便部署的CosyVoice推理程序
CosyVoice是当下比较出色的一款 TTS 模型,但其推理程序使用的Python体系比较老旧,需要在部署的时候做一些处理,而且Python依赖占用空间较大,不利于大量能力情况下的Agent部署。要是每个agent能力都要一堆Python十几G的依赖,每一堆还有版本冲突,那就不要卖机型了,不如回家卖红薯。 Velum编译之后只有一个可执行文件,所谓部署更新就是拷贝。一些预处理的模型相关的东西虽然需要用Python生成,但运行时是不需要任何Python的东西。
Velum同时也是一个例证,它是由人类做架构规划,DeepSeek-v4-pro完成的项目,也就是说,DeepSeek足以做这种程度的Vibe。在当下Claude只需要两轮配额就烧干的今天,稍微复杂点的程序,如果不能用DeepSeek做,最后还是要回家卖红薯。
希望以后Codex和Claude也能增强自己的竞争力,把售价向DeepSeek靠拢,让天下无红薯可卖,也未尝不是一件美事。
https://github.com/hardenedlinux/velum
本文来源:https://www.solidot.org/story?sid=85479
若有版权问题,请来信告知:13951431913#139.com 或在右方提交评论。
Velum: A CosyVoice Inference Program That Is Easy to Deploy
Nala Ginrut wrote: HardenedLinux recently released Velum, which can be used for CosyVoice inference. It is developed in modern C++ and compiled into a single executable file for easy deployment. CosyVoice is currently one of the more outstanding TTS models, but its inference program uses a relatively outdated Python stack that requires some handling during deployment, and the Python dependencies take up a large amount of space, which is not conducive to Agent deployment in scenarios with many capabilities. If every agent capability required a pile of Python dependencies totaling ten-plus gigabytes, with version conflicts on top of that, then you might as well forget about selling your hardware models and just go home and sell sweet potatoes. After compilation, Velum is only a single executable file, so deployment and updates are just copying. Although some preprocessing model-related things need to be generated with Python, nothing Python-related is needed at runtime. Velum is also a proof of concept: it is a project where humans did the architecture planning and DeepSeek-v4-pro completed it. In other words, DeepSeek is sufficient for this level of vibe. In today's world where Claude's quota burns out in just two rounds, for slightly more complex programs, if you can't do it with DeepSeek, you'll end up going home to sell sweet potatoes anyway. I hope that in the future Codex and Claude can also strengthen their competitiveness, move their prices closer to DeepSeek's, and make it so there are no sweet potatoes left to sell in the world—that would not be a bad thing at all. https://github.com/hardenedlinux/velum
Reply
