Baseten Engineering Blog: pyannote speaker diarization model sped up 9.6x
Baseten made inference for pyannote's speaker diarization model 9.6x faster. The blog also covers delta weight synchronization optimizations for hosted RL rollouts, Baseten leading in the Coval voice AI benchmark, and new MCP and skills for coding agents to use Baseten.
Body
Blog Inference engineering Model performance How Baseten makes pyannote’s diarization models 9.6x faster Matte Lim 1 other Model performance Optimizing delta weight syncs for managed RL rollouts Paras Stefanopoulos Model performance Baseten leads Coval’s voice AI benchmark Ansel Erol 1 other AI engineering New MCP and skill for coding agents to use Baseten Marius Killinger 1 other AI models Best open-source models for post-training Chloe Florit Model performance The efficient frontier of LLM inference Philip Kiely Model performance Agentic kernels in production Brian Li 2 others AI models GLM-5.3: Scaling with post-training, intuitively explained Chloe Florit 1 other AI engineering How to run any open model inside DeepSeek Harness Alex Ker 1 2 3 ... 27 requestAnimationFrame(function(){$RT=performance.now()}); Popular models