SenseTime Open-Sources SenseNova 6.8 Code2Video Model and Skill
SenseTime has released and open-sourced SenseNova 6.8 Code2Video, a lightweight model that creates and renders short videos by generating executable code, and has already achieved preliminary results in visual composition and motion design. The accompanying Skill supports turning ideas into videos and modifying them through follow-up instructions, and can also reconstruct reference videos into editable code. SenseTime has also open-sourced the model weights, the Skill, and the prompts and complete generation trajectories behind each demo video; these videos were all generated in a single run from a single prompt.
Why read this
AI score 60
SenseTime has open-sourced a model and Skill for generating and rendering short videos with code, and has released all generation trajectories to facilitate reproduction and secondary development.
Topics
Body
🎬 𝗗𝗲𝘀𝗰𝗿𝗶𝗯𝗲 𝘆𝗼𝘂𝗿 𝗶𝗱𝗲𝗮. 𝗔𝗜 𝘄𝗿𝗶𝘁𝗲𝘀 𝘁𝗵𝗲 𝗰𝗼𝗱𝗲. 𝗧𝗵𝗲 𝗰𝗼𝗱𝗲 𝗿𝗲𝗻𝗱𝗲𝗿𝘀 𝘁𝗵𝗲 𝘃𝗶𝗱𝗲𝗼. Introducing 𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮 𝟲.𝟴 𝗖𝗼𝗱𝗲𝟮𝗩𝗶𝗱𝗲𝗼, a 𝗹𝗶𝗴𝗵𝘁𝘄𝗲𝗶𝗴𝗵𝘁, 𝗼𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗲 𝗺𝗼𝗱𝗲𝗹 that generates executable code to create and render short videos, with promising early results in visual composition and motion design.
With the Skill, you can: 🔹 Turn an idea into a video and refine it through follow-up requests. 🔹 Recreate and remix reference videos in editable code.
We’ve open-sourced the 𝗺𝗼𝗱𝗲𝗹 𝘄𝗲𝗶𝗴𝗵𝘁𝘀 𝗮𝗻𝗱 𝗦𝗸𝗶𝗹𝗹, plus the prompts and complete generation trajectories behind every showcase video. Each was generated from a 𝘀𝗶𝗻𝗴𝗹𝗲 𝗽𝗿𝗼𝗺𝗽𝘁 𝗶𝗻 𝗼𝗻𝗲 𝗿𝘂𝗻, using the Skill.
We see code as a bridge between ideas and finished work, with future research exploring video editing, animation and 3D creation.
🤗 Model: https://t.co/PAuEGlFpHu 💻 Skill & Showcases: https://t.co/KzIhKuE02S