Xidian University Wins 9 Awards at the 3rd China Graduate Operating System Open Source Innovation Competition and Will Host the 4th
Nine teams from Xidian University won 1 first prize, 5 second prizes, and 3 third prizes in the national finals of the 3rd China Graduate Operating System Open Source Innovation Competition, tying for first nationwide in the number of awards. One team built a containerized PD-disaggregated inference system based on vLLM; in recovery tests, first-token latency dropped by about 36% and total recovery time was shortened by about 25%, while under mixed-load concurrency testing, throughput increased by 6.1% and P99 first-token latency decreased by 15.7%. The 4th competition will be hosted by Xidian University.
Body · AI translation
The 3rd China Graduate Student Operating System Open Source Innovation Competition and the OpenAtom Competition Operating System Special Track National Finals were held in Beijing. A total of 9 teams from the university advanced to the finals, winning 1 national first prize, 5 national second prizes, and 3 national third prizes, tying for first place nationwide in the number of awards.
Project introduction: This project aims to address the issues of cache transfer waiting, abnormal resource residue, and cross-stage scheduling coordination faced by large language model PD-disaggregated inference in containerized deployment. Based on the vLLM open-source inference framework and targeting open-source operating systems, the team built a containerized inference system integrating independent deployment, unified routing, fast recovery, and service governance. Centered on the complete lifecycle of requests, the team designed and implemented layer-by-layer pipelined KV cache recovery, fault-aware communication resource governance, and an end-to-end SLO-coordinated scheduling mechanism, and fixed compatibility issues between chunked prefill and KV transfer. Tested across multiple operating systems and GPU platforms, the system supports independent start/stop and scaling of P/D instances and can perform anomaly identification, residual resource cleanup, and service recovery. In recovery tests, compared with full request retransmission, first-token latency was reduced by about 36% and total recovery time was shortened by about 25%; in mixed-load concurrency tests, throughput increased by 6.1% and first-token latency P99 decreased by 15.7%, providing an engineering practice solution that balances performance and reliability for disaggregated inference services of large language models on open-source operating systems.
It is reported that the China Graduate Student Operating System Open Source Innovation Competition is one of the themed events of the China Graduate Student Innovation and Practice Series Competitions. It is a national, non-profit open-source innovation competition for graduate and undergraduate students, guided by the Department of Degree Management and Graduate Education of the Ministry of Education and hosted by the Chinese Society of Academic Degrees and Graduate Education. This year's competition was organized by Tsinghua University and attracted 483 teams from 112 graduate training institutions across the country to register. After rigorous review and rounds of screening, a total of 108 teams advanced to the national finals. Nine teams from our university successfully broke through and reached the finals, tying for first place nationwide in the number of advancing teams, fully demonstrating the disciplinary strengths of Xidian University in computer science and software and its talent cultivation achievements.
The Xidian University campus competition of this year's event was hosted by the Graduate Work Department of the Party Committee and organized by the School of Computer Science and Technology. To further stimulate graduate students' innovation awareness, promote learning and innovation through competition, and help graduate students improve their innovative practical abilities in the operating system field, the School of Computer Science and Technology attached great importance to the event and made coordinated plans. Professor Li Qingshan, head of the university's software engineering discipline, served as the head of the competition studio, and multiple teams from the school's graduate education, training, and practical teaching center worked in coordination, actively mobilizing, widely publicizing, and meticulously organizing to ensure the efficient and orderly progress of the event. The school invited the secretary-general of the organizing committee, representatives of the OpenAtom Foundation, and open-source community experts to attend the launch meeting of the Xidian University campus competition and provide systematic guidance for this year's event; organized a campus competition experience-sharing session and invited award-winning teams from the second national finals to share their preparation experience, helping this year's participating teams clarify their preparation ideas and make pre-competition plans; and invited experts from inside and outside the university to polish the participating works on site through multiple rounds, organized pre-competition defenses in line with national competition review requirements, and put forward improvement suggestions to enhance the quality of the works. By strictly controlling the quality of all stages of the competition, the school has continuously consolidated the foundation for cultivating basic software talent.
After deliberation by the organizing committee, the 4th China Graduate Student Operating System Open Source Innovation Competition will be hosted by Xidian University. The organizing committee unanimously agreed that Xidian University has long been deeply engaged in the electronic information field, with profound scientific and technological innovation foundations and a strong innovation atmosphere, and has achieved fruitful results in the China Graduate Student Innovation and Practice Series Competitions. The university's School of Computer Science and Technology has a solid disciplinary foundation and remarkable talent cultivation results, and has performed outstandingly in previous China Graduate Student Operating System Open Source Innovation Competitions, fully demonstrating Xidian University's strong disciplinary strength in operating systems and basic software. The person in charge of the relevant work of the school, as the representative of the host unit of the 4th competition, spoke on stage at the closing ceremony, stating that the university will carefully coordinate and plan, refine the work plan, and make every effort to provide service guarantees, striving to make the competition a high-level, high-quality, and influential open-source innovation event. The university will also take hosting this competition as an opportunity to systematically summarize competition organization experience, consolidate the event organization system, comprehensively improve the level of competition organization, and build a platform for open-source technology exchange and talent cultivation. It warmly welcomes participating teams from across the country to gather at Xidian University next year to exchange skills, jointly research and innovate, and work together to help promote the high-quality development of China's basic software industry.