Zhou Cong
I'm a third-year Ph.D. candidate in Computer Science at Shanghai Jiao Tong University.
Github: cong258258Email: cong258258@sjtu.edu.cn
Email: cong258258@outlook.com
Tel: +86 13122699848
About me
I'm a third-year Ph.D. candidate in Computer Science at Shanghai Jiao Tong University. I received my Bachelor's degree from the ACM Class, which is part of Zhiyuan Honor Program for top talented students at SJTU.
My research interests lies in Computer Systems. To be specific, I'm passionate about computer architecture, especially hardware accelerators, PIM architectures, HBM, etc. I'm current working on KV-store and LLM inference acceleration, utilizing novel hardwares like SmartNICs (NVIDIA Bluefield 3). Other areas in computer systems like networking ans operating systems are all new fields I would like to have a try on.
CV (English) CV (Chinese)Skills
My Work and Research Experience.
JULY. 2021 – JUNE. 2022
Advanced Computer Architecture Laboratory, Shanghai Jiao Tong University
Undergraduate Research Assistant at ACA lab, supervised by Prof. Li Jiang.
Participated in research projects on PIM (process-in-memory), building specific accelerators to optimize algorithms and data structures (point chasing in linked list, B+ tree, etc.) and optimizing certain memory-bound scenarios (memcpy/memset in cache, etc).
JUNE. 2022 – Jan. 2023
System Wireless Group, Microsoft Research Asia
Intern at MSRA Shanghai Wireless Group, supervised by Prof. Lili Qiu, Assistant Managing Director of Microsoft Research Asia.
Participated in research projects on wireless bandwidth estimation (5G, Wi-Fi, Low-Earth Orbit Satellite Networks, etc).
Sep. 2023 – Now
DDST Lab, Shanghai Jiao Tong University
Research Assistant at DDST lab, supervised by Prof. Linpeng Huang and Prof. Shengan Zheng.
I'm working on hardware-software co-design for KV-store and LLM inference acceleration.
SEPT. 2020 – JAN. 2021
CS152: C++ programming (B)
Teaching Assistant, TA team leader
JAN. 2021 – JUNE. 2021
CS1951 & CS0501H: Data Structure
Teaching Assistant, TA team leader of three classes
JUNE. 2021 – AUG. 2021
CS1952 & CS1956: Principle and Practice of Computer Algorithms
Teaching Assistant, TA team leader of two classes
SEP. 2021 – JAN. 2022
CS1953: C++ programming (A)
Teaching Assistant, TA team leader
During my four-semester experience as the TA group leader, I prepared numerous course projects, including a pipelined RISC-V simulator implemented in C++, an AI battle field game based on Monte Carlo, a railway ticket management system consisting of file-based data structures and web frontend, and STLite which is a naïve implementation of C++ STL, as well as taught useful algorithms from Information Olympics in class.
Projects, Awards and Publications
Competition
注意力算不队：KV Cache Reuse
Shu Shi, Huang Weiquan, Wang Guifeng, Zhou Cong
First Prize, Challenge Track, 3rd Massive Storage National College Student Information Storage Technology Competition by Huazhong University of Science and Technology (HUST), Jan. 2026
Competition
NIC-GPU-CPU Co-Infer (NGCoinfer): Collaborative Distributed LLM Inference Framework
Zhou Cong, Shu Shi, Li Jingxiang, Wang Yiyang, Huang Weiquan
Second Prize, 3rd Nvidia DPU Hackathon China, July. 2025
Textbook Authorship
Hands-On Data Structures and Algorithms (动手学数据结构与算法)
Yu Yong, Weng Huiyu, Fu Ling, Zhou Cong
Published by Posts & Telecom Press, 2024, ISBN: 9787115647801
Conference Paper
Marlin: I/O-Efficient Prefix KV Cache Retrieval for Long-Prefix LLM Serving
Published in Design Automation Conference (DAC), 2026
Conference Paper
Prism: Reducing Arithmetic for High-Recall Approximate Nearest Neighbor Search on Processing-in-Memory
Published in Design Automation Conference (DAC), 2026
Todo