Yuchen Jin marvels at the hand-written image inference engine from a year ago
AI summary
Yuchen Jin shares a conversation with a friend: a year ago, they built an ultra-fast inference engine for image models, and the entire engine was written by hand. He exclaimed in response, "Holy shit. Just ONE year ago."
Body
Crazy convo with a friend today:
“Remember that super fast inference engine we built for image models?”
“Yeah, a year ago.”
“Dude, we wrote the WHOLE thing by hand.”
Holy shit. Just ONE year ago.