English translation is being prepared.

English translation is being prepared.

View original

We have been training with TPUs in academia for two years now (huge thanks to Google TRC!). Works like Cambrian-1, Cambrian-S, RAE, and Scale-RAE would not have been possible without TPUs. We wrote a blog post sharing our experiences, optimizations, and lessons learned: https://t.co/vHTQXQyqqJ We hope this can help more people having a smoother experience working with TPUs, they are very powerful!