0

Does Your Model Run on AWS Trainium? Look It Up

https://huggingface.co/blog/torch-neuronx-model-support(huggingface.co)
A new Hugging Face Space, "torch-neuronx model support," has been launched to help users determine if popular models from the Hub can run on AWS Trainium. The tool indicates whether a model runs unmodified and provides metrics such as the number of Trainium cores used, wall time, and peak device memory. Users can also access the exact scripts and package requirements needed to run the models themselves on a Trainium instance. The test involves generating tokens and checking them for correctness or fluency. All the data presented in the Space is sourced from a public dataset that can be queried directly for detailed results.
0 points•by ogg•1 hour ago

Comments (0)

No comments yet. Be the first to comment!

Have an account? Log in to join the discussion.