HUGS supports 13 models: Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Llama-3.1-405B-Instruct-FP8, Hermes-3-Llama-3.1-8B, Hermes-3-Llama-3.1-70B, Hermes-3-Llama-3.1-405B-FP8, Nous-Hermes-2-Mixtral-8x7B-DPO, Mixtral-8x7B-Instruct-v0.1, Mistral-7B-Instruct-v0.3, Mixtral-8x22B-Instruct-v0.1, Gemma-2-27b-it, Gemma-2-9b-it, and Alibaba’s Qwen2.5-7B-Instruct.
The documentation page on HUGS shows that Hugging Face is expected to add support for models such as Deepseek, T5, Phi, and Command R soon. Other multimodal and embeddings models that are expected to be added soon includes Idefics, Llava, BGE, GTE, Micbread, Arctic, Jina, and Nomic.
Nvidia says NIM supports more, though, including its proprietary Nemotron models, models from Cohere, A121, Adept, Getty Images, Shutterstock, and open models from Google, Hugging Face, Meta, Microsoft, Mistral AI, Stability AI.
