LLM Inference
Available Models
LLM Inference
Available Models
List of models we currently host and their api keys
Models Coming Soon
| Model Name |
|---|
| Llama3 8B Instruct |
| Llama3 70B Instruct |
| Mistral 7B Instruct |
| Mixtral 8x7B Instruct |
| Mixtral 8x22B Instruct |
| Gemma2 9B |
| Gemma 7B Instruct |
If there are models that you would like to use that are not listed above, please let us know here and we will get them set up as soon as possible.
Contact us if you would like any further details on how we can solve your open-source hosting needs.