ποΈ Comparison Table of all supported Language Models
| Provider | Streaming | Tools (sync/streaming) | JSON Schema | JSON Mode | Supported Modalities (Input) | Observability | Customizable HTTP Client | Local Deployment | Supports Native Image | Comments |
ποΈ Amazon Bedrock
Maven Dependency
ποΈ Anthropic
- Anthropic Documentation
ποΈ Azure OpenAI
This is the documentation for the Azure OpenAI integration, that uses the Azure SDK from Microsoft, and works best if you are using the Microsoft Java stack, including advanced Azure authentication mechanisms.
ποΈ ChatGLM
https://github.com/THUDM/ChatGLM-6B
ποΈ DashScope (Qwen)
DashScope is a platform developed by Alibaba Cloud.
ποΈ GitHub Models
This is the documentation for the GitHub Models integration, that uses the Azure AI Inference API to access GitHub Models.
ποΈ Google AI Gemini
https://ai.google.dev/gemini-api/docs
ποΈ Google Vertex AI Gemini
Vertex AI is Google Cloud's fully-managed AI development platform that provides access to Google's large generative models, including the older generation (PaLM2) and the newer generation (Gemini).
ποΈ Google Vertex AI PaLM 2
The "Bison" models have been discontinued by Google.
ποΈ Hugging Face
HuggingFace Inference API
ποΈ Jlama
Jlama Project
ποΈ LocalAI
https://localai.io/
ποΈ MistralAI
MistralAI Documentation
ποΈ Ollama
What is Ollama?
ποΈ OpenAI
This is the documentation for the OpenAI integration, that uses a custom Java implementation of the OpenAI REST API, that works best with Quarkus (as it uses the Quarkus REST client) and Spring (as it uses Spring's RestClient).
ποΈ OpenAI Official SDK
This is the documentation for the OpenAI Official SDK integration, that uses the official OpenAI Java SDK.
ποΈ Qianfan
ηΎεΊ¦ζΊθ½δΊεεΈε€§ζ¨‘ε
ποΈ Cloudflare Workers AI
https://developers.cloudflare.com/workers-ai/
ποΈ ZhiPu AI
ZhiPu AI is a platform to provide model service including text generation, text embedding,
ποΈ Xinference
- https://inference.readthedocs.io/