The Challenge
Enterprises want to leverage the productivity benefits of ChatGPT & Co. but face significant hurdles:
- Data Privacy: Sensitive company data must not be sent to OpenAI or Anthropic
- GDPR Compliance: Processing must occur within the EU
- AI Act: Training obligations and documentation are required
- Integration: Connecting to internal systems (SharePoint, databases, APIs) is complex
- Extensibility: Proprietary solutions are difficult to customize
The Solution
CompanyGPT is an extensible AI assistant based on open source that runs entirely in the customer’s cloud. innFactory provides the technical implementation and ongoing operations.
Multi-Model Support
All leading LLMs in one interface - the customer chooses which models to activate:
| Provider | Models |
|---|---|
| OpenAI | GPT-4o, GPT-4o-mini, o1, o3 |
| Anthropic | Claude 3.5 Sonnet, Claude 3 Opus |
| Gemini 2.0 Flash, Gemini 1.5 Pro | |
| AWS Bedrock | Claude, Titan, LLama |
| STACKIT | LLama 3 (sovereign) |
Extensibility with MCP & n8n
Model Context Protocol (MCP) enables connection to any data source:
- SharePoint Integration with permission synchronization
- Database Connections (SQL, CosmosDB, PostgreSQL)
- REST API Integration for internal services
- Web Search with source citations
n8n Automation for AI-powered workflows:
- Automatic document creation
- Email classification and response
- Ticket routing and summarization
Enterprise Features
- SSO Integration (Entra ID, Keycloak, OIDC)
- Corporate Branding of the interface
- Agent Marketplace for internal AI agents
- Memory Function for context-aware conversations
- Audit Logging for compliance
Open Source & GitOps
CompanyGPT is based on LibreChat and other open source components:
- No vendor lock-in through proprietary software
- Full transparency over the code
- GitOps Deployment with Flux CD
- Automatic updates via GitHub Actions
Technical Architecture (Azure)
| Layer | Technology |
|---|---|
| Cloud | Microsoft Azure (also AWS/STACKIT) |
| Container | AKS (Azure Kubernetes Service) |
| Database | CosmosDB, Azure Postgres |
| Storage | Azure Blob Storage |
| Auth | Entra ID (Azure AD) |
| LLMs | Azure OpenAI, Vertex AI, Bedrock |
| Deployment | Flux CD, GitHub Actions |
| Monitoring | Azure Monitor, Grafana |
Our Services
- Architecture Design for customer-specific cloud environment
- Kubernetes Setup (AKS/EKS) for highly available operations
- SSO Integration with Entra ID or Keycloak
- MCP Server Development for custom integrations
- n8n Workflow Development for automation
- GitOps Pipeline with Flux CD
- DevOps & SRE for ongoing operations
- AI Act Training for employees
Reference Customers
CompanyGPT is deployed at over 20 companies across various industries:
- Schoen Kliniken - Medical documentation
- Rohrdorfer - Knowledge management in building materials
- AVG Mercedes - Customer service in automotive
- Duschl Ingenieure - Technical documentation
- ift Rosenheim - Research documentation
- Huber & Sohn - Project planning in timber construction
- and more…
Why CompanyGPT?
| Aspect | ChatGPT/Claude | CompanyGPT |
|---|---|---|
| Data Ownership | At OpenAI/Anthropic | In Your Cloud |
| GDPR | Problematic | Fully Compliant |
| Extensible | Limited | Unlimited (MCP, n8n) |
| Branding | Not Possible | Fully Customizable |
| Open Source | No | Yes (LibreChat) |
| AI Act | Unclear | Including Training |
Related Services: AI & Machine Learning | Azure Cloud | AWS Cloud | STACKIT Cloud
