Skip to main content

Check out Port for yourself 

LLM Provider Management

Closed Beta

Port's AI offerings are currently in closed beta and will be gradually rolled out to users by the end of 2025.

Limited Availability

The ability to configure your own LLM providers has limited availability. Please reach out to the Port support team for additional information and access.

Manage and configure the Large Language Model (LLM) providers that power all AI interactions in Port. This feature gives you control over which AI models are used across Port AI Assistant, AI Agents, and other AI-powered features.

LLM Approach Overview​

Port offers two approaches for AI model usage:

Port's Managed AI Infrastructure (Default)​

Port provides state-of-the-art LLMs through our secured cloud infrastructure by default:

  • No data training: We never train models on your data
  • Enterprise security: Your data is processed securely and not stored
  • Automatic updates: Always access to the latest model versions
  • Zero setup: Works immediately with no configuration required

Learn more about our data controls and security measures.

Bring Your Own LLM​

For organizations requiring additional control, Port also supports configuring your own LLM providers:

  • Data privacy: Keep AI processing within your own infrastructure
  • Compliance: Meet specific regulatory or organizational requirements

Supported LLMs and Providers​

Port supports the following LLM providers and models:

  • OpenAI: gpt-5
  • Anthropic: claude-sonnet-4-20250514
  • Azure OpenAI: gpt-5
  • AWS Bedrock: claude-sonnet-4-20250514

Port AI leverages gpt-5 and claude-sonnet-4-20250514 by default when no custom provider is configured.

How This Affects Port AI Features​

All Port AI features rely on the configured default providers. When working directly with the API, you can even select which provider and model to use for specific requests.

Frequently Asked Questions​

What are the benefits of using Port's managed AI infrastructure? (Click to expand)

Port's managed AI infrastructure provides several advantages:

  • Zero setup: Works immediately with no configuration required
  • Automatic updates: Always access to the latest model versions
  • Enterprise security: Your data is processed securely and not stored
  • No data training: We never train models on your data
  • Reliable performance: Optimized for Port's AI features

This is the recommended approach for most organizations as it provides the best balance of security, performance, and ease of use.

When should I consider bringing my own LLM provider? (Click to expand)

Consider bringing your own LLM provider when you need:

  • Enhanced data privacy: Keep AI processing within your own infrastructure.
  • Compliance requirements: Meet specific regulatory or organizational requirements.
  • Custom models: Define custom configuration on models not available through Port's managed infrastructure.
  • Integration requirements: Connect with existing AI infrastructure.

Note: This feature has limited availability. Contact the Port support team for access.

How does data handling differ between Port's managed infrastructure and bring your own LLM? (Click to expand)

Port's Managed Infrastructure:

  • Data is processed within Port's secure cloud infrastructure.
  • Your data is not used for model training.
  • Complete logical separation between different customers' data.
  • Data processing occurs within Port's controlled environment.

Bring Your Own LLM:

  • Data is processed by your chosen LLM provider.
  • You control where and how your data is processed.
  • Must comply with your provider's data handling policies.
  • Port still retain interaction data for operational purposes.

Detailed Information:

What security controls apply when using my own LLM provider? (Click to expand)

When using your own LLM provider, you maintain the same security controls as Port's managed infrastructure:

  • RBAC compliance: Port AI still respects your organization's access controls.
  • Data governance: All interactions respect your configured data access policies.
  • Audit trail: AI interactions are still logged and trackable.
  • Permission inheritance: Port AI cannot access data you don't have permission to view.

Additional considerations:

  • You're responsible for your LLM provider's security measures.
  • Ensure your provider meets your compliance requirements.
  • Monitor your provider's data handling practices.

Detailed Information:

Can I opt out of data storage when using my own LLM provider? (Click to expand)

Yes, you can opt out of data storage even when using your own LLM provider. However, there are important considerations:

What you can opt out of:

  • 30-day interaction data storage by Port.
  • Port's operational data retention.

Impact of opting out:

  • May impact Port's ability to provide support and troubleshoot issues.
  • Could affect AI feature performance and reliability.

Detailed Information:

How do I get access to bring your own LLM functionality? (Click to expand)

The bring your own LLM feature has limited availability. To get access:

  1. Contact Port support - Reach out to the Port support team or your account manager for additional information.
  2. Get approval - If approved, you'll receive access to configure your own providers.
  3. Configure your providers - Set up your preferred LLM providers and models using the API endpoints.

This feature is designed for organizations with specific compliance, privacy, or integration requirements that cannot be met by Port's managed infrastructure.

What happens to my existing AI interactions when I switch LLM providers? (Click to expand)

When you switch LLM providers:

  • Existing AI invocations: All previous interactions remain accessible and unchanged.
  • New interactions: Will use your newly configured provider.
  • Data continuity: No data is lost during the transition.
  • Performance: Response times and capabilities may change based on your new provider.

Important considerations:

  • Test your new provider configuration thoroughly.
  • Monitor performance and adjust settings as needed.
  • Ensure your new provider meets your security and compliance requirements.