Agent uptime
This guide explains how CustomGPT keeps your agents online by automatically switching to a fallback model provider whenever the primary OpenAI API is unavailable.
What is agent uptime?
Agent uptime is a built-in reliability feature that ensures your AI agent continues to function even if the primary model provider experiences downtime. If you are using an OpenAI model and the OpenAI API becomes unavailable, CustomGPT automatically reroutes requests to an alternative provider such as OpenAI via Azure or Anthropic. This happens instantly and without any manual input.
How automatic failover works
- CustomGPT detects an issue with the OpenAI API.
- Traffic is automatically redirected to a backup model provider.
- Once service is restored, the system switches back to the primary provider.
- No setup or configuration is required from the user.
Why this feature is important
Service disruptions from external model providers can interrupt support, sales, or other user-facing workflows. Agent uptime helps avoid those interruptions by ensuring your agent continues to respond, even during provider outages.
This feature is especially useful if your agent is used for:
- Consistent performance: Your AI agent stays responsive during provider outages.
- High-demand environments: Ensure your agent is always available, even during traffic spikes or time-sensitive use cases.
- Improved reliability: Keeps customer-facing experiences uninterrupted and stable.
By automatically switching to a backup provider, CustomGPT protects the continuity of your AI-powered experience and requires no action from your team.
How do I enable this fallback in case OpenAI is down?
You don't need to take any action. This feature is automatically enabled for all users who use an OpenAI model in their agents. There is no need to configure anything.
Does automatic fallback work is I use Anthropic models or Azure OpenAI?
Currently, this is not supported.
Note:
If your organization has strict compliance requirements for specific model providers, and you would like to enable downtime fallback, please contact our support to learn more about available options.
Updated 1 day ago