LLM Model Error Handling Improvement

Implement generalized error codes and smoother handling for model-related failures.
This will help both users and platforms create more reliable alert systems and improve overall system

Example for Open AI

Code

CodeOverview

401 - Invalid Authentication

Cause: Invalid Authentication
Solution: Ensure the correct API key and requesting organization are being used.

401 - Incorrect API key provided

Cause: The requesting API key is not correct.
Solution: Ensure the API key used is correct, clear your browser cache, or generate a new one.

401 - You must be a member of an organization to use the API

Cause: Your account is not part of an organization.
Solution: Contact us to get added to a new organization or ask your organization manager to invite you to an organization.

403 - Country, region, or territory not supported

Cause: You are accessing the API from an unsupported country, region, or territory.
Solution: Please see this page for more information.

429 - Rate limit reached for requests

Cause: You are sending requests too quickly.
Solution: Pace your requests. Read the Rate limit guide.

429 - You exceeded your current quota, please check your plan and billing details

Cause: You have run out of credits or hit your maximum monthly spend.
Solution: Buy more credits or learn how to increase your limits.

500 - The server had an error while processing your request

Cause: Issue on our servers.
Solution: Retry your request after a brief wait and contact us if the issue persists. Check the status page.

503 - The engine is currently overloaded, please try again later

Cause: Our servers are experiencing high traffic.
Solution: Please retry your requests after a brief wait.

503 - Slow Down

Cause: A sudden increase in your request rate is impacting service reliability.
Solution: Please reduce your request rate to its original level, maintain a consistent rate for at least 15 minutes, and then gradually increase it.

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board

πŸ‘πŸ» Feedback

Date

9 months ago

Author

Vrijraj Singh

Subscribe to post

Get notified by email when there are changes.