Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: The 429 error code hides the real cause. #5764

Closed
kmyczkowska-hypatos opened this issue Sep 18, 2024 · 2 comments
Closed

[Bug]: The 429 error code hides the real cause. #5764

kmyczkowska-hypatos opened this issue Sep 18, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@kmyczkowska-hypatos
Copy link

What happened?

Hello,
Would it be possible to return the 529 error code (as originally provided by the vendor) instead of mapping it to 429, which indicates the issue is on our side?

Relevant log output

Error code: 429 - {'error': {'message': 'No deployments available for selected model, Try again in 60 seconds. Passed model=vertex-claude-3-5-sonnet. pre-call-checks=False, allowed_model_region=n/a, cooldown_list=[(\'...\', {\'Exception Received\': \'litellm.APIConnectionError: Server error \\\'529 Internal Server Error\\\' for url \\\'..../anthropic/models/claude-3-5-sonnet@

Twitter / LinkedIn details

No response

@kmyczkowska-hypatos kmyczkowska-hypatos added the bug Something isn't working label Sep 18, 2024
@krrishdholakia
Copy link
Contributor

@kmyczkowska-hypatos if you bump to latest, this issue re: cooldowns is now fixed.

@krrishdholakia
Copy link
Contributor

Please feel free to re-open / create a new issue, with minimal repro steps, if this persists

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants