Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added CLOVA studio Hyperclova X API support #853

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

aschung01
Copy link

This PR adds support for the Hyperclova X API of CLOVA studio.

Product page
Chat completeion API docs

Even though it's still in closed beta, Hyperclova X is extensively used by Korean startups and companies, thanks to its proficiency in Korean.

Copy link

vercel bot commented Nov 20, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 27, 2023 2:38am

@krrishdholakia
Copy link
Contributor

missing:

  • exception mapping (check: exception_type())
  • streaming support (check: CustomStreamWrapper)

@aschung01 the colab you shared on discord worked for me. If you can add these missing items, i think this is good for merge.

@aschung01
Copy link
Author

I just added exception mapping & sync/async fake streaming, and added examples on the colab. Could you check it out? @krrishdholakia

@aschung01
Copy link
Author

I've also modified model_prices_and_context_window.json because the JSON format wasn't consistent. Now the entire file follows a unified format.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants