Skip to content

A sample app using Azure Cognitive Search for retrieval and Azure OpenAI models to power ChatGPT-style and Q&A experiences.

License

MIT, MIT licenses found

Licenses found

MIT
LICENSE
MIT
LICENSE.md
Notifications You must be signed in to change notification settings

lordlinus/Enterprise-ChatGPT

ChatGPT + Enterprise data with Azure OpenAI

This demo is based on azure-search-openai-demo and using static web app for frontend and Azure functions for the backend API's.

In addition to azure-search-openai-demo feature this repo includes:

  • Ability to upload file from UI
  • Update to newer version of langchain(0.0.141)
  • Updated rrr ( read-retrieve-read) approach to use pandas dataframe and Bing search lookup in addition to Azure cognitive search

    Note: update azure function config with BING_SUBSCRIPTION_KEY to use. Bing API service deployment is not yet included in the azd infra deployment

  • Create Azure functions in different programming language e.g. (C#) and easily replace using config file
  • Static web page by default configured with AAD auth

High Level Overview of components

Getting Started

IMPORTANT: In order to deploy and run this example, you'll need an Azure subscription with access enabled for the Azure OpenAI service. You can request access here. You can also visit here to get some free Azure credits to get you started.

AZURE RESOURCE COSTS by default this sample will create Azure App Service and Azure Cognitive Search resources that have a monthly cost, as well as Form Recognizer resource that has cost per document page. You can switch them to free versions of each of them if you want to avoid this cost by changing the parameters file under the infra folder (though there are some limits to consider; for example, you can have up to 1 free Cognitive Search resource per subscription, and the free Form Recognizer resource only analyzes the first 2 pages of each document.)

Prerequisites

To Run Locally

NOTE: Your Azure Account must have Microsoft.Authorization/roleAssignments/write permissions, such as User Access Administrator or Owner.

Installation

Project Initialization

  1. Create a new folder and switch to it in the terminal
  2. Run azd login
  3. Run az account set --subscription "<your target subscription>"
  4. Run azd init
    • For the target location, the regions that currently support the models used in this sample are East US or South Central US. For an up-to-date list of regions and models, check here. Make sure that all the intended services for this deployment have availability in your targeted regions.

Starting from scratch

Execute the following command, if you don't have any pre-existing Azure services and want to start from a fresh deployment.

  1. Run azd up - This will provision Azure resources and deploy this sample to those resources
  2. After the application has been successfully deployed you will see a URL printed to the console. Click that URL to interact with the application in your browser.

NOTE: It may take a minute for the application to be fully deployed.

Use existing resources

  1. Run azd env set AZURE_OPENAI_SERVICE {Name of existing OpenAI service}
  2. Run azd env set AZURE_OPENAI_RESOURCE_GROUP {Name of existing resource group that OpenAI service is provisioned to}
  3. Run azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT {Name of existing ChatGPT deployment}. Only needed if your ChatGPT deployment is not the default 'chat'.
  4. Run azd env set AZURE_OPENAI_GPT_DEPLOYMENT {Name of existing GPT deployment}. Only needed if your ChatGPT deployment is not the default 'davinci'.
  5. Run azd up

NOTE: You can also use existing Search and Storage Accounts. See ./infra/main.parameters.json for list of environment variables to pass to azd env set to configure those existing resources.

Deploying or re-deploying a local clone of the repo

  • Simply run azd up

Quickstart

  • In Azure: navigate to the Azure WebApp deployed by azd. The URL is printed out when azd completes (as "Endpoint"), or you can find it in the Azure portal.
  • Running locally: navigate to 127.0.0.1:5000

Once in the web app:

  • Try different topics in chat or Q&A context. For chat, try follow up questions, clarifications, ask to simplify or elaborate on answer, etc.
  • Explore citations and sources
  • Click on "settings" to try different options, tweak prompts, etc.

Resources

How to purge aad auth

To remove your data from Azure Static Web Apps, go to https://identity.azurestaticapps.net/.auth/purge/aad

Upload files failures

Currently only PDF docs are supported try to limit to smaller files. Support for large PDF file uploads and other doc version will be added soon

Azure functions troubleshooting

Enable application insights and check if you have all the required settings configured correctly

  • AZURE_FORM_RECOGNIZER_SERVICE
  • AZURE_OPENAI_CHATGPT_DEPLOYMENT
  • AZURE_OPENAI_GPT_DEPLOYMENT
  • AZURE_OPENAI_SERVICE
  • AZURE_SEARCH_INDEX
  • AZURE_SEARCH_KEY
  • AZURE_SEARCH_SERVICE
  • AZURE_STORAGE_ACCOUNT
  • AZURE_STORAGE_CONTAINER
  • AzureWebJobsStorage
  • ENABLE_ORYX_BUILD
  • FUNCTIONS_EXTENSION_VERSION
  • FUNCTIONS_WORKER_RUNTIME
  • SCM_DO_BUILD_DURING_DEPLOYMENT

About

A sample app using Azure Cognitive Search for retrieval and Azure OpenAI models to power ChatGPT-style and Q&A experiences.

Resources

License

MIT, MIT licenses found

Licenses found

MIT
LICENSE
MIT
LICENSE.md

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published