Skip to content

Latest commit

 

History

History
51 lines (39 loc) · 3.49 KB

integrated_vectorization.md

File metadata and controls

51 lines (39 loc) · 3.49 KB
Raw

Back to Chat with your data README

Integrated Vectorization

USER STORY | DEPLOYMENT INSTRUCTIONS

User Story

User Story

This feature allows chunking and vectorization of data during ingestion into Azure AI Search through built-in pull-indexers. It supports automatic processing of data directly from storage - meaning the user can just upload their data to Azure Blob Storage and the built-in pull-indexers will do the chunking, vectorization and indexing. This removes the need for Chat With Your Data to explicitly perform chunking, vectorization and pushing to the search index. Read more.

NOTE: Every instance of Chat With Your Data will need to be configured whether or not to use Integrated Vectorization at deployment time. Once deployed, you will be unable to switch between enabling and disabling Integrated Vectorization when the application is running. In order to run a fresh deployment to switch to and from Integrated Vectorization, refer to the following sections in this document:

Using the Deploy to Azure button

When you click the "Deploy to Azure" button on the repo's main page, you will be taken to the Azure portal, where you can select "true" for the option "Azure Search Use Integrated Vectorization". Integrated Vectorization

Local Deployment - If deploying for the first time

If you're deploying Chat With Your Data for the first time, run the following before running azd up to enable Integrated Vectorization:

 azd env set AZURE_SEARCH_USE_INTEGRATED_VECTORIZATION true

Local Deployment - If you already have a previous deployment

If you have previously deployed Chat With Your Data without Integrated Vectorization enabled, you probably have a search index already deployed to your Azure subscription. Integrated Vectorization will require a new, fresh index to function properly so please follow the below steps to enable Integrated Vectorization when you have a previous deployment:

  1. On your Azure portal, navigate to the resource group which has your Chat With Your Data deployment.
  2. Delete the existing search index. Delete Search Index
  3. Run the command azd env set AZURE_SEARCH_USE_INTEGRATED_VECTORIZATION true
  4. Run azd up

Local Deployment - If you want to switch back to push-based indexing from Integrated Vectorization

If you have a deployment with Integrated Vectorization enabled, and you want to disable it, you will need to follow the below steps:

  1. On your Azure portal, navigate to the resource group which has your Chat With Your Data deployment.
  2. Delete the existing search index. Delete Search Index
  3. Delete the existing indexer. Delete Search Index
  4. Delete the existing skillset. Delete Search Index
  5. Delete the existing datasource. Delete Search Index
  6. Run the command azd env set AZURE_SEARCH_USE_INTEGRATED_VECTORIZATION false
  7. Run azd up