amlana21 / llm-stream-publish Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

How to stream LLM responses using AWS API Gateway Websockets and Lambda

amlanscloud.com/llmstreampost/

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
.github/workflows		.github/workflows
inference_service		inference_service
infrastructure		infrastructure
lambda_functions		lambda_functions
test_responses		test_responses
Readme.md		Readme.md

Repository files navigation

How to stream LLM responses using AWS API Gateway Websocket and Lambda

For more details: https://amlanscloud.com/llmstreampost/

About

How to stream LLM responses using AWS API Gateway Websockets and Lambda

amlanscloud.com/llmstreampost/

aws devops terraform llm-inference

Report repository

Languages