how i improved FAST API response time by optimizing LLM selection, token management, and prompt design.
i had the opportunity to work on building the backend for a copilot project at my previous organization, using FastAPI, openai’s large language models (llms), langchain, and postgresql. the aim was to design backend apis that not only provided accura...
Nov 10, 20244 min read117
