Home Artificial Intelligence Productionize LLM RAG App in Django — Part I: Celery

Productionize LLM RAG App in Django — Part I: Celery

0
Productionize LLM RAG App in Django — Part I: Celery

Automate Pinecone Every day Upsert Task with Celery and Slack monitoring

Towards Data Science
Image credit: Outside Inc

It’s been some time since my last LLM post and I’m excited to share that my prototype has been successfully productionized as Outside’s first LLM-powered chatbot, Scout. For those who are an Outside+ member, you possibly can test it out over at https://scout.outsideonline.com/.

This journey began as my weekend curiosity project back in March 2023. I had the concept to construct a Q&A chatbot using OpenAI’s LLMs and Outside’s content as a knowledge base. Later I shared my prototype at our internal product demo day and I used to be thrilled by the interest it managed to spark. Scout quickly became an official project. On November twenty eighth 2023, we launched Scout to limited Outside+ members. Fast forward to today, April twelfth, 2024, over 28.3k unique users have already utilized this Outdoor Companion AI tool.

I couldn’t be more grateful for this moonstruck experience and I’ve been planning to write down a mini-series to share some behind-the-scenes insights into what it takes to bring LLM & RAG powered apps to life. To date I’ve planned to cover the next three parts:

  • 🦦 Part 1: Automate Pinecone Every day Upserts with Celery and Slack monitoring
  • 🦦 Part 2: Constructing an LLM Websocket…

LEAVE A REPLY

Please enter your comment!
Please enter your name here