Tweet Insight Pipeline with Rate-Limited LLM Classification

Asked at xAI · MLOps & Deployment · Difficulty: Medium · Last asked Jan 28, 2026

Build a small containerized pipeline that loads tweet records from a dataset file, validates them, stores them in a database, and uses an LLM API to classify each stored tweet. Two rate limiters protect the system: one on how fast records are accepted, one on how fast the LLM API is called.

Loading the problem…