LLM-Powered Real-Time Translation System

The project aimed to build a real-time multilingual translation pipeline leveraging LLMOps principles. The architecture employed Kafka for distributed data streaming, Hugging Face models for high-quality translations, FastAPI for API management, and Prometheus/Grafana for real-time monitoring. The project addressed key challenges such as latency, scalability, and evolving language trends. I set out to integrate the above seven key components to create a seamless and lightning-fast data streaming experience.

kafka_project_overview.png

List of Programs that I used

Kafka (All-about-it)

Docker

References

Datasets

Updated Project Pipelines

Development Log

Hand-Written Tree Map

Development Log (Due: 12/13/24)