Enterprise RAG
Aya Knowledge Base
Production RAG backend with document processing, PII protection, and Prometheus/Grafana monitoring.
About the Project
A production RAG backend that transforms raw documents into searchable knowledge. Supports multiple formats through Docling parsing, automatically detects and redacts PII, and provides hybrid search combining semantic and keyword retrieval. Includes production monitoring with Prometheus and Grafana.
Key Features
- Multi-format document processing: PDF, DOCX, PPTX, XLSX, images
- Advanced Docling parsing with table detection and image extraction
- Automatic PII detection and redaction
- Hybrid search: semantic + keyword retrieval
- Background task processing via Celery
- Prometheus metrics + Grafana dashboards for monitoring
Impact
Production-grade document intelligence with enterprise features: PII protection, monitoring, and multi-format support.
Tech Stack
FastAPIPineconeOpenAIDoclingCeleryRedisPrometheus
Metrics
Multi-format document processing
PII auto-redaction
Monitoring stack
Hybrid search
Interested in this project?
Let's discuss how I can build something similar for you.