Data Engineer III

Data Team • Remote • Full-time • 6–8 years

Overview

Senior Data Engineer responsible for designing scalable GenAI data platforms, building production-grade data pipelines, enabling RAG architectures, vector search, and AI-powered applications using Azure cloud technologies.

Required Skills

• Python, PySpark & SQL
• Apache Spark, Airflow & Kafka
• Azure Cloud Platform
• Azure Databricks
• Azure Machine Learning & MLflow
• Handling Unstructured Data (JSON, Logs, Documents, PDFs)
• RAG Pipelines & Embeddings
• Vector Databases & Azure AI Search
• Batch & Streaming Data Pipelines
• CI/CD & ML Lifecycle Management

Preferred Skills

• Azure OpenAI Services
• Agentic AI Workflows
• Pinecone or Similar Vector Databases
• Feature Engineering
• Model Monitoring & Retraining
• Automation & Infrastructure as Code