Senior Data Engineer

Responsibilities

• Design end-to-end data pipelines to process large volumes of unstructured enterprise data including documents, PDFs, and transaction records
• Build data ingestion frameworks with automated validation and quality checks for multiple sources and formats
• Implement large-scale processing using distributed computing frameworks like Spark, Flink, or AWS Glue
• Develop advanced feature engineering pipelines for document classification, entity extraction, and semantic tagging
• Design data warehousing and lakehouse architectures to support both real-time and analytical queries for AI reasoning
• Implement data governance, lineage tracking, and security protocols to protect sensitive information (PII, financial, and healthcare data)

Requirements

• 4–8 years of professional experience in data engineering
• 2+ years of experience specifically building data-intensive pipelines
• Expert-level Python skills for ETL development and data science workflows
• Deep expertise in processing unstructured data (documents, PDFs, images, and logs) at scale
• Proficiency with distributed data processing tools such as Apache Spark, Flink, or AWS Glue
• Strong experience with NLP and text processing (spaCy, transformers)
• Hands-on experience with AWS data services including S3, Athena, Glue, RDS, and DynamoDB

Preferred Qualifications

• Experience with vector databases such as Pinecone, Weaviate, or pgvector
• Knowledge of orchestration and monitoring tools like dbt, Terraform, Prometheus, or Grafana
• Familiarity with streaming technologies like Kafka or Redis Streams

Benefits

• Opportunity to learn from former AWS leaders and AI pioneers
• Direct ownership of high-impact "greenfield" projects from concept to launch
• Exposure to the latest Generative AI frameworks and cloud-native architectures
• Rapid career growth within a high-speed, mission-critical environment

About the Company

Aivar Innovations is an AI-first technology partner that combines cutting-edge technology with industry expertise. We build AI-augmented teams and scalable solutions that accelerate development and drive real momentum for global enterprises.