Senior Data Engineer – Optimize & Scale Data Infrastructure

About the role

We are looking for a highly skilled Senior Data Engineer to join our team and take ownership of optimizing, scaling, and maintaining our data infrastructure. You will play a critical role in ensuring data accuracy, performance, and reliability across our systems.

Key responsibilities

• Collect, validate, and ensure accuracy of data from multiple sources.
• Optimize and restructure databases to improve efficiency and scalability.
• Improve query performance, focusing on mission‑critical queries such as Evidence data.
• Implement and manage database sharding strategies for scalability.
• Design, develop, and maintain data models, data warehouses, and ETL pipelines.
• Operate in high‑volume, frequently updating data environments.
• Collaborate with product, engineering, and DevOps teams to ensure seamless data flow.
• Ensure data security and compliance using IAM roles and permissions.

Required profile

• Extensive experience with complex database structures, especially MySQL.
• Strong background in Big Data technologies and large‑scale data processing.
• Hands‑on experience with data modeling, warehousing, and ETL pipeline development.
• Proven ability to manage frequently updating data systems.
• Deep understanding of query optimization and performance tuning.
• Proficiency with AWS services, Redis, and IAM security controls.
• Strong problem‑solving skills and ability to thrive in fast‑paced environments.

Required skills

• MySQL
• Big Data technologies (e.g., Hadoop, Spark)
• Data modeling & warehousing
• ETL pipeline development
• Query optimization & performance tuning
• AWS services
• Redis
• IAM roles & permissions
• Database sharding
• CI/CD, containerization, monitoring
• Airflow, Spark, Kafka