Senior Data Engineer

About the role

Lineate is seeking a Senior Data Engineer to design, build, and maintain reliable, scalable ETL/ELT pipelines and data platform components for its real‑estate and mortgage technology product. The role involves integrating data from diverse sources, ensuring data quality, and supporting the company’s AI‑driven solutions for FinTech, HealthTech, and AdTech.

Key responsibilities

• Build and maintain reliable, scalable ETL/ELT pipelines and data platform components.
• Integrate data from multiple heterogeneous sources, including databases, APIs, files, and third‑party systems.
• Clean, normalize, transform, and map messy, incomplete, and inconsistent data without reliable unique keys.
• Develop solutions for record matching, deduplication, reconciliation, and entity resolution across different data sources.
• Design data models and implement data quality, validation, and monitoring processes.
• Investigate data discrepancies, troubleshoot pipelines, and continuously improve data reliability and performance.

Required profile

• 6+ years of hands‑on data engineering experience.
• Strong Python and SQL skills with production experience in ETL/ELT, data integration, and data modeling.
• Experience cleaning and mapping incomplete, inconsistent, or duplicated data from multiple sources.
• Proven ability to match records without a reliable common ID using composite keys, rule‑based or fuzzy matching, or entity‑resolution techniques.

Required skills

• Python
• SQL
• Airflow
• dbt
• Spark
• Kafka
• ClickHouse
• Snowflake
• Databricks

What we offer

• Freedom to develop with equal opportunity to learn and grow professionally.
• Clear career and professional path with a strong performance management system.
• Social benefits package, equipment, English lessons, gym membership.
• Flexible vacation time and inclusive in‑person and digital events.