Senior Data Engineer
- Posted 2 days ago
- Be among the first 10 applicants
Job Description
Job Description
6+ years in data engineering. Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries. Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support. Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only. Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails. Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains. Proven experience designing and building transaction/fact tables.
Required Skills
Primary Skills
911PythonHiveHadoopETL
Secondary Skills
snowflakesAzure
6+ years in data engineering. Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries. Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support. Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only. Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails. Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains. Proven experience designing and building transaction/fact tables.
Required Skills
Primary Skills
911PythonHiveHadoopETL
Secondary Skills
snowflakesAzure
More Info
About Company
Skills:
BigQuery, Python, Sql, dbt, Alembic, Big Data Engineering
Skills:
Devops, Machine Learning, Pyspark, Apache Spark, Azure Databricks, Sql, Python, Azure Synapse SQL Server, Generative AI, RAG frameworks
Skills:
Java, Scala, Restful Apis, Sql, Python, Kubernetes, big data engineering
Skills:
Golang, PostgreSQL, AWS Glue, Prometheus, Kafka, Grafana, Datadog, Jenkins, Cloudwatch, Sonarqube, AWS API Gateway, Rest Apis, Python, AWS, ClickHouse, GitLab CI, OpenTelemetry, Trivy, Semgrep
Skills:
Delta Tables / Delta Lake, Azure Data Factory (ADF), Azure Synapse, Apache Spark, Azure Data Lake, Databricks, Sql, Python, Unity Catalog