Senior Data Engineer
Veho
About Veho
About the Role
Responsibilities Include:
- Building, testing, and deploying data tools that empower engineering teams to move quickly without compromising operational goals
- Implementing specifications of complex applications, in partnership with members of the data platform team and other engineering teams.
- Participating in peer code reviews, providing comments and suggestions.
- Optimizing DBT pipelines, spark streaming pipelines, and EMR tasks to improve performance, reduce cost, and maintain SLAs for data latency, completeness, and reliability.
- Working with technical and non-technical end-users and product managers in a cross-functional, quick-moving, and collaborative environment
- Analyzing code, requirements, system risks, and software reliability and providing recommendations on how to leverage our technology more efficiently
- Learning new technologies quickly and efficiently - nobody comes into this role knowing every piece of the stack. You’ll need to learn from your peers, documentation, and experimentation to grow and succeed in this role.
What You Bring:
- 4+ years of experience building, testing, and deploying backend applications and/or data engineering systems.
- Experience with some kind of distributed data system, and the ability to reason correctly about system properties like consistency, latency, throughput, and fault tolerance.
- Experience with Infrastructure-as-Code systems like Terraform, AWS CDK, or Pulumi.
- You enjoy taking initiative, are a self-starter, and are willing to move fast and ship quickly while collaborating on big challenges.
- You are enthusiastic about working closely with team members to develop creative solutions to novel problems.
- Tech: SQL, DBT, Databricks, Kinesis, (py)Spark, EMR, Sigma, Airflow, Iceberg, Pulumi