hero
3,039
companies
3,514
Jobs
If you are a Techstars portfolio companyclaim your profile.

Senior Data Engineer

Certa

Certa

Data Science
India · Remote
Posted on Friday, June 30, 2023

Certa (getcerta.com) is a Silicon Valley based startup that is automating the vendor, supplier and other stakeholder onboarding processes (think background checks, agreements and the works) for companies across industries and geographies. With several Fortune 500 and Fortune 1000 clients, you will be working on challenges that redefine the way companies (big and small) do business.

The engineering team is solving deeply technical and challenging engineering problems at scale and we are looking to scale the team to keep up with our rapid growth. We are looking for rockstar engineers who are go-getters and love solving problems and building products.

We are looking for an experienced Senior Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining the data architecture that supports our data-driven applications and initiatives. You will work with the software engineers from our backend, DevOps, and partner engineering teams along with other stakeholders to ensure that our data is accessible, reliable, and scalable.

Responsibilities:

  • Design and implement scalable, reliable, and efficient data pipelines and workflows from scratch.
  • Develop and maintain data models, database schemas and data warehouses that support our data-driven applications.
  • Build and maintain ETL pipelines to extract, transform, and load data from various sources into our data warehouse.
  • Ensure data quality and integrity by implementing data validation and cleansing routines.
  • Optimize data storage and retrieval for performance and cost.
  • Develop and maintain data documentation and metadata.
  • Collaborate with the backend, DevOps and partner engineering teams, and other stakeholders to understand data requirements and ensure that our data architecture meets those needs.
  • Mentor and train junior data engineers.

** Requirements:**

  • 3+ years of experience in data engineering or a related field
  • Strong proficiency in SQL and experience with at least one of the major database systems (e.g. PostgreSQL, MySQL, Oracle, SQL Server)
  • Knowledge of SQL database design and data warehousing concepts/techniques
  • Hands-on experience in data analytics, batch/real-time data integration & processing
  • Experience in building ETL/ELT pipelines to ingest data from various sources across platforms and data formats.
  • Experience with data management tools and technologies such as Databricks, Snowflake, Apache Hadoop, Apache Spark, Apache Kafka
  • Experience with cloud-based data technologies (e.g. AWS, Azure, GCP) and associated services like S3, EC2, Redshift, Dataflow or BigQuery
  • Experience with ETL tools and frameworks (e.g. Apache Airflow, Apache NiFi, Talend, Informatica)
  • Strong programming skills in at least one of the major languages (e.g. Python, Java, Scala)
  • Experience with big data technologies and platforms (e.g. Hadoop, Spark, Kafka)
  • Experience in handling maintenance and scalability challenges with data pipelines.
  • Experience with version control systems (e.g. Git)
  • Excellent problem-solving skills and ability to work independently as well as in a team
  • Excellent communication and interpersonal skills
  • Experience in backend development is a plus

The ideal candidate demonstrates the following:

  • Ability to design and build reliable, scalable, and high performing enterprise data systems
  • Own end-to-end feature development and build features/systems from scratch
  • Understanding of data security, encryption is a plus
  • Ability to thrive in a dynamic and fast-changing environment
  • Results-oriented, proactive and showing overall leadership quality

We are ideally looking for 3+ years of experience, in as much of the tech stack as possible. If you love startups or have experience working with startups, we would be a match made in tech heaven.

Perks:

  • Best-in-class compensation
  • Performance-based ESOPs
  • Fully-remote work
  • Flexible schedules
  • Engineering-first culture
  • Continuous learning
  • Massive opportunities for growth
  • Opportunities to build systems & processes from scratch
  • Opportunity to build and lead a team
  • Paid vacation
  • Yearly offsite
  • Quarterly hacker house
  • Workstation setup allowance
  • Comprehensive health coverage
  • Maternity leaves
  • Latest Apple Workstation
  • Rockstar team to work with (we mean it!)