hero
3,345
companies
3,345
Jobs
If you are a Techstars portfolio companyclaim your profile.

Data Engineer

LyRise

LyRise

Software Engineering, Data Science
Cairo, Cairo Governorate, Egypt
Posted on Oct 15, 2024

Key Responsibilities:

  • Data Ingestion: Retrieve and securely store data from multiple sources and formats at regular intervals.
  • Data Processing: Develop and optimize scalable data processing scripts using tools like Polars and Xarray on distributed compute environments.
  • Data Monitoring: Build tools for continuous data monitoring and quality control using frameworks like Great Expectations.

Requirements & Skills:

  • 2-6 years of relevant Data Engineering experience, ideally in renewable or wind energy forecasting.
  • BSc/MSc in Computer Science or equivalent practical experience.
  • Proven experience with large-scale (TB-scale) data pipelines in production environments.
  • Strong proficiency in Python, SQL, and Git.
  • Fluent in English and willing to travel for team meetings across Europe.

Preferred Qualifications:

  • Cloud certification (e.g., AWS, Azure, GCP) at the associate level.
  • Familiarity with data formats such as NetCDF, GRIB, or Zarr.
  • Experience with high-dimensional data in production environments.
  • Experience with CI/CD for data engineering workflows.