Data Engineer
LyRise
Key Responsibilities:
- Data Ingestion: Retrieve and securely store data from multiple sources and formats at regular intervals.
- Data Processing: Develop and optimize scalable data processing scripts using tools like Polars and Xarray on distributed compute environments.
- Data Monitoring: Build tools for continuous data monitoring and quality control using frameworks like Great Expectations.
Requirements & Skills:
- 2-6 years of relevant Data Engineering experience, ideally in renewable or wind energy forecasting.
- BSc/MSc in Computer Science or equivalent practical experience.
- Proven experience with large-scale (TB-scale) data pipelines in production environments.
- Strong proficiency in Python, SQL, and Git.
- Fluent in English and willing to travel for team meetings across Europe.
Preferred Qualifications:
- Cloud certification (e.g., AWS, Azure, GCP) at the associate level.
- Familiarity with data formats such as NetCDF, GRIB, or Zarr.
- Experience with high-dimensional data in production environments.
- Experience with CI/CD for data engineering workflows.