Azure Data Engineer
Discover Dollar
Data Science
Bengaluru, Karnataka, India
Posted on Saturday, August 19, 2023
About Discover DollarDiscover Dollar’s mission is to help enterprises to create value by harnessing vast amount of unstructured data - in the form of email, chats, PDFs, and contract copies etc., using data-first approach using data science, AI and cutting-edge technologies.
Why Discover Dollar
- We are one of the great innovative product companies in the Finance space
- We have a great work culture and are certified Great Place to Work
- We have a great career in both Tech amp; non-Tech domain
- Experience in Design, Development and deployment using Azure Services (Azure data factory, Databricks, Synapse)
- Develop and maintain scalable data pipelines and build new data source integrations to support continuing increases in data volume and complexity.
- Developing Modern Data Warehouse solutions using Azure Stack (data Lake, Synapse, Databricks and Pyspark).
- Develop Batch Processing pipelines for structured and semi structured data.
- In-depth Skills w Azure synapse/Databricks and Pyspark and SQL
- Collaborate and engage with data Analyst, Science, Dev and Domain experts to build data pipelines.
- Working knowledge in orchestration of pipelines.
- Good understanding of Hadoop and distributed processing framework.
- Good understanding and experience in Azure Devops and CICD pipelines to deploy Azure resources.
- 1-2 years of industry experience in Azure Services
- Hunger to learn and looking for ways to improve yourself and the processes around you
- Self reliant, quick learner and a solid team player
- Excellent understanding of Azure Data Factory, Azure Synapse, Data Warehousing ,Python SQL.
