Description:
Hiring Data Engineering Specialist Dubai,(Onsite)
Location: Dubai, (Onsite)
Required Experience and Skills:
- Develop batch/real-time analytical solutions leveraging transformational technologies.
- Create and maintain optimal data pipeline architecture.
- Creates data engineering strategies that use business analytics and data platforms.
- Codes, tests, and documents new or modified data systems to create robust and scalable data platform for data analytics.
- Creates and maintains data catalog, interprets data results to business stakeholders and develops standards and processes for integration initiatives.
- Designs key and indexing schemes and designs partitioning, constructs and implements operational data stores and data marts.
Competencies
- Bachelor’s in computer science, computer engineering, or equivalent work experience
- Typically requires over 8 years of data engineering hands-on experience preferable in Azure platform.
- Experience in Azure Data Lake, Data Factory, Data Bricks and Logic Apps.
- Strong SLQ skills
- Experience using Big Data batch and streaming tools.
- Managing code repository in a large-scale data engineering platform.
- Strong understanding of business process, design solution and deliveries
Technical Skills
- Designed (or) worked-on solutions on Azure platform using Azure data factory, Azure Data Lake, Azure Data Bricks, Azure Synapse Analytics, Azure SQL, Power shell, Azure logic apps, Azure automation, Blob storage and T-SQL.
- Should have done at least 1 greenfield Data Lake, Delta Lake(or) Data warehousing project in Azure landscape.
- Design, build and maintain Azure Data Analytics solution.
- Should be well familiarized with CI/CD in Azure DevOps platform.
- Analyze, design, implement and test medium to complex mappings independently.
- Strong experience in transforming large datasets as per business needs.
- Should be able to write scripts in Python or any other scripting language.
- Understanding of Self-Service BI/Analytics, User Security, Mobility, and other BI
- Participate in design/discovery sessions and workshops with end users.
- A flexible approach to dealing with ad-hoc queries.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Proficient in Structure and semi structure data process.