Consulting D&A ¬ Azure Data Engineer – Senior

Sri Lanka

Consulting D&A ¬ Azure Data Engineer – Senior

Job Description

  • Hands on Data Engineering role. Delivering high-quality data engineering deliverables, helping to ensure project timelines are met, and providing informal mentoring / training to junior members of the team
  • Participate in RFP’s, solutioning and estimations
  • Hands on role on data models, data storage, cleansing, validation integration and transformation and data migration to manage data within the organization, for a small to medium-sized project 
  • Resolving escalated design and implementation issues with moderate to high complexity
  • Providing technical expertise to maximize value from current applications, solutions, infrastructure and emerging technologies and seek to continuously improve internal processes
  • Developing working relationships with peers across other engineering teams and beginning to collaborate to develop leading data engineering solutions
  • Driving adherence to the relevant data engineering and data modelling processes, procedures and standards
  • Need to work as a team member to contribute in various technical streams of project implementation 
  • Interface and communicate with the onsite coordinators 

Requirements

  • In-depth cloud domain experience with focus on Microsoft Azure / Microsoft Azure Stack solutions 
  • Experience building on Azure using Databricks, ADF 
  • Good to have Synapse experience 
  • Sound programming, debugging/troubleshooting and problem-solving skills with familiarity in Scala/ Java / Python on Spark/ Pyspark 
  • Strong knowledge in Pyspark/ Spark SQL 
  • Strong data warehousing concepts 
  • Good analytical skills  
  • 6+ years of work experience with very large data warehousing environment 
  • 6+ years of experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools. 
  • Specialization in a specific sector/domain will be an added advantage