Data Engineer (Hadoop, Spark, Athena)
Posted on12th June 2018
Salary/RateUp to £0.00 per day
About this job.
My client, a successful Data Analytics organisation based in Edinburgh are looking for what they are calling a Data Engineer on an initial 6-month contract.
Responsibilities in this role include:
*Designing and prototyping data pipelines that are used both internally and externally for making decisions.
*Reviewing and adopting industry leading data tools/frameworks that make processing and analysis of data easier
*Partnering with our internal research teams to ensure they have a data platform that enables the development of new products and analytics.
Essential skills required for this role include:
*Experience of building production data pipelines using a variety of technologies (Hadoop, Hive, Pig, Spark, Athena…) to deliver data in a variety of formats
*Experience of building and running Real-time data streaming solutions using technologies like Kafka or Kinesis
*Hands on experience with schema/message design and modelling
*Expert knowledge of at least one RDBMS system (SQL Server, Oracle, MySQL)
*Experience of working as part of high performing engineering team that processes data at scale.
*Strong understanding of the principles of test-driven development and agile methodologies
*You have strong views on how technology can improve decision making through automated data processes.
If this sounds like the role for you, please apply immediately with an up to date CV!