Skip to Content
Search For Jobs

What's your expertise?

Where should we look?

Zip Code

25 Km

25 Km
50 Km
100 Km
500 Km
1000 Km
2500 Km

Job Type

All
Contract  (41)
Permanent  (4)

Category

All
Engineering  (1)
Finance  (3)
IT  (30)
Other Opportunity  (11)
Main Content

Big Data Automation Engineer

Category:Contract
Location: Vancouver, BC V7M 3H9
Posted:Thu, March 07, 2019

Position Title: Big Data Automation Engineer

Opportunity Type: Contract 

Duration: 5 months starts with high possibility of extension

Responsibilities:

Big Data Automation Engineer Responsibilities/work and deliverables:

  • Create automation solution using spark and Scala
  • Shell scripting
  • SQL queries
  • Create and debug SQL
  • Knowledge transfer and mentoring of project staff
  • Peer review of other team member test cases
  • Help co-team members in understanding the logic and building scenarios for different pipelines
  • Provide knowledge transitioning and mentoring for junior resources
  • Support end users during user acceptance testing
  • Help co team members in understanding the logic and building scenarios for different pipelines
  • Provide knowledge transitioning and mentoring for junior resources
  • Support end users during user acceptance testing

Requirements:

  • Strong hands on experience with Spark programming
  • Strong hands on experience with creating and debugging SQL
  • Should be familiar with Scala programming
  • Good knowledge of Java (or any Object Oriented programming) and Python
  • Have good knowledge of Hadoop eco-system technologies like Spark, Scala, Spark shell, Scalatest, Drill and HDFS
  • Good hands on experience with Linux and shell scripting
  • Experience with leadership and mentoring of junior resources