Spark Developer

  • Full Time
  • Toronto


Job Title: Spark Developer
Location: Toronto, ON
Duration: Long Term Contract

Job Description:

Work on Spark Framework to ingest data from data lake.Prepare Spark SQL queries to generate reports out of Hive tablesExtensive experience in database query tuning, performance tuning, and troubleshooting application issuesProvide support to team members and helping them to understand the projects and requirements and guiding them to create the optimized solution of itSetup CICD pipeline for database changes using Github, Jenkin & Liquibase)

Essential Skills:
Relevant Experience(in yrs) 8+ YearsTechnical/Functional Skills
Big Data: Spark, Scala, Pyspark, SparkSQL, HDFS-
Microsoft Stack: T-SQL,
Good to have SSIS, PowerShell
Scripting Languages: Batch Script, Shell Script, Python
Additional Skills:- Agile, Scrum, Jira, Git, SVN, Liquibase

Job Types: Full-time, Fixed term contract

Work Location: In person