Sr Big Data Engineer

by Fairstone

Location: London, ON
Date Posted: Apr 17, 2024
Fairstone

Job Description


Sr Big Data Engineer

Responsibilities:

  • Work closely with other data and analytics team members to optimize the company’s data systems and pipeline architecture
  • Design and build the infrastructure for data extraction, preparation, and loading of data from a variety of sources.
  • Build data and analytics tools that will offer deeper insight into the pipeline, allowing for critical discoveries surrounding key performance indicators and customer activity
  • Always angle for greater efficiency across all of our company data systems

Qualifications:

  • Graduate degree in Computer Science, Information Systems or equivalent quantitative field and 5+ years of experience in a similar Data Engineer role.
  • Experience building and optimizing ‘big data pipelines’, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience working with and extracting value from large, disconnected and/or unstructured datasets
  • Demonstrated ability to build processes that support data transformation, data structures, metadata, dependency and workload management
  • Strong interpersonal skills and ability to project manage and work with cross-functional teams
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience with the following tools and technologies:
    • Hadoop, Spark, Kafka,
    • Relational SQL and NoSQL databases
    • AWS cloud services such as Glue, Lakeformation, EC2, RDS and Redshift
    • Stream-processing systems such as Storm and Spark-Streaming
    • Object-oriented/object function scripting languages such as Python, Java, C++, etc.

 

WE ARE PROUD TO BE: Montreal's Top Employers 2023 by Canada’s Top 100 Employers!

 

Learn more: https://www.fairstone.ca/en/about/canadian-lender

Follow us on LinkedIn: https://www.linkedin.com/company/fairstone/mycompany/

 

If you have a preferred language for communication, please kindly inform us whether you prefer French or English on your application.

 

Fairstone is an equal opportunity employer. Accordingly, we will make reasonable accommodations to respond to the needs of people with disabilities. Individuals who view themselves as Aboriginals, members of visible minorities, and disabled are encouraged to apply in confidence.

 

Time Type: Full time

 

Job Type: Permanent


Learn more and Apply