Jobs in Oakville

Newest first

Within 25 km of Oakville

Added 4 hours ago
Big Data Lead
Tekgence Inc
Mississauga, ON
Added 4 hours ago
Business Operations & Product Development Manager
Global Medical Products Inc.
Burlington, ON
Added 4 hours ago
Power Automate with AI
J&M Group
Mississauga, ON
Added 5 hours ago
Automation Engineering Co-op Student
CIMCO Refrigeration
Burlington, ON
Added 5 hours ago
AI/ML Compliance Lead
Roche
Mississauga, ON
Added 5 hours ago
Erin mills - Sales Associate - Part Time
The Aldo Group Inc / Le Groupe Aldo Inc.
Mississauga, ON
Added 5 hours ago
Accounting Analyst Intern - Winter 2027
McKesson
Mississauga, ON
Added 5 hours ago
Java Developer Lead Analyst - Vice President
Citi
Mississauga, ON
Added 5 hours ago
Aircraft Structures Technician (C-17)
Boeing
Mississauga, ON
Added 5 hours ago
Auditing and Supplier Director
GRIFOLS, S.A.
Mississauga, ON
Added 5 hours ago
Software Developer - Systems Performance
Ford Motor Company
Oakville, ON
Added 5 hours ago
Process Owner Assembly
gategroup
Mississauga, ON
Added 5 hours ago
Cook Assistant -CVH Patient Food Services
Trillium Health Partners
Mississauga, ON
Added 5 hours ago
Print Production Operator
Recrute Action
Mississauga, ON
Added 5 hours ago
Associate EI&C Engineer
Veolia | Water Tech
Oakville, ON
Added 5 hours ago
202610-127399 AI/ML Compliance Lead
Roche
Mississauga, ON
Added 5 hours ago
Maintenance Manager
Graham Packaging
Mississauga, ON
Added 5 hours ago
Corporate Recruiter
Not applicable
Burlington, ON
Added 5 hours ago
A National Service Manager (Retail & Fixtures)
ACI Brands Inc.
Milton, ON
Added 5 hours ago
Electrical & Instrumentation Engineer
Veolia | Water Tech
Oakville, ON
Added 5 hours ago
Senior Electrical, Instrumentation & Controls Engineer
Veolia | Water Tech
Oakville, ON
Added 5 hours ago
MarTech / AdTech Technical Lead
Capgemini
Mississauga, ON
Added 5 hours ago
Java Full Stack Developer
Capgemini
Mississauga, ON
Added 5 hours ago
Barista, Full Time & Part Time
Havergal
Toronto, ON
Added 5 hours ago
Housekeeper Casual
MAPLE LEAF LOUNGE
Mississauga, ON

Tekgence Inc

Big Data Lead

Mississauga, ON, Canada

Full-time

Within 25 km of Oakville · About 14.1 km from the city centre

Apply About employer

Applications open in a new tab.

Job details

Job type: Full-time
Apply by: Nov 26, 2026
Posted: Oct 27, 2026

Original job description

Role: Big Data Lead

Location: Toronto, ON

Fulltime

Develop and maintain scalable data pipelines using PySpark and Spark SQL for processing large datasets efficiently. Write clean, reusable, and optimized code in Python for data manipulation, analysis, and automation tasks. Design and implement ETL workflows to extract, transform, and load data from various structured and unstructured sources. Collaborate with data engineers, analysts, and stakeholders to understand data requirements and deliver solutions. Optimize Spark jobs for performance tuning, resource utilization, and minimizing execution time. Work with distributed computing frameworks to process and analyze big data in a cloud or on-premises environment. Develop and maintain unit tests to ensure the accuracy and reliability of data pipelines and transformations. Utilize Spark SQL for querying and managing large datasets stored in distributed systems like Hadoop or cloud storage. Monitor and troubleshoot data pipeline issues, ensuring reliability and timely delivery of data. Stay updated with the latest advancements in PySpark, Spark SQL, and big data technologies to improve existing systems.

Apply About employer

More about this job

Responsibilities

Develop and maintain scalable data pipelines and ETL workflows using PySpark, Spark SQL, and Python to process large datasets from structured and unstructured sources. Optimize and monitor distributed data processing, ensure pipeline reliability through testing and troubleshooting, and collaborate with engineers, analysts, and stakeholders to deliver data solutions.

Requirements

The role calls for experience developing data pipelines and ETL workflows with PySpark, Spark SQL, and Python, as well as working with distributed computing frameworks and large datasets. It also requires the ability to optimize Spark jobs, write unit tests, troubleshoot pipelines, and collaborate with technical teams and stakeholders; no education requirement is stated.

Skills

PySpark
Spark SQL
Python
Data Pipeline Development
ETL
Data Transformation
Distributed Computing
Big Data Processing
Spark Performance Tuning
Resource Optimization
Unit Testing
Data Quality
Pipeline Monitoring
Troubleshooting
Hadoop
Cloud Storage

Visa sponsorship

Not detected in the job text

Keywords

PySpark
Spark SQL
Python
ETL
Data Pipelines
Data Manipulation
Data Analysis
Automation
Structured Data
Unstructured Data
Distributed Computing
Big Data
Performance Tuning
Resource Utilization
Unit Testing
Data Reliability
Hadoop
Cloud Storage
On-Premises Environments
Pipeline Monitoring
Troubleshooting
Data Engineering
Data Analytics

Report this job