Sr. Data Engineer

Job title:

Sr. Data Engineer

Company

Black Diamond Group

Job description

Sr. Data Engineer
Calgary, ABAbout the Role
We’re Hiring for a Sr. Data Engineer in Calgary, AB. This role is hybrid – in-office with 20% flexibility to work from home.As a Senior Data Engineer, you will play a key role in architecting and optimizing a modern, scalable, and productized data ecosystem that enables internal teams and external partners to derive maximum value from our data assets. You will work on designing high-performance data pipelines, storage solutions, and API-driven data access mechanisms that support real-time decision-making and innovation.The ideal candidate has 5+ years of experience in data engineering, with modern data storage and processing, proficiency in ETL frameworks and event-driven architectures. They will also have strong API development skills and proficiency in Go, Java and/or Python. They will be a collaborative team player with a passion for innovation and mentoring other team members to increase overall team proficiency in data.Duties & Responsibilities:Data Architecture & Engineering

• Design and build a scalable, cloud-native data platform aligned with microservices.
• Develop real-time and batch data pipelines to power data-driven products.
• Implement SQL, NoSQL, and hybrid storage strategies for diverse business needs.

Data as a Product

• Enable self-serve data access with secure, well-documented data APIs.
• Collaborate with Product & Business teams to define and optimize data products.
• Ensure data quality, lineage, and governance in all data pipelines and products.

Microservices Integration & Performance

• Build event-driven architectures using Kafka, Azure Event Hub, or Service Bus.
• Develop scalable ETL/ELT processes for ingestion, transformation, and distribution.
• Optimize query performance, indexing, and caching for data-intensive apps.

Data Governance, Security, and Compliance

• Enforce data privacy, security, and access controls aligned with compliance standards.
• Implement observability and monitoring for data infrastructure and pipelines.
• Work with DevSecOps teams to integrate security into CI/CD workflows

Qualifications:Must Haves

• 5+ years of experience in data engineering, with exposure to Data Mesh and Data as a Product preferred.
• Expertise in modern data storage and processing, including SQL, NoSQL (Cosmos DB, PostgreSQL), Data Lakes (Azure Data Lake, Delta Lake, Apache Iceberg).
• Proficiency in ETL frameworks (e.g. Apache Kafka, Airflow, Flink, Spark, Azure Data Factory, Databricks).
• Experience with Event-driven architectures using Queues, Pub/Sub services (e.g. Azure Service Bus, Azure Event Grid, Amazon Event Bridge) and Containerized Environments (Container Apps, AWS ECS).
• Experience with Apache and/or Azure data platforms or similar, e.g. Fabric, Databricks, Snowflake, and Apache Hudi.
• Strong API development skills using GraphQL, REST, and/or gRPC for enabling data as a product.
• Proficiency in Go, Java, and/or Python.
• Deep understanding of data governance, security, lineage, and compliance using Microsoft Purview, OpenLineage, Apache Ranger, or Azure Key Vault.
• Experience with Infrastructure as Code (IaC) using Bicep, Terraform, or CloudFormation for managing cloud-based data solutions.
• Strong problem-solving and collaboration skills, working across data, engineering, and business teams.

Nice to Have

• Knowledge of ML, AI, and LLMs, including data engineering for model training and inference with Azure Machine Learning, Databricks ML, and MLflow.
• Hands-on experience in Notebooks (e.g. Jupyter, Databricks, Azure Synapse) for data workflows.

• Experience in real-time data streaming architectures.
• Exposure to data monetization strategies and analytics frameworks.
• Familiarity with federated data governance and self-serve data platforms.

About LodgeLinkLodgeLink, a Black Diamond Group company headquartered in Calgary, Alberta, Canada is more than just a digital marketplace and ecosystem for crew travel; we’re a caring tech company on a mission to transform workforce travel. Our digital platform is the key to unlocking seamless solutions for finding, booking, and managing crew travel and accommodation needs. Powered by a growing network of hotel and lodge partners, we address the unique challenges of crew travel, applying technology to streamline the entire process from booking to management, payments, and cost reporting. At LodgeLink, we’re not just saving our customers time and money; we’re changing the future of workforce (crew) travel – for the better.United by our vision to be THE ecosystem for workforce travel, our values reflect our commitment to collaboration, agility, dependability, inventiveness, and audacity. As a diverse and inclusive team, we come together, sharing ideas, building disruptive technology, and tackling complex problems. Our relentless pursuit to deliver value and superior customer experiences is inspired by a collective passion to ‘Create A Better Way’ for all.At LodgeLink, we’re seeking exceptional team players with an entrepreneurial spirit to contribute to our rapid growth. If you crave a career, not just a job, we could be the perfect fit.LodgeLink Total Rewards | Caring for our team is a priority, and we’re pleased to provide these benefits:

• Building a diverse and inclusive team, supporting career growth and development.
• Competitive base salaries.
• Share Appreciation Rights program for salaried employees.
• Paid vacation days and sick days.
• An employee charitable donation program.
• Hotel and travel discounts.
• Comprehensive benefits package including extended health, vision, dental, Health Spending Account, TeleDoc, Employee Assistance Program, Life, Long-term Disability, AD&D, and Critical Illness Insurance.
• Calgary’s Head Office: Located in beautiful Eau Claire in downtown Calgary, within a 5-minute walk to Prince’s Island Park

• Company-hosted events, and a game room.
• Ability to join our Social Club and join colleagues for fun events such as golf, bowling, curling, stampede events and more.
• Free access to the Aspen Properties Fitness Centers.

LodgeLink is a Black Diamond Group company. Learn more: www.lodgelink.comBlack Diamond Group is a publicly traded company with 20 years of experience in modular space and workforce solutions, and operations across Canada, the United States, and Australia. Learn more:We are an Equal Opportunity Employer
Black Diamond Group is committed to diversity, equal opportunity and ensuring that our employees can thrive in an inclusive environment. We are pleased to consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, marital status, family status, veteran status, Indigenous status, national origin, age, disability, or any other legally protected factors. Accommodation for applicants with disabilities is available upon request during the recruitment process.Company: LodgeLink

Expected salary

Location

Calgary, AB

Job date

Mon, 10 Mar 2025 04:31:04 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (hiring-jobs.com) you saw this job posting.