Senior Data Engineer

Job title:

Senior Data Engineer

Company

Validis

Job description

We get financial data.About Validis
Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and SaaS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry.Our current client base holds a number of blue- chip companies, mainly comprising audit firms and financial institutions who utilize our software to gather financial information from their clients. Validis has experienced significant growth since its inception and to support this, we are looking to expand our teams across number of strategic areas.At Validis we have a core focus on the two interconnected concepts of diversity & inclusion. We are a collaborative business who empower equal opportunities across all departments. With our innovative approach to hiring, we enable employees to be individual, contribute openly and embrace the integrity of their own ideas. Validis believe in unbelievable talent and in turn provide a valuable and integrated workplace for you to excel in.We believe in the power of being… YOU!About the roleWe are seeking an experienced Senior Data Engineer with a passion for building robust data pipelines and driving impactful projects. We’re looking for someone with a strong background in Python and SQL, and expertise in using DBT for data transformation and modelling. Our ideal candidate thrives on tackling new challenges and enjoys mentoring junior team members to support a collaborative and growth-oriented environment. The ideal engineer will have the ability to translate complex business requirements into efficient data solutions making them an invaluable asset to our data-driven organization.Key responsibilities of the Senior Data Engineer;

• Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.).
• Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes.
• Designing and implementing CI/CD workflows for data engineering projects.
• Optimize ETL processes for efficiency, scalability, and performance.
• Develop and maintain documentation for data pipelines and data models.
• Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity.
• Collaborate with data analysts, data scientists, and other engineers to understand data needs and business requirements.
• Stay up-to-date with the latest trends and technologies in the data engineering field, particularly in the area of ETL tools and frameworks.
• Participate in code reviews and knowledge-sharing sessions within the team.

About You
We’re looking for a passionate and experienced Senior Data Engineer who thrives in a fast-paced startup or SaaS environment. Here’s what makes you a great fit:

• Startup/SaaS Expertise (Desirable)
• Minimum 7+ years of experience as a Data Engineer or similar role.
• Experience designing and implementing CI/CD workflows for data engineering projects.
• Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment.
• Proven expertise in designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks.
• Strong understanding of data warehousing concepts and data modelling techniques.
• Experience with SQL and proficiency in writing complex queries (e.g., T-SQL, PostgreSQL).
• Familiarity with cloud platforms (AWS, GCP, Azure.
• An understanding of the nuances of both ETL and ELT approaches and can determine the optimal strategy for different scenarios.
• Excellent problem-solving and analytical skills with a strong focus on data quality.
• Effective communication and collaboration skills to work with cross-functional teams.
• Ambitious and eager to be part of a rapidly growing fintech company at the forefront of innovation.

Information around our benefits & culture can be found on our careers homepage

Expected salary

Location

London

Job date

Wed, 18 Sep 2024 01:40:21 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (hiring-jobs.com) you saw this job posting.