Data Engineer

Job title:

Data Engineer

Company

ITV

Job description

Data EngineerCommercial Technology & Change6 months FTC | Full TimeWhite City, London | HybridHiring Range: £50,000 – £60,000Your work matters to millions.Shaping culture is in the DNA of ITV. So, it’s not surprising that you’ll find us in every home in the UK, our productions are famous all over the world and we’re at the forefront of the digital streaming revolution.When you join us, you enter a fun working environment. With opportunities to learn, to grow and make a real difference. Small enough that your impact’s felt in the business, but big enough that your impact reaches millions of people.Come develop your skills, change TV and the course of your career. Don’t just watch it. Be part of it. Join ITV.Your impact sends ripples.The teamMillions of people use the products we build. We’re customer focused, informed by data and have a product mindset, using state-of-the-art cloud-first technology. Iterating and evolving daily. In a fast-changing world, we not only make sure our systems work effectively but our Technology teams are spearheading the transformation to a digital-first business. There’s never been a more exciting time to join us.As part of the Advanced Advertising Technology team, the focus is on data analytics, monetisation and financial governance. When you join us, you enter a fun working environment with opportunities to learn, to grow and make a real difference. Small enough that your impact’s felt in the business, but big enough that your impact reaches millions of people.The roleAs a Data Engineer, you will be responsible for designing, developing, maintaining, and optimising our data pipeline infrastructure using our proprietary central data platform (Symphony), which is based on Databricks. You will collaborate with cross-functional teams to design and implement scalable data solutions, ensuring efficient data ingestion, transformation, storage, and analysis.The role will entail but not be limited to:

• Taking ownership and delivery of the design, development, and maintenance of scalable data pipelines, infrastructure and data products using Databricks.
• Assisting and collaborate with the ITV commercial teams and data product owners to define data product requirements and visualisation needs
• Developing and optimising extract, transform, load (ETL/ELT) processes to ensure the smooth flow of data from various sources into the data platform. Perform data cleansing, validation, and enrichment to support accurate and reliable data analysis.
• Ensuring adherence to CT&C data architecture principles, best practice and processes by:

• Collaborate with data scientists, analysts, and stakeholders to capture and define data requirements and design appropriate data models and architecture. Optimise data storage formats and partitioning for efficient data retrieval and analysis
• Proactively offer support and assistance to the product management team to refine the design and building out data dashboards and other visualisation / presentation solutions
• Monitoring and optimising data pipelines and workflows. Identify and resolve performance bottlenecks, data quality issues, and data integration challenges.
• Defining the data quality characteristics of your data products and work with the QA team to implement automated quality processes to measure data correctness and report outcomes through our observability infrastructure
• Implementing data governance practices and ensuring compliance with ITV data privacy and security regulations.
• Ensuring all data products conform to all observability requirements and suitable dashboards are in place. Collaborate with the platform and service support teams to set in place the correct level of monitoring and reporting to verify solution performance and operational state
• Organising and proactively collaborating with other cross-functional teams across ITV. Document data pipelines, workflows, data presentation implementations and technical specifications for future reference.
• Staying up-to-date with industry trends and emerging technologies in the data engineering domain. Identify opportunities for process improvement, automation, and innovation to enhance data engineering capabilities
• Leading the engineering contribution to our delivery process by proactively: refining all tickets assigned to you and your team; identifying and distributing work for yourself and across your team; defining your team’s technical user stories; updating the team during stand-ups on progress and issues; ticket/card management; managing expectations relating to the delivery of work (what will be delivered and when)

Skills you’ll need (minimum criteria)

• Sufficient experience as a Data Engineer with specific experience designing and building Databricks/Hadoop (Cloudera/HortonWorks)/Spark data products:
• Strong programming skills in languages such as Python (PySpark preferred), Scala, or SQL with the ability to write production-grade code including automated testing
• Experience in owning, designing and implementing data pipelines ingesting enterprise levels of data volume. In-depth knowledge of data engineering concepts, data integration, and ELT/ETL processes.
• Experience in deploying code via CI/CD platforms (e.g. Github Actions, Jenkins)
• Proficiency in working with distributed computing frameworks, such as Apache Spark and working with cloud platforms (e.g., AWS, Azure, Google Cloud) and associated services (e.g., S3, Redshift, BigQuery).
• Familiarity with data modelling, database systems, and SQL optimization techniques.

Other things we’re looking for (key criteria)

• Excellent problem-solving, analytical thinking, and troubleshooting skills with the ability to make well thought out data backed business decisions
• Strong communication and collaboration abilities, with the ability to work effectively in a team environment
• Strong Leader able inspire and influence others
• Innovative and up to date with market trends and tooling
• Agile working embracing change and are willing to adapt to evolving requirements
• Knowledge of the UK broadcast industry & broadcast/OTT & digital marketing and advertising industry
• Familiar with data design techniques for classification and regression as well as knowledge of A/B testing, experimental design, and general statistical modelling
• Familiarity with architecture disciplines such as Data Mesh Architecture, Data Architecture, BI Architecture and Enterprise Architecture
• Good understanding of data governance, data privacy, and security principles.
• Knowledge of tools across other data management capabilities – data engineering, data governance, data quality, metadata management and master data management
• Knowledge of designing and building out data visualisation solutions based on technology such as: Tableau, AWS QuickSight, Looker, ThoughtSpot

ITV is for everyone.ITV strongly encourages applications for this role from disabled people. As a Disability Confident Leader, if you meet the minimum criteria for a role and you have declared that you are disabled, we’ll guarantee to take you to the next stage* (minimum criteria above).We’re happy to discuss any support/personalisation you may need during our application and selection process as part of our reasonable adjustments. Drop us a line if you require anything at .about applying with a disability.

• There may be a few exceptions where we are not able to take all eligible candidates to the next stage due to the volume of applications.

Because those who make an impact deserve to be rewarded for it.ITV offers some great rewards and benefits including

• Flexible working with a range of options to suit everyone
• Generous holiday allowance, plus you can buy more
• Annual bonus opportunity
• Competitive pension contribution
• Save as you earn – with an opportunity to buy ITV shares
• Wellbeing and volunteering days plus a wide range of opportunities to help you live a balanced and healthy life

Closing date: Thursday 25th July 2024

Expected salary

£50000 – 60000 per year

Location

London

Job date

Sat, 13 Jul 2024 04:02:57 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (hiring-jobs.com) you saw this job posting.