Purpose of the role
To build and support infrastructure that enables Data Science to provide services to the business.
Key Responsibilities / Duties
- Design and develop robust data infrastructure required to deliver Data Science projects.
- Maintain existing infrastructure, such as Airflow instances and Kubernetes clusters, that are used by Data Science to provide critical services to the business (e.g. Safer Gambling).
- Work with other data engineers and stakeholders to rationalise, and then regulate, the data model in the data warehouse.
- Collaborate with data scientists on their projects, particularly on the design of tools and data models, and other technical aspects.
Key Working Relationships
- Supporting the Data Science function (and BI generally) to deliver and support a wide range of projects.
- Working with DevOps in the Digital team to provision infrastructure, particularly in GCP (e.g. provisioning Kubernetes clusters).
- Working with stakeholders and heads of departments to ensure that engineering requirements are appropriately defined and given appropriate weight in project delivery.
Person Specification, Skills, Experience & Qualifications
- Degree in a scientific or quantitative field.
- Proven experience as a Data Engineer, particularly with Python, Airflow, Terraform, Git, GitLab (including CI/CD pipelines) and GCP (particularly Kubernetes, Helm and BigQuery).
- Profound knowledge of querying data with SQL and other tools, including the ability to work with complex data structures and very large data volumes.
- Proactive, independent, responsible and attentive to detail.
- Eager and able to learn, analyse, resolve problems, and improve the standard of BetVictor’s data infrastructure.
Ideal Attributes
- Experience querying MongoDB or other NoSQL Databases (e.g. HBase, Cassandra)
- Experience in using Kafka, Pub/Sub, Grafana, KNIME, DataIKU, etc.
Knowledge of sports betting and familiarity with Casino