Data Engineer
This job does not exist anymore.
Try running a new search or browse our vacancies.
Or fill in the form below to receive job alerts.
| Job Type | Perm |
| Area | City of London, England |
| Sector | Financial |
| Salary | GBP 75,000 - 95,000 Annual Salary |
| Advertiser | Eurobase People |
| Job Ref | 25218 |
| Job Views | 8 |
- Description
- The client is changing the way the world makes investments — but they can’t do it alone.
The client empowers assets managers, private equity firms, insurance companies and executive boards across the globe to solve their trickiest problems. The clients approach brings together analytics, research, algorithms, and science to help organizations continually improve their decision-making.
The clients vision is to help transform how the £70 trillion active asset management industry makes their investment decisions through a smart decision-making platform using behaviour science and advanced analytics.
The client is looking for a Data Engineer who can be part of enabling them to do so.
A successful candidate will ideally already have experience working with financial data. They will have an entrepreneurial mindset and be excited to colour outside the lines and wear whatever hat needs wearing to get the job done.
If you are a passionate problem solver with a can-do-attitude, driven by being part of a team that is at the
forefront of innovation, and wanting to go that extra mile, then this may be just the team for you.
Requirements:
- A bachelor's, master's degree or PhD in Computer Science, Electrical Engineering, Data Science, or a related field.
- 3+ years of hands-on experience as a data engineer, building ETL pipelines, financial data processing solutions, and owning the data lifecycle management (from data quality monitoring to storage, etc.).
- Strong working knowledge of Python and related infrastructure, including AWS Glue and AWS Lambda, working with analytics services, APIs, optimizing performance, and working with cloud environments such as AWS.
- Deep understanding of data science toolkits such as Jupyter Notebook, NumPy, Pandas, scikit-learn,
etc.
- Experience working with relational databases, with a strong understanding of data modelling and
schema design, specifically with Postgres.
- Experience building solutions on AWS and leveraging cloud service provider infrastructure to handle
high amounts of data processing at scale.
- Knowledge of engineering best practices and processes such as TDD, code reviews, code refactoring,
branch management, and CI/CD practices is essential.
- Excellent troubleshooting and problem-solving skills, with the ability to debug complex systems and
data issues.
- Strong communication skills both verbally and in writing, with the ability to effectively communicate
technical concepts to both technical and non-technical stakeholders.
- Experience mentoring junior data engineers and providing guidance on best practices and processes.
- Familiarity with Big Data technologies such as Hadoop, Spark, and Kafka would be a plus.
- Experience building and deploying containerized applications using tools such as Docker and Kubernetes would be a plus.
- A strong commitment to continuous learning and self-improvement, with the ability to keep up to date with the latest technologies and tools in the data engineering field.
What the job involves:
- Designing, implementing, and maintaining large-scale data processing systems on AWS, ensuring that they are scalable, efficient, and reliable.
- Leading the design and development of ETL pipelines that transform raw data into usable data sets for analysis.
- Owning the data lifecycle management, from data quality monitoring to storage, ensuring that data is properly classified, stored, and secured.
- Collaborating with data scientists and analysts to understand their data requirements and provide the necessary infrastructure to support their work.
- Optimizing performance of data processing systems by tuning database queries, improving data access times, and reducing latency.
- Building APIs and data ingestion processes to enable seamless data access across the organization.
- Managing relationships with stakeholders across the organization, including business users, product managers, and other technical teams.
- Keeping up to date with the latest technologies and tools in the data engineering field, and evaluating their potential use in the organization.
- Maintaining engineering best practices and processes such as TDD, code reviews, code refactoring, branch management, and CI/CD practices to ensure code quality and reliability.
- Collaborating with other engineers on areas such as DevOps, infrastructure, and security to ensure that data systems are properly integrated with the larger technology stack.
- Supporting our technical lead with estimates and architectural decisions to ensure timely and regular delivery of features over time
- Developing and maintaining documentation for data processing systems, including technical specifications, data flow diagrams, and architecture diagrams.
Our Tech Stack
We use a range of technologies in our stack:
• Backend: APIs written in a combination of Python (for analytics and complex data transformations) and Typescript (Node.js - for CRUD style operations). We also make heavy use of AWS Glue and AWS
Lambda for data processing pipelines.
• Databases: We use a combination of MySQL, Postgres, DynamoDB for our different services and we pull data from a variety of data providers with different types of feeds including sFTP, custom data loaders (EC2s) and APIs.
• Frontend: React, TypeScript, JavaScript, Next.js, D3.js, and TailwindCSS and maintain multiple micro-frontends as well as our own registry of NPM packages.
• Infrastructure: Serverless powers almost all our infrastructure. We use AWS and Infrastructure as Code for everything.
• CI/CD: Continuous deployment and integration process based on Bitbucket pipelines.
How do we know you're the perfect match?
• You’re passionate about innovation.
• You enjoy highly collaborative work.
• You thrive in a constantly evolving environment with challenging problems.
• You’re highly organised and love getting things done.
• You’re a good finisher, as well as a self-starter.
Company Benefits:
• The opportunity to be part of building and shaping the culture of a company focusing on a highly
innovative space within the investment industry.
• Somewhere you can instantly see the impact you have on your team and clients’ performance, and
where you are helping change the way investment decisions are made.
• A chance to learn from a group of individuals with world leading experiences across investment
classes, change management and behavioural science.
• A learning culture with dedicated time to learn new skills.
• Great office in central London with a gym and wonderful rooftop.
• Private health insurance
• A competitive salary, option plan and performance-based bonus.
Other FAQs:
• This is a full-time role
• We are open to visa sponsorship
• Option to work remote up to 3 days per week.
