Desia Limited: Backend Engineer (Data Platform)

Related keywords: data engineer remote jobremote job pythondata science remote job

This page contains product affiliate links.

Overview

Desia Limited, headquartered in London, is actively seeking a skilled and motivated Backend Engineer specializing in Data Platforms. This remote opportunity can be performed from anywhere in the world. The position requires full-time commitment and focuses primarily on developing a robust data platform. This role is integral in contributing to Desia’s data infrastructure, ensuring efficiency and reliability in data processing.

Primary Responsibilities

The Backend Engineer will take on various responsibilities that are crucial for the development and enhancement of the data platform. Key duties include:

• Developing and Enhancing Data Pipelines: The engineer will create and expand existing data processing pipelines for both structured and unstructured datasets using primarily Python and SQL.

• Integrating with Third-party Systems: The role involves working with external tools and APIs, such as Microsoft GraphAPI and financial data providers, to facilitate seamless data flow between these systems and Desia’s platform.

• Monitoring and Optimizing Performance: It is essential to track the performance of the data platform and analyze logs. The engineer will be responsible for recommending infrastructure improvements using tools such as Google Cloud Platform (GCP), Sentry, and CloudSQL.

• Collaborating on Data Modeling: The engineer will design and implement efficient data structures for both relational and non-relational systems, thus supporting scalable and reliable data processing.

• Ensuring System Reliability: Contributions towards stabilizing and scaling the platform are crucial, including addressing bottlenecks, optimizing queries, and ensuring smooth operations in containerized environments (e.g., Docker, Kubernetes).

Required Skills

To qualify for this position, candidates should possess a combination of the following must-have skills:

• Strong Python Expertise: Proven experience in both scripting and object-oriented programming (OOP) in Python is imperative.

• Solid SQL Skills: Candidates must have the ability to write efficient SQL queries and optimize database performance.

• Data Modeling: Hands-on experience in designing and organizing data in both relational and non-relational formats is required.

• Communication Skills: Excellent verbal and written skills in English are essential for collaboration.

  ---

• Adaptability: Candidates should be quick learners with the capacity to tackle new challenges effectively.

• Collaborative Mindset: The ideal candidate will be open to sharing ideas, providing constructive feedback, and contributing positively to team discussions.

Nice-to-Have Skills

While the above skills are crucial, the following nice-to-have skills may enhance a candidate's profile:

• Cloud Experience: Familiarity with GCP would be advantageous.

• Containerization Knowledge: Experience with tools such as Docker and Kubernetes is preferred.

• Database Expertise: Skills in PostgreSQL would be beneficial.

• Scheduling: Experience with task scheduling, including tools like cron or frameworks like Airflow, is valued.

• Python Libraries: Knowledge of libraries such as asyncio, pydantic, fastapi, and psycopg is a plus.

• Search Technologies: Familiarity with ElasticSearch or OpenSearch is helpful.

• System Design: Experience with building RESTful APIs and queue-based systems is advantageous.

Qualifications

Eligible candidates should ideally hold a Master's degree in Computer Science or a related field, or possess equivalent practical experience. Additionally, a minimum of three years of professional experience in Data Platform Engineering or backend roles is required.

Salary and Benefits

Compensation will vary depending on experience and skills, with salaries in the range of £40,000 - £65,000. Moreover, performance bonuses, stock options, and a retirement plan enhance the overall benefits package, making this an attractive opportunity for the right candidate.

Application Process

For those interested in applying for this exciting role at Desia Limited, detailed instructions and further application procedures are provided in the job listing. Be sure to highlight relevant experiences that align with the position’s requirements when submitting your application.

This job offer was originally published on weworkremotely.com