Toptal: Python Backend Development Talent with RAG and Agentic AI Experience

Job Overview

Toptal, a prominent player in the tech industry, is seeking a Python Backend Developer who is experienced with Retrieval-Augmented Generation (RAG) systems and agentic AI frameworks. This is an exciting opportunity for a skilled individual who can design, build, and deploy scalable AI-powered applications critical to the organization’s goals.

Role Responsibilities

The role of the Python Backend Developer is to deliver a production-grade RAG system and AI chatbots that securely integrate with various enterprise data, APIs, databases, and cloud services. The successful candidate will be an integral part of a dynamic and distributed team, requiring overlapping hours with US business hours.

Key Responsibilities:

• Design the end-to-end architecture for a scalable RAG system and AI chatbots.
• Develop Python backend services, REST APIs, and microservices using frameworks like FastAPI.
• Construct document ingestion, chunking, embedding, indexing, retrieval, and reranking pipelines.
• Implement vector search solutions utilizing Azure AI Search or comparable vector databases.
• Design autonomous AI agents that are capable of planning, reasoning, using tools, and making decisions.
• Create multi-step AI workflows using systems like LangGraph, LangChain, or CrewAI.
• Integrate commercial and open-source large language models (LLMs) including Azure OpenAI, OpenAI, and others.
• Manage conversation memory, session management, context management, and agent collaboration patterns.
• Connect AI workflows with a variety of APIs, databases, enterprise systems, and external tools.
• Develop asynchronous, high-performance services capable of managing concurrent AI workloads.
• Establish standards for logging, monitoring, tracing, observability, and security throughout the development process.
• Translate business requirements into effective technical designs and production-ready AI solutions.
• Collaborate with a wider team and take ownership of decisions related to architecture and implementation.

Required Skills and Experience

Candidates must possess a substantial background in Python backend development. The following competencies are mandatory for this position:

• 8+ years of professional experience in Python backend development.
• Strong familiarity with REST API, microservices, asynchronous services, and distributed backend systems.
• Proven hands-on experience in building production-grade RAG applications.
• In-depth knowledge of embeddings, document chunking, and processes related to semantic search, vector indexing, and retrieval strategies.
• Experience developing AI agents and multi-step LLM workflows, demonstrating proficiency in frameworks like LangGraph, LangChain, CrewAI, and AutoGen.
• Track record of integrating various LLMs, including OpenAI, Azure OpenAI, Anthropic Claude, and Gemini.
• Ability to design AI architecture beyond basic prompt engineering principles.
• Experience with the integration of AI applications encompassing APIs, databases, and enterprise systems.
• Strong grasp of production service standards including security, monitoring, logging, and observability principles.
• Advanced skills in deploying containerized applications via Docker and cloud platforms like Azure or AWS.
• Excellent communication and collaboration proficiencies that thrive in a distributed working environment.
• Availability to work several hours in overlap with US business hours.

Compensation

The specific salary for this position was not mentioned in the job description. Interested candidates may inquire during the interview process or at the initial application stage. Candidates should prepare to discuss their salary expectations based on their experience and market trends.

Work Environment

The position is full-time and is structured for remote work, specifically targeting individuals in the Asia region. The need for overlap with US business hours promotes a collaborative work environment, ensuring team members can engage and contribute effectively.

Application Process

Interested candidates can apply to Toptal for this role. They should have a robust portfolio and relevant experience that reflects the requirements stated in the job description. A well-prepared resume highlighting past work, projects, and experiences that align closely with the listed responsibilities can strengthen the application. To apply, candidates should visit the specified job posting on Toptal's site for submission details.

This job offer was originally published on weworkremotely.com