Related keywords: freelance remote jobremote job pythondata engineer remote job
Mindrift, a forward-thinking company in the tech industry, is seeking a Senior Python Data Scraping Engineer to become a vital part of their innovative Tendem project. This freelance position invites experts in web scraping and data extraction to apply their technical skills within a unique hybrid AI + human system. As a Senior Python Data Scraping Engineer, you will play a crucial role in driving advanced data scraping workflows that are essential for the project's success.
Mindrift is recognized for its mission to unlock the potential of Generative AI by leveraging real-world expertise from professionals across the globe. They connect specialists with AI projects, providing a platform that promotes collaboration between AI systems and human insights. Mindrift's approach merges cutting-edge technology with expert knowledge, aiming to bring innovative solutions to the industry.
In this role, you will be referred to as an AI Pilot, where your primary responsibilities will include collaborating with Tendem Agents—individuals who focus on repetitive tasks—while you employ your critical thinking skills and domain expertise to assure high-quality and actionable results. This remote position is perfect for technically proficient individuals who thrive in challenging situations and are experienced in the realms of data scraping and processing.
Your involvement in the Tendem project will encompass a variety of critical tasks, including but not limited to:
Owning end-to-end data extraction workflows, ensuring thorough coverage and accurate delivery of structured datasets.
Using internal tools like Apify and OpenRouter, combined with custom workflows, to enhance data collection and validation.
Adapting strategies to ensure reliable data extraction from dynamic and interactive web sources, particularly when handling JavaScript-rendered content or dealing with changes in site behavior.
Monitoring and maintaining stability in scraping operations amidst minor alterations in website structure while scaling data collection for larger datasets.
Candidates interested in this role must possess a robust skill set that demonstrates their ability to manage complex data scraping tasks. The minimum requirements include:
A minimum of 5+ years of relevant experience in fields like web scraping, data engineering, or software development.
A degree in Engineering, Applied Mathematics, Computer Science, or other related fields, with advanced degrees considered a plus.
Practical experience with Python web scraping tools, such as BeautifulSoup, Selenium, or equivalent, particularly for dynamic content and API interaction.
A solid understanding of data cleaning, normalization, and validation practices—capabilities crucial for delivering structured datasets in formats like CSV, JSON, or Google Sheets.
Familiarity with cloud infrastructure (AWS or equivalents) and Docker as part of real workflow integration.
For this specific project, expected task engagement is around 10–20 hours per week during active phases, though this is an estimate and actual workload may vary according to project demands. Flexibility is fundamental, as the project scope can change based on ongoing requirements.
As for financials, contributors can earn up to $45 per hour in this project role, based on experience level and contribution pace. Compensation is designed to reflect varying project scopes, complexities, and skill requirements accordingly.
This position is not only an opportunity to leverage your technical expertise in a highly dynamic field but also a chance to contribute to a forward-looking project that relies on innovative technology and human expertise. A link to your GitHub profile is beneficial and English proficiency, at least upper-intermediate level (B2), is required to ensure effective communication and collaboration.
If you meet the outlined requirements and are excited about driving advancements in AI-assisted data workflows at Mindrift, this freelance opportunity promises to be both rewarding and impactful.
This job offer was originally published on jobicy.com
This job offer summary has been generated using automated technology. While we strive for accuracy, it may not always fully capture the nuances and details of the original job posting. We recommend reviewing the complete job listing before making any decisions or applications.
