Senior Data Engineer

This page contains product affiliate links.

Overview

Netomi AI is on a significant mission to enhance customer experiences through artificial intelligence, supporting some of the world’s largest global brands. The company's aim is to build AI systems that foster customer loyalty, solving critical issues faced by top-tier clients. In this ambitious environment, they seek to expand their team by hiring a Senior Data Engineer who will play a crucial role in revolutionizing the customer experience sector using data-centric solutions.

Role and Responsibilities

As a Senior Data Engineer at Netomi, you will be responsible for a variety of key tasks aimed at developing innovative data solutions:

• Architect and implement scalable, secure, and reliable data pipelines utilizing modern data platforms like Spark, Databricks, Airflow, and Snowflake.
• Develop ETL/ELT processes that allow for the efficient ingestion of data sourced from various structured and unstructured environments.
• Conduct Exploratory Data Analysis (EDA) to identify trends, validate data integrity, and derive actionable insights that influence product development and inform business decisions.
• Collaborate closely with teams consisting of data scientists, analysts, and software engineers to design data models focused on high-quality analytics and real-time insights.
• Lead infrastructure projects that manage data within cloud platforms such as AWS and Azure, as well as data lakes and warehouses.
• Ensure that data governance, security, and compliance adhere to established best practices.
• Monitor and optimize data systems performance, addressing potential issues proactively.
• Mentor junior data engineers and contribute to the establishment of industry best practices in data engineering standards, tooling, and development workflows.
• Stay updated with the latest emerging technologies and trends in data engineering, recommending necessary improvements to current practices.

Required Qualifications

The ideal candidate for this Senior Data Engineer role should possess the following qualifications:

• A Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 8+ years of hands-on experience in data engineering or backend software development niches.
• Proficiency in Python, SQL, and at least one data pipeline orchestration tool such as Apache Airflow, Luigi, or Prefect.
• Strong expertise with cloud-based data platforms including AWS Redshift, GCP BigQuery, Snowflake, and Databricks.
• A deep understanding of data modeling, warehousing, and distributed systems.
• Experience with big data technologies, notably Apache Spark, Kafka, and Hadoop.
• Familiarity with DevOps practices, including CI/CD, infrastructure as code, and containerization with Docker or Kubernetes.

Preferred Qualifications

Candidates with the following additional qualifications will be favored:

• Experience in working with real-time data processing and streaming architectures.
• Knowledge of data security and privacy regulations such as GDPR and HIPAA.
• Familiarity with machine learning pipelines or testing data science workflows.
• Understanding of prompt engineering, particularly how LLM-based systems interact with data.
• A collaborative approach, having experience in working with cross-functional teams and dealing with stakeholders from non-technical domains.

Work Environment

Netomi is recognized as an equal opportunity employer and champions diversity in the workplace. The company evaluates all qualified applicants without regard to race, color, religion, gender, sexual orientation, disability, veteran status, and other protected characteristics. The team at Netomi values innovation, creativity, and hard work, offering an environment conducive to professional growth and success in artificial intelligence.

Conclusion

This position presents exceptional opportunities for professional development in the field of data engineering within the innovative sector of artificial intelligence. As part of the team at Netomi, you can expect to greatly impact the company's success while also developing your skills and career in a challenging yet supportive framework. If you are excited about contributing to a Generative AI revolution, this role is worth considering.

This job offer was originally published on himalayas.app