Senior Data Engineer

About the Role

We are seeking an experienced Senior Data Engineer to join our growing team. In this role, you will design, build, and maintain our data processing systems, ensuring they are scalable, reliable, and efficient. You will work closely with data scientists, analysts, and other stakeholders to understand their data needs and deliver solutions that enable data-driven decision making.

As a Senior Data Engineer, you will have the opportunity to work with cutting-edge technologies and solve complex data challenges for our clients across various industries.

Responsibilities

• Design, develop, and maintain scalable data pipelines using modern data engineering tools and frameworks
• Collaborate with data scientists and analysts to understand their data requirements and implement appropriate solutions
• Optimize data models and query performance to ensure efficient data access and processing
• Implement data quality checks and monitoring to ensure data accuracy and reliability
• Participate in architectural discussions and contribute to the design of data systems
• Mentor junior engineers and provide technical guidance to the team
• Stay up-to-date with the latest trends and technologies in data engineering

Requirements

• 5+ years of experience in data engineering or related field
• Strong programming skills in Python, Scala, or Java
• Experience with big data technologies such as Spark, Hadoop, and Kafka
• Proficiency in SQL and experience with both relational and NoSQL databases
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services
• Familiarity with data modeling, ETL design, and data warehousing concepts
• Experience with workflow orchestration tools like Airflow or Luigi
• Strong problem-solving skills and attention to detail