RED TIC is looking for a talented Data Engineer (Spark/Scala) to join our client’s team as a Data Engineer, you will play a key role in building and optimizing data pipelines, developing scalable data solutions and working with large datasets using Spark and Scala technologies.
Key Responsibilities:
Data Pipeline Development:
- Design, develop, and maintain robust data pipelines using Apache Spark and Scala to process and analyze large volumes of data.
- Integrate and consolidate data from various sources into a unified data warehouse, ensuring high-quality data processing.
- Build and optimize real-time and batch data processing workflows.
Collaboration and Data Solutions:
- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
- Work on designing and implementing scalable data architectures and data warehouses.
- Troubleshoot and debug complex data engineering issues to ensure the reliability of data systems.
Performance Optimization:
- Optimize Spark jobs and Scala-based processing to ensure efficient data handling, storage, and retrieval.
- Monitor system performance and optimize the architecture to meet business requirements while improving speed and scalability.
PROFILE REQUIRED
Technical Expertise:
- Strong experience in Apache Spark (especially with large-scale data processing).
- Proficiency in Scala for building high-performance applications and data pipelines.
- Experience with data storage systems such as Hadoop, HDFS, or NoSQL databases.
- Familiarity with distributed computing concepts and cloud platforms (e.g., AWS, Google Cloud, or Azure).
- Solid understanding of SQL and experience with relational databases (e.g., MySQL, PostgreSQL, or similar).
Experience:
- 3+ years of experience in data engineering or a related field.
- Proven track record of working with large datasets and building data pipelines.
Desirable Skills:
- Knowledge of additional data processing tools or languages such as Python or Java.
- Experience with containerization tools like Docker and orchestration tools like Kubernetes.
- Familiarity with data warehousing solutions (e.g., Redshift, BigQuery, Snowflake).
Soft Skills:
- Strong problem-solving skills and attention to detail.
- Ability to work independently as well as in a team environment.
- Excellent communication skills and the ability to collaborate with cross-functional teams.
recruitment consulting management training sourcing job jobs offer internship morocco africa java développement developpement développeur developpeur informatique application it jee android consultant devops fullstack. D’abord. Tout d’abord. En premier lieu. Ensuite, de plus. Finalement. En outre. Par ailleurs. En dernier lieu. enfin. D’abord, En premier lieu, Pour commencer, Premièrement, En conclusions ur conclure, Enfn, Finalement, En dernier lieu, bien que. il y a aussi il est vrai que… mais. tout en reconnaissant que… on peut supposer que. Par exemple . En fait . Prenons le cas de. Considérons, par exemple. L’exemple le plus r. Cependant. Mais. Pourtant. Toutefois. Néanmoins. Contraste. Alors que. Tandis que. Par contre. En revanche