Senior Big Data Engineer (Remote)

Job description / Role

Job Description

– Design and implement large-scale data processing systems and pipelines.
– Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka.
– Optimize data storage and retrieval strategies for performance and efficiency.
– Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
– Ensure data quality, integrity, and security across big data platforms.
– Lead efforts in data modeling, schema design, and data warehousing.
– Perform data extraction, transformation, and loading (ETL) from various data sources.
– Monitor and troubleshoot data processing jobs to ensure reliability and performance.
– Mentor junior engineers and provide technical guidance to the team.
– Stay current with emerging big data technologies and best practices to drive continuous improvement.

Personal Skills

– Strong communication, interpersonal, and presentation skills.
– Ability to multi-task and work under pressure.
– Excellent command of English.
– Excellent verbal and written communication skills; influencing skills and ability to work effectively in a geographically dispersed team.

Technical Skills

– Big Data Technologies: Expertise in Hadoop, Spark, Kafka, and related ecosystems.
– Programming: Proficient in Java, Scala, and Python for data processing and pipeline development.
– Data Modeling: Strong skills in designing data models and schema for big data applications.
– ETL Processes: Advanced knowledge of ETL (Extract, Transform, Load) techniques and tools.
– Database Management: Experience with NoSQL databases like Cassandra, MongoDB, and HBase.
– Cloud Platforms: Proficient in using AWS, Azure, or Google Cloud for big data solutions.
– Performance Tuning: Ability to optimize data processing systems for performance and scalability.
– Data Security: Understanding of data security principles and best practices.
– Collaboration: Strong teamwork and communication skills for cross-functional collaboration.
– Problem-Solving: Excellent analytical and problem-solving abilities to address complex data challenges.

Education

– Bachelor’s degree in Computer Science, Software Engineering, or a related field.

About the Company

Giza Systems, a leading systems integrator in the MEA region, designs and deploys industry-specific technology solutions for asset-intensive industries such as the telecoms, utilities, oil and gas, hospitality and real estate among other market sectors. We help our clients streamline their operations and businesses through our portfolio of solutions, managed services, and consultancy practice. Our team of 1000 professionals are spread throughout the region with anchor offices in Cairo, Riyadh, Dubai, Doha, Nairobi, Dar-es-Salaam, Abuja, Kampala and New Jersey, allowing us to service an ever-increasing client base in over 40 countries.