Big Data Engineer W (Remote)

Big Data Engineer

12+ month contract

Remote

Job Description-

A Bachelor’s or master’s degree in computer science, Engineering, or a related field is required.

• 8 to 10 years of professional development experience in cloud-based distributed systems.
• Hands-on experience with AWS services (such as S3, EMR, EC2, Glue, DynamoDB, RDS) or other cloud platforms.
• Proficiency in programming languages such as Python, Scala, or Java.
• Desired experience with Big Data tools, including Spark/PySpark, Hadoop, Hive, and NoSQL/SQL, as well as scripting languages.
• Experience with Snowflake or any relational database management system (RDBMS), including hands-on skills in writing complex queries.
• Practical experience in workflow orchestration tools like Airflow or Oozie.
• Proficiency in enterprise security, agile methodologies, and change management standards.
• Good understanding of distributed software applications, including system integration, testing, and troubleshooting.
• Experience in monitoring the health of distributed systems and developing strategies for error detection and recovery.
• Systems integration experience is essential.
• Ability to work with version control systems, such as GIT, including tasks like branching and merging.

Required Skills : Job description- A Bachelor’s or master’s degree in computer science, Engineering, or a related field is required. – 8 to 10 years of professional development experience in cloud-based distributed systems. – Hands-on experience with AWS services (such as S3, EMR, EC2, Glue, DynamoDB, RDS) or other cloud platforms. – Proficiency in programming languages such as Python, Scala, or Java. – Desired experience with Big Data tools, including Spark/PySpark, Hadoop, Hive, and NoSQL/SQL, as well as scripting languages. – Experience with Snowflake or any relational database management system (RDBMS), including hands-on skills in writing complex queries. – Practical experience in workflow orchestration tools like Airflow or Oozie. – Proficiency in enterprise security, agile methodologies, and change management standards. – Good understanding of distributed software applications, including system integration, testing, and troubleshooting. – Experience in monitoring the health of distributed systems and developing strategies for error detection and recovery. – Systems integration experience is essential. – Ability to work with version control systems, such as GIT, including tasks like branching and merging.