Senior Data Engineer Aws (Remote)

Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on crafting cutting-edge technologies that revolutionize industries. As a Software Engineer, you’ll play a vital role in our dynamic team, contributing to exciting projects that redefine urban living, establish new media channels for enterprise companies, or drive innovation in healthcare. This opportunity goes beyond code – it’s about creating epic solutions that leave a lasting impression in the market. If your passion for programming fuels your drive to make a real-world impact, consider this your pass to the captivating world of Product Development!

We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in building and maintaining robust data ingestion pipelines. The ideal candidate will have a strong foundation in data engineering principles, AWS technologies, and Python programming.

Responsibilities:

• Develop, Maintain and Enhance ETL Pipelines
• Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality.
• Provide accurate status tracking, reporting, and estimation using project methods and tools.
• Gather requirements, validate their understanding amongst the team, create and maintain relevant documentation.
• Execute activities within current methodology and upholding the highest quality standards.
• Foster collaboration with fellow engineers, designers, and managers to comprehend user pain points and iterate on solutions that drive client success.
• Take ownership of projects, from technical design to a successful launch.

Qualifications:

• Minimum 5 years of experience in data engineering or a related field.
• Strong proficiency in Python programming language.
• Deep understanding of AWS services, including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda.
• Experience with data ingestion pipelines, ETL processes, and data warehousing concepts.
• Proficiency in SQL and NoSQL databases.
• Experience with data modeling and schema design.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Experience with data security and privacy best practices.