Senior Data Software Engineer (Remote)

Our client is a leading provider of property insights and analytics, offering data-driven solutions to empower decision-making in real estate, financial services, and insurance industries. The ideal candidate will have a strong technical foundation in modern data engineering technologies and tools, with experience in Python, Spark, and cloud platforms (AWS or GCP). You will be responsible for contributing to the design, development, and deployment of robust data pipelines and systems to support our client’s evolving business needs.

This role involves collaborating with an onshore client team in a transitioning environment, requiring a proactive attitude and strong communication skills to ensure a smooth knowledge transfer.

Responsibilities

• Design, implement and maintain scalable and efficient ETL/ELT pipelines using tools like Python, Spark, Airflow and Kafka
• Work with cloud-based services such as AWS (DynamoDB, Glue, S3, Lambda, Fargate) or GCP to develop and optimize data workflows
• Implement and manage data storage solutions, including Snowflake, Elastic Search and SQL Server
• Develop containerized applications using Docker and manage container orchestration
• Ensure data quality and reliability through testing and monitoring
• Actively engage with the client team to acquire domain knowledge and ensure smooth knowledge transfer
• Collaborate with cross-functional teams to deliver high-quality data solutions on time
• Work within an Agile framework (e.g., Scrum, Kanban), and adhere to established DevOps practices such as CI/CD pipelines and automated testing
• Use GitFlow or similar version control workflows for development and deployment

Requirements

• Proficiency in Python, Spark, SQL and data pipeline orchestration tools like Airflow
• Solid understanding of distributed data systems and cloud architectures
• Hands-on experience with containerization and orchestration (Docker, Fargate)
• Strong communication skills and ability to manage stakeholder expectations in a transitioning environment
• Exposure to advanced technologies, such as serverless architecture and data lake design
• Highlight time zone flexibility to collaborate effectively with an Australian client
• Understanding and proficiency in general big data concepts

We offer

• By choosing EPAM, you’re getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

• EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
• We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients