Lead Data Engineer Id (Remote)

AgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch. We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment every day, there’s no better place – guaranteed!

What you will do

• Communicating with the different teams (Analytics, Product, Engineering) to understand their Data needs and business goals;
• Perform the necessary changes on the client’s data lake/pipelines to accomplish their business goals and needs;
• Building and maintaining complex pipelines to connect different sources of data together;
• Identifying and optimizing performance bottlenecks;
• Designing data structures for analytics;
• Writing clear technical documentation.

Must haves

• 5+ years experience in software development as Data Engineer;
• Strong skills and proven experience working with Data Lakes & Warehouse;
• Practical experience building and maintaining ETL/ELT data pipelines;
• Great communication skills as well as stakeholder management and requirements gathering;
• Strong experience with BigQuery, Airflow (AWS MWAA), AWS Athena and AWS Glue;
• Proficient in Python and SQL;
• Practical experience in building the data collection, validation and normalization;
• Advanced English;
• A strong sense of ownership and willingness to overcome every challenge with the same level of energy, regardless of the complexity or the end goal;
• Experience working in an environment leveraging remote communication and collaboration tools (e.g. Github, Slack, JIRA).

Nice to haves

• Experience working with DBT and Redshift is a high plus;
• Infrastructure experience as a DevOps Engineer;
• Experience working with PowerBI;
• You are passionate about writing clean, modern, maintainable, & highly-performant code;
• You have a pro-active ability and a self-starter attitude to troubleshoot and solve problems;
• You have experience working in an Agile environment;
• You have strong communication skills with excellent interpersonal effectiveness, in one-on-one interactions and presenting to a room;
• You have self-awareness and a desire to continually improve.

The benefits of joining us

• Professional growth

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps

• Competitive compensation

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities

• A selection of exciting projects

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands

• Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.