Data Engineer (Remote)

About Us:

At micro1, we’re all about connecting skilled remote professionals with some of the best companies in Silicon Valley. Our mission is to offer a stable, competitive income, along with access to top industry opportunities—all in a flexible work setting with a range of great benefits. We’re here to help you grow in your career. We’re proud to work with trusted partners such as Deel, Immutable, O’Gara, and LegalSoft.

What We Offer:

• Healthcare reimbursement
• Wi-Fi Reimbursement
• Unlimited Learning: Access to Udemy courses, books, and everything you need to keep growing
• And So Much More: We’re not just about work—we’re about creating an environment where you’ll love to be!

Job Summary:

We are seeking a highly skilled Data Engineer to join our dynamic team. You will play a crucial role in designing and developing data management pipelines, leveraging your expertise in Python, Azure, and Databricks. Your focus will be on configuring pipelines to enhance performance, ensure data quality, and optimize transformation queries. This is an exciting opportunity to work remotely with a team that values innovation and efficiency.

Key Responsibilities:

• Design and develop scalable data management pipelines and reusable components.
• Configure and optimize data pipelines using Azure and Databricks.
• Ensure high data quality and performance through meticulous testing and validation.
• Collaborate with cross-functional teams to integrate and onboard data effectively.
• Utilize CI/CD practices for efficient deployment and maintenance of data solutions.
• Troubleshoot and resolve issues related to data integration and resource management.
• Contribute to the continuous improvement of data analytics processes and methodologies.

Required Skills and Qualifications:

• Proven experience with Python development in data engineering contexts.
• Strong expertise in Azure functions and integration with source systems.
• Hands-on experience with Databricks for data processing and analytics.
• Proficiency in Azure DevOps and CI/CD methodologies.
• Excellent written and verbal communication skills, with a keen attention to detail.
• Data management and data integration experience, focusing on performance and quality.
• Ability to analyze and optimize data transformation and enrichment queries.

Preferred Qualifications:

• Background in cloud software engineering and platform design.
• Experience in developing data onboarding solutions and platforms.
• Strong data and analytics orientation, with a passion for data quality and performance optimization.