We are seeking an experienced Remote Lead Data Engineer with over 7 years of expertise in data engineering, particularly within the consumer finance domain or related industries such as consumer loans, collections, servicing, optional products, and insurance sales. This role is integral to enhancing our data architecture and operational efficiency.

Key Responsibilities

• Design and manage cloud resources in AWS.
• Execute data ingestion from diverse sources including RDBMS, REST APIs, flat files, streams, and time series data.
• Leverage Big Data technologies for effective data ingestion and processing.
• Employ Spark and other Cloud Services for data processing and transformation.
• Develop automated data quality checks to ensure the integrity of incoming data and validate calculation outcomes.

Required Skills

• Strong foundation in mathematics, statistics, computer science, data science, or a related field.
• Proficient in at least one programming language: Java, Scala, Python, or C#.
• Extensive production experience with technologies such as HDFS, YARN, Hive, Spark, Kafka, Oozie/Airflow, AWS, Docker/Kubernetes, and Snowflake.
• Well-versed in data mining tools (e.g., SAS, SQL, R, Python) and database technologies (e.g., PostgreSQL, Redshift, Snowflake, Greenplum).
• Familiarity with data visualization tools (e.g., Tableau, Looker, MicroStrategy).
• Strong organizational skills with the ability to manage multiple projects and deadlines efficiently.
• Excellent written and verbal communication skills, capable of presenting complex results to non-technical stakeholders.
• Knowledge of business intelligence tools and techniques.
• Experience with AWS certification, Spark Streaming, Kafka Streaming, ELK Stack, Cassandra/MongoDB, and CI/CD tools (e.g., Jenkins, GitLab, Jira, Confluence) is advantageous.

Qualifications

• Minimum of 7 years of experience in data engineering, preferably in the consumer finance sector.
• Proven track record in managing large datasets and data processing.
• Demonstrated expertise in data architecture and quality management.

Career Growth Opportunities

Joining our team provides a unique opportunity for professional development within the dynamic landscape of consumer finance. You will have access to ongoing learning and development resources, fostering your growth in data engineering and related fields.

Company Culture And Values

Our organization values innovation, integrity, and collaboration. We are committed to building a diverse and inclusive workplace that empowers our employees and promotes professional excellence.

Networking And Professional Opportunities

As a part of our team, you will engage with a network of skilled professionals in the data engineering domain, enhancing your collaborative skills and expanding your professional connections.

Compensation And Benefits

We offer a competitive salary based on experience, along with flexible remote work options, comprehensive health benefits, a retirement savings plan with matching contributions, and a generous vacation policy.

Employment Type: Full-Time