Data Engineer (Remote)

Data Engineer open position in Spain.

The position is to work remotely, full-time, long-term, with an Upper-Intermediate level of English.

The compensation for this role is around 65-75k € per year

This position allows you to join a fast-growing technology organisation redefining productivity

paradigms in the software engineering industry. 

At our client’s company, optimising technology costs and maintaining efficiency are core principles. As part of this ongoing initiative, they focus on optimising their data usage, particularly our reliance on Snowflake. As their data grows, so does the need to adopt a “run lean” approach. Additionally, they are embarking on a key project to migrate their data infrastructure from

Snowflake to Google BigQuery to enhance scalability and integration with their broader ecosystem.

We seek talented engineers to review, optimise, and lead the migration of specific workloads. Candidates should have a solid understanding of Snowflake, Google BigQuery, and SQL and be able to assess, suggest, and implement improvements while ensuring a seamless migration process.

The Impact You’ll Make:

– Lead the migration of data and workflows from Snowflake to Google BigQuery.

– Identify and implement strategies to reduce technology costs associated with Snowflake usage.

– Optimise data workflows to ensure cost efficiency and compatibility with BigQuery.

– Translate Snowflake schemas and queries into BigQuery formats, ensuring functional equivalence.

– Propose and execute infrastructure tweaks to improve data handling and processing times.

– Provide both advisory and hands-on support to ensure departments achieve optimal data efficiency during and after migration.

– Educate and mentor team members and departments on best practices for data optimisation and BigQuery utilisation.

– Develop and implement monitoring tools to track performance improvements and cost savings.

Technology Stack (Main Technologies):

– Google BigQuery (mandatory)

– Snowflake

– SQL

– DBT

– AWS

– ECS, Lambda

– Apache Airflow

– Python

– Datadog / Monte Carlo

What You’ll Bring To Us:

– Proven Snowflake and Google BigQuery expertise, with a strong track record of leading data migrations and implementing cost optimisation strategies.

– Proficiency in Python and Airflow for automating and orchestrating data workflows.

– Ability to leverage DBT for data transformations, ensuring robust and optimised data pipelines.

– Working knowledge of Monte Carlo (SQL) and Streaming and Open Table formats

– Strong ability to work with cross-functional teams, providing advisory and hands-on support.

– Effective communication skills to share knowledge and best practices across the organisation.

– Keen analytical skills to identify inefficiencies and propose actionable improvements.

– Creative problem-solving to implement innovative solutions.

– Dedication to monitoring performance and making iterative improvements to maintain optimal operations.

– Excellent problem-solving skills and attention to detail.

– Excellent written and verbal English communication skills.

– Proactivity and capacity to bring well-thought-out solutions.

The company that hires is a fast-growing technology organization that is shifting the productivity paradigms in the software engineering industry. They bridge the gap between business and technology and they achieve this by helping their clients’ design new innovative products, and by building, scaling, and managing the technology teams that bring alive those ideas.

 The headquarters are in The UK, and it is also based in Portugal and Argentina.

The project is about a platform to issue the fastest and most reliable payments in more than 150 currencies, with in-country acquiring, world-class fraud filters and reporting through one API. It accepts all major international credit and debit cards, as well as popular alternative and local payment methods. 

The hiring is as an employee in Spain and includes:

– Work tools (laptop, monitor, working chair)

– Sanitas medical insurance

– 23 days of vacation +24 & 31 Dec.

– Flexible remuneration: Cobee (amount expent in some expenses does not apply to taxes)

– Monthly bonus for ordinary expenses (40€)

– Full access to corporate benefits platform

– Reduced Fridays (working up to 15 hs)

The process consists of a brief interview with me, an HR interview, a tech interview, and a final call with the client.

(Ref#0974) Esp ..