Decskill, founded in 2014 as an IT Consulting Company, places paramount importance on its greatest asset: its people. Our main mission is to deliver value through knowledge and talent, and we achieve this by fostering a culture of excellence and investing in the development and well-being of our people. With over 600 dedicated professionals and offices in Lisbon, Porto, Madrid, and Luxembourg, Decskill operates across three core areas:

Decskill Talent: We believe that our people are key to our success. Through Decskill Talent, we empower our team to embrace the digital transformation challenges of our clients. We collaborate with clients to drive innovation, ensuring project success and business growth.

Decskill Boost: Equipping our team with the latest tools and methodologies, we optimize Time-to-Market and deliver innovative solutions exceeding client expectations.

Decskill Connect: Our team collaborates closely with clients to implement and manage IT infrastructures that generate long-term value.

At Decskill, we believe that by nurturing and empowering our people to confront the challenges of digital transformation, we create value not only for our clients but also for our entire ecosystem, fostering a digital community dedicated to growth and progress.

We are looking for a DataOps Engineer for a remote project in Portugal.

Requirements:

• Google Cloud Platform: General knowledge of the platform and various services, and at least one year of experience with GCP.
• Apache Airflow: At least two years of experience with the Airflow orchestrator, experience with Google Composer is a plus.
• Google BigQuery: Extensive experience (at least 4 years) with GBQ, know how to optimize tables and queries, and able to design database architecture.
• Terraform: At least two years of experience with Terraform, and know good practices of GitOps.
• Apache Spark: this is an optional expertise we would value (Some pipelines use PySpark).

Responsibilities:

• Incident Response;
• Understand problems from a user perspective and communicate to clearly understand the issue;
• Reproduce bugs or issues that users are facing;
• Apply root cause analysis to quickly and efficiently;
• Find the root cause of the problem, patch it, test it, and communicate with the end user;
• Write postmortems summarizing every step of resolution and helping the team to track all issues;
• Monitor existing flows and infrastructure and perform the same tasks when discovering bugs/issues through monitoring and alerting;
• Maintenance o Monitor flows and infrastructure to identify potential issues;
• Adapt configurations to keep flows and infrastructures working as expected, keeping the operations without incident;
• Database Optimization o Track costs and time of processing through dedicated dashboards;
• Alert people who query tables the wrong way, involving high costs;
• Track down jobs, views, and tables that are running inefficiently and occur either high costs or low speed of execution;
• Optimize jobs, queries, and tables to optimize both costs and speed of execution;
• Infrastructure Management o Manage infrastructure through Terraform;
• Decommission useless infrastructures such as services, tables, or virtual machines;
• Track future deployments with a Data Architect and participate in Deployment Reviews;
• Accompany Data Engineers during the entire process of deployments. o Accompany Data Engineers in the following period of active monitoring;
• Ensure diligent application of deployment process, logging, and monitoring strategy;
• Take over newly deployed flows in the run process.

If you’re interested in this job please send your CV in English to: carolina.novais@decskill.com with reference “CN/DataOps”.

Decskill is committed to equality and non-discrimination with all our talents. We recruit and promote talent, based on diversity and inclusion, regardless of age, gender, ethnicity, race, nationality or any other form of discrimination incompatible with the dignity of the human being.