Senior Data Engineer (Remote)

Project Description:

We are looking for a Senior Azure Data Engineer who can perform the design, implementation, and testing of cloud computing solutions using ADF, ADB, ADL, and Snowflake technology, creating, monitoring, and optimizing ETL/ELT processes, and migrating solutions from on-premises to public cloud platforms.

Should have Knowledge of SQL language and cloud-based technologies, Data warehousing concepts, and data modeling. metadata management. Experience Migration to AWS or Azure Snowflake platform, Azure data factory, and Azure data lake. Performance tuning and setting up resource monitors.

Responsibilities:

• Create, test, and implement enterprise-level apps with Snowflake, ADF, ADB, ADL etc

• Design and implement features for identity and access management

• Create authorization frameworks for better access control

• Solve performance issues and scalability issues in the system

• Transaction management with distributed data processing algorithms

• Possess ownership right from start to finish

• Build, monitor, and optimize ETL and ELT processes with data models

• Migrate solutions from on-premises setup to cloud-based platforms

• Understand and implement the latest delivery approaches based on data architecture

• Project documentation and tracking based on understanding user requirements

• Perform data integration with third-party tools including architecting, designing, coding, and testing phases

• Manage documentation of data models, architecture, and maintenance processes

• Continually review and audit data models for enhancement

• Maintenance of ideal data pipeline based on ETL tools.

• Coordination with BI experts and analysts for customized data models and integration

• Code updates, new code development, and reverse engineering

• Performance tuning, user acceptance training, and application support

• Maintain confidentiality of data • Risk assessment, management, and mitigation plans

• Regular engagement with teams for status reporting and routine activities

• Migration activities from one database to another or on-premises to cloud

Mandatory Skills Description:

5+ years of experience

Microsoft Azure Data Lake, SnowFlake, Microsoft Azure Databricks, ETL, Microsoft Azure Data Factory, Analytical Skills, SQL, Data Modeling

•Snowflake modeling – roles, databases, schemas

•SQL performance measuring, query tuning, and database tuning

•ETL tools with cloud-driven skills

•Integration with third-party tools

•Ability to build analytical solutions and models.

•Coding in languages like Python, Java, JavaScript

•Root cause analysis of models with solutions

•Hadoop, Spark, and other warehousing tools

•Managing sets of XML, JSON, and CSV from disparate sources

•SQL-based databases like Oracle SQL Server, Teradata, etc.

•Snowflake warehousing, architecture, processing, administration •

•Data ingestion into Snowflake

•Enterprise-level technical exposure to Snowflake applications

Nice-to-Have Skills Description:Hadoop, Oracle