Mlops Databrick Engineer (Remote)

Mlops Databrick Engineer | Rarr Technologies | Worldwide

Databricks MLOps
We are seeking a skilled Databricks MLOps Engineer with a strong background in Python to join our dynamic team. You will be responsible for building, deploying, and maintaining our ML models, ensuring efficient CI/CD pipelines, and automating various processes to support our development teams. This role requires a deep understanding of Databricks services, MLOps practices, and Python scripting.

Key Responsibilities:

1. Databricks MLOps Implementation:

• Set up and configure Databricks ML platform for industrialization of ML models.
• Automate MLOps workflows to streamline machine learning processes.
• Implement CI/CD pipelines for ML model deployment GitHub integration.
• Monitor and optimize ML model performance in production.
• Deploy and manage infrastructure on Azure/AWS Databricks using Infrastructure as Code (IaC) tools like Terraform or ARM templates.
• Monitor and optimize cloud resource utilization and costs.

2. Automation & Scripting:

• Streamline processes and improve efficiency by developing automation scripts and tools using Python
• Automate routine tasks such as deployments, monitoring, and incident response.

3. Machine Learning:

• Different types of Machine Learning techniques such as Supervised, Unsupervised, Classification, Regression.
• Pipeline of Machine Learning Development Process
• Evaluation of Machine Learning Models and how to address Overfitting/Underfitting.

4. Collaboration & Support:

• Work closely with development teams to integrate MLOps best practices.
• Troubleshoot and resolve issues related to model deployment and industralization.
• Support development teams in their use of Databricks services and DevOps tools.

5. Security, Networking & Compliance:

• Implement and maintain security best practices within the Databricks environment.
• Strong understanding of Unity catalog model governance and security
• Ensure compliance with industry standards and internal policies.

5. Continuous Improvement:

• Stay up to date with the latest trends and best practices in MLOps, cloud computing, and automation.
• Contribute to the continuous improvement of our MLops processes.

Key Qualifications:

Education:

• Bachelors degree in Computer Science, Information Technology, or a related field.

Experience:

• 6-9 years of experience in MLops with a focus on Databricks (Azure AWS).
• Proficiency using MLFlow
• Proficiency in Python for automation, scripting, and tool development.
• Strong experience with DevOps tools including pipelines, repositories, artifacts, and boards.
• Experience with Infrastructure as Code (IaC) using Terraform, ARM templates, or equivalent.
• Solid understanding of CI/CD processes and tools.
• Experience with containerization technologies like Docker and Kubernetes is a plus.

Skills:

• Knowledge of Databricks’ collaborative notebooks, Feature Store, MLFlow, Lakehouse Monitoring, Model Serving and Unity Catalog for end-to-end machine learning lifecycle management.
• Proficient in Git and version control systems.
• Familiarity with monitoring tools such as Azure Monitor, Prometheus, or Grafana.
• Knowledge of configuration management tools like Ansible or Chef.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.

Preferred Certifications:

• Databricks Certified ML Engineer Associate
• Databricks Certified ML Engineer Professional
• Any relevant Python certifications

Tagged as: remote, remote job, virtual, Virtual Job, virtual position, Work at Home, work from home