Principal AI & Data Cloud Platform Engineer (B-1223) - UNION Vienna

Feladatok:

Design and own the Azure Native Data & AI Platform architecture

Lead Azure Databricks platform implementation and evolution

Define enterprise data, analytics, ML and AI platform standards and best practices

Design Lakehouse and Medallion architectures

Define the technical architecture and standards for enterprise MLOps capabilities

Define patterns for operationalizing machine learning models from development through production

Define standards for model lifecycle management, deployment and monitoring on the platform

Drive the adoption and evolution of MLflow and related ML lifecycle capabilities

Define reusable platform capabilities that enable Data Scientists to develop, deploy and operate machine learning solutions efficiently

Establish architectural patterns for batch and real-time model inference and model serving

Drive platform scalability, reliability, observability and performance

Lead Infrastructure as Code adoption

Design CI/CD standards and patterns for data, ML and platform components

Drive automation across data and machine learning solution lifecycles

Mentor engineering teams and provide technical leadership

Collaborate with Data Scientists on productionization patterns and technical requirements for ML and AI solutions

Collaborate with Security and Governance teams to ensure secure and governed data and AI workloads

Evaluate emerging Azure, Databricks, Machine Learning and Generative AI capabilities

Support enterprise architecture and technology roadmap planning

Elvárások:

7+ years of experience in Data Engineering, ML Engineering, Cloud Platform Engineering, or a related field.

3+ years of experience designing and developing enterprise-scale Azure Data Platforms or comparable cloud platforms on AWS or GCP.

Strong experience with Azure Databricks, Apache Spark, and distributed/parallel data processing.

5+ years of hands-on experience with Python and strong SQL skills.

Strong understanding of modern data architectures, including Delta Lake, Azure Data Lake Storage Gen2, and Azure Data Factory.

Solid understanding of machine learning lifecycles, MLflow, and MLOps architecture, including model deployment and productionization patterns.

Proven experience with CI/CD, Azure DevOps or GitHub Actions, and Infrastructure as Code using Terraform.

Strong enterprise architecture experience, with the ability to design scalable, secure, and maintainable cloud data and AI platforms.

Proven technical leadership and mentoring experience, with the ability to drive architectural decisions and take end-to-end ownership of complex initiatives.

Excellent analytical, problem-solving, and communication skills, with the ability to communicate effectively with both technical and non-technical stakeholders.

Excellent professional communication skills in English.

Előnyt jelent:

Experience with Azure Machine Learning or comparable enterprise ML platforms.

Experience with enterprise data governance and metadata management platforms such as Unity Catalog or Microsoft Purview.

Experience with data quality frameworks, lineage, access governance, and data discovery.

Experience with Feature Store concepts, model serving, and batch or real-time inference architectures.

Experience with Docker, Kubernetes, and containerized workloads.

Experience with Azure OpenAI, Large Language Models (LLMs), RAG, and vector database architectures.

Experience with event-driven architectures and streaming technologies such as Azure Event Hubs or Kafka.

Azure Solutions Architect certification.

Databricks Professional Certification.

Amit kínálunk:

You’ll have the opportunity to take on meaningful responsibilities and make a real impact.

Our flexible working model allows you to work from home most of the month, helping you balance work and everyday life.

We look forward to seeing you in the office on team days, where you’ll enjoy a modern, comfortable and inspiring working environment.

We offer an attractive benefits package, including a cafeteria package, , a company mobile phone and employee discounts.

Your health and well-being matter to us. That’s why we provide health insurance to all our employees, which can also be extended to cover family members.

We’re more than just a workplace – we’re a community. You’ll have plenty of opportunities to take part in community and CSR initiatives, as well as company events throughout the year.