Senior Data Engineer
CurrentI am a member of Databricks Center of Excellence TeamI got "Global Shell Recognition Award" for 2023Presentation about Delta Sharing in a Databricks User Community Event in Brussel • Across Regions * Cloud ProvidersDelta Live Tables Pipelines & Data Asset Bundles • Serverless, Materialized Views, Streaming tables, Liquid Clustering, Vector Deletion, Append flows...Setting up Databricks on AWS as a platform (Biggest achievement in my career) Devops • Terraform, Repo, Terraform State Design & Implementation • CI/CD, Github & Github Actions Design and Support Implementation Platform Admin • Integration of Databricks with AWS • Unity Catalog Full Design and Implementation User Management • Workspace Configuration • Storage Credentials and External Location AWS Solution Architect • Network (VPC, Subnets) • Security (Security groups) • User Access Management (IAM Roles) • Service Control Policies • Multi-tenancy Design & Implementation Developer •API Gateway (Rest), Lambda function Data Engineer Architect • End2End design • Setting standarts