Corning It Data Technical Leader
CurrentMy responsibilities varied with different projects:A. Databricks Platform Admin:✔Design and establish permissions on Databricks tailored to various projects.✔Restructure existing permission frameworks to align with company cybersecurity standards.✔Assist projects in deploying code and data to production environments.✔Create operational Standard Operating Procedures (SOPs) and deliver them to the operations team.B. DevOps Engineer:✔Provide Databricks development… Show more My responsibilities varied with different projects:A. Databricks Platform Admin:✔Design and establish permissions on Databricks tailored to various projects.✔Restructure existing permission frameworks to align with company cybersecurity standards.✔Assist projects in deploying code and data to production environments.✔Create operational Standard Operating Procedures (SOPs) and deliver them to the operations team.B. DevOps Engineer:✔Provide Databricks development guidelines to developers and establish templates for reference.✔Create project-specific git flows and define CI/CD processes.✔Develop templates for automated testing.✔Establish deployment and rollback procedures.C. Data Engineer:✔Develop data pipelines on the Databricks platform using PySpark Show less