Vice President Data Engineering , Analytics & Machine Learning Platforms
CurrentLeading multi-year program to reimagine and modernize the data, analytics and machine learning environment to drive business growth. Platform leverages AWS S3 for Data Lake to store data from various sources via batch and real-time ingestion patterns. - Designed multi-zone Data Lake with automated batch and real-time ingestion with data cataloging and registration. - Built out multiple data pipelines using Hive, Spark and Nifi to create purpose built data sets. - Implemented SnowFlake Cloud Data Warehouse for analytics and dashboard reporting. - Integrated SageMaker, Jupiter Hub, Anaconda and Spark to enable Advanced DataScience team to build, train and deploy machine learning models as batch pipelines and realtime API's. - Migrated legacy Hadoop Data Pipelines and Analytics Workspace to modernized platform. - Implemented Informatica Data Governance application suite.Well versed in the following technologies...- Data Lake - S3, Glue, Athena- Data Pipelines - Spark, HiveQL, Nifi, Cloudera Data Platform- Data Warehouse - Snowflake, DB2 Warehouse Cloud- NoSQL - Cassandra, DynamoDB- Data Science - SageMaker, Anaconda, Python, Jupyter Hub- Orchestration - Airflow, Jenkins, Kafka- Containerization - Docker, Kubernetes, - Data Governance - Informatica Enterprise Data Catalog