Principal Solutions Architect - Big Data
CurrentI’m working at Ligadata as Big Data Architect/ Hadoop Infrastructure and Systems, and my main responsibilities come at hardware planning, solution design, and driving the implementation and future support to ensure the implemented eco-systems are running smoothly, tuned, with latest technologies and best security model.In details:- Leading Hadoop and infrastructure architecture design.- Lead clusters implementation and give best practices for implementation and configuration.- Running R&D for the new Big Data technologies and driving the needed POCs.- Develop integration between Big Data components- Develop new tools needed for reporting and data governance.- Develop automated performance reports templates for various ECO-Systems clusters statistics- Design, and build Big Data security models and develop security integrations- Driving Linux performance tuning and providing trouble shooting and tuning best practices.- Engaging with OEM, Vendors and clients architecture and design meeting to provide solution recommendations.- Driving Hadoop and others Big Data Eco-System components major and minor upgrades- Develop automated solution for data movements between storage tiers- Develop Disaster Recovery solutions for various Big Data production implementations.- Manage Infrastructure on both Clouds (Azure and AWS) as well as on-prem- Docker and Kubernetes Management and implementation for some of the implemented Big Data Eco-System services.