Lead Consultant
Current• Interact with business stakeholders and designers to understand and implement business requirements.• Hadoop development and implementation.• Loading data from disparate data sets.• Designing, building, installing and configuring Hadoop environments.• Transforming data using Spark and Scala.• Translate complex functional and technical requirements into detailed design.• Performing analysis of vast data stores and uncover insights.• Maintaining security and data privacy using Kerberos, Ranger, KTS and KMS.• Creation of scalable and high-performance web services for data tracking.• Query optimization for high-speed querying.• Managing and deploying HBase.• Testing prototypes and oversee handover to operational teams.• Proposing best practices/standards.• Monitoring the daily activities, queries and load on the Database• Performing the Dataroom Activity from Greenplum to GCP Cloud on monthly basis to make sure that a copy of the production data is secured on the Cloud.• Addition and removal of users.• Co-ordinating with different teams like Linux team or Hardware team for various issue that occur on daily/weekly/monthly basis.• Performing Weekly Activity on the Database like Vacuum Analyze, Re-indexing, Partitioning and Full DB Analyze.• Extraction of the Production Data from GreenPlum database to Cloudera Platform while Migration phase.• As a Lead, handling the team as per the daily activities in different shifts (24 x7) and the migration activities along with the validation steps to be followed keeping everybody on the same page.• Migration from CDP to Snowflake.• Using AWS as a staging area for migration from CDP to Snowflake.