As a Senior Big Data Administrator I do play critical role in managing and optimizing Hadoop infrastructure on multi-cloud and responsible for ensuring the reliability, performance, and security of our big data environment, supporting data-driven initiatives across the organization.

• Develop and drive the overall data architecture strategy in alignment with the organization's business objectives.• Develop and maintain a comprehensive data solution, considering both short- term goals and long-term organization vision.• Collaboration with diverse team to comprehensively understand their data challenges, covering areas like Data Quality, Governance, Analytics, Data Architecture, Data Lakes, DWH, and MDM.• Conducting in-depth requirement gathering meeting with client stakeholders from both business and Data analytics departments to assess the current data landscape.• Acted as the key interface between business stakeholders and development teams, effectively translating business development requirements (BDR) into actionable technical specifications, thereby ensuring alignment with organizational objectives.• Implemented comprehensive data masking and security protocols to safeguard Personally Identifiable Information (PII), in compliance with regulatory standards. Ensured that security measures are integrated at each stage of the development lifecycle.• Managed and mentored development teams, overseeing code quality and data modeling, to ensure that deliverables meet architectural standards and business requirements. Coordinated with Enterprise Architects (EA) for plan reviews and strategic alignment.• Took ownership of technical certification processes, validating that all architectural and development efforts meet quality and performance benchmarks, thus mitigating risks and ensuring project success.• Demonstrated an in-depth understanding of clients' strategic enterprise data needs, leading to more efficient data management practices.

• Installation, Configuring, managing and maintaining Cloudera CDP/CDH 3000 nodes prod grade cluster.• Designed data strategies to improve data extraction, transformation, availability, quality and data securities.• Develop and implement data protection policies and procedures, Payment Card Industry Data Security Standard (PCI DSS)• Configuration of Apache Druid real-time analytics database world second largest cluster for handling large volumes of data and providing fast query performance• Enhancements and performance tuning on various Hadoop components: HDFS, YARN, Hive, HBase, Spark, Impala etc. • Securing Hadoop cluster includes configuration of Authentication, authorization, Data encryption and Auditing. • Ability to quickly solve any ongoing Hadoop prod cluster issues.• Expertise in CDH/HDP cluster upgradation and Cluster Migration from on prem to Public cloud.

Architecture and provides a complete set of Hadoop Infrastructure and Support services for enterprise grade applications and Open source. Fully managed Hadoop clusters with multiple hosting options and 24x7 monitoring, support and Maintenance of Hadoop clusters.Administered and maintained Hadoop clusters, overseeing data processing, storage, and security.Collaborated with software developers to optimize applications for Hadoop and other big data technologies.Monitored system performance and resource utilization, tuning configurations for optimal results.Conducted troubleshooting and resolved technical issues, maintaining high availability for mission-critical applications.

Assisted in the transition from traditional software development to a DevOps culture, leading to a more agile and responsive development process.Automated server provisioning and configuration management using Ansible, resulting in a 50% reduction in manual intervention.Collaborated with development teams to define application deployment strategies and created deployment pipelines in Jenkins.Improved system monitoring and logging to proactively identify and address issues, resulting in increased system stability.Conducted regular performance and security assessments, and implemented necessary improvements.Maintained version control repositories and enforced branching and code review processes.

Assessment and Requirement Analysis : Conduct in-depth analysis of the client's data infrastructure and business requirements.Designed and Implemented Healthcare Insurance Portability and Privacy Act(HIPAA) and California Consumer Privacy Act 2018 (CCPA)Big Data Strategy and Planning : Develop and implement a Big Data strategy aligned with the client's business goals.Technology Selection and Integration : Evaluate and recommend appropriate Big Data tools and platforms such as Hadoop, Spark, NoSQL databases, and data warehouses.Data Ingestion and Processing : Design and implement data pipelines for collecting, ingesting, and processing large volumes of structured and unstructured data.Data Storage and Management : Set up and manage data storage solutions like HDFS, distributed databases, and data lakes.Data Analysis and Machine Learning : Implement predictive and prescriptive analytics to derive insights from data.Data Security and Compliance

Worked for Global payments US, to configure the secured multi-node in premise cluster using Cloudera Enterprises Distribution. Cluster planning, Service layout designing, infra design, configuration of customized database for Hadoop services. Securing Hadoop cluster configured Active directory Kerberos for authentication, implemented Sentry/Ranger for database authorization, SSL/TLS configuration, configured encryption zones for sensitive data in HDFS.Configuration of centralized Hadoop user management, Hadoop cluster resource management and HDFs storage planning.Fine tuning of cluster, alert configuration and cluster utilization report generation. Maintenance and 24*7 Hadoop cluster support.

Worked on Hadoop POC, installation and configuration of single node hadoop cluster on local machine and fully distributed multi-node cluster on AWS cloud. Creating pipeline to ingest data to HDFS from diverse data sources. Commissioning and decommissioning of nodes,log analysis and diagnostic of hadoop cluster.Setup new Hadoop users, setting up Kerberos principals and validating their access. Troubleshooting installation & configuration issuesMonitor Hadoop cluster job performance and capacity planning, health of the cluster services keeping a track of all the running Hadoop jobs. Hadoop Job monitoring and Cluster health check and generate reports. Monitoring the system performance during peak hours and suggest and recommend upgrading if bottlenecks occurs.