20+ years of IT, 10+ years of big data analytics. Experience in perform end-to-end ETL pipeline from data ingestion, transformation, indexing, catalogue, develop and to ingest hundreds of millions records daily from vast variety data sources using Cloudera Hadoop cluster of +70 server in big data Hadoop ecosystem, Zookeeper, data lake, store and manage large data sets in columnar (NoSQL) Accumulo across cluster, store data in cluster of Elasticsearch of +40 servers.Design schema and sharding the distributed and tolerant powerful text search SolrCloud cluster. Utilize combination of Kafka messaging service, Elasticsearch, Accumulo, complex regex to ingest, clean, transform data for machine learning in data science project. Perform continuous Nginx and S3 streaming log analysis using Splunk search head and forwarder.Perform data transformation of billion records of health care data using Databricks SparkSQL/Scala and graphing capabilities. Experience of using AWS S3, Glue, Athena to build data catalogue and search sustainability data. Setup Google cloud platform data proc cluster to perform data transformation and analytic in Goolge bucket.Experience of cluster of NiFi data flow and Pentaho to build ETL pipeline with Kafka, Elasticsearch, Aws S3, Accumulo. Expertise of data parsing using regular expression regex, data extraction and mapping XML, JSON, binary, base64 encoding/decoding, GPG encryption. Profound experience in full software development cycle, Object Orientation, distributed systems, multiple-tier SOA,JEE, cloud platform, database, and data integration and engineering, data migration, Java development, Scala, Shell Scripting.SkillsAWS Cloud: EC2, S3, Athena, Glue, SNS, Analytics, EMR, RDS Azure datablob/storage, Google Cloud Platform Data Proc, PythonBig Data, Databricks on AWS/Azure, Cloudera Hadoop/YARN, SparkSQL, PySpark, Zookeeper, Accumulo, Hive, Search Engine SolrCloud, ElasticSearch, Splunk, Pentaho, NiFi, Kafka.