I am a Big Data Engineer for more than 11 years now. I specialize in Big data & Azure Cloud to develop Data pipelines and build data products. Currently work for a client based in US developing pipelines to bring their data into Azure Data lake in agile model.My specialty include Spark, python & Azure Databricks.
Tiger Analytics
View- Website:
- tigeranalytics.com
- Employees:
- 6018
-
Senior Data EngineerTiger AnalyticsSurrey, Bc, Ca -
Technology LeadInfosys Jan 2021 - PresentBurnaby, British Columbia, Canada -
Technology AnalystInfosys Aug 2020 - Dec 2020Burnaby, British Columbia, Canada -
Technology AnalystInfosys Aug 2018 - Jul 2020Trivandrum, Kerala, India -
Senior Systems EngineerInfosys Mar 2015 - Jul 2020Thiruvananthapuram Taluk, Kerala, India1) Was involved in implementing hive models for a client who was a leading pharmaceutical company in US. 2) Was involved in development of Azure data lake project for a leading coffee chain corporation. Their data was to be brought into Azure data lake.a) Developed data lake management tool for Azure data lake. The data will be either purged or archived into the blob storage based on the retention policy of the data. The tool was executed using the airflow via DAG.b) Developed python scripts for starting the HDI cluster in Microsoft Azure from backend. The HDI cluster was required the validations based on Drools using spark and Scala which was ran in HDI cluster. Once the validations were executed, the script terminate the HDI cluster. These scripts were also executed using the Airflow scheduler.3) Was involved in R&D of Redis frame work for integrating into a Realtime data framework tool developed by Infosys. 4) Developed a model pipeline for sentiment analysis of twitter data. The pipeline was build using spark(pyspark) and kafka framework.a) The producer part will read the data from twitter for a specific handle. The format is json. The required fields will be filtered and published to kafka topic.b) The consumer part will read data from kafka streams to spark streaming framework and convert data frame. c) The sentiment analysis is done on the tweet text of the twitter data. The sentiment analyzed data is normalized further and stored in a Cassandra Db.d) The twitter sentiment analysis, along with other matrix such as tweet count per minute, etc. can be viewed using a visualization tool such as Kibana/Grafana. 5) Worked for Azure Stack for near real time data analysisa) Invloved in developing pipeline to consume data streams from kafka and process it in spark framework.b) Combined it with different Azure stack such as Azure Cosmos db, Azure SQL DW & Azure Analysis Services to visualize the data in Power BI. -
Senior System EngineerInfosys May 2013 - Feb 2015Bengaluru, Karnataka, IndiaProduction Support Engineer in Oracle Apps E-Business Suite for Procurement Module.
Sandeep R Kamath Education Details
-
Electrical, Electronics And Communications Engineering -
Model Technical Higher Secondary School, KaloorElectronics + Computer(Technical) -
Tirumala Devasom High School, MattancherrySslc
Frequently Asked Questions about Sandeep R Kamath
What company does Sandeep R Kamath work for?
Sandeep R Kamath works for Tiger Analytics
What is Sandeep R Kamath's role at the current company?
Sandeep R Kamath's current role is Senior Data Engineer.
What schools did Sandeep R Kamath attend?
Sandeep R Kamath attended Cochin University Of Science And Technology, Model Technical Higher Secondary School, Kaloor, Tirumala Devasom High School, Mattancherry.
Who are Sandeep R Kamath's colleagues?
Sandeep R Kamath's colleagues are Chandra Mukherjee, Abhishek Singh Pushkar, Dinesh Patnaik(We Are Hiring), Saran Gunasekaran, Sushmitha Ramesh, Sandeep Kumar Kairamkonda, Md Mubasir.
Free Chrome Extension
Find emails, phones & company data instantly
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial