Karthik Murugesan Email and Phone Number
I am a skilled Big Data Engineer with over a decade of IT experience, including 4+ years specializing in Big Data technologies. Passionate about transforming data into strategic insights across diverse industries.What Sets Me Apart๐My unique ability to bridge technology and real-world business needs. Combining a robust foundation in Spark SQL, Hive, Hadoop, and more with a strategic mindset to optimize data workflows for maximum efficiency and business impact.Core Competencies & Skills๐ฐ Spark SQL | Serialized Data Handling (Hive, AVRO, Parquet, ORC) | Data Pipeline Management (Sqoop) | Data Lake Architecture (Amazon S3) | Team Management | Agile Methodologies | Effective Communication | Scalable Spark Solutions๐ผ My Services๐ Advanced Data Processing๐ Data Lake Mastery๐ Seamless Data Integration๐ Spark Performance Wizardry๐ Strategic Insights๐ Key ProjectsThroughout my career, I've contributed to significant projects:โ IndusInd Badoop Developer: Leveraged Spark SQL to drive data insights, enhancing business strategies.โ Axis Bank Project: Orchestrated smooth API integration, optimizing critical banking systems.โ Commercial Bank of Dubai (CBD) Project: Designed seamless data workflows, enhancing module functionalities.๐ Contact Me:Ready to unlock the potential of your data? Let's connect! Whether it's data engineering, analytics, or strategic insights, I'm here to help. Reach out to me via LinkedIn or email at:๐ง :siddukn2022@gmail.com for collaborations, discussions, and opportunities in the world of data excellence.
Innoactive
View- Website:
- innoactive.de
- Employees:
- 33
-
Big Data EngineerInnoactive Jan 2023 - Present๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ป๐ฑ๐๐๐๐ป๐ฑ ๐๐ฎ๐ป๐ธAs a part of Innoactive Intelligence, now under the umbrella of Gupshup, I am driving the IndusInd Bank project. In this role, I architect robust data pipelines and structures to ensure efficient data processing and analysis.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพImplementing Spark SQL in production, establishing vigilant performance monitoring and proactive issue resolution systems.โพManaging serialized dataโฆ Show more ๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ป๐ฑ๐๐๐๐ป๐ฑ ๐๐ฎ๐ป๐ธAs a part of Innoactive Intelligence, now under the umbrella of Gupshup, I am driving the IndusInd Bank project. In this role, I architect robust data pipelines and structures to ensure efficient data processing and analysis.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพImplementing Spark SQL in production, establishing vigilant performance monitoring and proactive issue resolution systems.โพManaging serialized data proficiently in Spark, encompassing formats like Avro, Parquet, and ORC for optimized efficiency.โพUtilizing specialized Spark serialization tools and Java serialization techniques to enhance data processing performance.โพNavigating through binary and textual data landscapes adeptly using Spark DataFrames and RDDs.โพApplying advanced Spark methodologies, including data compression and off-heap storage, for optimal performance.โพAdministering AWS EMR Spark clusters to ensure impeccable performance and high availability.โพDesigning and executing data pipelines on Amazon EMR, leveraging the capabilities of Spark, Python, and Scala.โพDevising architectures for data lakes on Amazon S3, striking a balance between performance and cost- effectiveness.โพEnhancing Spark jobs and workflows to achieve scalability and resource efficiency.โพDeveloping intricate Spark applications for complex data transformations.โพTailoring the use of ORC, Parquet, and Avro formats to suit specific use cases.โพBalancing Hive table partitioning strategies to enhance query responsiveness.โพDiagnosing common Hive challenges, fine-tuning queries for optimal performance.โพSculpting Hive performance through meticulous configuration and strategic optimization.โพMitigating Hive bottlenecks to improve overall efficiency.โพLeveraging Hive's capabilities to amplify query performance. Show less -
Hadoop DeveloperInnoactive Jan 2019 - Dec 2022๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ป๐ฑ๐๐๐๐ป๐ฑ ๐๐ฎ๐ป๐ธAs a Hadoop Developer at Innoactive Intelligence, I played a pivotal role in driving the success of the IndusInd Bank project. This role involved architecting robust data pipelines and structures to ensure efficient data processing and analysis, contributing significantly to the project's objectives.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพSpearheaded the implementation of Spark SQL in production, introducing performanceโฆ Show more ๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ป๐ฑ๐๐๐๐ป๐ฑ ๐๐ฎ๐ป๐ธAs a Hadoop Developer at Innoactive Intelligence, I played a pivotal role in driving the success of the IndusInd Bank project. This role involved architecting robust data pipelines and structures to ensure efficient data processing and analysis, contributing significantly to the project's objectives.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพSpearheaded the implementation of Spark SQL in production, introducing performance monitoring and proactive issue resolution systems.โพProficiently processed serialized data in Spark, encompassing formats like Avro, Parquet, ORC, and Protobuf, while considering their distinctive features and limitations.โพLeveraged Spark serialization libraries such as Kryo and Java serialization to optimize data serialization and deserialization performance.โพSkillfully managed binary and textual data formats in Spark, utilizing Spark DataFrames and RDDs for serialization and deserialization.โพExpertly applied Spark serialization and compression techniques, including block-level compression, dictionary encoding, and off-heap storage, reducing data storage and processing overhead.โพAssured high availability and fault tolerance by maintaining and monitoring Spark clusters on AWS EMR.โพDesigned and executed batch processing data pipelines on Amazon EMR, leveraging Apache Spark, Python, and Scala to process terabytes of data cost-effectively and at scale. Show less -
Senior Software EngineerFinoculus Software India Pvt Ltd Jun 2016 - Jan 2019๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ ๐ถ๐ ๐๐ฎ๐ป๐ธDuring my tenure as a Senior Software Engineer at Finoculus India Pvt Ltd, I made significant contributions to the Axis Bank project. My role involved various responsibilities that encompassed the development and maintenance of critical banking systems and ensured seamless integration for enhanced customer experiences.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพOrchestrated the integration of bank system APIs, facilitating seamlessโฆ Show more ๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ ๐ถ๐ ๐๐ฎ๐ป๐ธDuring my tenure as a Senior Software Engineer at Finoculus India Pvt Ltd, I made significant contributions to the Axis Bank project. My role involved various responsibilities that encompassed the development and maintenance of critical banking systems and ensured seamless integration for enhanced customer experiences.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพOrchestrated the integration of bank system APIs, facilitating seamless functionality.โพEngaged in server-side development, enhancements, and project maintenance.โพManaged the release process across various environments โ SIT, UAT, and Production.โพLed branching and tagging in the repository, maintaining version control for releases.โพConducted code reviews, peer assessments, unit testing, and bug resolution. Show less
-
Software EngineerTagit Mar 2013 - May 2016๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ผ๐บ๐บ๐ฒ๐ฟ๐ฐ๐ถ๐ฎ๐น ๐๐ฎ๐ป๐ธ ๐ผ๐ณ ๐๐๐ฏ๐ฎ๐ถ (๐๐๐)As a Software Engineer at Tagit India Pvt Ltd, I played a pivotal role in the development and enhancement of the Commercial Bank of Dubai (CBD) project. My responsibilities spanned across various phases of the project, from integrating bank system APIs to fine-tuning module functionalities.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพIntegrated bank system APIs, ensuring smooth systemโฆ Show more ๐ฃ๐ฟ๐ผ๐ท๐ฒ๐ฐ๐: ๐๐ผ๐บ๐บ๐ฒ๐ฟ๐ฐ๐ถ๐ฎ๐น ๐๐ฎ๐ป๐ธ ๐ผ๐ณ ๐๐๐ฏ๐ฎ๐ถ (๐๐๐)As a Software Engineer at Tagit India Pvt Ltd, I played a pivotal role in the development and enhancement of the Commercial Bank of Dubai (CBD) project. My responsibilities spanned across various phases of the project, from integrating bank system APIs to fine-tuning module functionalities.๐๐๐ฎ ๐๐ค๐ก๐๐จ & ๐๐๐จ๐ฅ๐ค๐ฃ๐จ๐๐๐๐ก๐๐ฉ๐๐๐จ:โพIntegrated bank system APIs, ensuring smooth system interoperability.โพDeveloped and conducted unit testing for modules like Account Summary, Funds Transfer, Bill Payment, Card activation & Deactivation.โพManaged project releases across different environments, including SIT, UAT, and Production.โพOversaw version control through branching and tagging in the repository.โพConducted code reviews, peer evaluations, unit testing, and bug fixing. Show less
Karthik Murugesan Education Details
-
S.A Engineering CollegeComputer Science
Frequently Asked Questions about Karthik Murugesan
What company does Karthik Murugesan work for?
Karthik Murugesan works for Innoactive
What is Karthik Murugesan's role at the current company?
Karthik Murugesan's current role is Experienced Big Data Engineer | A Decade of IT Excellence | Turning Data into Business Gold.
What schools did Karthik Murugesan attend?
Karthik Murugesan attended S.a Engineering College.
Who are Karthik Murugesan's colleagues?
Karthik Murugesan's colleagues are Berkay Yildiz, ์ ํ Moon, Berkay Toku, Hervรฉ Fontaine, Danielle Rivera.
Not the Karthik Murugesan you were looking for?
-
-
Karthik Murugesan
Greater Bengaluru Area -
Karthik Murugesan
Data Engineering Manager | Certified Scrum Master | Certified Snaplogic Enterprise AutomationChennai -
Karthik Murugesan
Product Manager @ Messer India | Product Management | Project Management | User Experience & Research | Competitive Analysis | Product Roadmap | Iso AuditorCoimbatore
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records ร $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial