Jagadeesh N

Jagadeesh N Email and Phone Number

Actively Looking for New Opportunities in AWS & Data Engineering roles | Sr. Data Engineer| Analytics | ML Engineer | Python | Bigdata | Hadoop | Azure | AWS | Kafka | ETL | Talend | SQL | Snowflake | Data bricks | BI @ Mayo Clinic
rochester, minnesota, united states
Jagadeesh N's Location
United States, United States
About Jagadeesh N

Experienced Senior Data Engineer with a profound expertise in crafting, executing, and refining data pipelines over an extensive span of 10 years. Specializing in the integration of open-source technologies within the AWS ecosystem, adeptly utilizing Apache Spark, Hive, Hadoop, Python, and PySpark for intricate data processing and analytical tasks.Demonstrating a nuanced mastery in architecting Spark applications leveraging PySpark Data Frame, RDD, and Spark SQL on AWS EMR (Elastic MapReduce), optimizing for superior performance and scalability. Proficiently navigating a broad spectrum of AWS services including S3 (Simple Storage Service), EC2 (Elastic Compute Cloud), EMR, Glue, Lambda, CloudFormation, CloudWatch, CloudTrail, and Redshift, orchestrating seamless data processing and analytics workflows.Specialized in real-time data replication strategies employing AWS Kinesis, facilitating instantaneous transfer of data to AWS S3, Redshift, or other destinations, ensuring prompt insights and decision-making. Showcasing exemplary prowess in AWS IAM (Identity and Access Management) for crafting and implementing meticulous S3 bucket policies to fortify data security and access controls.Proficient in AWS Glue for streamlined data cataloging and management, fostering optimized data organization, transformation, and retrieval, paving the way for enhanced analytics capabilities. Equally proficient in AWS Athena for executing SQL-like queries directly on data stored in Amazon S3, empowering agile data analysis and insights generation, thereby circumventing the need for intricate ETL processes.Extensively engaged with a diverse array of AWS big data products, including AWS Glue, AWS EMR, AWS Athena, AWS Redshift, AWS QuickSight, AWS Lambda, and AWS Step Functions, facilitating end-to-end data processing and analytics solutions, Adept in programming languages such as Python, Scala, Java, and SQL within the AWS platform, harnessing the flexibility of SDKs and APIs for seamless integration with AWS services.Pioneering the design, execution, and optimization of multifaceted data pipelines across a myriad of use cases, driving substantial enhancements in data processing efficiency, scalability, and cost-effectiveness on the AWS cloud platform. Instrumental in spearheading the implementation of real-time data replication solutions utilizing AWS Kinesis, thereby facilitating the prompt availability of mission-critical data for analysis, machine learning model training, and decisive decision-making.

Jagadeesh N's Current Company Details
Mayo Clinic

Mayo Clinic

View
Actively Looking for New Opportunities in AWS & Data Engineering roles | Sr. Data Engineer| Analytics | ML Engineer | Python | Bigdata | Hadoop | Azure | AWS | Kafka | ETL | Talend | SQL | Snowflake | Data bricks | BI
rochester, minnesota, united states
Website:
mayoclinic.org
Employees:
33134
Jagadeesh N Work Experience Details
  • Lorris Services Llc
    President
    Lorris Services Llc Oct 2023 - Present
    Texas, United States
  • Mayo Clinic
    Sr. Data Engineer
    Mayo Clinic Apr 2021 - Present
    Kansas City Metropolitan Area
    As a seasoned Data Engineer specializing in healthcare data management and analytics, expertise lies in architecting and implementing intricate AWS cloud solutions tailored specifically for the unique challenges of managing Electronic Health Records (EHR) and HL7 messages. Over 8 years of dedicated experience, a comprehensive understanding of the complexities involved in processing and analyzing healthcare data, leveraging the full capabilities of AWS services to drive transformative advancements within the industry.A cornerstone of the technical approach involves the implementation of real-time data streaming architectures using Amazon Kinesis. By architecting robust data ingestion pipelines and employing advanced data processing techniques, ensures the timely and accurate processing of HL7 messages from diverse sources. This enables healthcare organizations to derive actionable insights in real-time, facilitating prompt interventions and informed decision-making in patient care.In parallel, spearheaded the integration of machine learning models using AWS SageMaker to analyze EHR data. Leveraging sophisticated algorithms and scalable infrastructure, these models enable predictive analytics and personalized medicine applications, empowering healthcare professionals with data-driven insights to enhance clinical outcomes and optimize patient care pathways.Ensuring the utmost compliance and security of healthcare data is a paramount consideration in the technical approach. Meticulously implement AWS Identity and Access Management (IAM) policies and Key Management Service (KMS) encryption to enforce granular access controls and data encryption, safeguarding sensitive patient information against unauthorized access. Continuous monitoring and optimization of AWS infrastructure performance and cost-effectiveness through advanced monitoring tools such as CloudWatch and CloudTrail further reinforce data security measures while optimizing operational efficiency.
    View
  • The Depository Trust & Clearing Corporation (Dtcc)
    Data Engineer
    The Depository Trust & Clearing Corporation (Dtcc) Oct 2019 - Mar 2021
    Coppell, Texas, United States
    As a Data Engineer, spearheaded the development and deployment of a sophisticated platform at DTCC's Coppell facility, specifically engineered for real-time processing and analysis of financial data. Employing a microservices architecture, a diverse range of AWS services were meticulously integrated, including Amazon Kinesis for high-throughput data ingestion, Amazon EMR for distributed data processing utilizing Apache Spark, and Amazon S3 for scalable data storage.Core responsibilities encompassed the intricate implementation of data pipelines seamlessly integrating specialized algorithms tailored for complex event processing, machine learning models, and advanced data mining techniques, all meticulously crafted to optimize financial data analysis. Noteworthy achievements include architecting and optimizing the ETL framework, AWS Glue for automated ETL processes.Ensuring robust data security and compliance measures was paramount, leading to the seamless integration of the ETL framework with DTCC's DLP and data tokenization services. The igration of complex datasets from legacy on-premises storage systems to cloud-based solutions such as Amazon S3 and Amazon Redshift, was executed with meticulous attention to detail to ensure data consistency and integrity throughout the transition process within the LORIS workstream.Uilization of AWS Lambda functions to orchestrate data migration from Amazon Redshift to downstream applications, alongside the use of PySpark scripts for intricate data transformation and manipulation, was pivotal. Playing a central role in implementing and managing ETL solutions using AWS Glue.This involved developing and maintaining AWS Glue and AWS Data pipelines, integrated with AWS CloudWatch and AWS X-Ray for c monitoring and performance optimization, resulting in actionable insights driving informed decision-making.
    View
  • Travelport
    Data Engineer
    Travelport Jan 2017 - Oct 2019
    Englewood, Colorado, United States
    As a Data Engineer, pivotal contributions were made in migrating and modernizing Travelport's travel data platform to the Azure cloud. The focus remained on architecting scalable infrastructure and implementing robust data governance measures. The endeavor encompassed the migration of intricate data pipelines, ETL processes, and analytical workloads to Azure services such as Azure Data Factory, Databricks, and Synapse Analytics. To ensure compliance with GDPR and PCI-DSS regulations, stringent data governance and security measures were meticulously implemented, with Azure Monitor and Log Analytics serving as key monitoring and surveillance tools.Technical advisory services were provided to stakeholders, offering design recommendations, resolving technical issues, and devising solutions for Big Data analytics. A significant aspect of the role involved spearheading collaborative efforts to design and implement a comprehensive ETL solution for managing diverse travel data types. Advanced ETL techniques, including SQL and SnowSQL, were utilized to efficiently extract, transform, and load vast volumes of structured and semi-structured travel data, crucial for Travelport's operational and strategic decision-making.The development and deployment of a scalable and secure Azure data platform were meticulously planned and executed, incorporating robust ETL processes using Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics. This empowered Travelport to effectively utilize its data assets, driving enhanced business outcomes and sustaining competitiveness in the travel industry. From a technical standpoint, engineering and optimization of SQL-based ETL pipelines were executed utilizing SnowSQL, Azure Data Factory, and other pertinent technologies, ensuring seamless integration of approximately 150 billion raw records from multiple sources. Furthermore, the architecture and implementation of medium to large-scale Business Intelligence (BI) solutions on Azure.
    View
  • Micron Technology
    Power Bi/Sql Developer
    Micron Technology Sep 2014 - Dec 2016
    Boise, Idaho, United States
    As a seasoned data professional, my expertise spans end-to-end ETL development and Business Intelligence (BI) solutions. Proficiency in crafting efficient ETL frameworks is showcased, with a robust system in SSIS specifically designed and implemented for processing and monitoring flat file imports, ensuring reliable data management for key clients.In the realm of BI, skilled architecture is evident, adept at designing, building, and deploying impactful solutions using Power BI to enhance data visualization and deliver valuable business insights. Additionally, a strong foundation in version control is demonstrated through leading branching, merging, tagging, and release activities using GIT, streamlining development processes.Automation capabilities are a cornerstone of my skill set, exemplified in the creation of scripts for an in-house metadata explorer project. Through the utilization of Shell Script and SQL, processes are automated, and multiple Metadata resources are loaded from the data warehouse, improving efficiency and accuracy in data management.Furthermore, proficiency in scripting languages like Shell and Python is displayed, with Python scripts developed for seamless data transfer from MongoDB to SQL Database. Additionally, a keen understanding of database optimization is showcased, with various indexing strategies and aggregate techniques implemented to enhance performance. Expertise extends to the management of Analysis Services objects, where strategic configurations are made for optimal functionality. Overall, this multifaceted skill set ensures a holistic approach to data management and analytics, covering ETL, BI, scripting, and database optimization.
    View

Jagadeesh N Education Details

Frequently Asked Questions about Jagadeesh N

What company does Jagadeesh N work for?

Jagadeesh N works for Mayo Clinic

What is Jagadeesh N's role at the current company?

Jagadeesh N's current role is Actively Looking for New Opportunities in AWS & Data Engineering roles | Sr. Data Engineer| Analytics | ML Engineer | Python | Bigdata | Hadoop | Azure | AWS | Kafka | ETL | Talend | SQL | Snowflake | Data bricks | BI.

What schools did Jagadeesh N attend?

Jagadeesh N attended Jntuh College Of Engineering Hyderabad.

Who are Jagadeesh N's colleagues?

Jagadeesh N's colleagues are Even Wells, Charles Ritmire, Robin Cherry, Henrique Borges Da Silva, Angela Majerus, Robert Davis, Larissa Cook.

Not the Jagadeesh N you were looking for?

View similar profiles

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.