Prasanna R Email and Phone Number

I have extensive experience in cloud integration, particularly with Azure Stack, seamlessly connecting it with various Azure services like Azure Active Directory, Azure Kubernetes Service (AKS), and Azure Functions. This proficiency enables hybrid cloud scenarios and extends capabilities for diverse projects. Additionally, I specialize in designing and deploying Azure SQL databases, ensuring the selection of appropriate service tiers, configurations, and deployment models tailored to specific project requirements.My expertise extends to data integration and management, demonstrated by configuring and upgrading the On-Premises Data Gateway between different data sources, such as SQL Server, Azure Analysis Services, and Power BI service. I excel in integrating Informatica Power Center with external systems and databases using APIs and custom connectors, fostering seamless data exchange and integration. Moreover, I've developed and maintained metadata repositories within Informatica Power Center to facilitate efficient data lineage tracking and impact analysis.

I specialize in architecting and implementing robust data pipelines on AWS, seamlessly integrating Lambda with services like S3, DynamoDB, and Kinesis for efficient data ingestion and processing. Additionally, I've leveraged AWS RDS to serve as a reliable Hive Metastore, ensuring data integrity even in the event of EMR termination. My expertise extends to scripting automation for ingestion across diverse sources like API, AWS S3, Teradata, and Redshift using Scala, while ensuring data quality through complex transformations in Informatica.With a strong foundation in SQL databases, Python libraries, and Apache Airflow, I orchestrate intricate data workflows, optimizing ETL processes for accuracy and efficiency. My proficiency in Hadoop ecosystem components like Hive, Pig, and Kafka enables seamless integration and extraction of insights from structured and semi-structured data. I further enhance data processing capabilities through Spark applications, custom serialization logic, and Spark streaming for real-time data handling, storage, and analysis.In addition to my technical prowess, I excel in visualization and reporting tools like Tableau and Power BI, crafting intuitive dashboards and standardized reports to empower stakeholders with actionable insights. With expertise in containerization using Docker and Kubernetes, I ensure scalability, resource management, and system stability for microservices-based applications, driving efficiency and innovation across the organization.

In my recent roles, I've honed my skills in leveraging a variety of Azure serverless technologies, including Azure Data Factory and Azure Functions, alongside Informatica, to architect scalable and cost-efficient ETL pipelines. Additionally, I've delved into Java-based Map Reduce programs for seamless integration with Azure HDInsight, facilitating distributed data processing solutions for large-scale analytics. Moreover, my proficiency extends to developing Scala-based ETL pipelines within the Azure data ecosystem, automating data extraction, transformation, and loading processes while preparing for migrations to Azure Synapse.Furthermore, my expertise spans across a spectrum of data engineering tasks, encompassing SQL Script Stored Procedures, PowerShell scripting for data extraction, Spark Applications development using Scala and Python, and implementation of Apache Spark data processing projects. I've successfully incorporated Kafka's distributed messaging principles and Spark Streaming into ETL workflows, facilitating real-time data ingestion and processing. Additionally, my experience extends to utilizing Pig for ETL transformations, Map Reduce, Hive, and PIG for scalable data analysis, and development of Spark jobs on Databricks for data cleansing, validation, and standardization tasks.Moreover, I possess adeptness in data visualization tools, having created interactive Tableau dashboards with drill-down capabilities and optimized their performance for fast and responsive visualizations, even with large datasets. Furthermore, I've utilized Power BI's Q&A feature for natural language querying and developed custom Power BI visuals and extensions using Power BI Developer Tools and JavaScript SDK. Lastly, I've streamlined development and deployment processes using Docker Compose for orchestrating multi-container Python applications.

In my role, I've focused on ingesting data while ensuring thorough cleansing and transformation processes, leveraging AWS Lambda, AWS Glue, and Step Functions. Additionally, I've spearheaded the code migration of a quality monitoring tool from AWS EC2 to AWS Lambda, crafting logical datasets to administer quality monitoring on Snowflake warehouses. My experience extends to creating Python topology scripts for generating cloud formation templates to establish AWS EMR clusters, showcasing my proficiency in orchestrating complex cloud infrastructure.Furthermore, I specialize in building intricate ETL processes using Python libraries like Pandas, NumPy, and Scikit-Learn, ensuring efficient data movement and transformation. I've also worked extensively with SQL and PL/SQL procedures, optimizing queries for complex data manipulations, extractions, and aggregations to ensure high performance and responsiveness. Moreover, I've integrated Kafka with Spark Streaming for real-time data processing and developed Scala scripts to enhance the performance and scalability of data pipelines.Moreover, I'm adept at monitoring web services using Hadoop and Spark to control applications and analyze their operation and performance. I utilize Hive for data analysis, leveraging its integration with HBase to compute various metrics for reporting on dashboards. Additionally, I'm proficient in integrating Scala with technologies like Hadoop and Kafka, enabling seamless data ingestion and processing across diverse platforms. Finally, I've designed and developed end-to-end data pipelines within distributed environments, utilizing big data tools like the Spark framework and Tableau for data visualization and analytical reporting.