Rajendra Prasad Email & Phone Number

Newark, De, Us

Topeka, Kansas, United States

I have a robust background in designing and managing data storage solutions on Azure, including Azure Data Lake Storage and Blob Storage. My experience extends to deploying and optimizing SQL databases, managing NoSQL databases using Cosmos DB, and integrating Informatica Data Quality processes to maintain high data standards. I've implemented scalable data processing solutions with Azure Data Factory and Azure Databricks, developing efficient ETL pipelines for seamless data extraction… Show more I have a robust background in designing and managing data storage solutions on Azure, including Azure Data Lake Storage and Blob Storage. My experience extends to deploying and optimizing SQL databases, managing NoSQL databases using Cosmos DB, and integrating Informatica Data Quality processes to maintain high data standards. I've implemented scalable data processing solutions with Azure Data Factory and Azure Databricks, developing efficient ETL pipelines for seamless data extraction, transformation, and loading.In addition to my Azure expertise, I've developed and maintained ETL processes using Snowflake, adhering to best practices for data extraction and transformation with Python scripting. I've integrated data from various sources, including databases, APIs, and flat files, ensuring data accuracy through data cleansing, normalization, and validation. My experience with big data processing solutions includes using Hadoop ecosystem tools like HDFS, MapReduce, and Hive, and managing Hadoop clusters for optimal performance. I have also effectively used DBeaver and created PySpark scripts to load data across different systems.My skills in data warehousing extend to designing and implementing solutions on Snowflake, and I have experience with Tableau and Power BI for creating and optimizing dashboards. I've utilized SQL for data retrieval and analysis, generating reports to support business decisions. Additionally, I have evaluated and selected NoSQL databases such as MongoDB and Cassandra based on project requirements. Throughout my career, I've worked closely with business clients and QA teams, used Jira and Confluence for project management, and maintained job status updates and collaboration through tools like GitHub, DBeaver, and Teradata SQL. Show less

Charlotte, North Carolina, United States

I have extensive experience in designing and implementing robust data engineering and security frameworks using a variety of AWS services and big data technologies. Notably, I developed a fine-grained access control system for AWS S3 using AWS Lambda and DynamoDB, ensuring secure and efficient data access. My expertise extends to end-to-end architecture assessments of AWS services such as Amazon EMR, Redshift, and S3, enabling optimized cloud solutions for large-scale data processing… Show more I have extensive experience in designing and implementing robust data engineering and security frameworks using a variety of AWS services and big data technologies. Notably, I developed a fine-grained access control system for AWS S3 using AWS Lambda and DynamoDB, ensuring secure and efficient data access. My expertise extends to end-to-end architecture assessments of AWS services such as Amazon EMR, Redshift, and S3, enabling optimized cloud solutions for large-scale data processing. Additionally, I have a strong background in API development with AWS Lambda, creating multi-tier Java-based web services for seamless data integration with MongoDB. My proficiency in ETL processes is demonstrated by my work with AWS Glue, where I conducted data extraction, aggregation, and consolidation using PySpark, and implemented a high-availability ETL framework for Hadoop and Cassandra.Moreover, I have implemented advanced error handling and performance tuning in Informatica workflows, significantly improving efficiency and reliability. My skills in big data technologies are further highlighted by my experience with Spark, Kafka, Hadoop, and related frameworks, where I optimized data ingestion, processing, and streaming operations. I also have substantial experience in utilizing Python for database interactions, automation of workflows, and data validation, which has greatly enhanced the efficiency and accuracy of data engineering tasks. Furthermore, I have developed and optimized Snowflake data processes, managed Kafka clusters, and created insightful data visualizations using Power BI and Tableau, driving data-driven decision-making within organizations. My commitment to best practices in version control with GitHub ensures collaborative and transparent development processes. Show less

I have developed a strong foundation in data engineering and cloud infrastructure, particularly within Azure environments. I set up and maintained real-time data streaming pipelines using Azure Stream Analytics, ensuring efficient and reliable data processing. My collaboration with DevOps teams focused on integrating data engineering processes into the overall Azure infrastructure, adhering to Azure DevOps practices for seamless operations. Additionally, I implemented CI/CD pipelines using… Show more I have developed a strong foundation in data engineering and cloud infrastructure, particularly within Azure environments. I set up and maintained real-time data streaming pipelines using Azure Stream Analytics, ensuring efficient and reliable data processing. My collaboration with DevOps teams focused on integrating data engineering processes into the overall Azure infrastructure, adhering to Azure DevOps practices for seamless operations. Additionally, I implemented CI/CD pipelines using Jenkins and Airflow for Docker and Kubernetes containers, successfully migrating ETL pipelines from SQL Server to a Hadoop environment. My expertise extends to creating and managing workflow processes in Informatica to automate data integration tasks, along with developing complex SQL queries and PL/SQL procedures, which were converted into ETL tasks for streamlined data handling.I have extensive experience with big data technologies and tools, including integrating Kafka with Hadoop for continuous data streaming and processing. My work involved developing Scala workflows for cloud-based data extraction and transformation, as well as running Spark and Spark SQL operations. In Python, I utilized libraries such as Pandas and NumPy to manipulate large datasets, addressing scalability challenges effectively. Furthermore, I optimized Tableau dashboards and Power BI reports for better performance, employed advanced SQL methods for data migration from Teradata/SQL Server to Hadoop, and managed Snowflake usage to address performance bottlenecks. My commitment to quality is reflected in my practice of writing unit tests and deploying production-level code through Git, ensuring robust and reliable data solutions. Show less

New Delhi, Delhi, India

I have extensively developed and maintained robust data storage solutions on AWS platforms, particularly Amazon RDS and Redshift. My focus was on optimizing database performance and ensuring efficient data retrieval for large datasets. I designed and implemented efficient ETL processes using SQL and tools like Informatica PowerCenter, and built ETL pipelines with Sqoop for automating data ingestion from various RDBMS including Oracle and SQL Server. My expertise also includes utilizing SQL in… Show more I have extensively developed and maintained robust data storage solutions on AWS platforms, particularly Amazon RDS and Redshift. My focus was on optimizing database performance and ensuring efficient data retrieval for large datasets. I designed and implemented efficient ETL processes using SQL and tools like Informatica PowerCenter, and built ETL pipelines with Sqoop for automating data ingestion from various RDBMS including Oracle and SQL Server. My expertise also includes utilizing SQL in combination with Spark SQL for preprocessing, cleaning, and joining large datasets, which significantly enhanced data quality and accessibility.Additionally, I have automated reconciliation processes between multiple systems using SQL, Python, and Shell scripting to validate data flow and integrity. I have a strong background in designing and implementing complex SQL queries for ETL processes, creating and managing database objects such as tables, views, stored procedures, triggers, and functions to maintain efficient data structures. My experience extends to optimizing SQL queries for NoSQL databases, incorporating sharding, replication, and scalability features. I have also developed insightful SQL-based reports for business intelligence, optimizing data models to support comprehensive data analysis and reporting needs. Show less