Project: Cloud-Based Data Warehouse Using AWS RedshiftObjective: Developed a cloud data warehouse solution for centralized data management and analytics using AWS Redshift. Addressed client's challenge of managing data from various databases by consolidating it on AWS RedshiftRoles and Responsibilities:● Verified data ingestion into the Landing S3 Bucket.● Created and executed AWS Glue jobs to transfer data to the Final S3 Bucket.● Automated the process using AWS Lambda to… Show more Project: Cloud-Based Data Warehouse Using AWS RedshiftObjective: Developed a cloud data warehouse solution for centralized data management and analytics using AWS Redshift. Addressed client's challenge of managing data from various databases by consolidating it on AWS RedshiftRoles and Responsibilities:● Verified data ingestion into the Landing S3 Bucket.● Created and executed AWS Glue jobs to transfer data to the Final S3 Bucket.● Automated the process using AWS Lambda to trigger Glue jobs.● Ensured seamless data transfer and management between S3 buckets.● Created tables in Redshift and copied data from the Final S3 Bucket using the COPY command.● Verified data insertion into Redshift tables.Technologies Used: AWS S3, AWS Glue, AWS Lambda, AWS Redshift. Show less

Project: Healthcare Data Analytics PlatformObjective: Developed a Big Data platform for analysing health and insurance policies addressed the need for large-scale data storage and parallel processing to handle extensive data volumes. Implemented an integrated Hadoop solution for enterprise-level data management.Roles and Responsibilities:● Imported data from relational databases (MySQL, Oracle) into Hive using Sqoop.● Created and optimized Hive tables for better query… Show more Project: Healthcare Data Analytics PlatformObjective: Developed a Big Data platform for analysing health and insurance policies addressed the need for large-scale data storage and parallel processing to handle extensive data volumes. Implemented an integrated Hadoop solution for enterprise-level data management.Roles and Responsibilities:● Imported data from relational databases (MySQL, Oracle) into Hive using Sqoop.● Created and optimized Hive tables for better query performance.● Ingested and processed flat files into Hive Warehouse.● Engaged with Business Analysts to gather and clarify requirements.● Implemented data validation and quality checks.● Developed ETL workflows and data pipelines for end-to-end data integration.● Utilized various file formats (Text, CSV, Avro, ORC) and compression formats (Snappy, bzip2).● Written Hive queries for business data analysis.Technologies Used: Hadoop, Hive, SQOOP, MySQL. Show less

● Assisted in the development and maintenance of SQL databases● Created and optimized SQL queries and reports● Supported data migration and integration tasks.● Gained hands-on experience in database administration and performance tuning.