Divya . Email & Phone Number

•Sr. Data Engineer with over 7 years of experience in all phases of the software development life cycle (SDLC). Proficient in the BIG DATA ECOSYSTEM, including Hadoop and related technologies such as HDFS, HBASE, MapReduce, HIVE, PIG, FLUME, OOZIE, SQOOP, and ZOOKEEPER, with a focus on building highly scalable data analytics applications. Expertise in Hadoop cluster administration, utilizing Apache, Cloudera, and Amazon Web Services (AWS).•Experienced in AWS services like EC2, S3, ELB, RDS, SQS, EBS, VPC, AMI, SNS, Cloud Watch, Cloud Trail, Cloud Formation, Autoscaling, Cloud Front, IAM, and R53. Skilled in working with a variety of data formats, including CSV, Text, Sequential, Avro, parquet, orc, and Json.•Extensive experience designing and implementing data migration and transformation strategies using a range of Azure services including Azure SQL Database, Azure Data Lake (ADLS), Azure Data Factory (ADF) V2, Azure SQL Data Warehouse, Azure Key Vault, Azure Data Flows, Azure Databricks, Azure Synapse, Azure Blob Storage, and more.•Experienced in migrating on-premises ETL to GCP using cloud native tools like Cloud Data Proc, Big Query, Google Cloud Storage, and Composer. Proficient in using Hadoop ecosystem and data processing tools like Tableau, Quick Sight, and Power BI.•Experience using Python libraries and tools such as Pandas, NumPy, Scikit-learn, and Matplotlib to perform data analysis and visualization, as well as building machine learning models.•In-depth knowledge of Sqoop and YARN, as well as experience with NoSQL databases like MongoDB, Cassandra, and HBase. Proficient in data modeling and database performance tuning, with experience in creating MapReduce applications using Apache Hadoop. Skilled in using Talend Big Data Studio 6.0, AWS Redshift, and Azure data platforms.•Well-versed in developing web UI applications using HTML, CSS, Bootstrap, JavaScript, Ajax, Spring MVC, Spring Boot, jQuery, Angular.js, and React.js. Knowledgeable in container systems like Docker and container orchestration like EC2 Container Service and Kubernetes and experienced in building end-to-end CI/CD pipelines in Jenkins.•Adept in project management techniques, including Waterfall, Spiral, and Agile/SCRUM, with a thorough understanding of Scrum, Continuous Integration, and Test-driven Development methods. Skilled in Python development, with experience in the Flask framework and Fast API.

• 

  University Of Central Missouri

  Computer Science