Nidhi Mishra Email & Phone Number

I am a dedicated and results-driven software engineer with extensive experience in big data, cloud computing, and full-stack development. Over the course of my career, I have developed a strong foundation in designing and implementing scalable solutions that enhance operational efficiency and drive business value.At Accenture, I successfully migrated over 10 TB of on-premise Data Lake to AWS, utilizing S3 for object storage and AWS EMR to improve data accessibility. This migration project significantly streamlined data management processes. I also optimized data warehousing efficiency by 30% by performing partitioning and bucketing on S3 data interfaced with Hive on EMR.In my role, I created and executed Spark jobs with PySpark on EMR, which reduced data processing times from 20 hours to 12 hours. This not only accelerated data workflows but also improved productivity. Additionally, I transformed over 5 ER data models into a Snowflake schema using Dynamic Mapping in Informatica PowerCenter, facilitating efficient data integration and management.My expertise extends to developing ETL pipelines, having built over 5 pipelines that integrate Informatica (IICS) with RabbitMQ, Snowflake, Salesforce SFMC, and Tableau. These pipelines leveraged APIs and Agile methodologies to enable real-time data flow and analytics, providing timely and accurate data insights.I have also implemented Python-based business solutions that reduced inter-team dependencies by 60% and saved over 650 hours. In addition to my professional experience, I have completed several impactful projects. For instance, I developed an automated system for daily stock market data collection from the NSE website using Python, Flask, SQL, and Apache Airflow. This system included robust data quality checks and visualizations to display stock trends over different periods, providing valuable insights into market movements.I also built a real-time data dashboard using Django, integrated with beacons, to enhance airport security. This project demonstrated my ability to develop innovative solutions that address real-world challenges.I possess knowledge of a wide range of technologies including Python, Flask, Django, SQL, Apache Airflow, AWS services, Docker, and various front-end frameworks such as React and Next.js. My skills in cloud platforms, ETL processes, and data visualization tools enable me to deliver comprehensive and efficient solutions.Feel free to reach out to me at nidhimish005@gmail.com to set up an interview. #OpentoWork #DataEngineer #SoftwareEngineer