Niharika N Email & Phone Number

Charlotte, North Carolina, United States

I have been integral in developing and optimizing data pipelines and infrastructure to support the company's data-driven decision-making processes. Developed and maintained robust data pipelines to ingest, transform, and load large volumes of transactional data from diverse sources into the data lake and data warehouse, ensuring data integrity, accuracy, and timeliness. Designed and implemented ETL processes using Apache Spark, Python, and SQL to process and cleanse raw data, enabling downstream analytics and reporting activities. Mastered complex data queries with precision, leveraging SQL as a powerful tool for data manipulation and analysis. Utilized Python for agile and efficient data transformation and processing, enhancing data workflow effectiveness. Tackled colossal datasets using Apache Spark, harnessing its distributed computing power to overcome big data challenges. Established scalable, reliable, and high-performance data storage solutions within Amazon Redshift and Google BigQuery, supporting critical data storage and analysis needs. Employed Apache Airflow to orchestrate intricate data workflows, automating complex tasks with precision and reliability. Created compelling visualizations using Tableau and Power BI, providing stakeholders with actionable insights and guiding data-driven decision-making. Navigated containerization with Docker and Kubernetes, ensuring scalable and resilient data infrastructure deployment. Utilized Git for robust version control, ensuring code integrity and traceability in data pipeline and infrastructure management. Collaborated with data scientists, analysts, and software engineers to understand data requirements, design scalable solutions, and support business objectives. Conducted in-depth data analysis and troubleshooting to identify root causes of data issues, proactively addressing anomalies and discrepancies.

Hyderabad, Telangana, India

I played a pivotal role in designing and optimizing data infrastructure to support the company's analytical and business needs. Designed, implemented, and optimized ETL processes to ensure accurate and efficient data extraction, transformation, and loading from various sources into the data warehouse. Created and maintained scalable data models and schemas using dimensional modeling techniques to support analytical requirements. Leveraged Apache Spark and Hadoop to process and analyze large datasets, enhancing data processing performance and scalability. Deployed and managed data solutions on AWS, including services like S3, Redshift, and EMR, ensuring efficient data storage and processing. Implemented real-time data integration and streaming solutions using Apache Kafka, ensuring timely and accurate data availability for business applications. Established data quality checks and governance practices to comply with industry standards and regulatory requirements. Worked closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver tailored data solutions. Conducted performance tuning and optimization of data queries and ETL processes to enhance retrieval speeds and reduce processing times. Automated data workflows using Apache Airflow and implemented monitoring solutions to ensure the reliability and performance of data pipelines. Documented data engineering processes, data models, and pipeline architectures, providing training and support to team members and stakeholders. Engineered and maintained a data lake architecture using AWS S3, enabling efficient storage and retrieval of large volumes of structured and unstructured data. Integrated data pipelines with BI tools like Tableau, Power BI, and Looker to provide real-time data access and support interactive reporting and visualization.

Hyderabad, Telangana, India

I honed my skills in designing, developing, and maintaining robust and scalable web and mobile applications. Designed and developed applications using Java, Python, and JavaScript, ensuring high performance and scalability. Managed relational databases, optimized database design, and wrote complex SQL queries to support various application functionalities. Developed RESTful APIs to enhance communication between front-end and back-end systems, boosting application performance and interoperability. Conducted thorough testing and debugging using unit tests, integration tests, and automated testing frameworks to ensure high-quality code. Actively participated in Agile development processes, including sprint planning, daily stand-ups, and retrospectives, to deliver incremental updates and improvements. Utilized Git for version control to manage code repositories, track changes, and collaborate effectively with other developers. Integrated third-party services and APIs into applications to expand functionality and capabilities. Conducted code reviews to ensure adherence to best practices and provided mentorship to junior developers. Worked closely with clients and stakeholders to gather requirements, provide progress updates, and deliver solutions that met business needs. Continuously sought opportunities to improve software development processes, tools, and techniques, contributing to overall team efficiency.