Anisha Sahoo Email & Phone Number

Bengaluru, Karnataka, India

India

• In my role within the McAfee AI Research group, I've focused on creating a platform to enhance McAfee's cybersecurity threat analysis capabilities.• With over 4 years of experience in Big Data Engineering, I've constructed a Data Lake (Delta Lake) on AWS S3, establishing 25+ standalone, scalable Big Data ETL pipelines using PySpark and Python in Databricks, handling approximately 1 TB of data daily.• I've also developed streaming raw data ingestion and transformed data pipelines, managed data reconciliations, and set up Hive tables for downstream systems.• Additionally, I've collaborated with various teams, including product managers and data scientists, to create live dashboards for critical business decisions, orchestrated data pipelines, and conducted code reviews and mentorship for junior team members.• My work also includes implementing PoCs on MSK Connect for cost-effective data streaming and optimizing long-running pipelines.• Throughout these tasks, I've adhered to agile methodologies to ensure the development and productionization of data and AI-powered threat analysis systems.

Pune, Maharashtra, India

• Working as part of Next Gen Consumer Banking, Barclays UK as client on developing Data Lake in AWS S3 and building 15+ Standalone Scalable Big Data ETL pipelines.• Worked on implementing checksum feature for the data and control files of outbound files.• Worked on nested, top-level column addition and pre-combine Key updates on top of existing schema and table. • Implemented various credit card features for Barclaycard like historical Aggregates (ATD, LTD, YTD) for customers, skip payment counters based on Payment Due Date.• Understanding Business needs and Requirements, following agile methodology and developing solutions for the product areas.

Pune, Maharashtra, India

• Having 3 years of relevant experience in handling Streaming Data from Kinesis Stream in AWS Glue Spark Streaming Job using Apache Hudi as the framework and building Data Lake in AWS S3.• Loading data from No-SQL database (AWS DynamoDB), post transformation storing it in S3 data lake in parquet format.• Worked on data reconciliation where data quality check is performed for source data with transformed data stored in the data lake. • Created outbound files (Data and Control Files) for downstream using S3 Data Lake as the source. • Worked on outbound file archive and migration from Cloud (AWS S3) using AWS Data Sync service to a On-premise server for usage by downstream.• Have worked on the decoupling complex schema structure which helps streaming data from a Non-SQL Data Base(DynamoDB) to get structured and ready to be deliverable to the downstream.• Have implemented and managed complex read-on schema and write-on schema versions which supports continuous changes in table structure.• Designed orchestration for ETL Pipeline workflow using AWS Step Function which is triggered automatically by AWS CloudWatch triggers. • Implemented AWS CloudFormation templates for automatically deploying various resources in all environments. • Developed CloudWatch alarms and alerts for any failures in jobs and step functions which helps in finding RCA for the issues faster in production.• Implemented various optimization techniques for better performance of pipeline, possesses good de-bugging skills, performed code reviews, and executes various POCs within the team.

Bhubaneshwar Area, India

This project was in collab with IIT Kharagpur.Have worked on how Decentralized Authentication System can be more secured than OAuth 2.0.

Kharagpur Area, India

Paid Summer internship at IIT Kharagpur during 2018-19 for 50 days. WORKED ON A PROJECT: Quality of Service Support (QoS) for Software Defined Data Centers using SDN. -Have worked in a Hyper-converged architecture which has 3 architectural components a) Virtualized Central Processing Unit (VCPU) to support computation virtualization b) Software Defined Networking (SDN) to support network virtualization c) Software Defined Storage (SDS) to support storage virtualization -Have converted the manual functioning, working and management of virtual machines into fully automated system via python coding. -Have implemented an algorithm where the Bandwidth of various Network and Disk Loads that runs inside various Virtual Machines are automatically adjusted depending on Network Congestion. -In short, worked on improving the ways of handling network trafficking. -Data sets have been derived with algorithm and without algorithm and data analysis have been done.

Pune Area, India

Summer School on Information Security and Forensics: ACM India, Pune

Bachelor Of Technology, Computer Science

Intermediate, Library And Information Science

Matriculation