Mayank Shekhar Roy Email & Phone Number

Dallas, Texas, Us

Dallas, Texas, Us

Data Validation Framework (Aug. 2023 – Present)Established a Validation Framework for cross-verifying data between BigQuery tablesthrough the creation of Airflow DAGs and utilizing Google Cloud Services and implementedtheir scheduled execution at predefined intervals to uphold data integrity.Scope: Python, Apache Airflow, BigQuery, Google Cloud, Google DVT, Data Modeling• Extensively researched on leveraging Google Data Validation Tool and formulateddata models to architect a comprehensive validation framework from the ground up,aimed at achieving efficient and effective data validation results.• Conducted comprehensive analysis of data validation outcomes and implementedSNS services to promptly notify users in the event of discrepancies within theirdatasets.

Riverside, Ca, Us

Project 1 : Network Metadata ETL Pipelines I orchestrated the Network Metadata exports by stabilizing the active pipelines and automating the monitoring and sustainance on legacy on-prem cloud system. Revived the dormant pipelines by defining and developing in Amazon Web Services for the Endpoint product. Technical Scope: Python, S3 Datalake, Spark-Core, Spark-SQL, VerticaDB, Bitbucket, Perl, Bash, VSQL.• Exported Metadata from several Vertica DB tables by utilizing Perl and Bash scripting knowledge to start the influx of data streaming into the pipeline.• Successfully converted the Vertica tables to well-structured parquet files using python scripts and VSQL transformation tools.• Conducted proofs of concept for Fidelis Endpoint leading to migration and implementation of pipelines in Amazon Web Services.Project 2 : Refactored the Malware Classifiers transformers by modifying the existing workflow from semi structured to a proper structured aggregate workflow.. Scope: S3 Datalake, Spark-Core, Spark-SQL, Spark-scala Bitbucket, Perl, Bash, VSQL.,MySQL• Regenerated the parsed results in the classifiers for the long array columns by computing their metrics : min, max, mean, standard deviation. Successfully parsed the nested json columns and extracted the relevant fields to be used in the feature extraction pipeline.• Aggregated the string-array columns with rank-count scala transformers and created the equivalent array of unique strings. Computed the distinct list of features corresponding to the non-distinct list of fields and applied the transformers.

Mclean, Va, Us

Project 1 : Cyber Remediation (Marketing & Analysis) I oversaw cyber remediation activities for marketing and data analysis purposes. As one of my core projects, I was part of a team analyzing 27 TB of data from 1.8 million critical files. Routine tasks involved identifying and minimizing risk by meticulously examining communications sent to clients and evaluating downstream impact.Technical Scope: Python, S3 Datalake, Apache Spark, Spark-Core, Spark-SQL, Snowflake, GithubKey Contributions:• Enabled analysis of large-scale datasets by applying expertise in building robust PySpark frameworks.• Successfully reduced cyber risk by eliminating exposure to 3+ million NPI data (including credit card details, SSN, and ITINs).• Achieved quality results leading to targeted remediation of true positives only.• Ensured security by storing and encrypting audit evidence in AWS S3 buckets.Project 2 : California Consumer Privacy Act ProjectI facilitated communications by generating reports of tables registered on Nebula by building an S3 validation framework to fetch results from data stored in SquadronDB. I also created a database of Json configuration files for tables (Pre-Approval, Rapid, Lead) which could be pushed into the Siphon Framework. In addition, I created AROW jobs for QA and production, thereby streamlining scheduling and monitoring of processes.Technical Scope: Python, S3 Datalake, DBeaver, Github, AROWKey Contributions:• Expedited procedures by setting up an email SNS service on EC2 instance and automating the framework using CronJobs.• Gained in-depth knowledge of GitBash and Git commands by merging scripts to the master branch and raising pull requests.

I evaluated encrypted data and selected the most appropriate cipher. I also implemented ciphers and linear feedback shift registers (LFSR). In addition, I encrypted data and assessed resulting complexity.Key Contributions:• Mastered block and e-stream ciphers (Trivum and Grain).• Acquired thorough understanding of AES and DES encryption standards.

Hyderabad , Telangana, In

I assisted world-class researchers studying computational linguistics in the LTRC Anusaaraka Lab.Technical Scope: CLIPS, Anusaaraka, Corpus, Microsoft ExcelKey Contributions:• Augmented the state-of-the-art Anusaaraka English-Hindi translation tool by developing 64 accepted rules for word sense disambiguation.• Successfully trained the machine to identify and correctly express relevant factors by applying expertise in machine learning algorithms.

Master Of Science - Ms, Computer Science & Engineering

Bachelor'S Degree, Computer Science