Shashank Gupta Email & Phone Number

Idaho, United States

• Leading a team of 7 to develop and test python automations using PySpark, to carry out validation automation.
• Worked on identifying root cause and solving the issue collaborating with cross-functional teams.
• Worked on building user stories and gathering requirements to create stories in JIRA and documenting the processes in Confluence.
• Experience in working with day-to-day ad-hoc tasks, using GCP and airflow for smooth processing of the deliverables.
• Experience in working with teams both off-shore and on-shore to plan and execute the sprint as per Agile requirements.
• Gathering of Requirements from various systems business users.

• Defined the vision and strategy for data governance implementation for clients.
• Led teams of Software Engineers, Data Engineers, Data Quality Analysts, and Data Analysts to build complex and innovative solutions.
• Managed the data infrastructure, overseeing the planning and execution of testing efforts to ensure accuracy and performance measures are being met, in securing the overall success of business intelligence for the.
• Designed, built, deployed, and customized complex data governance and analytics solutions with the goal of creating a customized and complex data ecosystem to influence test design, manual and automated test execution.
• Established data strategy, data policies, data standards, organization, and administration.
• Synthesized and documented dataflows for critical business processes to maintain data policies.

New Jersey, United States

• Designing and Developing Apache NiFi jobs to get the files from transaction systems into data lake raw zone.
• Analyzed the user requirements and implemented the use cases using Apache NiFi.
• Worked on reading and writing multiple data formats like JSON, ORC, Parquet on HDFS using PySpark.
• Experienced with Azure Micro Services, Azure Functions and Azure Solutions.
• Hands on experience on Azure VPN-Point to Site, Virtual networks, Azure Custom security, end point security and firewall.
• Caching, SQL Azure, NoSQL, Storage, Network services, Azure Active Directory, API Management, Scheduling, Auto Scaling, and PowerShell Automation.

Jacksonville, Florida, United States

• Have actively taken part in Data Profiling, Data Cleansing, Data Migration, Data Mapping and actively helped developers to Compare data with original source documents and validate Data accuracy.
• Worked on Tableau, to create dashboards and visualizations.
• Data profiling and data quality checkup on the data for multiple units to ensure it met the specified business rules and standards set within the organization.
• Partitioning and bucketing ideas were implemented in the Apache Hive database, which increases query retrieval performance.
• Implemented indexes on OLTP/OLAP tables to improve navigation performance within large datasets
• Configured Policy Center with tight document/imaging support, new screens, revised assignment logic and other standard rules/screen/UI changes.

Raleigh, North Carolina, United States

• Written Hive queries for data analysis to meet the business requirements
• Migrated an existing on premises application to AWS.
• Developed PIG Latin scripts to extract the data from the web server output files and to load into HDFS
• Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting
• Created many Sparks UDF and UDAFs in Hive for functions that were not preexisting in Hive and Spark SQL.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs and Scala.

Hyderabad, Telangana, India

• Recommended structural changes and enhancements to systems and Databases.
• Conducted Design reviews and technical reviews with other project stakeholders.
• Was a part of the complete life cycle of the project from the requirements to the production support
• Created test plan documents for all back-end database modules
• Used MS Excel, MS Access, and SQL to write and run various queries.
• Worked extensively on creating tables, views, and SQL queries in MS SQL Server.

Hyderabad, Telangana, India