Vikas B Email & Phone Number

United States

St Louis, Missouri, United States

• Worked on multi cloud environment both AWS and GCP services.
• Designed and developed batch and streaming pipelines using AWS and GCP services for different clients.
• Expertise in designing and deployment of Hadoop cluster and different Big Data analytic tools including Apache PySpark, with Cloudera Distribution.
• Worked extensively on SQL, PL/SQL, Scala and UNIX shell scripting.
• Involved in Data mapping specifications to create and execute detailed system test plans. data mapping specifies what data will be extracted from an internal data warehouse, transformed, and sent to an external entity.
• Experience in building and architecting multiple Data pipelines, end to end ETL and ELT process for Data ingestion and transformation in GCP.

Rogers, Arkansas, United States

• Worked in multi cloud architecture designing, building multiple Data pipelines, end to end ETL from Data ingestion and transformation in GCP and AWS data pipelines.
• Implemented Big Query data process from GCP Pub/Sub topic to Bigqueryusing cloud Dataflow with python and also used rest API with python to ingest Data from other systems into BigQuery.
• Executed cloud dataflow to run Data Validation between raw source file and Bigquery and integrated monitoring Bigquery, Dataproc using Stackdriver across environments.
• Wrote Perl scripts covering data feed handling, implementing business logic, communicating with web services through SOAPLite module and WSDL.
• Generated the data cubes using hive, Pig, JAVA Map-Reducing on provisioning Hadoop cluster in AWS.
• Created S3 buckets (configure, policies, permissions) and used AWS S3 for storage and backup of Data in to AWS and AWS Glacier to store archive data.

St Louis, Missouri, United States

• Migrated an existing on-premises application to Amazon Web Services (AWS) and used its services like EC2 and S3 for small data sets processing and storage, experienced in maintaining the Hadoop cluster on AWS EMR.
• Developed solutions to pre-process large sets of structured, semi-structured data, with different file formats like Text, Avro, Sequence, XML, JSON, and Parquet.
• Developed an ETL process in AWS Glue to migrate customer data from external data stores such as S3 into AWS Redshift.
• Built pipelines to copy the data from multiple sources to destination in AWS Redshift.
• Migrated the data from Redshift data warehouse to Snowflake database.
• Built dimensional modelling, data vault architecture on Snowflake.

Jacksonville, Florida, United States

• Created Pipelines in ADF using Linked Services/Datasets/Pipeline to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, and write-back tool.
• Build a scheduling framework using python SDK to launch and collect status for all ADF jobs. The status is stored on the SQL database so that real-time dashboards could be built for visual representation of pipelines.
• Developed Python UDF for handling nested JSON data from the source system and flattening to line-item level records. These flattened records are further transformed using Spark transformations for daily aggregations.
• Developed data pipelines and ETL workflows in Azure Synapse Analytics using Azure Data Factory, Azure Databricks, and Azure Synapse Studio.
• Built and deployed Azure Synapse Analytics pipelines and workflows using Azure DevOps and Azure Resource Manager templates.
• Integrated Azure Synapse Analytics with other Azure services such as Azure Blob Storage, Azure Event Hubs, and Azure Key Vault.

Hyderabad, Telangana, India

• Developed Advance PL/SQL packages, procedures, triggers, functions, Indexes and Collections to implement business logic using SQL Navigator.
• Generated server-side PL/SQL scripts for data manipulation and validation and materialized views for remote instances.
• Created management analysis reporting using Parallel Queries, Java Stored Procedures. Participated in change and code reviews to understand the testing needs of the change components. Worked on troubleshooting defects.
• Involved in defragmentation of tables, partitioning, compressing and indexes for improved performance and efficiency. Involved in table redesigning with implementation of Partitions and Partition Indexes to make.
• Experience in Database Application Development, Query Optimization, Performance Tuning and DBA solutions and implementation experience in complete System Development Life Cycle.
• Used Informatica Power Center Designer to analyze the source data to Extract & Transform from various source systems by incorporating business rules using different objects and functions that the tool supports.