Ketankumar Patel Email & Phone Number

Irvin, Taxas

•Built a centralized Data Lake on AWS Cloud leveraging primary services such as S3, EMR, Redshift, and Athena to enable seamless data ingestion and processing•Created data pipelines for different events to load the data from DynamoDB to the AWS S3bucket and then into the HDFS location, using PySpark for efficient data processing•Developed PySpark jobs to pull data from third-party and native data sources and dump data into AWS S3 for analytics and reporting purposes, after required transformations using best compression techniques, creating Hive tables on top of processed data•Loaded data into S3 buckets using AWS Glue and PySpark, filtered data stored in S3 buckets using Elasticsearch, and loaded data into Hive external tables•Used AWS EMR to transform and move large amounts of data into and out of other AWS data stores and databases, such as Amazon S3 and DynamoDB, running Hadoop/Spark jobs on AWS EMR•Designed and developed a Security Framework to provide fine-grained access to objects in AWS S3 using AWS Lambda and DynamoDB•Implemented AWS Lambda functions to run scripts in response to events in the Amazon DynamoDB table or S3, and integrated with other AWS services like Kinesis, RedShift, AWS Lambda, and CloudWatch metrics•Executed queries in Amazon Athena with the alerts coming from S3 buckets and identified the alerts generation difference between the Kafka cluster and Kinesis cluster, optimizing the data ingestion process•Ran log aggregation, website activity tracking, and commit logs for a distributed system using Kafka, ensuring data consistency and reliability•Created Airflow Scheduling scripts in Python, automating the data processing and ingestion tasks•Developed Spark code using Scala and Spark-SQL/Streaming for faster processing of data, and Scala scripts and UDFs using both data frames/SQL and RDD in Spark for data aggregation, queries, and writing back into the S3 bucket

Philadelphia, Pennsylvania, United States

• Created, owned, and drove an ongoing, end-to-end product roadmap by working with business areas to identify, sequence, and prioritize enhancement request. Ensured alignment of product features and stories and led UAT sessions for business stakeholders. Communicated frequently with stakeholders to ensure engagement and buy-in on decisions and proposed solutions• Extensively worked with various data transformation techniques in SSIS by creating SQL scripts as well as C# scripts (Script Component Task), various data transformations and data flow tasks.• Implemented Complex logic and used Partitioned Tables functionality for huge volumes of data.• Wrote Complex PL SQL scripts to get data out of Oracle for Reporting purpose and load that into SQL Server Reporting Data warehouse.• Designed dimensional model for SSAS Cube source database. Created SQL Views to implement Star schema.• Designed SSIS Packages to extract, transfer, load (ETL) existing data into SQL Server from different environments for the SSAS cubes.• Engineered the SSIS architecture for new system keeping in mind the dynamic package Configuration using Environment variable and SQL server tables. Also took care of Error handling by creating a database that would have Error tables.

Charlotte, North Carolina, United States

•Developed/Monitored ETL packages with different data sources (SQL Server, Flat Files, Excel files, etc) and loaded the data into target tables by performing different kinds of transformations using SSIS.•Responsible for successfully deploying SSIS Package into Production environment and used Package configuration to export various package properties to make package environment independent and Scheduled Jobs to automate the packages. •Proficient in Data migration between homogeneous/heterogeneous systems and SQL Server using SSIS, BULK INSERT, DTS Import/Export utility, and BCP. •Responsible for creating several reports such as drill down reports, parameterized reports, linked reports, sub reports, Matrix Reports, Charts using SQL Server Reporting Services. •Created email subscriptions for data driven reports by using Report Manager. •Responsible for migrating the DTS packages into SSIS. •Responsible for extracting the data from XML and CSV files to SQL Server 2008. •Responsible for creating the Staging tables, successfully migrated old data from legacy system into SQL Server 2016 using SSIS Packages. •Involved in migrating databases from On-premise to both AWS RDS and SQL Server on EC2 by using both native backup and Import/Export technologies in completed fashion.•Transferred data by adding Derived Column Transformation, count of records, merging of data has been done while pulling data from Source to the Target. •Created various Stored Procedures to validate the data from source and update the records and insert them into a newly created table. •Developed several Complex Reports (daily, weekly, monthly, quarterly and yearly) using SSRS•Performed T-SQL tuning and optimizing queries for Reports which take longer time in execution, Used Pivot tables to provide structured Reports like monthly, weekly. •Scheduled the Reports to run on daily and weekly basis in Report Manager and also email them to director and analysts to review in Excel Sheet.