Satya . Email & Phone Number

Charlotte, North Carolina, United States

In a bustling corporate environment at Truist Bank in Charlotte, NC, I spearheaded the innovative adoption of Agile methodologies to streamline application development. Through weekly Sprints and meticulous stand-up meetings, we ensured progress tracking and issue resolution were seamless. Leveraging Azure's PaaS services, I architected a scalable framework for real-time data processing, facilitating intuitive data visualization. Our migration from on-premises to cloud was executed flawlessly… Show more In a bustling corporate environment at Truist Bank in Charlotte, NC, I spearheaded the innovative adoption of Agile methodologies to streamline application development. Through weekly Sprints and meticulous stand-up meetings, we ensured progress tracking and issue resolution were seamless. Leveraging Azure's PaaS services, I architected a scalable framework for real-time data processing, facilitating intuitive data visualization. Our migration from on-premises to cloud was executed flawlessly, minimizing downtime and optimizing integration. With Python Spark programs, I processed HDFS files efficiently, employing various Spark components for comprehensive data manipulation. By orchestrating intricate ETL workflows with Apache Airflow and integrating BI tools like Power BI, stakeholders derived actionable insights, empowering strategic decision-making. This dynamic ecosystem thrived on continuous improvement, with JIRA as our trusty companion for task management. Show less

Madison, Wisconsin, United States

Immersed in the dynamic world of data integration and analytics, my journey traversed diverse landscapes, from Hadoop environments to AWS infrastructures. In the realm of healthcare data, compliance with regulations like HIPAA was paramount. Leveraging Terraform, I orchestrated the provisioning of robust infrastructure on AWS, ensuring regulatory adherence. Utilizing the prowess of AWS services like Lambda and CloudTrail, I fortified our systems for scalability and security. Spark SQL became my… Show more Immersed in the dynamic world of data integration and analytics, my journey traversed diverse landscapes, from Hadoop environments to AWS infrastructures. In the realm of healthcare data, compliance with regulations like HIPAA was paramount. Leveraging Terraform, I orchestrated the provisioning of robust infrastructure on AWS, ensuring regulatory adherence. Utilizing the prowess of AWS services like Lambda and CloudTrail, I fortified our systems for scalability and security. Spark SQL became my ally in crafting custom ETL scripts for Amazon Redshift, enabling seamless data processing and analytics. Integrating Matillion with Apache Kafka facilitated real-time data processing, pivotal for our downstream applications. Containerization with Docker ensured consistent deployment across environments, while Talend and Informatica streamlined our ETL processes for Hadoop. Amidst it all, my role extended to designing data models and objects, ensuring data integrity and efficiency within Oracle databases. Show less

San Diego, Ca

• Strong understanding of AWS components such as EC2 and S3• Managed security groups on AWS, focusing on high-availability, fault-tolerance, and auto scaling using Terraform templates. Along with Continuous Integration and Continuous Deployment with AWS Lambda and AWS code pipeline.• Developed SSRS reports, SSIS packages to Extract, Transform and Load data from various source systems• Implementing and Managing ETL solutions and automating operational processes.• Was responsible… Show more • Strong understanding of AWS components such as EC2 and S3• Managed security groups on AWS, focusing on high-availability, fault-tolerance, and auto scaling using Terraform templates. Along with Continuous Integration and Continuous Deployment with AWS Lambda and AWS code pipeline.• Developed SSRS reports, SSIS packages to Extract, Transform and Load data from various source systems• Implementing and Managing ETL solutions and automating operational processes.• Was responsible for ETL and data validation using SQL Server Integration Services.• Measured Efficiency of Hadoop/Hive environment ensuring SLA is met• Optimized the Tensor Flow Model for efficiency• Created Entity Relationship Diagrams (ERD), Functional diagrams, Data flow diagrams and enforced referential integrity constraints and created logical and physical models using Erwin.• Defined and deployed monitoring, metrics, and logging systems on AWS.• and Spark SQL for ETL jobs and using the right technology for the job to get done.• Compiled data from various sources to perform complex analysis for actionable results• Defined facts, dimensions and designed the data marts using the Ralph Kimball's Dimensional Data Mart modeling methodology using Erwin.• Worked on Big data on AWS cloud services i.e. EC2, S3, EMR and DynamoDB• Created ad hoc queries and reports to support business decisions SQL Server Reporting Services (SSRS).• Analyze the existing application programs and tune SQL queries using execution plan, query analyzer, SQL Profiler and database engine tuning advisor to enhance performance.• Optimizing and tuning the Redshift environment, enabling queries to perform up to 100x faster for Tableau and SAS Visual Analytics.Environment: AWS, EC2, S3, SQL Server, Erwin, Oracle, Redshift, Informatica, RDS, NOSQL, MySQL, Dynamo DB, Docker, PostgreSQL, Tableau, Git Hub Show less

India

• Worked on various performance optimizations like using distributed cache for small datasets, partition and bucketing in Hive, doing map side joins etc.• Performed pre-processing on a dataset prior to training, including standardization, normalization.• Worked with heterogeneous source to Extracted data from Oracle database, XML and flat files and loaded to a relational Oracle warehouse.• Developed PIG scripts for the analysis of semi structured data.• Worked on Oozie workflow… Show more • Worked on various performance optimizations like using distributed cache for small datasets, partition and bucketing in Hive, doing map side joins etc.• Performed pre-processing on a dataset prior to training, including standardization, normalization.• Worked with heterogeneous source to Extracted data from Oracle database, XML and flat files and loaded to a relational Oracle warehouse.• Developed PIG scripts for the analysis of semi structured data.• Worked on Oozie workflow engine for job scheduling.• Worked with Avro Data Serialization system to work with JSON data formats.• Hive Context, with transformations and actions (map, flat Map, filter, reduce, reduce by Key).• Migrated ETL jobs to Pig scripts to do Transformations, even joins and some pre-aggregations before storing the data onto HDFS.• Performed tuning of SQL queries and Stored Procedure for speedy extraction of data to resolve and troubleshoot issues in OLTP environment.• Written Hive jobs to parse the logs and structure them in tabular format to facilitate effective querying on the log data.• Worked on different file formats like Sequence files, XML files and Map files using MapReduce Programs.• Developed PIG UDF'S for manipulating the data according to Business Requirements and also worked on developing custom PIG Loaders.• Evaluated model accuracy by dividing data into training and test datasets and computing metrics using evaluators.Environment: Hive, HDFS, Oozie, Map Reduce, Oracle 10g, SQL, OLTP, Windows, MS Office Show less

India

• Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translated business rules and functionality requirements into ETL procedures using Informatica Power Center.• Normalized tables, established joins, and created indexes wherever necessary utilizing profiler and execution plans.• Expertise in developing web-based LAMD stacks applications using Python and Django for large dataset analysis.• Utilized dimensional data modeling techniques… Show more • Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translated business rules and functionality requirements into ETL procedures using Informatica Power Center.• Normalized tables, established joins, and created indexes wherever necessary utilizing profiler and execution plans.• Expertise in developing web-based LAMD stacks applications using Python and Django for large dataset analysis.• Utilized dimensional data modeling techniques and storyboarding ETL processes.• Hands-on experience in analyzing the data and writing Custom MySQL queries for better performance, joining the tables and selecting the required data to run the reports.• Restricted data for Users using row level security and use filters.• Utilized technology such as MySQL and Excel PowerPivot to query test data and customize end-user requests.• Performed Unit Testing and tuned the Informatica mappings for better performance.• Re-engineer existing Informatica ETL process to improve performance and maintainability.• Demonstrated leadership by guiding newcomers with the best practices of the company. Show less