Chakri C Email and Phone Number

 Implemented Installation and configuration of multi-node cluster on Cloud using Amazon Web Services (AWS) on EC2. Handled AWS Management Tools as Cloud watch and Cloud Trail. Stored the log files in AWS S3. Used versioning in S3 buckets where the highly sensitive information is stored. Integrated AWS Dynamo DB using AWS lambda to store the values of items and backup the DynamoDB streams Automated Regular AWS tasks like snapshots creation using Python scripts. Designed data warehouses on platforms such as AWS Redshift, Azure SQL Data Warehouse, and other high-performance platforms. Install and configure Apache Airflow for AWS S3 bucket and created dags to run the Airflow Prepared scripts to automate the ingestion process using Pyspark and Scala as needed through various sources such as API, AWS S3, Teradata and Redshift. Created multiple scripts to automate ETL/ ELT process using Pyspark from multiple sources Developed Pyspark scripts utilizing SQL and RDD in spark for data analysis and storing back into S3 Developed Pyspark code to load from stg to hub implementing the business logic. Built data sets for end-user business consumption by retrieving data from multiple data sources using SQL, SAS, or Python (prefer Python). Developed code in Spark SQL for implementing Business logic with python as programming language. Designed, Developed and Delivered the jobs and transformations over the data to enrich the data and progressively elevate for consuming in the Pub layer of the data lake. Worked with a team of security engineers and analysts within the IPRM department to deploy, sustain, and monitor technical controls and tools to meet specific security requirements. Utilized expertise in database security to identify potential security risks and vulnerabilities within the client's database systems. Conducted requirements gathering, architecture, development, testing, training, implementation, and support of reporting applications.

 Gathering data and business requirements from end users and management. Designed and built data solutions to migrate existing source data in Data Warehouse to Atlas Data Lake (Big Data) Analyzed huge volumes of data Devised simple and complex HIVE, SQL scripts to validate Dataflow in various applications. Performed Cognos report validation. Made use of MHUB for validating Data Profiling & Data Lineage. Devised PL/SQL statements - Stored Procedures, Functions, Triggers, Views and packages. Made use of Indexing, Aggregation and Materialized views to optimize query performance. Created reports using Tableau/Power BI/Cognas to perform data validation. Involved in creating Created Tableau dashboards using stack bars, bar graphs, scattered plots, geographical maps, Gantt charts etc. using show me functionality. Dashboards and stories as needed using Tableau Desktop and Tableau Server Performed statistical analysis using SQL, Python, R Programming and Excel. Worked extensively with Excel VBA Macros, Microsoft Access Forms Import, clean, filter and analyze data using tools such as SQL, HIVE and PIG. Used Python& SAS to extract, transform & load source data from transaction systems, generated reports, insights, and key conclusions. Developed story telling dashboards in Tableau Desktop and published them on to TableauServer which allowed end users to understand the data on the fly with the usage of quick filters for on demand needed information. Analyzed and recommended improvements for better data consistency and efficiency

 Involved in complete Implementation lifecycle, specialized in writing custom MapReduce, and Hive Extensively used Hive/HQL or Hive queries to query or search for a string in Hive tables in HDFS Continuous monitoring and managing the Hadoop cluster using Cloudera Manager Implemented Spark using Python and Spark SQL for faster processing of data Used Spark for interactive queries, processing of streaming data and integration with popular NoSQL database Used the Spark -Cassandra Connector to load data to and from Cassandra Implemented test scripts to support test driven development and continuous integration. Dumped the data from HDFS to Oracle database and vice-versa using Sqoop Extensively involved in Installation and configuration of Cloudera Hadoop Distribution. Provided support for EBS, Trusted Advisor, Cloud Watch, Cloud Front, IAM, Security Groups, Auto-Scaling, AWS CLI and Cloud Watch Monitoring creation and update. Worked with Amazon Web Services (AWS) using EC2 for computing and S3 as storage mechanism Deployed Lambda and other dependencies into AWS to automate EMR Spin for Data Lake jobs Scheduled spark applications/Steps in AWS EMR cluster. Extensively used event-driven and scheduled AWS Lambda functions to trigger various AWS resources. Implemented advanced procedures like text analytics and processing using the in-memory computing capabilities like Apache Spark written in Scala. Developed spark applications for performing large scale transformations and denormalization of relational datasets.