Eswar Kumar Email & Phone Number

Medina, Medina‏, SA

• Involved in developing Shell and Python scripts to automate in the big data environment.
• Analyzed large and critical datasets using Cloudera, HDFS, MapReduce, Hive, Hive UDF, Pig, Sqoop and Spark.
• Developed Spark Applications by using Scala and Implemented Apache Spark data processing project to handle data from various RDBMS and Streaming sources.
• Developed Preprocessing job using Spark Data frames to flatten Json documents to flat file.
• Developed Dashboard reports on Tableau.
• Moving data from Teradata to a Hadoop cluster Using TDCH/Fast export and Apache NIFI.

New York, NY, US

• Design and Develop ETL Processes in AWS Glue to migrate accidents data from external sources like S3, Text Files into AWS Redshift.
• Experience in building and architecting multiple Data pipelines, end to end ETL and ELT process for Data ingestion and transformation.
• Created service accounts using Terraform with the respective roles to supporting the services deployed for managing the GCP Tech Stack.
• Developed Python scripts to parse XML, Json files and load the data in AWS Snowflake Data warehouse.
• Migrating an entire oracle database to BigQuery and using of power bi for reporting.
• Build data pipelines in airflow in GCP for ETL related jobs using different airflow operators.

San Jose, CA, US

• Implemented Responsible AWS solutions using EC2, S3, RDS, EBS, Elastic Load Balancer, and Auto scaling groups, Optimized volumes and EC2 instances.
• Wrote Terraform templates for AWS Infrastructure as a code to build staging, production environments & set up build & automations for Jenkins.
• Configured Elastic Load Balancers (ELB) with EC2 Auto scaling groups.
• Created Amazon VPC to create public-facing subnet for web servers with internet access, and backend databases & application servers in a private-facing subnet with no Internet access.
• Created AWS Launch configurations based on customized AMI and use this launch configuration to configure auto scaling groups.
• Utilized Puppet for configuration management of hosted Instances within AWS Configuring and Networking of Virtual Private Cloud (VPC).

Abbott Park, Illinois, US

• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL, and Azure Data Lake Analytics. Data Ingestion to one or more Azure.
• Designed and Implemented cloud-based solutions in Azure by creating Azure SQL database, setting up Elastic pool jobs and designing tabular models in Azure analysis services. Have extensive knowledge in creating.
• Develop modern data solutions by analyzing, designing, and constructing them with the Azure PaaS service.
• Used various GCP components such as Dataflow with python SDK, DataProc, BigQuery, Composer (Airflow), Gsuite for impersonation of the service accounts, Cloud IAM, Cloud Pub/Sub, Cloud functions for handling functions.
• Worked on implementing Data Lake in Google Big Query, Google Cloud Storage, SQL Scripts to load data to BigQuery, and Composer for running the Talend and Query Scripts.
• Worked with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Dataframe API, Spark Streaming, and MLlib, and worked explicitly on PySpark.

Los Angeles, CA, US

• Developed data processing tasks using PySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations, used Pandas, NumPy, Spark in Python for developing.
• Hands-on experience with Snowflake utilities, Snow SQL, SnowPipe, Big Data model techniques using Python and Java and Data Integrity checks have been handled using Hive queries, Hadoop, and Spark.
• Developed ETL Pipelines in and out of data warehouse, developed major reports using advanced SQL queries in Snowflake.
• Built ETL pipelines in and out of data warehouse using combination of Python and Snowflakes SnowSQL writing SQL queries against Snowflake.
• Worked collaboratively to manage build outs of large data clusters and real time streaming with Spark.
• Developed the batch scripts to fetch the data from AWS S3 storage and do required transformations in Scala using Spark framework.

Hyderabad, Telangana State, IN

• Performed Data Analysis, Data Migration, Data Cleansing, Transformation, Integration, Data Import, and Data Export.
• Devised PL/SQL Stored Procedures, Functions, Triggers, Views and packages. Made use of Indexing, Aggregation and Materialized views to optimize query performance.
• Designing the schema and created DDL Scripts for ETL Metadata tables to store the run time metrics of the Datastage Jobs.
• Used Informatica Power center to load data from Flat files to DB2, XML Files to DB2, Flat files to Oracle.
• Implemented Hive Partitioning and Bucketing on the collected data in HDFS.
• Experienced with Spark Context, Spark-SQL, Data Frame, Datasets, Spark YARN.