Srujana Y Email & Phone Number

Massachusetts, United States

• Experience in building and architecting multiple Data pipelines, end to end ETL and ELT process for Data ingestion and transformation. • Worked extensively with AWS services like EC2, S3, VPC,Appflow, ELB, Auto Scaling Groups, Route 53, IAM, Cloudtrail, Cloudwatch, Cloudformation, Cloudfront, SNS, and RDS. • Design, Development, Testing and implementation of ETL processes using Informatica Cloud.• Developed Python scripts to parse XML, Json files and load the data in AWS Snowflake Data warehouse. • Design and Develop ETL Processes in AWS Glue to migrate Campaign data from external sources like S3, Parquet/Text Files into AWS Redshift. • Utilized Cloud Watch to monitor resources such as EC2, CPU memory, Amazon RDS, B services, DynamoDB tables and EBS volumes• Experience in integrating AWS PaaS and SaaS solutions with other AWS services such as Amazon S3, Amazon RDS, and Amazon DynamoDB.• Knowledge of Software as a Service (SaaS) solutions available on AWS, such as WorkMail, WorkDocs, and WorkSpaces.

California, United States

• Develop a data platform from scratch and took part in requirement gathering and analysis phase of the project in documenting the business requirements.• Worked in designing tables in Hive, MYSQL using SQOOP and processing data like importing and exporting of databases to the HDFS, involved in processing large datasets of different forms including structured, semi-structured and unstructured data.• Developed rest API's using python with flask and Django framework and done the integration of various data sources including Java, JDBC, RDBMS, Shell Scripting, Spreadsheets, and Text files.• Worked with Hadoop architecture and the daemons of Hadoop including Name-Node, Data Node, Job Tracker, Task Tracker, and Resource Manager.• Used AWS data pipeline for Data Extraction, Transformation and Loading from homogeneous or heterogeneous data sources and built various graphs for business decision-making using Python matplot library• Developed scripts to load data to hive from HDFS and involved in ingesting data into Data Warehouse using various data loading techniques.• Build Cassandra queries for performing various CRUD operations like create, update, read and delete, also used Bootstrap as a mechanism to manage and organize the html page layout

Cincinnati, Ohio, United States

• Involved in full Software Development Life Cycle (SDLC) - Business Requirements Analysis, preparation of Technical Design documents, Data Analysis, Logical and Physical database design, Coding, Testing, Implementing, and deploying to business users.• Transformed and analyzed the data using Pyspark, HIVE, based on ETL mappings.• Utilized Hadoop and Databricks to process large data sets in a distributed computing environment.• Experience with deploying and managing Airflow clusters on Azure using tools such as Azure Kubernetes Service (AKS) and Azure Container Instances (ACI)• Developed and maintained data integration and transformation processes using ADF.• Implemented Azure Data Factory (ADF) to design and implement data pipelines for financial data. This included creating and configuring ADF pipelines, data integration and movement using ADF and data transformation using ADF Data flow.• Implemented Airflow DAGs for automating data loading and transformation processes.

New Jersey, United States

• Involved in implementation of new statistical algorithms and operators on Hadoop and SQL platforms and utilized optimizations techniques, linear regressions, K-means clustering, Native Bayes and other approaches.• Developed Spark batch job to automate creation/metadata update of external Hive table created on top of datasets residing in HDFS.• Developed Data Serialization spark common module for converting Complex objects into sequence bits by using AVRO, PARQUET, JSON, CSV formats.• Worked on ERModeling, Dimensional Modeling (StarSchema, SnowflakeSchema), Data warehousing and OLAP tools.• Populated HDFS and PostgreSQL with huge amounts of data using Apache Kafka.• Design and develop Rest API (Commerce API) which provides functionality to connect to the PostgreSQL through Java services.• Designed Batch Audit Process in batch\shell script to monitor each ETL job along with reporting status which includes table name, start and finish time, number of rows loaded, status, etc.

India

• Involved in gathering business requirements, logical modeling, physical database design, data sourcing and data transformation, data loading, SQL, and performance tuning. • Used SSIS to populate data from various data sources, creating packages for different data loading operations for applications. • Created various types of reports such as complex drill-down reports, drill through reports, parameterized reports, matrix reports, Sub reports, non-parameterized reports and charts using reporting services based on relational and OLAP databases. • Experience in developing Spark applications using Spark-SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats. • Developed and executed a migration strategy to move Data Warehouse from an Oracle platform to AWS Redshift. • Built S3 buckets and managed policies for S3 buckets and used S3 bucket and Glacier for storage and backup on AWS.