Sriram A Email & Phone Number

Irving, Texas, United States

Developed Spark jobs using Scala/PySpark and Spark SQL for faster data processing, reducing processing time by 30%.• Developed Scala scripts using both Data frames/SQL/Data sets and RDD/MapReduce in Spark for Data Aggregation, queries and writing data back into OLTP system through Sqoop.• Created graphical reports, tabular reports, scatter plots, geographical maps, dashboards, and parameters on Tableau and Microsoft Power BI improving insights delivery for stakeholders by 20%.• Worked with building data warehouse structures, and creating facts, dimensions, aggregate tables, by dimensional modeling, Star and Snowflake schemas.• Created Spark clusters and configuring high concurrency clusters using Azure Databricks to speed up the preparation of high-quality data.• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, Spark SQL, and U-SQL Azure Data Lake Analytics.• Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks.• Developed JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the SQLl Activity.• GIT used for version control and font management.• Created airflow DAG’s to sync files from box, analyze data quality, and alert for missing files.• Implemented a CI/CD pipeline using Jenkins, Airflow for Containers from Docker and Kubernetes.• Designed, documented operational problems by following standards and procedures using JIRA.• Developed SQL, PL/SQL stored procedures for efficient data querying and retrieval.

United States

Involved in full Software Development Life Cycle (SDLC) - Business Requirements Analysis, preparation of Technical Design documents, Data Analysis, Logical and Physical database design, Coding, Testing, Implementing, and deploying to business users.• Developed ETL pipelines in and out data warehouse using combination of Python and Snowflake Writing SQL quires against Snowflake.• Created reports in Power BI to visualize SharePoint list items, improving report delivery time by 15%.• Developed Tableau reports on the business information to examine the examples in the business.• Design Setup maintain Administrator the Azure SQL Database, Azure Analysis Service, Azure SQL Data warehouse, Azure Data Factory, Azure SQL Data warehouse.• Optimized the Hive tables using optimization techniques like partitions and bucketing to provide better performance with HiveQL queries.• Used tools like Jira, GitHub to update the documentation and code.• Worked on SQL queries in dimensional data warehouses and relational data warehouses. Performed Data Analysis and Data Profiling using Complex SQL queries on various systems.• Followed Agile methodology, participating in daily sprints and backlog grooming.

Pennsylvania, United States

Worked with the business users to gather, define business requirements and analyze the possible technical solutions.• Developed Spark jobs to clean data obtained from various feeds to make it suitable for data ingestion into Hive tables for analysis.• Created Custom Input Formats in Spark to handle various file formats, increasing processing efficiency.• Worked on AWS Redshift for data warehousing and querying large datasets. Utilized AWS Athena for serverless querying of structured data in S3, optimizing query performance with partitioning and parallel execution.• Created graphical reports, tabular reports, scatter plots, geographical maps, dashboards, and parameters on Tableau and Microsoft Power BI improving insights delivery for stakeholders by 20%.• Developed and managed ETL jobs using AWS Glue to automate data extraction, transformation, and loading processes, leveraging PySpark for complex data transformations.• Integration with S3: Leveraged Amazon S3 as a data lake to store raw and processed data, facilitating easy access for Glue jobs and downstream analytics.• Designed and maintained end-to-end ETL pipelines for real-time and batch processing using AWS services, including Redshift Spectrum and S3. This ensured the delivery of data to business intelligence tools like Tableau for visualization.• Developed multiple Spark jobs in Scala & Python for data cleaning and preprocessing.• Used PySpark jobs to run on Kubernetes Cluster for faster data processing.• Design and develop Tableau visualizations which include preparing Dashboards using calculations, parameters, calculated fields, groups, sets and hierarchies.• Performed Data Integration, Extraction, Transformation, and Load (ETL) Processes.• Worked on Snowflake environment to remove redundancy and load real time data from various data sources into HDFS using Kafka.• Implemented SQL, PL/SQL stored procedures.

Las Vegas, Nevada, United States

• Designed and developed Spark jobs using Scala for end-to-end data pipelines, handling batch processing of large datasets.• Used spark and spark-SQL to read the parquet data and create the tables in hive using the Scala API.• Developed highly complex Python and Scala code, which is maintainable, easy to use, and satisfies application requirements, data processing and analytics using inbuilt libraries.• Developed Spark code in Python and SparkSQL environment for faster testing and processing of data and Loading the data into Spark RDD and doing In-memory computation to generate the output response with less memory usage.• Designed, developed, tested, and maintained Tableau functional reports based on user requirements.• Developed ETL’s in using Spark SQL, RDD, and Data Frames.• Migrated MapReduce programs into Spark transformations using Scala, reducing execution time by 40%.• Worked with different feeds data like JSON, CSV, XML and implemented Data Lake concept.• Analyzed the SQL scripts and designed the solution to implement using PySpark. • Use SQL queries and other tools to perform data analysis and profiling.• Followed agile methodology and involved in daily SCRUM meetings, sprint planning, showcases and retrospective.