In my role at Tresata, I have been deeply involved in utilizing our proprietary tools, written in Scala, for various data engineering tasks. These tools enable us to perform actions such as printing schema, viewing sample data, and generating insights to detect patterns, anomalies, and critical data elements for cleaning and connecting datasets. After identifying the necessary transformations, I write scripts to clean and integrate the data, ensuring the logic is sound and the results are accurate.Our team also developed a visualization platform that allows us to create reports and dashboards by indexing data on OpenSearch. This platform supports building nodes and edges to visualize connections between entities.I’ve worked on two notable projects: Opera House Project: We analyzed booking and ticketing data, producing reports on top-selling shows across various time slots and languages. Financial Firm Project: We tackled the complex challenge of entity resolution from multiple data sources. Due to infrastructure constraints, we utilized Power BI to generate insights, working within the client's environment.Additionally, I created an orchestration tool to automate the entire data processing workflow, from loading and cleaning to connecting datasets and generating statistics. I developed different versions of this tool, including ones using SBT and Argo Workflow.Beyond these projects, I’ve also contributed to research and development efforts by working with Azure Functions, OneLake, and Microsoft Fabric. My role also involved manual and automation testing during product development, and I led the tech team for a hackathon, where I created datasets, a data dictionary, and managed GitHub for participant collaboration.

Training Experience with Microsoft Business Intelligence Tools:During my training, I worked extensively with Microsoft BI tools, including SSAS, SSIS, and SSRS. My primary task was to transform data and generate meaningful reports and dashboards. For example, I worked with datasets containing bowlers' performance data and calculated their economy rates and averages. Additionally, I analyzed team records, including match performances, win/loss percentages over the years, and ground-specific statistics.Nike Project - Data Engineering with Teradata and Informatica:In my first client project with Nike, I was responsible for using Teradata to create tables, functions, and stored procedures. I also utilized Informatica PowerCenter to connect to databases and design workflows within the studio. A significant task involved transforming data from various regions, where I had to separate data based on country and apply specific codes depending on other columns. This included handling data for regions like APAC, China, and Latin America. I also managed workflow monitoring for running and debugging processes, alongside performing thorough unit testing to ensure data accuracy.FedEx Project - Leveraging Databricks and Spark:In another project with FedEx, I gained experience working with Databricks and learning Apache Spark. I was involved in creating Delta tables and views, which were then stored and analyzed. By creating temporary views, I ran complex SQL queries to solve various use cases. My contributions to this project were recognized, and I was awarded the Infosys Insta Award for my efforts.