Akshay Aghade Email & Phone Number

Pune, Maharashtra, India

Bengaluru, Karnataka, India

Netzero Sustainability Economics India Pvt Ltd:Data Engineer | March 2023Project Overview:At Netzero Sustainability Economics India Pvt Ltd, I am spearheading transformative change as a Data Engineer. My primary responsibility is to store data in Azure Data lake while utilizing Azure Data Factory for seamless querying. Leveraging the power of Azure Databricks Notebook and the PySpark engine, I ensure data quality and accuracy, guaranteeing reliable insights for decision-making. With expertise in ETL/data processing, I efficiently write output data to Storage Layer, enabling robust analysis and actionable results. I thrive in this dynamic environment, using PySpark, Python, and Spark-SQL, along with various Azure services. Join me in shaping a sustainable future through cutting-edge data engineering practices.Key Takeaways:Expertise in Azure Services:The project deepened my understanding of Microsoft Azure, particularly Azure Databricks and Azure Data Factory, showcasing my evolving expertise in cloud services.Collaborative Project Execution:The successful collaboration with cross-functional teams emphasized my strong teamwork and communication skills, crucial for navigating complex data engineering projects.Data Quality Focus:The emphasis on robust data validation highlighted my commitment to ensuring data quality, a foundational aspect of any successful data project.Performance Optimization Skills:The continuous pursuit of performance excellence demonstrated my proficiency in fine-tuning processes for enhanced efficiency, a skill set invaluable in dynamic data engineering environments.Overall, This project was not just about data migration; it was a testament to my capabilities as a Data Engineer, emphasizing my commitment to delivering high-quality solutions, optimizing processes, and showcasing expertise in the intricate landscape of data engineering within the Azure ecosystem.

Bengaluru, Karnataka, India

As a Data Engineer, I played a pivotal role in designing and implementing data solutions, specifically focused on data warehouse development using Redshift. Here are the key responsibilities and accomplishments during my tenure:Data Warehouse Development: Led the migration of data from MySQL server to AWS S3, utilising AWS Database Migration Service (DMS) for seamless data transfer. Developed and optimised data pipelines using PySpark and Spark-SQL, ensuring efficient data processing and transformation.Data Transformation and Business Logic: Implemented complex business logic and data transformations within AWS Glue, leveraging PySpark and Spark-SQL. Utilised a combination of wide and narrow transformations to manipulate and refine data, ensuring data quality and integrity.AWS Services: Leveraged various AWS services, including Redshift, Glue, S3, Lambda, SQS, SNS, and RDS, to build end-to-end data solutions. Designed and implemented ETL processes using AWS Glue for data extraction, transformation, and loading.Performance Optimisation: Implemented various performance optimisation techniques, such as data caching, persistence, and broadcast joins, to improve data processing speed and efficiency. Conducted thorough data profiling and analysis to identify bottlenecks and optimise query performance.Collaboration and Agile Methodology: Collaborated with cross-functional teams including data analysts, data scientists, and business stakeholders to understand data requirements and deliver tailored solutions. Practiced Agile/Scrum methodology to ensure efficient project management and timely delivery of milestones.Overall, My tenure was marked by a commitment to excellence in data warehousing. The successful execution of this project demonstrated my proficiency in PySpark, AWS services, & collaborative project management, positioning me as a valuable asset in the dynamic field of data engineering.