As a Data Engineer with 2 years of experience at Infinite Computer Solutions, I have honed my skills in building and optimizing data solutions using cutting-edge technologies. My expertise includes:Azure Databricks: Crafting scalable data pipelines and integrating with various data sources.Apache Spark & PySpark: Developing distributed data processing workflows to handle large datasets efficiently.Python & Scala: Leveraging these programming languages to build robust data processing and analysis applications.SQL: Crafting complex queries and optimizing database performance.Power BI: Creating insightful and interactive data visualizations to drive business decisions.In addition to my core data engineering skills, I have a solid foundation in manual testing from a 6-month stint, where I was involved in writing test cases, executing test plans, and reporting bugs. This experience has enhanced my attention to detail and problem-solving abilities, ensuring the quality and reliability of the solutions I develop.