Big Data Engineer - Tech Lead
CurrentAs a Big Data Engineer specializing in PySpark and Spark SQL within the Databricks environment, I am responsible for architecting and implementing scalable data solutions that drive strategic decision-making. My role involves designing robust data pipeline and managing large-scale data processing with an emphasis on optimization and performance. I leverage my expertise in Python and SQL to develop and execute complex data transformations, ensuring data integrity and accessibility. My work supports critical business functions by providing actionable insights through advanced data analytics, contributing to enhanced business intelligence and competitive advantage.Tech Lead, Web DevelopmentI lead the development and management of two data analytics platforms, focusing on a tech stack that includes ReactJS, NextJS, NodeJS, Transact-SQL, GraphQL, and RESTful API architecture, CI/CD pipeline automation. My role encompasses overseeing web developers, architecting solutions on Azure Web Cloud Services, and integrating data visualization tools like PowerBI and Tableau API. I excel in modeling relational databases and constructing data pipelines to ensure efficient data flow and storage. My leadership ensures our projects align with strategic goals, enhancing data accessibility and insights.