Senior Data Engineer
Current- Designed and implemented a recommendation system using AWS Lambda, APIs, databases, and Python to provide personalized service suggestions based on user commute times.- Developed dynamic pricing pipelines and algorithms to calculate wages in real-time based on demand, supply, and location data.- Introduced Apache Airflow for efficient data processing and job scheduling, deploying Airflow and migrating existing jobs.- Assumed the role of a product manager for data-related projects, spearheading the implementation of new features from concept to launch, leveraging market research and technical feasibility assessments to guide the development process.- Contributed to the development of data pipelines for efficient data storage and processing in a data lake environment, supporting downstream applications and analytics.