Machine Learning Engineer
- Engineered and deployed document parsing and question-answering systems, harnessing advanced natural language processing techniques. Achieved precision in extracting pertinent information from unstructured data sources using the Vision-based Encoder-Decoder Model.- Contributed the design and execution of data pipeline utilizing Python libraries such as Pandas, Numpy, and Spark. Ensured seamless data integration across diverse platforms, contributing to enhanced data accessibility and system efficiency.- Leveraged Pandas, Seaborn, and Tableau to craft engaging visualizations. Transformed complex datasets into intuitive visual representations, aiding in effective communication of insights to both technical and non-technical stakeholders.- Led the development and implementation of data pipeline jobs using Spark, leveraging its robust capabilities for large-scale data processing. Designed and optimized complex ETL (Extract, Transform, Load) workflows to ingest, clean, and transform data from various sources, ensuring data integrity and consistency. Utilized Spark's distributed computing framework to efficiently handle massive datasets, significantly improving processing speed and scalability. Collaborated with cross-functional teams to deploy and monitor data pipelines, providing actionable insights for business decision-making.