Senior Data Engineer
Current. Build ETL pipeline for continuous and batch wise data processed at the Business User end.. Use AWS Redshift, AWS S3, Apache Airflow to automate and schedule the flow of data into the datamart.. Create the pipeline of data into the datalake and datamart for business requirements indicated by user.. Articulate GenAI tools to the higher efficient intelligence on to Air-fleet maintenance, Air-fleet performance and User engagement.. Launched automated scheduled python scripts running to connect corporate sharepoint against other domain.. Launch optimisation models to efficiently increase the total revenue for SIA from Air-fleet operators across the globe.. Maintain 8 different departments data into customised datamart and maintain its running efficiency 100%. Create the complete data engineering pipeline fornew projects from any departments using cloud architecture AWS.. Created a custom in-house programming to deploy the data science projects deployed. Worked with custom VPC running multiple EC2 instances for different Data science projects.. Deployed pdf to information extractor with any invoices for Quality department and deployed to multiple departments including HR, Finance etc. Deployed fuzzy search model to replace abbreviated text into user generic full form text, for generalising the product for future.