Data Engineer
Current• Responsible for the maintenance and enhancement of PL/SQL scripts aimed at retrieving data and constructing reports tailored to diverse financial departments within the banking sector. Proficient in managing relational databases, particularly Oracle.• Collaborated with data warehouse teams to extract necessary customer data from in-house servers and store it in Azure Data Lake storage.• Led the migration of in-house PL/SQL scripts to Azure Databricks using PySpark & SQL, accelerating report generation speed by 15 times, enhancing data processing efficiency and end-user experience significantly.• Implemented Bash scripts to streamline pre- and post-processing of generated reports, and automated the delivery of daily and ad-hoc reports to end users via email.• Engineered a robust log analytics solution using Power BI, enabling streamlined monitoring and analysis of report execution logs. Optimized failure tracking with precise timestamps, reducing manual intervention and reducing total reporting time by 50%.• Optimized a PL/SQL script using associative arrays and indexing, reducing execution time from 8 hours to 50 minutes, significantly enhancing the Anti-Money Laundering team’s ability to detect fraudulent transactions efficiently.
