Bi Lead
CurrentSpearheaded improvements in ETL logging, enhancing visibility and traceability for daily jobs, leading to faster issue identification and resolution.Designed and implemented a scalable ETL framework for processing data files lacking column names, allowing seamless ingestion of unlimited files.Optimized ETL processes to handle compressed files efficiently, resolving bottlenecks and improving system throughput.Led the transition from Redshift to Iceberg, significantly enhancing query performance and aligning the architecture with modern data practices. Addressed the absence of identity columns by developing a unique counter solution.Collaborated with project managers to streamline resource planning, ensuring accurate deliverables and alignment with organizational goals.Actively worked on process improvements and increased customer value visibility through effective communication and feedback loops.