Lead Data Integration Specialist
Current• Design and develop ETL (Talend) / SQL / Python / Linux based processes to perform complex data transformation processes.• Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms (RDBMS and No-SQL platforms)• Build Data Integration solutions to handle batch / streaming / IoT (Hadoop/Confluent/ActiveMQ) / REST API (Datatron) data on ETL, Big-Data platforms (Couchbase, S3)• Work jointly with Data Science team on ML operation automations alongside developing automated EDAs to convey to leadership how ML model changes would affect our final results• Manage changes in the Enterprise Data Warehouse according to Data Warehousing best practices• Provide thought leadership to deliver creative and efficient data related technical solutions• Gather requirements and construct documentation to aid in maintenance and code reuse in accordance with team processes and standards• Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms• Monitor scheduled jobs and improve reliability of ongoing processing• Monitor, measure, and enhance ways to improve system performance• Conduct interviews to fill positions within my core data engineering team, leading them to success within the company, following industry best practices