Senior Data Engineer
CurrentCreate data solutions and review the requirements with managementDrive development of tools, reporting improvements, and automation, and create new innovative and insightful reportsCreate queries and user defined functions that require aggregating large data sets on a regular basis in a performant fashion with PostgreSQLDetect data quality issues and provide production supportDebug data issues in existing reports and implement fixesAcquire data from transactional source systems to the data mart using Databricks platform and build ETL pipelines with Spark SQLExperience in managing tasks through JIRA, Git, and deploying database code using Liquibase and Jenkins as a member of our Scrum team where we have two-week sprints, user stories and a product backlog. Build, scale and maintain data pipelines to process huge number of daily events into Spark