Btsa - Data Engineer
CurrentDescription:In the health plans and providers sector, focused on constructing data pipelines and backend architecture for dashboards powered by machine learning analytics. Empowered client teams to uncover valuable insights and make data-driven decisions that enhance overall performance.Roles & Responsibilities:- Enhanced and extended the existing data pipeline for continuous improvement and compatibility with each new version release of the tool- Overhauled the data architecture for the latest version and created comprehensive data flow diagrams to centralize the architecture for streamlined development- Enhanced data loading processes across local, staging, and production environments- Translated complex business rules and metrics calculations into executable code, yielding actionable insights from raw data- Extracted data from open-source web resources and processed it into analytical insights, subsequently ingesting it into the database.- Developed adaptable code to accommodate data for the upcoming year- Automated processes using shell scripts and created workflows in Databricks to enhance operational efficiency.
