Data Integration Engineer
CurrentResponsible for the design, development, deployment, and maintenance of multiple Live/Historical Data Integration services on cloud (AWS and Azure) and on-premise (client infrastructure IT and OT network), focusing on ingest, transform, and blend/integrate structured and unstructured data and deliver data to the back-end platform. Multiple data sources and communication protocols such as OPC (UA and DA), SQL Databases, MongoDB, SFTP Connections, file exporters/importers (JSON, XLS and CSV), Azure Data Lake (V1 & Storage Gen2), S3 Buckets, REST APIs, OSISoft Pi System, MQTT and NATS. Communicating / liaising with clients’ IT personnel to discover what sources and connectors they have available and to interface with.