Senior Engineer
CurrentSenior engineer on a cutting edge global Maritime data platform project. The data platform provides near real time system and sensor data capture, data transformation, data analytics, AI and machine learning capabilities on board and on shore for a very large demographic of data consumers. I am the infrastructure lead designing, deploying and managing the virtualised and Linux based Hadoop (Hortonworks data platform), Apache NIFI & Kafka, Apache Spark, HBase, Hive, GraphQL, Docker, Jenkins, Ansible, bitbucket, Jira, confluence and wider big data ecosystem. The solution is hosted on a hybrid on premise / off premise cloud stack. I support the data science, dev ops, UI and applications development and wider internal and external community. The key services and capabilities are delivered in agile iterative sprints.