Technology Analyst C10
• Developed and optimized Python scripts for transitioning data models from prototype to SIT, UAT, and production environments using PySpark, Java Spark, Scala, and Hadoop.• Managed HDFS and Hive tables to retrieve and analyze trading data across various asset classes, enhancing surveil- lance and analysis.• Improved data processing capabilities with Cloudera, Apache HBase, and Hue, resulting in increased efficiency and accuracy.• Oversaw the Actor-Based Dashboard surveillance systems, ensuring strict compliance with security protocols and regulatory requirements.• Led the development and deployment of Equities Syndicate Stabilization projects, implementing advanced algorithms and data processing techniques to maintain market stability. Coordinated with the L3 support DevOps team for seamless production integration.