Insight is a professional training program for data engineers.Developed SafePay, scalable and extendable framework for fast and safe P2P payments. Ingested 44M Venmo transactions via Kafka, categorized in Spark Streaming and persisted in Cassandra. Ran PySpark batch job to detect anomalies. Solution coded in Python and deployed on AWS EC2 11 node cluster. Cassandra data model optimized for fast ingestion and partitioned for efficient batch processing. Monitoring dashboard built in Flask and jQuery. Project was implemented in 4 weeks start to finish.Led presentations on big data topics: Hadoop, Spark, Cassandra, Graph databases, Enterprise Architecture and System Design

Created reference architectures (data lineage, risk), coded Cypher queries, conducted client-facing POCs that involved graph data modeling, data ingestion, database cluster configurationPresented at sales events, delivered Neo4j training, resolved support issues (Levenshtein range index)Evaluated and learned other graph query languages - Gremlin (Titan), GSQL (TigerGraph)

Delivered consulting engagements at major financial institutions.Established technology stack (Hadoop, Greenplum, Gemfire, Solr, Genesys) and data ingestion process for machine learning data analytics platform that fed mobile banking application with model predictions (spending, offers). Created swagger APIs, data model, integration sequence diagrams for the dev teamDefined product features, achieved sign-off on requirements, influenced executive stakeholders. Planned sprints for joint data engineering/data science team, groomed backlog, passed design process tollgatesManaged technology selection (Oracle XML vs MongoDB) for application redesign necessitated by poor DB performance. Defined conceptual, logical and physical schemas (relational, XML, JSON)

Established IT vision, standards, roadmaps and budgets (~$50M/year), technology selection criteriaLed design and delivery of Informatica MDM hub that integrated data from Salesforce, Workday HRIS, WebSphere, Oracle OIM, PostgreSQL. Designed DB schema, staging pipeline, configured ETL jobsImplemented Oracle IDM platform that integrated all enterprise identities and enabled SSO. Coded connector extension in Java, developed Oracle SQL scripts. Managed data cleansing across all systems

Created actionable enterprise data architecture (EDA) roadmap that reduced number and cost of data feeds between 65 sources (CRTS, Murex, Reuters). Advocated IT Ops best practices based on COBITDeveloped governance model that spanned acquisition, transformation, and delivery of data

Built distributed J2EE WebLogic e-commerce platform for mobile account paymentsArchitected point-of-sale transaction engine. Converted UML to Java class model Developed banking integration framework with NeXT (Objective C) and CORBA (C++)

Developed bespoke solutions in C++ and Java.