Scrum Master for a team of 15 members consists of both Software Engineer and Data Scientist.Manager for 8 Software Engineers.Leading the effort of building the Cross Device Graph for Trade Desk

Leading a team consisting of engineers and data scientists building Identity Graph for The Trade Desk

• Leading team of several developers. Drove technical vision, defined deliverables, collaborated across teams and with stakeholders.• Leading the effort of migrating Experian end to end credit reporting service from on prem to AWS. Deep understanding in financial credit reporting flows.• Utilized Kafka to stream CDC events from on prem databases, and developed microservices to encrypt, replicate, transform and save data on AWS RDS databases. Apply partitioning to enforce order and improve performance.• Enhanced RocksDB, a file based log structure database for fast, low latency storage.• Developed docker based microservices that runs on AWS ECS clusters that handle large volume of data. Utilized GRPC for communication in between and applied envoy as proxy.• Deep involvement in security. Applied TLS for all transaction between services. Developed process to encrypt PII data using customized keys and also use PGP encryption for text encryption. Also applied AWS KMS key for all data at rest, including RDS, Kafka, S3, DynamoDB.• Received highest performance review in a row since joining.

Designed and implemented microservices that collect metrics with volume of over 250k records per second with millisecond level latency.Optimized Spark streaming pipeline that receiving over 250k records from 5 minutes during peak hour to several seconds by finding optimum configurations (Spark, JVM, Kafka, NoSQL database). Added comprehensive metrics for future maintenance. Managed end to end ETL pipeline from web endpoint to Kafka topics, enrich data using Spark Streaming and calling NoSQL databases, loading into Hive table, applying data transformation logic and into different report tables and data lake using Spark batch.

• Worked on Amazon Retail Pricing team that handles all of Amazon Retail price calculation• Worked on several large scalable system projects from scratch to post implementation mainly using JAVA.• Contributed to the new big data platform using AWS tools: S3, Data pipeline, EMR, DynamoDB, SQS• Work experiences of Hadoop technologies such as Spark and Hive.• Served as the first member of a new team. Worked with manager and product manager to define work’s requirement, project plans and maintenance.• Worked closely with Legal consultant, business partners from different countries and led several project management work