Hus Shareef Email & Phone Number

Toronto, ON, CA

Toronto, Ontario, Canada

• Developed:
• Framework for ETL hardening, to reduce down times and ease switch overs
• Storage transition strategies and their adoption, generating savings of $900,000 a year
• Cloud native deployment of the data pipeline using Helm and Kubernetes
• ETL tuning and optimizations - shuffle, memory, GC, pushdowns, parallelization tuningTechnologies:Spark, Kafka, Airflow, Python, Docker, Kubernetes, Terraform; AWS

United States

• Developed:
• ETL pipelines to assign scores for vulnerabilities discovered in the network
• Design strategies to improve - the resiliency, availability, and performance of the data pipeline
• Production rollout strategies for the data pipelines and their associated componentsTechnologies:Spark, Flink, Presto, Python, Docker, Kubernetes, Terraform; AWS - EMR, SQS, Lambda

Reston, Virginia, United States

• Developed:
• Data pipelines to gather metrics and evaluate the eligibility of loan applications
• Real-time monitoring dashboards using Hive queries & views that consolidated the data
• ETL’s to aggregate and extract data from ~1Bil data records across disparate source systems
• Performance tuning and optimizations of data pipelines and data-service APIs

Chevy Chase

• Developed:
• Personalization pipelines to identify language cues for targeted advertisements.
• Data pipelines to flag – customer state to improve customer engagement in the IVR systems
• Fraud detection system, to capture anomalous policy changes across 25 Mil policies
• Streamline IVR interactions with customers, by customizing rules identifying caller intent

Centerville, VA, United States

• Developed:
• a prototype for recommendation engine to identify relevance among 35,000 car models
• data pipelines that mine consumer activity metrics – to identify consumer behavior patterns
• an in-house web-crawler, to scrape data for deriving business insights
• AWS batch & lambda jobs, that periodically run DB replication scripts across environments
• Hive queries & views that consolidated the data for analysis dashboardsTechnologies: Spark, Hive, Python, GoLang, Java, Docker, JavaScript, SQL, MongoDB; AWS: EMR, Lambda, Batch, ECS, Athena, RDS

Fairfax, Virginia

• Assist with classroom instruction and running the Q&A sessions for the students
• Organising and running the lab sessions - applying the concepts from class
• Work to identify issues with students and guiding them in their areas of improvement
• Grading the assignments and lab submissions to provide feedback

Ipswich, United Kingdom & Hyd India

• Developed:
• Big-data components using Hadoop MR, Pig for diagnostic info from 3 mil customers.
• PySpark modules for scraping data from 10 million transactions daily.
• Scripts using Python to extract data and push to relational and non-relational DB's
• RESTful micro-services in J2EE leveraging Spring modules.
• Unit-testing (TDD) modules with Junit, Spock and mock frameworks - WireMock, PowerMock