Hus Shareef Email & Phone Number

Toronto, On, Ca

Toronto, Ontario, Canada

Developed:• Framework for ETL hardening, to reduce down times and ease switch overs• Storage transition strategies and their adoption, generating savings of $900,000 a year • Cloud native deployment of the data pipeline using Helm and Kubernetes• ETL tuning and optimizations - shuffle, memory, GC, pushdowns, parallelization tuningTechnologies:Spark, Kafka, Airflow, Python, Docker, Kubernetes, Terraform; AWS

United States

Developed:• ETL pipelines to assign scores for vulnerabilities discovered in the network• Design strategies to improve - the resiliency, availability, and performance of the data pipeline• Production rollout strategies for the data pipelines and their associated componentsTechnologies:Spark, Flink, Presto, Python, Docker, Kubernetes, Terraform; AWS - EMR, SQS, Lambda

Reston, Virginia, United States

Developed:• Data pipelines to gather metrics and evaluate the eligibility of loan applications• Real-time monitoring dashboards using Hive queries & views that consolidated the data • ETL’s to aggregate and extract data from ~1Bil data records across disparate source systems• Performance tuning and optimizations of data pipelines and data-service APIs

Chevy Chase

Developed:• Personalization pipelines to identify language cues for targeted advertisements.• Data pipelines to flag – customer state to improve customer engagement in the IVR systems• Fraud detection system, to capture anomalous policy changes across 25 Mil policies• Streamline IVR interactions with customers, by customizing rules identifying caller intent

Centerville, Va, United States

Developed: • a prototype for recommendation engine to identify relevance among 35,000 car models• data pipelines that mine consumer activity metrics – to identify consumer behavior patterns• an in-house web-crawler, to scrape data for deriving business insights• AWS batch & lambda jobs, that periodically run DB replication scripts across environments• Hive queries & views that consolidated the data for analysis dashboardsTechnologies: Spark, Hive, Python, GoLang, Java, Docker, JavaScript, SQL, MongoDB; AWS: EMR, Lambda, Batch, ECS, Athena, RDS

Fairfax, Virginia

• Assist with classroom instruction and running the Q&A sessions for the students• Organising and running the lab sessions - applying the concepts from class • Work to identify issues with students and guiding them in their areas of improvement• Grading the assignments and lab submissions to provide feedback

Ipswich, United Kingdom & Hyd India

Developed :• Big-data components using Hadoop MR, Pig for diagnostic info from 3 mil customers.• PySpark modules for scraping data from 10 million transactions daily.• Scripts using Python to extract data and push to relational and non-relational DB's• RESTful micro-services in J2EE leveraging Spring modules.• Unit-testing (TDD) modules with Junit, Spock and mock frameworks - WireMock, PowerMock• Behavioral testing (BDD) modules with Cucumber & continuous integration through Jenkins, JIRA, Git.Technologies: Big Data: Hadoop Map Reduce, Apache - Pig and Spark, Python (PySpark)Back-end: Java with Spring (Boot, Core, Bean, AOP, Data), Python, Shell, SQL, NoSQL, JS & Groovy