Gurleen Mangat Email and Phone Number

- Led the creation of the foundational processes and services to empower business value through data and standardized SDLC- Added PySpark into tech stack via enabling EMR and generic framework for pipeline development using Apache Spark and Python- Setup and enforced codebase standards (PR rules, PEP8, Mozilla SQL)- Optimized Redshift and EMR for performance, resilience, scalability while minimizing costs- Implemented Great Expectations and PyTest; defined standards for DE team- Added CI/CD for Airflow using Git Actions to eliminate manual effort in deployments- Designed and implemented near real-time data pipeline to consume raw session data and calculate core seller performance statistics that Jane’s sellers and Jane’s internal data team can use to drive business decisions by processing raw JSON data from Kinesis stream using PySpark and loaded aggregated results in Redshift- Integrated Great Expectations to perform data quality and data validation checks like record count, duplicate records, non-null columns to reduce customer impact in case of data errors- Worked with Customer service team to build data pipeline to export customer and order data from Redshift to Kustomer CRM reducing customer service agent chat times by 2 minutes- Collaborated with business to translate requirements into data pipelines that feed into BI dashboard Looker using Python, AWS Lambda and/or PostgreSQL (Redshift) depending on the request- Implement security policies using AWS IAM roles and policies whenever required- Mentoring and supported 3 other data engineers via code reviews, architecture design review and knowledge sharing sessions

- Design and develop new data pipelines using PySpark to ingest data and perform transformations- Leading initiative to migrate existing data pipelines from Oracle data warehouse to Cloudera environment for Tier 1 Payment Service Provider- Define processes and guidelines for ongoing development like code reviews, pull requests and branch naming conventions- Design and develop CI/CD using Jenkins and Maven- Leading initiative for designing generic application to ingest data using Azure Datafactory from multiple sources- Developing code in PySpark for data ingestion and analytics

Projects:Ingestion Framework- Assisted in development/maintenance of metadata driven data ingestion framework to ingest different types of data sets from various source applications used within the organization (ASCII, EBCDIC, XML and RDBMS) using Python and Java- Project used a diverse stack of applications like Oozie for workflow orchestration, Autosys for automated job scheduling, Spark to perform computation on HDFS, HQL to ingest data, Sqoop to retrieve data from RDBMS systems, YAML to store metadata and YARN to manage resources on clusterSmall File Compaction- Designed and implemented Java application which would compress and compact small files at Hive table/database location on HDFS based on metadata retrieved from Hive Metastore within a specific time range- Application used Spark API’s to interact with Hive Meta Store and dynamically generate list of partition paths where files are meant to be compacted based on file serialization and compression types

- Create/maintain MS Excel database to map applications to their respective servers for metrics tracking and reporting. This metric was used to project infrastructure health for next three years.- Work/co-ordinate with multiple Technology Operations teams, Application teams, Projects/PM’s to remediate old infrastructure to reduce overhead and licensing costs- Manage initiative to migrate applications from Windows Server 2003 to Window 2008/2012 using AppZero to mitigate security risks

- Development/maintenance of build, packaging and deployment scripts to optimize deployment process and reduce deployment times using shell scripting- Maintain, support several application environments and troubleshoot environment issues by reviewing logs in timely manner- Coordinate/work with multiple teams: Application Development, QA, Production support teams and clients to successfully build, package and deploy code into various environments (SIT/UAT/PROD)- Identify the variances across environments and troubleshoot issues related to Weblogic and oracle databases- Provide day to day environment operational and application support to clients and developers for projects/initiatives to be executed in testing environment such as infrastructure build activities, enhancements and/or upgrades, code deployment/synchronization and maintenance- Ensure communication with team members to facilitate and share knowledge and experiences gained that can apply to current and future projects/initiatives

- Nightly Archive Monitoring.- Creating and implementing change tasks.- Monitoring NetBackup failures and re-running backups.- Creating and implementing SSH keys.- SSL certificate liaison between CIBC and Symantec.- Project Work on SHA1 upgrade to SHA256.- Monitoring NetIQ alerts and action on them as per required procedures.- Monitoring Autosys/Tumbleweed alerts for process and file transfer failures.- Performing daily tasks of maintenance, health checks on production and backup servers.- Providing level 1 support for Windows Servers and applications (hosted on both Unix and Windows).- Performing patching, remediation and patch reporting

Vendor Managed Networks- worked another Co-op term (May 2014- Aug 2014)- Manage network of CIBC for Branches, ABM and Campuses.- Communicating with vendors using CIBC internal ticketing system.- Identifying, analyzing and solving network problems with help of vendors.- Following up with vendors for progress or possible resolution of a problem.- Keeping track of network problems like unavailability of network, issues with LAN, slowness of network, network issues with VOIP phones.