Create and maintain data pipelines using airflow, s3, ec2, emr, pyspark, and shell scripting. Maintain and operate clients on-prem, cdp hadoop application which sends TB's of data to our machine learning platform, hosted on aws. CI/CD using github / github workflows. Build, test and deploy containers using docker and k8s. In-house pipelines using databricks and unity catalog objects. Current projects involve packaging and deploying cloud/customer agnostic AI products.

DevOps engineer supporting an on-prem hadoop application. Extensive knowledge in building CI/CD pipelines, end to end data engineering solutions, and support. Tools and packages are: HDFS, Hive, NiFi, Ranger, Ambari, Yarn, RHEL, Git, ucDeploy, ucBuild, Broadcom ESP, and Cherwell SM.

My role as an architect was to provide full life cycle data solutions and consultancy services to my internal customers, predominantly data scientists. Through data ingestion, transformation and automation, I was able to provide my teammates large, flattened, denormalized views of data, taking the grunt work out of data science. I utilized tools such as Cloudera Hue, Hive, Impala, Spark shell, oozie, sqoop, as well as some Unix and Linux shell scripting.

Analyst, data modeler, and big data set preparation for data science were my 3 hats. Uses Teradata, Oracle, and Hue (impala & hive) as my main tools. I support a dimensional data lake, some RDBM's, and are part of a team building out a big data environment on the hadoop (via Cloudera Hue) stack, for big data analytics.

Worked on the CA Clarity PPM application, providing internal consultative services to project managers, program managers, and other users of the Clarity PPM tool. My role includes report & portlet design, QA testing, and overall system documentation.

Risk Management Process Technology GroupWork with business line to gather requirements & scope for development projects.Design and develop functional and non-functional requirements (FNF's) for development projects.Work with internal software engineers to de-bug coding issues as well as unit testing.Build test cases against FNF's via HP Application Life-cycle Management.Execute test scripts, pre-release validation, as well as post-deployment validation.SharePoint designer and administrator for a team of 20+, both domestic and off-shore.

Liaison between application development, database administration, and systems engineering to coordinate and deploy regularly scheduled code implementation and migration.Participate in system design and business requirements creation for network mandated changes.Work with outside terminal and ATM simulation vendors on integrating test tool onto test and development platforms.Work directly with help desk for all client/server gateway related issues. Also work directly with clients IT organizations during production issues.Lead technical contact to the Visa payments network. Led technical design and implementation of new or modified links and production applications into their data centers worldwide.Together with systems programming, continually participate in system load balancing implementations and design.Participate in scheduled and non-scheduled downtime system maintenance as change leader, ensuring deployment tasks are satisfied.Ensure financial messaging interoperability between clients back end core processing systems and our transaction processing platforms.Backup disaster recovery planner. Participates in business continuity planning and design, as well as regularly scheduled disaster recovery functional testing. Voluntarily accepted this position.Rotate on 24 hour on-call pager schedule. Regularly participate in weekend and off schedule maintenance and code migration.

Collected business rules and requirements from customers in order to create SOW and implementation Contracts, as well as legal and bench-marking documentation throughout the implementation process.Manage the implementation of proprietary fraud detection software onto clients back end core processing systems.Configure, analyze and maintain fraud detection systems during and after implementation process to ensure benchmarks are met and project stays within scope.Initialize and configure fraud management file space on mainframe systems to receive and transmit secure customer information used within the fraud detection system.

Performed data analytics for both Visa and MasterCard networks for mass compromise alerts, major reissues, and fraud trending bulletins.Developed custom VBA software for fraud support team which converted AS/400 raw data into Microsoft excel formatted reports.Worked in conjunction with fraud specialists to decipher fraud reimbursements evaded by fraud detection system.Developed fraud trending reports and query engines for senior management, using SQL and VBA within Microsoft Access. Created the first performance metrics tracking reports available to managers within fraud group.