-Setting up Logstash configurations for ingesting data into SQS, Kinesis, and ElasticSearch-Deploying infrastructure using Terraform and AWS Cloudformaton/SAM-Constructing data pipelines using Kinesis, AWS lambda, and Snowflake data warehouse-Designing Python ETL tool for parallelized extracting and uploading to AWS S3

-Automated development environments using Python, Boto3 and AWS-Configured and developed data pipelines using Apache Airflow -Contributed to PySpark jobs running on Kubernetes

-Designed, managed, and developed data solutions with python and AWS cloud services-Engineer data flow that pulls and combines data from APIs, S3, on premise databases; post data to third party's API-Develop business partnership reporting framework utilizing Pentaho, PostgreSQL and Jenkins; satisfy internal/external requirements for compliance and accounting-Solve repetitive daily loading of 100 different marketing data files into 20+ database tables using metadata; inject values into modules at runtime-Advised and mentored shared services team that interfaced with all departments in the company

-Built process with python and PostgesSQL to ingest nearly 1000 log files from 100+ clusters each day and report on critical content. -Developed monitoring tool to predict abnormal spikes in activity and alert team.

-Significantly reduced PostgreSQL response times from hours down to seconds through query and system optimizations-Implemented, documented, and scripted continuous archiving and point-in-time recovery eliminating a potential 24 hour data loss -Created Puppet profiles for complete configuration of PostgreSQL/PostGIS servers-Developed python script to parse and alert on database logs -Extracted, transformed, and loaded (ETL) geographic data into PostgreSQL and develop database code to perform spatial analysis

-Reduced timeouts and improved website response times with SQL Server database tuning of stored procedures, indexes, and functions-Automated deployments for MongoDB replica sets and single nodes using CloudFormation (AWS)-Developed bash scripts for backing up and restoring to/from S3 (AWS)-Successfully engineered ETL project from GoldMine (SQL Server) CRM to SalesForce.com-Installed and configured many data systems – Hadoop/Hive, Teradata, Aster, Oracle - for providing integration to Alteryx's BI analytic platform-Developed BI packages to extract, clean, manipulate, report on, and analyze data from a variety of system

-Resolved large performance bottlenecks within SQL Server-Designed database systems to process and distribute data including high availability and disaster recovery solutions; database mirroring and replication-Developed PowerShell scripts and SSIS packages to automate database copies, source control, schema changes and administrative tasks-Upgraded SQL 2000 to SQL Server 2008-Documented procedures and guidelines for SQL Server

-Built high performance SQL Server database clusters from the ground up-Collaborated with development teams to push out daily schema and database codes changes -Deployed SSRS and wrote many reports for departmental analytics-Drastically reduced SQL Server Wait Times up to 85%-Migrated several MySQL/Oracle Databases into SQL Server-Managed and tuned a robust storage area network(SAN) containing several 3Par storage systems and Brocade fiber switches-Effectively designed and documented DR strategies for terabytes of data for OnStor network attached storage(NAS) devices including onsite failover and off site replication

-Provided first hand system support in a high-paced technical environment-Managed communication with multiple exchanges and third parties vendors to facilitate proper technology protocol-Monitored and resolved various hardware and software problems -Configured TCP/IP, Active Directory, Windows 2003 and Windows XP

-Delivered efficient technical support and customer service to users addressing workstation, server, network, and remote access issues -Maintained and configured back-up procedures-Deployed and maintained desktops and servers -Created and modified user accounts for Active Directory and Exchange Server-Controlled and monitored asset inventory

-Consultant for streamlining project efficiency-Edited data following migration from AutoCAD to GIS platform-Managed cable data conversion processes-Resolved data problems associated with projection and overlap -Supported daily correspondence from clients

-Acquired knowledge of the electrical system infrastructure, read distribution maps, and identified discrepancies in database layout-Collaborated with a team of GIS professionals on an electrical data conversion project; responsibilities included map layout and GIS editing-Ensured the quality and production of data entered or edited