Andrei Shevchenko Email & Phone Number

New York, Ny, Us

Amsterdam, Noord-Holland, Nl

- Migration of on-prem Hadoop based DataLake into Azure cloud (Synapse, Data Factory) utilizing infrastructure as a code approach (Terraform, Azure DevOps, Ansible)- On-prem Hadoop Platform engineering: Clusters configuration, Maintenance activities, Software upgrades- Hadoop Security: Kerberos, RBAC, TLS, Data at Rest Encryption- On-prem services configuration automation: Ansible, Terraform, Azure DevOps- DataLake Performance analysis and tuning: inefficient jobs/queries, inefficient storage strategies, non-optimal cluster configuration - Batch ELT(ETL) jobs development and orchestration: Spark, Airflow- Monitoring implementation: Telegraf, VictoriaMetrics, Grafana, Splunk- Facilitated adoption of agile methodology in the team

Newtown, Pa, Us

- Maintained Hadoop clusters stability and configuration- Implemented and tuned Kerberos based Hadoop security on a number of production environments - Analyzed configuration flaws and worked out remediation strategies

San Ramon, California, Us

- Improved collaboration and decision making processes in the team- Helped colleagues to grow by providing guidance and organizing knowledge-sharing sessions

San Ramon, California, Us

- Ensured smooth operation of petabytes scale data warehouse built on top of Hadoop- Planned and performed major platform upgrades, integrated new services; built new development environments; analyzed and tuned cluster performance- Designed and transitioned infrastructure to a fully fault-tolerant state- Implemented cluster resources fair sharing policies, which significantly improved user experience during peak hours- Conducted proactive capacity plannings to maintain desirable performance level and reserved space- Significantly improved Infrastructure as a Code coverage in the environment- Developed effective ETL pipelines and helped Data Engineers to optimize their code- Developed automation tools for a variety of processes: cleanups, deployments, monitoring, etc.

Nottingham, Gb

- Ensured smooth operation of Information Security servers and services (FreeBSD/Windows server)- Applied configuration management approach based on CFengine- Ensured company-wide compliance with information security standards (including PCI DSS)- Deployed and maintained centralized log collection and analysis system (SIEM); Intrusion detection system (IDS); file integrity monitor services (FIM); data leak prevention systems (DLP)- Monitored services and OSes for vulnerabilities, designed and applied remediation actions- Developed Information Security configuration standards to improve overall security level in the company- Audited Network equipment configurations for compliance with security standards ( Cisco ASA/IOS )

- Ensured uninterrupted service for ISP clients by constant monitoring and prompt response to incidents- Configured Core, Aggregation and Access level equipment: link aggregation; dynamic routing; virtual local area networks; spanning tree protocol; traffic filtering and control- Tested and deployed QoS configuration across the city, which improved connection quality for important classes of traffic and was a prerequisite for IPTV service deployment- Developed tooling to automate routine troubleshooting and maintenance tasks- Contributed to monitoring systems improvement