Lead Data Engineer
Currento Performed data modelling, data cleansing and made the data available for data scientist to score their models.o Developed the data quality framework using AWK, shell scripts, python and UNIX scripts.o Tested the compatibility of different open-source software with existing systems.o Worked on the Microsoft Azure environments (blob storage, Data Lake, AZ copy) using HIVE as extracting language.o Utilized Azure data factory for transforming and moving the data from virtual machine to Data factory & SQL server.o Designing and implementing Splunk based best practice solutions.o Used Splunk Search Processing Language SPL and regular expressions.o Deploy new Splunk systems and monitoring Splunk internal logs from the monitoring console (MC) to identify and troubleshoot existing or potential issues.o Creation of indexes, forwarded and indexer management, Splunk field extractor IFX, search head clustering, indexer clustering and Splunk upgradation.o Designed and assisted in developing and customizing the scripts for Quality framework using Python.o Analyzed the data and created models to store data in big data environment.o Used industry testing tools to include Nessus, Tenable, Webinspect, Appdetective, DBprotect and Xacta.o Implemented security plans and designed security for NSANet on Intel Community systems and implemented confidential/ CSS (IC) security control standards. Utilized Xacta tracking system.o Established and deploy pipelines, activities with datasets and linked services according to the business requirements.o Provided guidance on data network systems selection, remediation policies and best practices for HIPAA, PCI, SOX and CDM.o Perform vulnerability assessment of confidential assets using Tenable, Nessus scanner.o Identify and exploit vulnerabilities by using tools like Nmap and Rapid 7 Nessus to determine exploitable ports, protocols and services.
