Data Engineer/Applications Solution Engineer
Round Rock, Texas, Us
Big Data Analytics• Successfully supported and secured a TPCx-BB top rank for the Hadoop benchmark publication for Dell 14G servers and networking in the Scale Factor 10000 category. Tasks included tuning Hive configurations, Spark Machine Learning Library with MKL (Intel Math Kernel Library), validated with Hive explain plans, and performed Hive on Tez characterization. Developed automated performance codes (TPCx-BB, IO characterization, and network throughput) with Python.• Validated and designed on-prem BDaaS (Big Data as a Service) for BlueData. Performance characterized BlueData docker multi-tenancy for Hadoop, Cassandra, and R-Studio. Compared NVIDIA Tesla V100 and Pascal P100 GPU vs CPU for MapD databases and TensorFlow. Developed Python codes to drive tests and collect results.IOT and Analytical Insight Modules• IOT data ingestion and ETL: Parsed and flattened MongoDB JSON files to load into Impala. Involved in development of predictive maintenance model for IOT devices.• Executed scale-out performance for the EMC Analytical Insight Module in the Isilon Data Lake environment.Hadoop and NoSQL• Automated scale-out performance and tuning Hadoop performance for Isilon OneFS/WebHDFS.• Produced competitive studies for Greenplum, Cassandra under different configurations including virtual and bare metal.• Automated and developed python scripts to drive workloads for TPC benchmark, Terasort and Cassandra tests; Generating ETL code scripts and datasets.Virtualization of Greenplum Appliance• Completed Oracle code conversion and data migration to virtualized Greenplum for EMC DWBI platform. Utilized open source and customized Perl scripts to convert Oracle stored packages and DDLs, extract data from Oracle, and load into Greenplum.• Presented at EMC World.Flash Drive/SSD Characterization for Data Warehouse, Hadoop and OLTP• Performance analyzed and characterized for DSS, Analytics, ETL and OLTP workloads.