Senior Hadoop Developer
Current- Responsibilities:
- Developing custom aggregate functions using Spark SQL and performed interactive querying.
- CreatingHive tables, dynamic partitions, buckets for sampling and worked on them using HiveQL.
- Using Hive tables and Hive SerDe’s to store data in tabular format.
- Experienced with optimizing techniques to get better performance from Hive queries.
- Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further… Show more Responsibilities: