Priyanka G Email & Phone Number

Hadoop and Big Data Developer/Engineer with expertise in : • Apache Hadoop, MapReduce, HDFS, Hive, Pig, Impala, HBase, Sqoop, Flume, Zookeeper, Ambari, Oozie, Kafka, YARN, Spark.• Databases like Oracle, MySQL, Teradata, Microsoft SQL Server, MS Access, and NoSQL.• Programming languages like C, C++, Java, Scala, SQL, Python, MPI, OpenMP, CUDA, Visual Basic and Unix Shell Scripts.• Worked with Eclipse IDE, IntelliJ IDEA, Maven and ANT, Tableau, MATLAB, Cygwin, Microsoft Visual Studio.• Operating Systems & others include Linux(CentOS, Ubuntu), Unix, Windows, Putty, WinSCP, VMWare, Oracle VirtualBox, AWS and Microsoft Office Suite.

• 

  Hadoop Developer

  Reliable Software

  Jul 2018 - Present

  • Exporting raw financial data (stock tickers) in different formats (Avro, XML, CSV) from the client in batches (yearly and quarterly) into HDFS environment to create Data Lakes using Sqoop. • Creating Hive tables, loading data using Incremental imports and writing queries to parse the data. • Collaborating with the BI team to understand the project requirements and creating custom Hive UDFs using Java and Maven dependencies to compute various metrics for reporting and analysis. • Using Spark for fast processing of data to ease iterative and interactive querying by creating RDDs by determining effective partitioning.• Utilizing Spark MLLib and NumPy for developing machine learning algorithms like clustering, adaptive prediction, and classifiers to analyze the data. • Deploying Oozie Workflow Engine and writing shell scripts to manage and automate interdependent Sqoop, Pig and Hive and Spark jobs.• Installed and configured Apache Hadoop clusters using Ambari for application development and Hadoop tools like Hive, Pig, HBase, HDFS, and YARN in Linux (CentOS).• Designing and given technical presentations and presenting results on Hadoop architecture, Hadoop ecosystem, and Big Data applications and projects.