Hello Network,Please go through my profile and let me know if you have any Data Engineer roles at your priority clients or it would be great if you could share my profile with your network and help me in my job search.You can reach me at de.teja2701@gmail.com- IT experience in Analysis, Design, Development and Big Data in Scala, Spark, Hadoop, Pig and HDFS environment and experience in Python.- Firm understanding of Hadoop architecture and various components including HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce programming. - Have experience in data analytics, designing reports with visualization solutions using Tableau desktop and publishing on to the Tableau server.- Good Knowledge in Amazon Web Services (AWS) concepts like EC2, S3, EMR, Elastic Cache, DynamoDB, Redshift, Aurora.- Involved in Software development, Data warehousing and Analytics and Data engineering projects using Hadoop, MapReduce, Pig, Hive and other open source tools/technologies.- Extensively used SQL, Numpy, Pandas, SparkML, Hive for Data Analysis and Model building. - Experience in analyzing, designing, and developing ETL Strategies and processes, writing ETL specifications. - Excellent understanding of NOSQL databases like HBASE, Cassandra, MongoDB.- Experience with ETL workflow Management tools like Apache Airflow and have significant experience in writing python scripts to implement the workflow.- Scheduled Airflow DAGs to run multiple Hive and Pig jobs, which independently run with time and data availability.- Hands on experience in GCP, Big Query, GCS Bucket, Cloud Dataflow, DataProc, BQ Command line utilities.- Expertise in Hadoop Ecosystems tools which including HDFS, YARN, MapReduce, Pig, Hive, Airflow, Sqoop, Flume, Spark, Zookeeper and Oozie.-Developed multiple POC’s using PySpark and deployed on the YARN Cluster, compared the performance of Spark, with Hive and SQL.- Have good interpersonal, communication skills, strong problem-solving skills, explore/adopt to new technologies with ease and a good team member.TECHNICAL SKILLSHadoop Ecosystem :HDFS, SQL, YARN, PIG Latin, MapReduce, Hive, Sqoop, Spark, Yarn, Strom, Zookeeper, Oozie, Kafka, Storm, Flume, AirflowProgramming Languages: Python, PySpark, JavaScript, Shell ScriptingBig Data Platforms: Cloudera, HortonWorksAWS Platform: EC2, S3, EMR, Redshift, DynamoDB, Aurora, VPS, Glue, Kinesis, Boto3Databases: Netezza, MySQL, UDB, HBase, MongoDB, Cassandra, SnowflakeData Visualization: Tableau, BO Reports, Splunk