Pooja M Email & Phone Number

Greetings LinkedIn community,I'm a seasoned Data Engineer with 11 years of experience developing resilient data pipelines and transforming data in the raw layer to deliver it to downstream users. I possess skilled expertise in leveraging Microsoft Azure Cloud and its service offerings that include Azure Data Factory, Azure Databricks, Logic Apps, Function Apps, Azure Synapse, Azure Blob Storage and Azure DevOps. I have also leveraged Azure Data Lake for data storage purposes and implemented data organization solutions. Moreover, I am well-versed with Big Data technologies that include HDFS, Spark, Hadoop, NoSQL databases, Map-Reduce, HBase, Hive, Teg, Sqoop, Pig, Zookeeper, Flume. Developed in Hive, Spark SQL, Kafka, and Spark Streaming environments to deliver actionable insights through real-time data analysis, leading to improved decision-making and enhanced revenue growth. I am also proficient in scripting languages like Python and Scala to retrieve, load, clean, prepare and transform data as per business requirements. I am familiar with various file formats such as Apache Parquet, CSV, AVRO, XML, and JSON whiledeveloping end-to-end data solutions using Apache Hive and Apache Spark.I'm a dedicated team player who thrives in collaborative environments. I stay ahead of the curve in data engineering by proactively researching and evaluating emerging trends and best practices.Connect with me to collaborate on innovative data projects.