I have around eight plus years of IT experience and more than four plus years I have been primarily working into big data engineering, and have extensive experience with multiple big data technologies and ecosystems ,for ingestions I have used scoop and spark JDBC. And also I've used Kafka, and for processing I've used spark dataframes, Spark SQL and Spark Streaming as well and for ad-hoc queries, I been using hive. And my current project I'm working as a data engineer responsible to get the data from multiple data sources, from some of the our DBMS systems like Oracle and also I do get it from the flat files and the messaging queues as well. I use Apache scoop and Kafka to ingest the data into a data lake. Now I do a lot of work on data cleaning and data transformations and data validations standardizations and all these things using Spark and I work on data frames and also RDDs and Spark Streaming as well and I do a lot of work on creating the hive and write ad-hoc queries from their visualization tools can get connected with the hive I have experience working with the cloud technologies as well. I have used multiple AWS services , I used s3, EMR, Glue, redshift, Athena, Lambda and step functions multiple services I've been using . Earlier projects i have experience with azure Databricks and Azure data lake too. These are all the different tools which I have been working on.