Imam Bux Email and Phone Number

My job is to build and look after data pipelines using Cloudera Data Platform (CDP). I use tools likeApache Sqoop, Kafka, spark streaming and my own shell scripts to pull in data from different placessecurely and efficiently into our data lake.My work involves cleaning, fixing, and getting the data ready for analysis using Informatics BDM ortools similar to it. I make sure the data is clean and consistent before it gets analyzed.I also create and maintain how the data is… Show more My job is to build and look after data pipelines using Cloudera Data Platform (CDP). I use tools likeApache Sqoop, Kafka, spark streaming and my own shell scripts to pull in data from different placessecurely and efficiently into our data lake.My work involves cleaning, fixing, and getting the data ready for analysis using Informatics BDM ortools similar to it. I make sure the data is clean and consistent before it gets analyzed.I also create and maintain how the data is organized and stored in Cloudera Hive or other placeswhere we keep our data. I work on making sure we can access and use the data quickly and easily forour analysis needs.A big part of my job is to bring together data from many different sources. This could be data that'sstructured or unstructured, data that's constantly being updated, or data from outside services. I makeit all work together in one place.I also focus a lot on keeping our data safe and making sure we're handling it the right way. This meanssetting up rules and systems to protect the data and make sure only the right people can get to it.I'm always working to make our data pipelines and processes better, faster, and more reliable. Thismight mean figuring out how to make things run smoother or solving problems that slow us down.Over the past two years, I've done a bit of everything when it comes to handling data. From organizingit and making it useful for our team, to keeping it safe and making sure we're doing things the rightway. Show less

Develop and maintain robust data ingestion pipelines, ensuring the efficient and secure collection ofdata from various sources, such as network logs, customer interactions, and IoT devices.Implement data processing frameworks and tools, such as Hadoop, Spark, and Kafka, to handle largevolumes of structured and unstructured data. Perform data cleansing, enrichment, and aggregation asrequired.Design and manage data storage solutions, including distributed file systems and… Show more Develop and maintain robust data ingestion pipelines, ensuring the efficient and secure collection ofdata from various sources, such as network logs, customer interactions, and IoT devices.Implement data processing frameworks and tools, such as Hadoop, Spark, and Kafka, to handle largevolumes of structured and unstructured data. Perform data cleansing, enrichment, and aggregation asrequired.Design and manage data storage solutions, including distributed file systems and NoSQL databases, toaccommodate the growing volume of data. Optimize data storage for cost-effectiveness andperformance. Show less