Big Data, Data Analytics, Warehouse, Etl, Aws Consultant
Current-> Selection tools and technology as per organizational data size -> System deployment (of selected big data tools) in on-premise (HDP/Cloudera) or in cloud (AWS) -> Scripts for data collection, preprocessing, normalization, enrichment, storage in HDFS/Kafka-> Spark job for analysing both batch and streaming data-> Display analysed data using visualization.