Vishnu Vardhan Email & Phone Number

West Haven, CT, US

Maryland, United States

I have successfully Configured Spark Streaming to receive real-time data from Kafka and store it in HDFS. Consumed XML messages using Kafka, processed them with Spark Streaming to capture UI updates, and created data pipelines for business reporting using on-premise Kafka clusters. Performed detailed analysis of business problems to design solutions and.

Florida, United States

As a Big Data Engineer, I have architected and created various data pipelines, handling full-cycle ETL and ELT processes for data ingestion and transformation in AWS and Spark. I built Scala code using higher-order functions to optimize iterative Spark algorithms and managed jobs using the Fair scheduler, developing job processing scripts with Oozie.

Texas, United States

I have successfully migrated SQL databases to Azure Data Lake, Azure Data Lake Analytics, Azure SQL Database, Data Bricks, and Azure SQL Data Warehouse, leveraging Azure Data Factory for access control. I developed scripts using Azure CLI commands to transfer data from an FTP server to the ingestion layer and automated the creation of Azure HD Insights.

Hyderabad, Telangana, India

I evaluated business requirements and prepared detailed specifications for developing programs. I handled data transfer from RDBMS to HIVE incrementally using Sqoop jobs, storing the data in Avro files. My work involved the Hadoop ecosystem, including Hive and Sqoop, and loading data from the UNIX file system to HDFS.I imported relational data from RDBMS.

Hyderabad, Telangana, India

I gathered business requirements and converted them into new T-SQL stored procedures using Visual Studio for database projects. I performed unit tests on all code and packages, ensuring their accuracy and reliability. My responsibilities included analyzing requirements and impacts by participating in Joint Application Development sessions with business.