Baskar Vedhachalam Email & Phone Number

Chennai, Tamil Nadu, India

Working as a Senior Associate Data Engineering L2 Position.Working in Azure Databricks development using spark and Azure Datalake.Migration done from Cloudera to Azure Databricks.

Working as a Senior Data EngineerInvolving BigData Data Model and working on Spark Application Development as well.Migration has been done from SQL to Cloudera using Spark and Hive Technologies.Also constructed the Reporting model post data migration.Maintain the data quality as per existing standard.

Chennai, Tamil Nadu, India

▪ In depth knowledge and experience in Hadoop Architecture and various Hadoop daemons such as Name Node, Data Node, Secondary Name Node, Resource Manager, Node Manager and High Availability.▪ Experience in usage of Hadoop distribution Cloudera 5.13 (CDH 5)▪ Hands on experience on various big data application phases like data ingestion, data analytics.▪ Expertise in using Spark-SQL with various data sources like JSON, parquet in HIVE.▪ Migrating the code from Hive to Apache Spark… Show more ▪ In depth knowledge and experience in Hadoop Architecture and various Hadoop daemons such as Name Node, Data Node, Secondary Name Node, Resource Manager, Node Manager and High Availability.▪ Experience in usage of Hadoop distribution Cloudera 5.13 (CDH 5)▪ Hands on experience on various big data application phases like data ingestion, data analytics.▪ Expertise in using Spark-SQL with various data sources like JSON, parquet in HIVE.▪ Migrating the code from Hive to Apache Spark and Scala using Spark SQL, RDD▪ Developed Hive Queries to parse the raw data, populated external & managed tables and store the refined data in partitioned external tables.▪ Improvising the tuning options using HIVE functions such as Partitioning, Bucketing , Index, CBO etc.▪ Experience in transferring data from RDBMS to HDFS and Hive using SQOOP.▪ Good understanding of processing streaming data using Kafka and Spark.▪ Created Kafka topics with appropriate replication and partition.▪ Experience in NoSQL Document database Elastic Search. Show less

Chennai, Tamil Nadu, India

• Designed Hive repository with external tables, internal tables, buckets, partitions , ACID property ,UDF and ORC compressions for incremental data load of parsed data for analytical operational dashboards.• Implemented Spark using Scala for faster data processing.• Used Impala for querying HDFS data to achieve better performance.• Worked various HDFS file formats like Avro, Parquet and TextFile.• Used Spark-SQL to Load JSON data and create schema RDD and loaded into Hive… Show more • Designed Hive repository with external tables, internal tables, buckets, partitions , ACID property ,UDF and ORC compressions for incremental data load of parsed data for analytical operational dashboards.• Implemented Spark using Scala for faster data processing.• Used Impala for querying HDFS data to achieve better performance.• Worked various HDFS file formats like Avro, Parquet and TextFile.• Used Spark-SQL to Load JSON data and create schema RDD and loaded into Hive tables and handled structured data using Spark-SQL.• Load data into Spark RDD and do the computation in memory to produce output.• Handled heterogeneous data sources such as RDBMS, Streaming data and different file formats.• Involved in devising data migration strategy from heterogeneous databases such as RDBMS, MS SQL Server integrating shell scripts, Sqoop Show less

Chennai, Tamil Nadu, India

• Understanding the Client requirement and creating the data model.• Creating Tables, feed the master data and creating procedure, function to add/update admin configuration.• We created logic to push the data from one environment to production by a single click from the application.• Performance tuning and database maintenance for the application.• Involved in deployment and code maintenance.• Migration done for existing application from one structure to another… Show more • Understanding the Client requirement and creating the data model.• Creating Tables, feed the master data and creating procedure, function to add/update admin configuration.• We created logic to push the data from one environment to production by a single click from the application.• Performance tuning and database maintenance for the application.• Involved in deployment and code maintenance.• Migration done for existing application from one structure to another structure.• Database Backup Maintenance and regular monitoring.• Created the encryption keys to protect the confidential user data.• Maintained the client environment and deployment process has been take care. Show less

Chennai, Tamil Nadu, India

• I was involved in monitoring the traffic flow of each server. • During the monitoring process if any unexpected problem occurs, we used to escalate to the concern team and then they will have resolve the issue• Whenever client needs logs for particular MSISDN, we will take the logs from corresponding servers and will send to the client and also will check the phone-activation message and Music activation for the devices.• We were using ITSM tool for logging the tickets for… Show more • I was involved in monitoring the traffic flow of each server. • During the monitoring process if any unexpected problem occurs, we used to escalate to the concern team and then they will have resolve the issue• Whenever client needs logs for particular MSISDN, we will take the logs from corresponding servers and will send to the client and also will check the phone-activation message and Music activation for the devices.• We were using ITSM tool for logging the tickets for each issue on which we were working Show less

Bachelor Of Engineering - Be, Computer Science

Education record

Education record