Dilip P Email & Phone Number

1. 6+ years of combined IT experience as a Big Data Engineer, Python Engineer and Business Analyst, and an expert in designing, development, and implementing data models for big data applications2. Hands On experience in developing Spark applications using Spark tools like RDD transformations, Spark Core, Spark Streaming and Spark SQL3. Have experience in technologies, tools and databases like Big Data, AWS, Azure, SQL, Hadoop, Hive, Pig, Sqoop, HBase, Spark, Cassandra, and Hue4. Excellent Knowledge using Partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance5. Proficient in relational databases like Oracle, MySQL and SQL Server6.Extensive experience in development of Bash scripting, T-SQL, and PL/SQL scripts7. Strong experience in working with NO SQL databases and its integration Dynamo DB, Cosmo DB, Mongo DB, Cassandra and HBase8. Extensively worked on AWS services like EC2, S3, EMR, RDS, Athena, Lambda Function, Step Function, Glue Data Catalog, SNS, RDS(Aurora), Redshift, DynamoDB, and Quick Sight and other services of the AWS family9. Extensive knowledge in working with Azure cloud platform (HDInsight, VM, Blob Storage, Data Lake, Data Bricks, ADLS Gen 2, Azure Data Factory, Synapse, and Data Storage Explorer)10. Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL11. Capable of understanding and knowledge of job workflow scheduling and locking tools/services like Oozie, Zookeeper, Airflow and Apache NiFi12. Extensive experience in Configuring Spark Streaming to receive real time data from Apache Kafka and store the stream data to HDFS and expertise in using Spark-SQL with various data sources like JSON, Parquet and Hive13. Proficient in Python Scripting and worked in stats function with NumPy, Pandas for organizing data and visualization using Matplotlib14. Experience in working with GIT, Bitbucket Version Control System15. Knowledge in using Integrated Development environments like Eclipse, NetBeans, IntelliJ, STS16. Hands on Experience in using Visualization tools like Tableau, Power BI17. Capable in working with SDLC, Agile and Waterfall Methodologies

• 

  Sacred Heart University

  Computer Science