Shailesh Panday Email & Phone Number

Boston, Ma, Us

Washington, Dc, Us

- Spearheaded effort to create structured streaming data pipeline using Apache Spark, Databricks and AWS.- Process millions of messages from Confluent Kafka every hour - Implemented 5Vs of Big Data!- Data Ingestion into Kafka as producer and consecutive writes to DynamoDB- Created Data Visualization and Dashboards for quality checks and anomaly detection.- Logging through Datadog, CloudWatch etc.

Washington, Dc, Us

- Created Recommendation system Data pipeline to feed items and events information into AWS Personalize Machine Learning Model.- Designing and implementing Data Engineering, Machine Learning, and BI Analytics initiatives on AWS, encompassing the design, development, and optimization of data pipelines utilizing services like Lambda, EMR, Step Functions, S3, and Glue.- Led the creation of Machine Learning Models using AWS Personalize, ensuring accurate and efficient predictive analytics capabilities.- Managed queueing applications using Confluent Kafka and SQS, facilitating seamless data ingestion and processing.- Directed the development of comprehensive end-to-end data pipelines on Databricks and Apache Spark, catering to both streaming and batch processing requirements.- Orchestrated release pipelines using TFS, streamlining the deployment process and ensuring consistent software delivery.- Pioneered Infrastructure as Code software development in AWS cloud using Terraform by HashiCorp and CloudFormation, optimizing resource provisioning and management for scalability and efficiency.Language: Python, PySpark, SQL, MYSQL, Terraform, CloudFormation, C#Database: Snowflake, DynamoDB, Streams, DynamoDB Accelerator (DAX), RDS, AuroraDB, Postgres etc

Boston, Ma, Us

- Analyze multiple sources of structured and unstructured data to propose and design data architecture solutions for scalability, high availability, fault tolerance, and elasticity.- Hands on experience in developing ETL/ ELT pipelines using Python.- Architecting enterprise data warehouse solutions- Schema design and dimensional modeling - Facts, Dimensions, Star and Snowflake Schema Design- Variety of database tools and technologies (SQL Server, Oracle, Postgres, MS Access etc.)- BI Analytics and ELT using Microsoft's Business Intelligence tools (SSIS, Informatica)- Data Visualization (Power BI, Tableau, DAX, MDX)- Managing Dataflow for OLTP and OLAP and reporting using SSRS and SSAS (Tabular+MultiDimensional)- Data Migration On-premise to Cloud (AWS)- Responsible of meeting practice objectives such as Recruitment Support & Team Interface, Handling Proof of concepts on technology space, Building competencies.Language: SQL, Python, R, C#, VB.Net, PowerShell, DAX, MDXCloud: AWSData Visualization: PowerBI, Tableau, Denodo DB: SQL Server, Postgres, Oracle, GuidewireSource Control: TFSDomain: Commercial and Auto Insurance

Nashville, Tennessee, Us

- Design and development of database architecture solutions for various application needs.- Develop conceptual, logical and physical design for various data types and large volumes.- Solid expertise in RDBMS and Dimensional Modelling, Designing of STAR, SNOWFLAKE Schemas.- Performance tuning ETL Packages, Stored procedures and SQL queries by applying best practices, indexing strategies along with good understanding of tools & server architecture.- Developed numerous reports and complex dashboards in Power BI, Tableau etc., - Architect, design and implement high performance large volume data integration processes, database, storage, and other back-end services.-Load unstructured data into MongoDB.Domain: InsuranceTechnology: SQL Server, Postgres, Oracle, Microsoft Business Intelligence SSIS, SSRS and SSAS Multidimensional, Cassandra, NoSQL, MongoDB

Ca

- Directly interacted with client to gather requirements for software development.- Create VBA forms in MS Access to process the data and automatically generate reports.- Hands-on expertise in developing database solutions, performance optimization, complex stored procedures, database objects (Tables, Views, Triggers etc.,), ETL packages & OLAP Cubes (Tabular and Multi-Dimensional) using Microsoft Intelligence BI Tools (SSIS, SSAS). Work closely with stakeholders, at a technical and user level, to design and produce solutions.- Work closely with the product management and development teams to rapidly translate the understanding of customer data and requirements to product and solutions- Participate in Rapid Application Development and Agile processes to deliver new Data warehouse services and components.- Set architectural vision and direction across a matrix of teams.- Design, development & maintenance of the ETL frameworks, Business Intelligence Solutions.- Facilitated project management and quality activities by using TCS's IPMS tool. IPMS help project planning and management. IRIS tool is used to track events and project related metrics in all phases of the software development cycle.- Prepared standard testing document, user manual, and checklist.Domain: TelecommunicationTechnology: Microsoft Business Intelligence, MS Access, VBA, MS Excel, Macro, ASP.Net, VB.Net, C#, SQL Server, MySQL, SAP, Business Objects etc.