Rishabh Vaidya Email & Phone Number

Arlington, Tx, Us

Dallas, Tx

• Collaborated with cross-functional teams to architect and implement scalable data warehouses, emphasizing data modeling and ETL pipelines.• Engineered efficient Python-based ETL pipelines, managing vast and diverse data sources with Pandas and Numpy.• Applied SQL expertise to ensure data quality, performing filtering, grouping, joining, and aggregation.• Leveraged Hadoop and Hive for distributed processing, optimizing data analysis performance.• Designed cloud-based data processing pipelines on AWS and Azure, spanning ingestion, processing, transformation, and loading.• Spearheaded real-time data processing using Apache Kafka and Spark Streaming for swift data ingestion and processing.• Employed Snowflake for high-performance data warehousing, facilitating real-time analytics.• Pioneered a real-time analytics platform with Kafka, Spark Streaming, and Snowflake integration.• Established robust security and access controls to ensure data privacy and compliance.• Collaborated with software engineers to integrate data pipelines, enabling real-time insights.• Proficiently utilized AWS services (S3, Redshift, EMR, Glue) and either GCP or Azure for scalable data solutions.

New York, New York, United States

• Utilized Azure Data Factory to create and manage complex ETL workflows, ensuring efficient data extraction, transformation, and loading.• Leveraged Delta Live Tables Streaming and Delta Lake for real-time data processing, enhancing insights from streaming sources.• Collaborated cross- Utilized functionally to design data models, guaranteeing data integrity and optimal performance.• Automated data workflows with Apache Airflow, enabling efficient task scheduling, monitoring, and error handling.• Employed PySpark for data manipulation, enhancing data quality and accuracy across various analytical tasks.• Implemented data normalization and integrity principles to eliminate inconsistencies and redundancies.• Designed and implemented a cloud data warehouse on Snowflake, encompassing data modeling, ETL, and access controls.• Collaborated with Data Scientists to develop pipelines, enhancing predictive analytics and data-driven insights.• Orchestrated end-to-end data pipelines using AWS Glue, S3, and Redshift, ensuring smooth data movement and transformation.• Utilized Hadoop and Hive to build flexible data warehousing solutions, optimizing query performance and analysis.• Contributed to real-time analytics projects using Apache Kafka and Spark Streaming, enabling timely insights from streaming data.

Minnetonka, Mn

• Actively contributed to data visualization projects, specializing in data analysis, visualization design, and technical issue resolution.• Created intuitive and visually appealing application interfaces using data visualization tools such as Tableau, and Power BI.• Developed interactive dashboards and reports to present complex data insights effectively.• Implemented data models and transformations to prepare data for visualization using tools like SQL, Python, or R.• Utilized best practices in data visualization to ensure clarity, accuracy, and usability of visualizations.• Collaborated with stakeholders to understand requirements and translate them into actionable visualizations.• Ensured responsiveness and compatibility of visualizations across various devices and screen sizes.• Integrated data sources from disparate systems and databases to create comprehensive visualizations.• Utilized advanced visualization techniques such as heat maps, treemaps, and network diagrams to convey insights.• Generated insights and recommendations based on data analysis to drive business decision-making processes.• Managed version control and collaborated with team members using tools like Git for code management.• Automated data visualization processes and deployments to streamline workflows and increase efficiency.• Worked closely with cross-functional teams throughout the data visualization development lifecycle.