Mani Deep Email & Phone Number

Illinois, United States

• Expert in data wrangling techniques, utilizing tools like Spark and Data Proc for preprocessing, cleaning, and transforming large datasets. Applied advanced SQL and database management skills to support enterprise-wide.
• Provided mentorship and technical guidance to developers, fostering a collaborative environment and enhancing the team’s ability to deliver complex database-centric conversion and application system migration projects
• Develop deep understanding of the data sources, implement data standards, and maintain data quality and master data management.

New Jersey, United States

Connecticut, United States

• Designed and developed scalable and cost-effective architecture in GCP for ingestion, storage, processing, and visualization.
• Migrated on-prem oracle database to Big Query to power the dashboards
• Developed batch and streaming pipelines using Apache Beam and running them on Dataflow
• Build data pipelines in airflow in GCP for ETL related jobs using different airflow operators

India

• Designed and developed scalable and cost-effective architecture in AWS Big Data services for data life cycle of collection, ingestion, storage, processing, and visualization.
• Developed PySpark Data Ingestion framework to ingest source claims data into HIVE tables by performing Data cleansing, Aggregations and applying De-dup logic to identify updated and latest records.
• Involved in creating End-to-End data pipeline within distributed environment using the Big data tools, Spark framework and Tableau for data visualization.

India

• Developed complex web, middleware, and back-end systems in Python, SQL and Perl for Linux and Windows.
• Experience in developing views and templates with Python and Django's view controller and templating language to create a user-friendly website interface.
• Placed data into JSON files using Python to test Django websites. Used Python scripts to update the content in database and manipulate files.