Building software in blockchain tech

Worked as a Principal Engineer and helping to build Data & AI/ML platforms on Databricks, Spark, MLFlow.

- Building self service data systems on Hadoop/HBase/Spark- Building OLAP on Hadoop- Building NLP systems

- Architecting a multi-TB MapR - Hadoop Datawarehouse for a leading apparel retailer in the US- Experience building batch and near real-time data pipelines using Hive, Spark SQL, MapR-DB (HBase)- Built SQL-on-Hadoop layer on Apache Drill for Batch Reports & Data Discovery use cases- Building an Image Analytics solution. Dominant Color Detection, Text Extraction from Images.- Building K-Means models to extract dominant color- Experience in Python, pyspark

Big Data Ingestion Architecture (Hadoop, Hive, Amazon Redshift), Visual Data Discovery (Tableau & Qlikview), Presales Support.Worked on a predictive analytics & an insights platform solution for a large MVNO in the UK. Solution ingested close to 100 mln records/100GB on a daily basis.Data at rest was close to 10 billion records/20TBSQL Server/SSIS for integrationAmazon Redshift ds2.xlarge clusters as the MPP datastoreSelf Service BI on Qlikview & Tableau… Show more Big Data Ingestion Architecture (Hadoop, Hive, Amazon Redshift), Visual Data Discovery (Tableau & Qlikview), Presales Support.Worked on a predictive analytics & an insights platform solution for a large MVNO in the UK. Solution ingested close to 100 mln records/100GB on a daily basis.Data at rest was close to 10 billion records/20TBSQL Server/SSIS for integrationAmazon Redshift ds2.xlarge clusters as the MPP datastoreSelf Service BI on Qlikview & Tableau. Python 3.5 , Boto & Shell scripts for scripting the orchestration workflowUsed Luigi as the job scheduler/orchestratorDeployed on Amazon AWS Cloud Show less

Founder & Head of Technology of 3joins.com, An Interviewing as a Service Company.Platform on AWS. Running on Django, Python 3, Postgres.

- Solution Architecture and Design of a Global Geo-Spatial, Catastrophe Risk Exposure Data System- Planning and Scoping of features from Requirements to Delivery.- Improving efficiency of solution delivery processes- Key technologies include IBM DB2 Spatial, Netezza, IBM MDM, PBBI Spectrum, IBM IIS Datastage and ArcGIS

- Presales Consulting on Enterprise Datawarehouse and BI strategy Implementations- Full lifecycle project plans on Enterprise Master Data Management- Work on differentiators for key proposals

- Senior Datawarehouse and BI Architect working for Global Markets Division of Chartis- Architecting a strategic operations data-mart that will rollout to more than 800 users across 60 different countries.- Developing a solution on Datastage 8.x and Oracle 11g

- Architected a Datamart for the Trade Finance business of CIT Group as part of a Corporate Datawarehouse initiative.- Developed the solution on Oracle 10g, Datastage 8.x, Business Objects 3.0- Responsible for ETL and DW architecture.

- Responsible for establishing a BI CoE for MS and SAP technology toolset.- Responsible for innovation of BI frameworks contributing to pre-sales efforts and accelerated development lifecycles.- Created RUBIC Airline framework for accelerating BI projects for the revenue management business of Airlines industry.- Created RUBIC SAFE framework to support BI analytics for support implementations of a DW/BI project.

- Played a key role in Corporate/Business Performance Management Strategy- Provided an Enterprise DW/BI Strategy (encompassing ETL, DW and BI strategy, BICC organization development, project roadmap creation) for the Aon Affinity business function.- Performed a detailed, comprehensive enterprise DW & BI Health Assessment- Drafted a Data & BI Governance Roadmap with implementation details.- Was responsible for the DW & BI Business-Case Building

- Responsible for managing a from-scratch datamart buildup across multiple business functions like Operations & Service, Engineering & Sales.- It was developed on Oracle 10g, OBIEE and OWB.- Near Real-time datamart delivering KPIs to the executives.- It was rolled out to 5 states within the United States, over a period of 1 year.- Managed a team of 7 (onsite-offshore)