Nilanjan Deb Email & Phone Number

Bengaluru, KA, IN

Bengaluru, Karnataka, India

• Collaborated on deploying, improving, and upgrading the entire software stack in GKE as part of the Data Platform team, and managed on-call operations to ensure continuous system availability and reliability.
• Revamped ETL processes by optimizing DBT macros, reducing data processing time by two hours and improving the SLA, ensuring quicker, more reliable data storage in Hive tables.
• Implemented and maintained self-managed Airflow for scheduling ETL jobs, enhancing data processing efficiency in Trino; achieved a 50% reduction in job failures and significantly boosted overall data pipeline.
• Directed the development of a comprehensive Billing system for Cloud Cost monitoring, covering Storage, K8s, and Compute, and created an analytics dashboard; delivered reports that simplified leadership.
• Defined team’s security protocols by addressing critical image vulnerabilities and establishing ACL in Trino; significantly improved data platform security compliance.
• Initiated enhanced security protocols for the data platform. Identified and addressed critical image vulnerabilities in Trino, Superset, and Airflow; established ACLs, improving platform compliance.

Bengaluru, Karnataka, India

• Designed and implemented an end-to-end backend architecture with an intuitive UI portal, ensuring seamless visibility and tracking of configuration changes.
• Introduced Single Sign-On and a robust authorization system with Access Control Lists for the Config Store. This empowers clear ownership and facilitates a comprehensive review of configuration changes.
• Setup Docker and CI/CD pipeline that leads to faster development, integration, and deployment in the K8s cluster.

Bengaluru, Karnataka, India

• Created Trino connector plugins for Databricks and Impala, enabling query federation and supporting diverse data source integration, enhancing the platform’s data analysis capabilities.
• Executed deployment of OPA with Trino for precise access control leveraging AD groups, enabling row-level filters and column masking, thereby enhancing data security and compliance across the platform.
• Configured CubeJS on top of Trino, developing a sophisticated semantic layer that streamlined data product consumption, specifically enabling seamless integration with PowerBI.
• Orchestrated HDFS and Hive deployment for Iceberg tables, leveraging Trino for writing to HDFS. This implementation decoupled storage from the query engine, enhancing data management flexibility and efficiency.

• Orchestrated the successful execution of three pivotal projects at HelioWeb by accurately understanding client needs, establishing clear timelines, and budgeting effectively, resulting in a 20% improvement in project.
• Developed a comprehensive full-stack app for P2P delivery startup; enabled order monitoring, rider tracking, revenue management, and subscription management, increasing operational efficiency by 70% and reducing manual.
• Launched a permissions-based plates manufacturing web app, enforcing ACL on employee operations, implementing plate cost calculation, and automating invoice generation; revamped customer job status tracking and.
• Engineered a full-featured Student Management Portal for kindergarten, facilitating student enrollment, activity management, class scheduling, and a PWA for parents, resulting in a 50% increase in administrative.

Pilani, Rajasthan, India