Dibyajyoti Sarkar Email & Phone Number

Bengaluru, Ka, In

Bengaluru, Karnataka, India

➜ Developed several PySpark-based AWS Glue jobs to extract key dimensions from the firm's extensive user clickstream data stored in S3. This improved accessibility for business users and lowered both query time and cost.➜ Built a low-code marketing communication tool utilizing AWS Pinpoint, SQS, Lambda, and other services to help the firm connect with users via tailored push and in-app messages across multi-step engagement journeys.➜ Enhanced user retention by building a search feature into our platform. Built a RAG system by generating sentence embeddings of our content library with AWS Bedrock’s Titan model, storing them in AWS OpenSearch, and accessing them through an API for cosine similarity-based retrieval.➜ Globally secured API access to AWS by enforcing MFA through IAM policy and a Python tool that grants temporary session tokens.➜ Boosted annual revenue by $0.7M through the integration of a wellness app into our platform. Built user registration API with S2S AUTH using AWS Cognito, subscription update Webhook using Lambda and FIFO SQS, and indexed DynamoDB table for quick subscription lookups, enabling seamless integration of services.

Hyderabad, Telangana, India

➤ Dibyajyoti has reduced analysis effort by building a source code search utility in Python that finds all DataStage jobs containing a user-specified keyword.➤ He has developed a data processing framework in PySpark to streamline his client's transition to Big Data. His framework abstracts common ETL operations to simple functions that users can call to build their business-logic-driven data integration pipelines. His framework also supports adv. analytical operations like complex datatypes, regex, windowing, pivoting, hierarchical, and co-related querying of data, in addition to capturing SCD change and history.➤ He has also helped his client migrate all their business reporting applications to his framework. Resulting in their transitioning from an Oracle-based batch-processed system to a near-real-time system on AWS and Snowflake.

Kolkata, West Bengal, India

➤ Dibyajyoti has developed several DataStage jobs of varying complexities to help his client ingest transactional data into their enterprise data warehouse. In the process, he has demonstrated expertise in using stages like Transformer, Sort, Pivot, Aggregator, CDC, RD, Join, Lookup, etc.➤ He has also written several complex yet performant SQL scripts capable of efficiently handling large volumes of data.

Master Of Technology

Bachelor Of Technology