Worked with leading Global Bank on its big data Hadoop ecosystem & involved in development of standardized set of data assets which are structured & tailored to generate Business insights.Analysed data requirements sourced from Basel 3 regulations and contributed to the generation of credit and lending reports for various bank products, leading the design process through data discovery in a Spark environment.Led end-to-end delivery of demands as a Cross-Functional member, adeptly… Show more Worked with leading Global Bank on its big data Hadoop ecosystem & involved in development of standardized set of data assets which are structured & tailored to generate Business insights.Analysed data requirements sourced from Basel 3 regulations and contributed to the generation of credit and lending reports for various bank products, leading the design process through data discovery in a Spark environment.Led end-to-end delivery of demands as a Cross-Functional member, adeptly balancing dual roles of Data Analyst and Business Analyst.Designed and tested data models, deploying them within the Apache Hadoop framework for scalability and performance. Conducted entity resolution to ensure data accuracy.Developed tools and scripts for handling large datasets, utilizing SQL and PySpark for efficient processing. Deployed code and conducted testing including smoke tests and UAT. Show less

1. Designed detailed documentation from requirement gathering to support the design process.2. Implemented advanced big data techniques using PySpark, MapReduce, and other tools to develop robust ETL pipelines. Utilized Airflow for workflow management.3. Leveraged SQL, Hive, and HDFS for efficient data warehousing and storage, enabling streamlined data retrieval and effective analysis. Documented design decisions and data flows.4. Operated in an Agile Project Management environment,… Show more 1. Designed detailed documentation from requirement gathering to support the design process.2. Implemented advanced big data techniques using PySpark, MapReduce, and other tools to develop robust ETL pipelines. Utilized Airflow for workflow management.3. Leveraged SQL, Hive, and HDFS for efficient data warehousing and storage, enabling streamlined data retrieval and effective analysis. Documented design decisions and data flows.4. Operated in an Agile Project Management environment, utilizing tools like JIRA and Confluence for streamlined project execution and collaboration. Show less