As a DWH/BI Developer, I excel in developing, and maintaining data solutions that drive business insights. My professional journey includes a key role in a streaming ETL project, where I applied my skills in SQL, Unix, and PySpark to manage real-time data processing and transformation.Key Responsibilities:- Streaming ETL Development: Engineered and optimized ETL processes for real-time data streams, ensuring efficient data ingestion, transformation, and loading.- SQL… Show more As a DWH/BI Developer, I excel in developing, and maintaining data solutions that drive business insights. My professional journey includes a key role in a streaming ETL project, where I applied my skills in SQL, Unix, and PySpark to manage real-time data processing and transformation.Key Responsibilities:- Streaming ETL Development: Engineered and optimized ETL processes for real-time data streams, ensuring efficient data ingestion, transformation, and loading.- SQL Proficiency: Developed complex SQL queries and stored procedures for accurate and high-performance data handling.- Unix Expertise: Utilized Unix shell scripting for automation, data manipulation, and job scheduling, enhancing workflow efficiency.- PySpark Utilization: Implemented scalable data processing tasks using PySpark in big data environments.- Data Integration: Collaborated with cross-functional teams to integrate data from various sources, ensuring consistency and quality.- Performance Tuning: Conducted performance tuning and optimization of ETL processes and queries to improve system efficiency.- Data Visualization: Created and maintained BI dashboards and reports using tools like Tableau and Power BI.- Documentation and Compliance: Maintained comprehensive documentation of data workflows, adhering to governance standards.Technical Skills:- SQL: Advanced SQL scripting and query optimization.- Unix: Proficient in Unix shell scripting.- PySpark: Experienced in PySpark for large-scale data processing.- ETL Tools: Familiar with Apache Kafka- Big Data Technologies: Knowledgeable in Hadoop and Hive. Show less