Senior Data Engineer
Current• Network security support• Implementing Firewall (Palo Alto, Cisco ASDM) related changes to client’s service requests• Audit security policies on all corporate firewalls• Engage Network Security SMEs and Information Security Team on all policies applied to firewalls• Responsible for Pre and Post network security device roll-out and management.• Designed and implemented scalable and efficient data pipelines using technologies such as Apache Spark, Apache Airflow, reducing… Show more • Network security support• Implementing Firewall (Palo Alto, Cisco ASDM) related changes to client’s service requests• Audit security policies on all corporate firewalls• Engage Network Security SMEs and Information Security Team on all policies applied to firewalls• Responsible for Pre and Post network security device roll-out and management.• Designed and implemented scalable and efficient data pipelines using technologies such as Apache Spark, Apache Airflow, reducing data processing time by 30%.• Developed ETL processes to extract, transform, and load structured and unstructured data from various sources into data lakes and data warehouses (e.g., Redshift, Snowflake).• Implemented data quality checks and monitoring solutions to ensure data accuracy, consistency, and completeness.• Collaborated with data scientists and analysts to understand data requirements and optimize data models and schemas for analytics and reporting purposes.• Managed and optimized databases (SQL and NoSQL) to support data storage and retrieval needs, ensuring high performance and availability. • Assisted in designing and building data pipelines for real-time data ingestion and processing using Kafka and Apache Flink.• Conducted performance tuning and optimization of SQL queries and database schemas to improve query execution times and overall system efficiency.• Created data visualization dashboards using tools such as Tableau and Power BI to provide insights into key business metrics. Show less