Data Engineer
Current Region Umbrella: EMEA, Americas, LATAM, APAC., Handling full Data stack: Database Design, Data Engineering, and Data Analysis. Equipped with 2 high-performance laptops, an Azure Virtual Desktop, and 5 screens for optimal productivity. Programming Languages: Python & MySQL - Dependency level = "Full", Basis = "Daily". IDE's: JetBrains/PyCharm & Workbench/MySQL., Universal Database Manager: DBeaver 24.1.1., Cloud Database: Amazon RDS (PostgreSQL)., Database Management: 1 Oracle Database, 16+ MySQL Databases, 34 PostgreSQL Schemas., Currently managing: 1 Oracle Database, 16+ MySQL Databases, 4 Data Warehouses, 1 Data Lake, 5 Data Hubs, 2 Data Gateways, 33 Data Pipelines, 34 PostgreSQL Schemas., "Custom Built Developements (Python, MySQL)" - 1 Analytics Data Warehouse, 8 Data Marts, 22 Data Pipelines, 8 Data Sources, 20+ reusable Python libraries and continuing to develop more. Orchestrating & Building Infrastructure: Apache Airflow (via Docker) – Custom setup from scratch with YAML, configuration, Redis, Celery Executor, DB Init, Scheduler, Worker, and Webserver components. Optimization Challenge Accomplished: Managed an SQL file with 18,385,988 lines, identified and resolved errors efficiently through command-line execution. BI's: Power BI for Data Visualisation and Oracle BI for Data Intelligence. Operations & Administration: Oracle Eloqua (Segments, Shared filters, ETL processes), Adobe AEM PROD Author - 6.5 (Data collection, validation, flow check, ETL processes), Joomla (AcyMailing, Fabrik, Akeeba and +) Web Scraping: Proficient in bs4/BeautifulSoup and Selenium for automated Data extraction., Spreadsheet: Excel - Spreadsheet purpose: Presenting reports. Other open-source application: Notepad++ (REGEX, Extended, Quick Data Transformations)., Extra Curriculums: Adobe Analytics, MS Access, Power Automate, Notepad, OneNote, MS Word, SharePoint., Cloud service: Microsoft., Web & Cloud Host: SiteGround., FTP: FileZilla.,