Python Developer (Back-End Web Development | Data Engineering)
Applied Django Rest Framework (DRF) and FastApi to construct RESTful APIs and Falsk forcreating lightweight backend applications.Applied robust principles of object-oriented programming and implemented design patternssuch as the Factory pattern, Strategy pattern, Repository pattern and Singleton.Led the development of 10+ data extraction projects, consistently delivering effectivesolutions for handling large datasets.Successfully extracted an impressive 40 million data records daily through a strategic blendof API calls and HTML parsing techniques.Managed MongoDB databases with a substantial 250 million documents.Used RabbitMQ and Kafka for efficient message queuing.Performed daily querying on Elasticsearch, handling a vast dataset exceeding 93 billionrecords. Applied the Elasticsearch’s Painless scripting language to manipulate and extractvaluable insights from the data.Hands-on experience with Logstash, actively contributing to the efficient processing andmanagement of data pipelines, handling approximately 40 million daily records.Effectively leveraged Apache Airflow to process and manipulate more than 15 million datarecords daily, ensuring streamlined and efficient data workflows.