Devops Tech Lead
CurrentProficiency in programming languages such as Python or SQL, as well as experience with big data technologies like Spark, and NoSQL databases. Experience with data storage solutions such as databases, data lakes, and cloud-based storage platforms.Ability to design and implement data models for various types of data, including structured, semi-structured, and unstructured data.Ability to identify and solve complex problems related to data processing and storage.A strong focus on accuracy and quality in data processing and storage.Good communication skills: Ability to effectively communicate with stakeholders and work in a team environment.Relevant experience in data engineering, such as building and maintaining data pipelines, developing data storage solutions, and implementing data processing systems.Continual learning: A willingness to learn and stay up-to-date with new technologies and trends in data engineering. I have been studying how to run sparks jobs in Kubernetes and Apache Kafka and embed it in the data pipeline.