Big Data Engineer
CurrentIPONWEB is the big company that provides the complex solutions for real-time advertising.As a part of ETL team I improve a system to aggregate a large amount of data and make it work 24/7 reliably.Responsibilities and achievements:* Optimize for time and memory a complex data processing pipelines using Apache Spark.* Integrate popular open-source data format tools (like Avro, Parquet, e.t.c.) to fill custom requirements* Make the integration tests and automation for… Show more IPONWEB is the big company that provides the complex solutions for real-time advertising.As a part of ETL team I improve a system to aggregate a large amount of data and make it work 24/7 reliably.Responsibilities and achievements:* Optimize for time and memory a complex data processing pipelines using Apache Spark.* Integrate popular open-source data format tools (like Avro, Parquet, e.t.c.) to fill custom requirements* Make the integration tests and automation for release and test processes Show less