Marina Popova

Marina Popova Email and Phone Number

Software Engineer @ Volt Active Data
Arlington, MA, US
Marina Popova's Location
Arlington, Massachusetts, United States, United States
About Marina Popova

Seasoned Engineer/Technical Lead with deep experience in:-- design and development of highly performant, scalable, distributed applications - on-premises and cloud-based (AWS and GCP), using micro-services architecture and utilizing container technologies such as Docker and Kubernetes-- Big Data (event streaming) focus: design and implementation of highly scalable micro-services to process millions of events per hr (with resulting T's of storage) and perform real- and near-real- time analyses of the data-- design and implementation of analytics and reporting solutions, utilizing SQL and NoSQL storage systems, for real-time and historical data analytics-- highly skilled in Java (OO and Functional) application design, development and architecture (J2EE in the past life too :) ) for production-ready systems and like to play with Python, Kotlin, Scala for toy projects-- technical leadership and agile project management with distributed development teamsSome of the most interesting and fun projects I've worked on lately!:-- architect , plan and execute migration of an on-prem log analytics solution to a GCP-based one with PubSub, Filebeat, ElasticSearch/Kibana, Cloud functions, Dataflow and BigQuery-- design an alert detection system using Redis for distributed counters-- design and implementation of distributed real-time streaming aggregations of data by dynamic dimensions, using event-time semantics, capable of processing both old (out-of-order) and current events and storing the results into AWS RDS. The most interesting features:-- -- idempotent counting/aggregation operations -- -- no increased memory footprint to handle out-of-order events (in comparison to Spark watermarks)-- -- horizontally scalable by adding more instances of the application-- highly scalable Java Streams-based application to reprocess historical data from AWS S3, calculate specified metrics and store aggregates into Postgres and/or index into ElasticSearch-- suite of applications/tools to ingest data from Kafka, bulk process in multiple threads, and store into multiple destinations (Cassandra, AWS S3, ElasticSearch) - with built-in data/process monitoring

Marina Popova's Current Company Details
Volt Active Data

Volt Active Data

View
Software Engineer
Arlington, MA, US
Marina Popova Work Experience Details
  • Volt Active Data
    Software Engineer
    Volt Active Data
    Arlington, Ma, Us
  • Harvard Extension School
    Instructor For "Modern Data Analytics"
    Harvard Extension School Jan 2024 - Present
    Cambridge, Ma, Us
    Instructor, "Modern Data Analytics" class: https://courses.dce.harvard.edu/?details&srcdb=202402&crn=26646
  • Harvard Extension School
    Instructor For "Introduction To Functional And Stream Programming For Big Data Systems" Class
    Harvard Extension School Sep 2019 - Present
    Cambridge, Ma, Us
    https://www.extension.harvard.edu/course-catalog/courses/introduction-to-functional-and-stream-programming-for-big-data-systems/25668?subjects=Computer%20Science&term_description=Spring%20Term%202021
  • Harvard Extension School
    Instructor For "Principles Of Big Data Processing" Class
    Harvard Extension School Aug 2017 - Present
    Cambridge, Ma, Us
    https://www.extension.harvard.edu/academics/courses/principles-big-data-processing/15417?_ga=2.229902239.260988716.1503141010-3885565356.1448286330
  • Techtarget
    Engineer
    Techtarget Feb 2021 - Present
    Newton, Ma, Us
    Designing and building cool event processing pipelines on Google Cloud Platform - utilizing Cloud Functions (Python), PubSub and BigQuery as data destination;Latest project: migration and redesign of an on-prem log processing pipeline (Logstash+Kafka+KSQL+Elasticsearch) into a GCP cloud-based pipeline: GCP PubSub + Filebeat + Elasticsearch/Kibana + GCP Dataflow + Google BigQuery. The resulting pipeline is now comfortably processing a few Million events per day, enriches/transforms/aggregates in real time, visualizes in Kibana, stores data into BigQuery for further analytics and can scale dynamically as needed
  • Open Source Project Kafka-Elasticsearch-Consumer
    Contributor To The Open Source Project Kafka-Elasticsearch-Consumer
    Open Source Project Kafka-Elasticsearch-Consumer Feb 2015 - Present
    This application: https://github.com/BigDataDevs/kafka-elasticsearch-consumer, can be used as an embedded (or standalone) library to read incoming events from Kafka and batch index them into ElasticSearch. The main features are:-- zero data loss guarantee-- customizable start options (any offset for any partition)-- retention of failed to index events for later re-processing-- highly scalable horizontally - by starting up and adding new instances of the application the workload is dynamically re-balanced In collaboration with other great engineers, we are working on adding next set of features such as using new Kafka 9/10 consumers and Kafka Connect interfaces.
  • Netapp
    Engineer
    Netapp Dec 2019 - Jan 2021
    San Jose, California, Us
    developing distributed streaming applications using Kafka and Flink and deploying them to on-premises (OpenShift VMs) and cloud (AWS) infrastructure using Kubernetes and Helm
  • Yottaa
    Principal Software Engineer
    Yottaa Dec 2014 - Dec 2019
    Waltham, Ma, Us
    Working on cool problems of providing real-time as well as historical analytics over large quantities of log data: processing massive data streams via Flume and Kafka with final destinations in Cassandra, Amazon S3 and ElasticSearch
  • Harvard University Extension School
    Teaching Assistant, "Java 8 And Hadoop Mapreduce Programming Model" Class
    Harvard University Extension School Sep 2016 - Jun 2017
    Cambridge, Ma, Us
  • Harvard University
    Teaching Assistant, Cloud Computing (Cscie90) And Big Data Analytics (Cscie63) Classes
    Harvard University Jan 2015 - May 2017
    Cambridge, Massachusetts, Us
    Responsibilities: -- prepare and teach Labs-- answer students questions to help them better understand materials-- grade assignments and final projects
  • Epsilon
    Sr Consulting Engineer
    Epsilon Feb 2013 - Dec 2014
    Irving, Texas, Us
    Developing distributed system to process and analyze large TX and non-TX data. Latest interesting projects I've worked:-- design and implement a highly scalable application for bulk content upload and storage in Cassandra using hierarchical ExecutorServices; this app is designed to scale horizontally to hundreds of concurrent uploads on demand and expose real-time stats of all processes for monitoring-- design and development of a Content Repository application to store and manage, via exposed REST interfaces, large volumes of data of various media types, using Cassandra as the underlying storage solution.
  • Ibm
    Staff Engineer/ Architect
    Ibm Jan 2012 - Feb 2013
    Armonk, New York, Ny, Us
    One of the latest projects I've worked on was research, proof-of-concept and implementation of integration between our suite of J2EE applications and the IBM Cognos reporting server. In particular, I was working on the authorization and authentication integration part. I have evaluated two approaches: by using a central LDAP server as a Cognos Authentication provider, syncing our J2EE applications to the LDAP server via JNDI APIs and , the winning one, a Custom Authentication Provider implemented using Cognos APIs. The custom provider is utilizing an existing CAS infrastructure of our J2EE application by making REST calls to the application to generate and validate CAS tickets.
  • Emptoris
    Staff Engineer And Architect
    Emptoris Jun 2011 - Feb 2013
    One of the larger projects I've worked at during this time was the deep integration of some of our J2EE applications with the SAP Business Objects reporting server. On this project I have led a distributed team of 8-12 engineers, contractors, SAP implementation engineers , QA engineers and report designers. I was responsible for the functional and technical requirements management, research of the new technologies, proof-of-concepts of the most critical technical areas, overall solution architecture, BOBJ security architecture and setup of custom access levels, development of the integration code using BOBJ Java SDKs as well as the project management. Due to the novelty of the technologies for us (SAP BOBJ administration and SDKs), very aggressive timelines and dynamic requirements and priorities this project required a highly agile approach for management and implementation. I was keeping multiple development/research tracks going on in parallel and was reviewing status , arising issues and tasks almost every day to adjust according to the changing requirements, priorities and results of the research and proof-of-concepts. It was one of the most challenging projects I have led and it was very gratifying to see it successfully delivered on time and with very high quality. The main reason for success though, I think, was in how amazingly well our team has worked together - helping and encouraging each other, adjusting to changes in the direction and facing each day's new challenges with a smile :) - so it was not a surprise when the whole team was awarded the Quarterly Company Excellence Award for this project.
  • Emptoris
    Principal Software Engineer
    Emptoris Feb 2007 - Jul 2011
    Design and development of J2EE-based contract management solutions
  • Bea
    Senior Software Engineer
    Bea Oct 2005 - Feb 2007
    Us
    Continue working on RFID middleware J2EE solutions as part of the WebLogic Platform after the acquisition of ConnecTerra, Inc. by BEA.
  • Connecterra, Inc.
    Senior Software Engineer
    Connecterra, Inc. Feb 2005 - Oct 2005
    Us
  • Thomson & Thomson
    Lead Software Engineer
    Thomson & Thomson 1998 - 2005

Marina Popova Skills

Java Enterprise Edition Java Agile Methodologies Enterprise Software Tomcat Software Development Rest Jboss Application Server Web Services Spring Weblogic Integration Distributed Systems Sql Core Java Sdlc Databases Spring Framework Unix Agile Project Management Hadoop Solution Architecture Jdbc J2ee Architecture Hibernate Software Engineering Soa Representational State Transfer Apache Kafka Business Objects Ant Jms Oracle Scalability Maven Cassandra Amazon Web Services Junit Scala Flume Software Development Life Cycle Service Oriented Architecture Big Data Drools Technical Architecture Ldap Cognos Python Redis

Marina Popova Education Details

  • Saint Petersburg State University
    Saint Petersburg State University
    Astronomy
  • Harvard University
    Harvard University
    It

Frequently Asked Questions about Marina Popova

What company does Marina Popova work for?

Marina Popova works for Volt Active Data

What is Marina Popova's role at the current company?

Marina Popova's current role is Software Engineer.

What is Marina Popova's email address?

Marina Popova's email address is ma****@****app.com

What is Marina Popova's direct phone number?

Marina Popova's direct phone number is +161789*****

What schools did Marina Popova attend?

Marina Popova attended Saint Petersburg State University, Harvard University.

What are some of Marina Popova's interests?

Marina Popova has interest in Animal Welfare, Children, Environment, Science And Technology.

What skills is Marina Popova known for?

Marina Popova has skills like Java Enterprise Edition, Java, Agile Methodologies, Enterprise Software, Tomcat, Software Development, Rest, Jboss Application Server, Web Services, Spring, Weblogic, Integration.

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.