Bindu P Email & Phone Number

Bindu P is a Data Engineer at Verizon.

• 

  Data Engineer

  Verizon

  Dec 2021 - Present

  • Perform data modelling, data source analysis, data sourcing specifications, ETL design &  specification.  • Analyzed the sql scripts and designed it by using PySpark SQL for faster performance. Contributed in building our cloud infrastructure and Cloud data warehouse (S3 data lake and Redshift) in AWS • Worked on critical, highly complex customer problems that span multiple AWS services • Worked with Airflow scheduler and Apache Kafka streaming. • Performing data quality checks like restream missing records, correct the bad records and key value count check, Row count tolerance check between source and target etc.  • Design and Develop ETL Processes in AWS Glue to migrate Campaign data from external  sources like S3, ORC/Parquet/Text Files into AWS Redshift.  • Data Extraction, aggregations, and consolidation of Adobe data within AWS Glue using  PySpark.  • Develop and maintain data architecture artifacts and standards, including data naming, data dictionaries, naming conventions, etc. • Responsible for designing and implementing End to End data pipeline using Big Data tools including HDFS, Hive & Spark.   • Extracting, Parsing, Cleaning, and ingesting the incoming web feed data and server logs into the HDFS by handling structured and unstructured data. • Involved in building one of the largest financial data platform worldwide, processing multi- terabyte scale US market transaction data.   • Responsible for designing and developing market regulation software, primarily focused on developing cloud based big data processing platform using Hadoop/Spark, NoSQL data modelling for serving low-latency user facing application, building RDBMS equity market surveillance patterns and supporting framework