Sreeja B Email & Phone Number

Jersey City, New Jersey, United States

Created connections to various data sources such as amazon redshift, DynamoDB, etc. using spark.Developed spark-based ingestion framework for ingesting data into NoSQL Databases and created tables in Redshift and DynamoDB and executing complex computations and parallel data processing. Worked on Launching various AWS resources such as EC2, S3, Redshift, DynamoDB, etc. using Terraform. Developed Spark code using python for Pyspark and Spark-SQL for faster testing and processing of… Show more Created connections to various data sources such as amazon redshift, DynamoDB, etc. using spark.Developed spark-based ingestion framework for ingesting data into NoSQL Databases and created tables in Redshift and DynamoDB and executing complex computations and parallel data processing. Worked on Launching various AWS resources such as EC2, S3, Redshift, DynamoDB, etc. using Terraform. Developed Spark code using python for Pyspark and Spark-SQL for faster testing and processing of data.Moved the data from RDBMS to HDFS using Sqoop.Scheduled the EMR jobs using AWS Data Pipeline service.Performed Data Validation, Data Cleaning, features scaling, features engineering using Pandas and Numpy packages in Python.Written the code to store the dataflow moment logs into DynamoDB Show less

Lafayette, Louisiana, United States

Created and maintained highly scalable and fault tolerant multi-tier AWS environments spanning across multiple availability zones using Terraform and CloudFormation.Involved in SQOOP implementation which helps in loading data from various RDBMS sources to Hadoop systems.Developed Python scripts to extract the data from the web server output files to load into HDFS.Written a python script which automates to launch the EMR cluster and configures the Hadoop applications using… Show more Created and maintained highly scalable and fault tolerant multi-tier AWS environments spanning across multiple availability zones using Terraform and CloudFormation.Involved in SQOOP implementation which helps in loading data from various RDBMS sources to Hadoop systems.Developed Python scripts to extract the data from the web server output files to load into HDFS.Written a python script which automates to launch the EMR cluster and configures the Hadoop applications using boto3Created various data pipelines using PySpark, Scala and Spark SQL for faster processing of data. Written Spark-SQL and embedded the SQL in SCALA files to generate jar files for submission onto the Hadoop clusterConverted all Hadoop jobs to run in EMR by configuring the cluster according to the data size. Show less

Chicago, Illinois, United States

• Worked with Sqoop for importing and exporting the data from HDFS to Relational Database systems/mainframe and vice-versa loading data into HDFS.• Stored data in AWS S3 like HDFS and performed EMR programs on data stored in S3. • Worked on Big Data Hadoop cluster implementation and data integration in developing large-scale system software.• Developed workflow in Oozie to automate the tasks of loading data into HDFS and pre-processing with Hive.• Involved in converting Hive/SQL… Show more • Worked with Sqoop for importing and exporting the data from HDFS to Relational Database systems/mainframe and vice-versa loading data into HDFS.• Stored data in AWS S3 like HDFS and performed EMR programs on data stored in S3. • Worked on Big Data Hadoop cluster implementation and data integration in developing large-scale system software.• Developed workflow in Oozie to automate the tasks of loading data into HDFS and pre-processing with Hive.• Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs and Scala.• Involved in Migrating the platform from Cloudera to EMR platform.• Developed analytical component using Scala, Spark, and Spark Streaming.• Involved in creating Hive Tables, loading with data, and writing Hive queries which will invoke and run MapReduce jobs in the backend.• Developed web application using HBase and Hive API to compare schema between HBase and Hive tables.• Created scripts to append data from temporary HBase table to target HBase table in Spark.• Developed complex and multi-step data pipeline using Spark.• Populated HDFS and Cassandra with huge amounts of data using Apache Kafka.• Assisted in exporting data into Cassandra and writing column families to provide fast listing outputs• Developed and designed system to collect data from multiple portals using Kafka and then process it using spark. Show less

Dallas, Texas, United States

• Developed multiple POCs using Scala and deployed on the Yarn cluster, to check the performance of Spark, with Hive and SQL/Teradata. • Installed and configured Hive, Pig, Sqoop and Oozie on the Hadoop cluster. • Worked with Senior Engineer on configuring Kafka for streaming data. • Developed Spark scripts by using Scala shell commands as per the requirement. • Performed processing on large sets of structured, unstructured and semi structured data. • Created applications… Show more • Developed multiple POCs using Scala and deployed on the Yarn cluster, to check the performance of Spark, with Hive and SQL/Teradata. • Installed and configured Hive, Pig, Sqoop and Oozie on the Hadoop cluster. • Worked with Senior Engineer on configuring Kafka for streaming data. • Developed Spark scripts by using Scala shell commands as per the requirement. • Performed processing on large sets of structured, unstructured and semi structured data. • Created applications using Kafka, which monitors consumer lag within Apache Kafka clusters. • Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and extracted the data from Oracle into HDFS using Sqoop.• Develop predictive analytic using Apache Spark Scala APIs • Cluster co-ordination services through Zookeeper. • Used Apache Kafka for collecting, aggregating, and moving large amounts of data from application servers. • Developed Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of data. • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team. Show less

Delhi, India

• Excellent JAVA, J2EE application development skills with strong experience in Object Oriented Analysis, extensively involved throughout Software Development Life Cycle (SDLC)• Implemented various J2EE standards and MVC framework involving the usage of Struts, JSP, AJAX and servlets for UI design. • Used SOAP/ REST for the data exchange between the backend and user interface. • Utilized Java and MySQL from day to day to debug and fix issues with client processes. • Developed… Show more • Excellent JAVA, J2EE application development skills with strong experience in Object Oriented Analysis, extensively involved throughout Software Development Life Cycle (SDLC)• Implemented various J2EE standards and MVC framework involving the usage of Struts, JSP, AJAX and servlets for UI design. • Used SOAP/ REST for the data exchange between the backend and user interface. • Utilized Java and MySQL from day to day to debug and fix issues with client processes. • Developed, tested, and implemented financial-services application to bring multiple clients into standard database format. • Created web service components using SOAP, XML and WSDL to receive XML messages and for the application of business logic. • Involved in configuring web sphere variables, queues, DSs, servers and deploying EAR into Servers. • Involved in developing the business Logic using Plain Old Java Objects (POJOs) and Session EJBs.• Developed authentication through LDAP by JNDI.• Developed and debugged the application using Eclipse IDE.• Involved in Hibernate mappings, configuration properties set up, creating sessions, transactions and second level cache set up.• Involved in backing up database & in creating dump files. And also creating DB schemas from dump files. Wrote developer test cases & executed. Prepared corresponding scope & traceability matrix.• Implemented JUnit and JAD for debugging and to develop test cases for all the modules. • Hands-on experience of Sun One Application Server, Web logic Application Server, Web Sphere Application Server, Web Sphere Portal Server, and J2EE application deployment technology. Show less