Sai T Email & Phone Number

Plano, Tx, Us

United States

Fort Lauderdale, Florida, United States

• Developed Talend Jobs to perform ETL operations. Developed entire pipeline from source to target locations.• Troubleshooting the talend work flows.• Scheduled the talend jobs based on the client requirement in Talend Console Management.• Performed operations like joining two tables, aggregation, sorting, Insert and Update the table, connecting to the several databases and connecting to the AWS cloud.

Kansas, United States

● Worked on building the entire pipeline of the project.● Analyzed 5 years of NFL history data and generated graphs based on our analyses using matplotlib libraries in Google Colab Environment● Implemented the concept called Dynamic column partitioning for the NFL dataset to minimize the schema mismatch concerns.● Applied machine models to the dataset to assist in the prediction.

Bengaluru, Karnataka, India

● Developed Spark Applications to implement various data cleansing/validation and processing activity of large-scale datasets ingested from traditional data warehousing.● Worked both with batch and real time streaming data sources.● Experienced in creating Hive external tables to perform ETL on data that is produced on daily basis.● Developed custom Nifi flows for streaming data and data transformations.● Developed data transformations job using Spark Data frames to flatten JSON documents to csv.● Worked with the Spark for improving performance and optimization of the existing transformations.

Bengaluru, Karnataka, India

● Source Data is from four Different Databases like MySQL, Big Table, DB2 and web services.● As per the requirement, we have data from the source consisting of different data sets, using python connecting to the database and loading the data into csv files and storing on the Google Cloud Storage.● Now the transformations and business logic are applied and loaded into respective tables in google spanner.● Based on the JIRA stories the transformation has been done and the data is properly loaded.