Alan Tai Email & Phone Number

San Francisco, California, Us

New York, Ny, Us

San Francisco, Ca, Us

- Continued to generate insights into online user behavior using Hadoop, Python, Scala, and/or Spark.- Managed a team of 4 in SF. Later helped set up and recruit a team of 6 in Prague.- Helped implement new continuous integration (CI/CD) processes within GitLab to improve the team's workflow.- Learned Scala and created an application to easily transfer partitioned data from HDFS to S3 in a custom format. This was more robust and efficient than the previous implementation.- Learned Spark on Scala and helped lead the entire team to adopt Spark as the main language for data processing. This included creating development environments and having one-on-one/group learning sessions with engineers to facilitate the learning of Spark in a timely manner.

San Francisco, Ca, Us

- Continued to generate high level insights into online user behavior using Hadoop, Python, Bash, and Tableau.- Provided guidance to the rest of the team for all technical and design issues.- Created a Bash script that leverages the Amazon S3 CLI to easily transfer partitioned data to S3 in a different custom format. This helped eliminate the need to create custom solutions for each project and helped save about an hour of time per engineer per week.- Implemented new processes that allowed the team to switch to Azkaban as the main orchestration tool for recurring pipeline executions.- Worked closely with Sales Engineers and Customer Success Managers to understand clients' data needs and what we can do to provide data that fulfills those needs.

San Francisco, Ca, Us

- Generated pipelines that provided high level insights into online user behavior using Hadoop, Python, and Bash.- Built a Python, SQL, and Java batch processing pipeline that generated approximately 20% of the team's yearly revenue.

San Carlos, California, Us