Senior Backend Engineer/Big Data
Wrote python routines to log into the websites and fetch data for selected options. • Used python modules such as requests, urllib, urllib2 for web crawling. • Used other packages such as Beautifulsoup for data parsing. • Worked on writing and as well as read data from csv and excel file formats. • Worked on a resulting reports of the application and Tableau reports. • Modifying data using SAS/BASE, SAS/ MACROS. • Performed QA testing on the application. • Developed… Show more Wrote python routines to log into the websites and fetch data for selected options. • Used python modules such as requests, urllib, urllib2 for web crawling. • Used other packages such as Beautifulsoup for data parsing. • Worked on writing and as well as read data from csv and excel file formats. • Worked on a resulting reports of the application and Tableau reports. • Modifying data using SAS/BASE, SAS/ MACROS. • Performed QA testing on the application. • Developed approaches for improving NLP pipeline. • Create custom VB scripts in repackaging applications as needed. • NLP File Prep Settlement-Prepare files for review for Settlement. • Held meetings with client and worked all alone for the entire project with limited help from the client. Environment: Python 2.7, Sypder(IDE), Windows 7, Terdata, Requests, urllib, urllib2, Beautifulsoup, Tableau,Python Scripting,JSON. Show less