Data Engineer
CurrentBuying a home does not have to feel complicated. Our simplified approach helps you search, buy, and move in—all without having to stumble through the traditional process. We brought our local experts together, giving you a team of research analysts, loan officers, and tour agents—all under one roof—including a dedicated Flyhomes Agent to guide you every step of the way. That is guaranteed funds for the seller, making your cash offer even more competitive.Responsibilities:• Worked as Data Engineer in extraction data and preparing data according to business requirements. • Used Pandas, NumPy, Seaborn, Tensorflow, Pytorch, Matplotlib, Sci-kit-learn, and NLTK in Python for developing data pipelines and various machine learning algorithm • Employed statistical methodologies such as A/B tests, experiment design, and hypothesis testing.• Implemented Apache Airflow for authoring, scheduling, and monitoring Data Pipelines• Worked with commercial data mining tools such as R and Python depending on job requirements. • Performed K-means clustering, Multivariate analysis, and Support Vector Machines in Python.• Performed Data Profiling to learn about behavior with various features such as data pattern, location, date, and Time.• Worked with different data sources like HDFS, and Hive for Spark to process the data.• Performed Logistic Regression, Classification, Random Forest, Decision Tree, and SVM to classify package is going to deliver on time for the new route.• Worked on Deep learning platforms such as TensorFlow and AWS ML.• Designed various scalable systems using Hadoop technologies in various environments. • Optimized Hive queries using best practices and the right parameters and using technologies like Hadoop, YARN, Python, and PySpark.• Created several types of data visualizations using Python and PowerBI.• Created SQL tables with referential integrity and developed advanced queries using stored procedures and functions using SQL server management studio.