Ben M Email & Phone Number

Seattle, Washington, United States

Developed a real-time cloud-based data ingestion system that enabled all subsidiaries to submit and report operations data to their HeadquartersDeveloped Web Services and REST for sending and receiving data from the external interface in CSV, Excel, and JSON formatUtilized Python to develop the backend processes of the applicationDesigned RESTful APIs utilizing Python Flask to integrate the backend of the cloud application to AngularJSImplemented REST API’s in Python using… Show more Developed a real-time cloud-based data ingestion system that enabled all subsidiaries to submit and report operations data to their HeadquartersDeveloped Web Services and REST for sending and receiving data from the external interface in CSV, Excel, and JSON formatUtilized Python to develop the backend processes of the applicationDesigned RESTful APIs utilizing Python Flask to integrate the backend of the cloud application to AngularJSImplemented REST API’s in Python using micro-framework like Flask with SQL Alchemy in the backend for management of data center resourcesDeveloped backend Python algorithms to parse multiple data files and prepare data for validationManipulated and validated subsidiary data using Python, Regular Expression (Regex), and PandasCreated stored procedure functions for data loading, complex inserts, and updates in PostgreSQLDeveloped Python scripts to automate the deployments to the development, QA, and production environmentsUtilized Git as a version control tool in the projectPython packages used included Flask, RegEx, os, sys, logging, JSON, ConfigParserUtilized pre-trained Word Embedding layer plus bidirectional LSTM layer. The output layer with 28 types of phrase intents mentioned in replies for a job pitch.Build skills database indexed against clusters of job designations by using crawlers and scrapping. Calculated skills based on occurring frequencies and requirements in the job description dataset.Implemented a Neural Network for identifying education details from resume files and regex based module for extraction of tenures and timelines. Used resume analytics and persona building for search suggestions.Worked on NoSQL databases including Cassandra, MongoDB and checked the data quality scripts. Used Python, Spark SQL to transfer tables into Spark for faster processing of data.Prediction and auto-completion of job descriptions using text mining models. Show less

Indianapolis, Indiana, United States

Developed full stack Python web framework with an emphasis on simplicity, flexibility, and extensibility. It is built atop excellent components and reinvents zero wheels. WSGI, routing, templating, forms, data, plugins, config, events, SQLAlchemy, Storm, CouchDB, OpenID, App Engine, jQuery, etc.•Developed and implemented secure AWS Lambda serverless functions in Python and Node.js. Managed all Serverless functions with the Serverless Framework allowing for ease of management and cloud… Show more Developed full stack Python web framework with an emphasis on simplicity, flexibility, and extensibility. It is built atop excellent components and reinvents zero wheels. WSGI, routing, templating, forms, data, plugins, config, events, SQLAlchemy, Storm, CouchDB, OpenID, App Engine, jQuery, etc.•Developed and implemented secure AWS Lambda serverless functions in Python and Node.js. Managed all Serverless functions with the Serverless Framework allowing for ease of management and cloud provider flexibility.•Wrote python scripts using Boto3 to automatically spin up the instances in AWS EC2 and OPS Works stacks and integrated with Auto scaling to automatically spin up the servers with configured AMIs.•Developed custom airflow operators using Python to generate and load CSV files into GS from SQL Server and Oracle databases.•Wrote and executed several complex SQL queries in AWS glue for ETL operations in Spark data frame using SparkSQL.•Successfully migrated the Django database from SQLite to MySQL to Postgres SQL with complete data integrity.•Performed Kafka analysis, feature selection, feature extraction using Apache Spark Machine.•Involved in Pipelining data into AWS Glue then used PySpark to perform complex transformations standardizing the data and stages it into S3 buckets. •Developed microservices on boarding tools leveraging Python and Jenkins allowing for easy creation and maintenance of build jobs and Kubernetes deploy and services.•Worked in DevOps group running Jenkins in a Docker container with EC2 slaves in Amazon AWS cloud configuration.•Developed Spark Applications by using Scala, Java and Implemented Apache Spark data processing project to handle data from various RDBMS and Streaming sources.•Used AWS Redshift, S3, Spectrum and Athena services to query large amount data stored on S3 to create a Virtual Data Lake without having to go through ETL process. Developed ETL processes to move data between RDBMS and NoSQL data storage. Show less

India

Used Shell scripting to automate the frequently performed operations and to run sequence of commands as a single command.Extensive code reviewing using GitHub pull requests, improved code quality, and also conducted meetings among peer.Integrated Kubernetes with Networking, Storage, Security, Telemetry and other services to provide a comprehensive container infrastructure.Managing the Docker container through the pods and performing the load balance between the pods through… Show more Used Shell scripting to automate the frequently performed operations and to run sequence of commands as a single command.Extensive code reviewing using GitHub pull requests, improved code quality, and also conducted meetings among peer.Integrated Kubernetes with Networking, Storage, Security, Telemetry and other services to provide a comprehensive container infrastructure.Managing the Docker container through the pods and performing the load balance between the pods through Kubernetes.Worked on AWS Cloud Watch events to trigger AWS Glue reporting jobs for job failures or network errors.Designed and developed an entire module called CDC (change data capture) in python and deployed in AWS GLUE using PySpark library and python.Worked in DevOps group running Jenkins in a Docker container with EC2 slaves in Amazon AWS cloud configuration.Designed and developed web crawler in python using Scrappy framework and using RabbitMQ as a messaging server between the microservices.Microservices architecture development using Python and Docker on an Ubuntu Linux platform using HTTP/REST interfaces with deployment into a multi-node Kubernetes environment.Developed Python and Django for the backend development and front-end application using React, Webpack, Redux and MySQL for database.Designed the real-time analytics and ingestion platform using Storm and Kafka. Wrote Storm topology to accept the events from Kafka producer and emit into Cassandra DB.Involved in data migration processes to migrate historical data from legacy system into AWS Redshift (to S3 as flat files and Redshift as tables) using Python.Develop and Execute scripts on AWS Lambda to generate AWS Cloud Formation template.Designed, created, executed, and kept up answers for utilizing Docker, Jenkins, Git, and Puppet for microservices and ceaseless arrangement. Show less