• Big Data developer with over 7 years of professional IT experience in the areas of Health Care, Insurance and Product related fields.• Extensive experience in working with various distributions of Hadoop like enterprise versions of Cloudera, Horton works and good knowledge on Amazon’s EMR. • In-depth experience in using various Hadoop Ecosystem tools like HDFS, MapReduce, Yarn, Pig, Hive, Sqoop, Spark, Storm, Kafka, Oozie, Elastic search, HBase, and Zookeeper.• Extensive knowledge of Hadoop architecture and its components.• Exposure to Data Lake Implementation using Apache Spark.• Extensively worked on Spark Streaming and Apache Kafka to fetch live stream data.• Used Scala and Python to convert Hive/SQL queries into RDD transformations in Apache Spark.• Experience in integrating Hive queries into the Spark environment using Spark SQL.• Handled importing data from RDBMS into HDFS using Sqoop and vice-versa.• Extensive experience in importing and exporting streaming data into HDFS using stream processing platforms like Flume and Kafka.• Experience in developing a data pipeline using Pig, Sqoop, and Flume to extract the data from weblogs and store in HDFS.• Created User Defined Functions (UDFs), User Defined Aggregated Functions (UDAFs) in PIG and Hive.• Hands-on experience in tools like Oozie and Airflow to orchestrate jobs.• Proficient in NoSQL databases including HBase, Cassandra, MongoDB and its integration with the Hadoop cluster.• Expertise in Cluster management and configuring Cassandra Database.• Great familiarity with creating Hive tables, Hive joins & HQL for querying the databases eventually leading to complex Hive UDFs.• Worked on data warehousing and ETL tools like Informatica, Talend.• Developed web page interfaces using JSP, Java Swings, and HTML scripting languages.• Used web-based UI development using JavaScript, jQuery UI, CSS, and jQuery, HTML5.• Experience with best practices of Web services development and Integration (both REST and SOAP).• Experienced in using build tools like Ant, Gradle, SBT, and Maven to build and deploy applications into the server.• Experience in complete Software Development Life Cycle (SDLC) in both Waterfall and Agile methodologies.
-
Big Data DeveloperBlue Cross Blue Shield Jun 2019 - PresentChantilly, Va, Us• Responsible for managing data from disparate sources.• Experienced in loading and transforming large sets of structured semi-structured and unstructured data.• Using Hive Script in Spark for data cleaning and transformation purpose.• Responsible for migrating data from various conventional data sources as per the architecture.• Used Apache Nifi for file conversions and data processing.• Good experience working with Hadoop distributions such as HORTONWORKS and CLOUDERA.• Collaborated with data modelers and other developers during the implementation.• Load data into Hive partitioned tab.• Developed applications to map the data between different sources and destinations using Python and Scala.• Performed unit testing and collaborated with the QA team for possible bug fixes.• Hands on experience on AWS infrastructure services Amazon Simple Storage Service (Amazon S3) and Amazon Elastic Compute Cloud (Amazon EC2).• Load consumer response data in AWS S3 bucket into Hive external tables in HDFS location to serve as feed for tableau dashboards.• Worked in Agile and used JIRA for maintain the stories about project. • Responsible for design, installation and maintenance All ELK and Kafka services.• Responsible for Mapping JSON and CSV data in Elastic search filters, DSL queries for Elastic search to handle customer search request and Search APIs.• Experience working with Cloudera Distribution Hadoop(CDH) and Hortonworks data platform(HDP).• Exploring new elastic components which can improve existing system like elastic cloud enterprise to centralize all clusters and playbooks and Ansible and machine learning. • Install, configure, administer, and support multiple Kafka clusters and Elastic search clusters, Perform maintenance and troubleshooting, capacity planning and growth projections -
Spark DeveloperVanguard Jan 2018 - May 2019Valley Forge, Pa, Us• Involved in analyzing business requirements and prepared detailed specifications that follow project guidelines required for project development.• Used Sqoop to import data from Relational Databases like MySQL, Oracle.• Involved in importing structured and unstructured data into HDFS.• Responsible for fetching real-time data using Kafka and processing using Spark and Scala.• Worked on Kafka to import real-time weblogs and ingested the data to Spark Streaming.• Developed business logic using Kafka Direct Stream in Spark Streaming and implemented business transformations.• Worked on Building and implementing real-time streaming ETL pipeline using Kafka Streams API.• Worked on Hive to implement Web Interfacing and stored the data in Hive tables. • Migrated Map Reduce programs into Spark transformations using Spark and Scala.• Working with open source Apache Distribution then Hadoop admins have to manually setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site. However, when working with popular Hadoop distribution like Hortonworks, Cloudera or MapR the configuration files are setup on startup and the Hadoop admin need not configure them manually.• Experienced with Spark Context, Spark-SQL, Spark YARN.• Implemented Spark Scripts using Scala, Spark SQL to access hive tables into Spark for faster processing of data.• Implemented data quality checks using Spark Streaming and arranged passable and bad flags on the data.• Implemented Hive Partitioning and Bucketing on the collected data in HDFS.• Implemented Sqoop jobs for large data exchanges between RDBMS and Hive clusters.• Extensively used Zookeeper as a backup server and job scheduled for Spark Jobs.• Developed traits and case classes etc. in Scala. -
Big Data AnalystStrong-Bridge May 2015 - Jul 2017
Frequently Asked Questions about F Razia
What company does F Razia work for?
F Razia works for Blue Cross Blue Shield
What is F Razia's role at the current company?
F Razia's current role is Big Data Developer at Excellus BCBS.
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial