Tuesday, May 30, 2017

Project use cases

1. Get the top 5 Features list for a particular time period as per country or continent.
    See if the newly release feature is in the list.

2. Advanced consumer client is a combination of Batch processing and streaming. Kafka is used as messaging system and for every 5 minutes streaming job will start. Inside this Job, Kafka direct methodology is used to fetch messages from Kafka topics. Users subscribe in amd.com and choose their preferences and interests to get suggestion from AMD of appropriate  Graphics card. Here the streaming job gets executed, all the users data who are subscribed for suggestions would be written to Kafka topic by web application and post processing the suggestions are communicated to customer via e-mail or phones(as per their choice).

3. Check if the user has installed all the prerequisite software's. gets the list of installed softwares from user -> import all the needed software names for the graphics card and perform Left join.
The record that has null specifies the softwares those the user is yet to install. - Batch Process

Software update check also happens as a streaming process where on ad-hoc basis if user checks for software updates. - Spark Streaming

4. Sensor data capture by kafka which specifies the machine failure because of network faults, electrical failure, etc. Kafka reads from network socket.

5. Kafka in Marketing project implements consumer API's in spark streaming job to get the info.

No comments:

Post a Comment