Featured Skills: Python, Apache Kafka, Storm, Cassandra, ElasticSearch Client: Serendio Architected and developed a real-time data pipeline. This pipeline ingests high volume of twitter stream, extract information on the fly using NLP and expose the stored data via REST API. This pipeline was deployed in bare metal servers.
Featured Skills: Python, Kafka, Cassandra, ElasticSearch Client: Serendio Developed an architecture to handle streaming data from Chinese websites. This service streams data from various Chinese websites like sina weibo, tencent, renren, etc. enriches it on the fly and stores them.