O'Reilly、Cloudera 主办
Make Data Work
2017年7月12-13日:培训
2017年7月13-15日:会议
北京,中国

从简单到复杂:Apache Kafka应用实例详解 (From simple to complex: A detailed explanation of Apache Kafka applications in practice)

此演讲使用中文 (This will be presented in Chinese)

Jiangjie Qin (LinkedIn)
09:00–12:30 Thursday, 2017-07-13
数据工程和架构 (Data engineering and architecture)
地点: 多功能厅5A(Function Room 5A) 观众水平 (Level): 中级 (Intermediate)
平均得分:: *****
(5.00, 2 次得分)

必要预备知识 (Prerequisite Knowledge)

观众需要对数据基础架构有基本了解。演讲本身会尽可能由浅入深。

需要提前准备的资料和下载 (Materials or downloads needed in advance)

  • 一台笔记本电脑 ,Linux或macOS
  • 安装Git、Gradle 3.5、JDK 1.8
  • A laptop (Linux or macOS) with Git, Gradle 3.5, and JDK 1.8 installed

您将学到什么 (What you'll learn)

观众将会学习如何使用合理使用Kafka来解决实际需求。

描述 (Description)

1. Apache Kafka简介
1.1 Kafka的基本概念(Topic,Partition,Offset)
1.2 Kafka的数据生命周期(Producer,Broker,Consumer)
1.3 Kafka的特性(high throughput,low latency,persistency,replication)
1.4 Kafka的功能接口

2. Kafka的应用实例
2.1 数据流水线
2.2 流处理(如果Kafka 0.11在演讲时已发布将会介绍transaction support)
2.3 数据库备份
2.4 CDC

3. Kafka的运维
3.1 如何判断一个Kafka Cluster是否健康(核心指标)
3.2 如何对Kafka Cluster进行性能分析
3.3 LinkedIn的Kafka运维工具


Jiangjie Qin offers an introduction to Apache Kafka, covering basic concepts, the data lifecycle, features, and APIs. Jiangjie then walks you through using Kafka’s data pipeline, stream processing, database replication, and CDC, explains how to evaluate if a Kafka cluster is healthy and how to analyze the performance of a Kafka cluster, and shares LinkedIn’s operation tools for Kafka.

Photo of Jiangjie Qin

Jiangjie Qin

LinkedIn

Jiangjie Qin is on the Data Infrastructure team at LinkedIn. He works on Apache Kafka and is a Kafka Committer. Previously, he worked at IBM, where he managed IBM’s zSeries platform for banking clients. Jiangjie holds a master’s degree in information networking from Carnegie Mellon’s Information Networking Institute.

联系OReillyData

关注OReillyData微信号获取最新会议信息并浏览前沿数据文章。

WeChat QRcode

 

Stay Connected Image 1
Stay Connected Image 3
Stay Connected Image 2

阅读关于大数据的最新理念。

ORB Data Site