O'Reilly、Cloudera 主办
Make Data Work
2017年7月12-13日:培训
2017年7月13-15日:会议
北京,中国

在Apache Hadoop和Spark上加速大数据加密 (Speed up big data encryption in Apache Hadoop and Spark)

此演讲使用中文 (This will be presented in Chinese)

Haifeng Chen (Intel)
14:50–15:30 Friday, 2017-07-14
安全 (Security)
地点: 多功能厅2(Function Room 2) 观众水平 (Level): Intermediate

必要预备知识 (Prerequisite Knowledge)

A basic understanding of distributed systems like HDFS and Spark, how data encryption works, and encryption algorithms

您将学到什么 (What you'll learn)

Understand the performance challenges of data encryption posed by the existing implementations and learn the proven ways to solve these challenges in Hadoop and Spark

描述 (Description)

当现代平台的数据处理能力已经达到了内存速度级时,使用加密来确保数据安全却会严重地降低性能。在大数据时代,当企业偏好性能而不是安全的时候,它们就正在面临着严重的数据泄露的风险,并由此带来对它们业务的损害的增加。

本议题里,我们会帮助你理解这一问题,以及现有的加密实现方法所导致的数据加密带来的性能挑战。同时会展示一些经过证明是有效的在Hadoop和Spark上充分利用已有硬件来提升数据加密速度的方法。我们也会介绍我们在Apache开源社区里为帮助用户解决这一问题所做的工作和最新的进展,并解密使用硬件加速技术来保护你的数据的方法。

更具体地,我们将分享:

  • Java AES加密的性能现状和面临的挑战,以及基于SASL DIGEST-MD5的RPC和网络加密。
  • 为什么以及怎么样在基于硬件加速的条件下使用Apache Commons Crypto来提升加密的性能
  • Apache Hadoop和Spark社区为解决这个加密的性能挑战所完成的最新工作,以及了解它是如何工作的


Although the processing capability of modern platforms is approaching memory speed, securing big data using encryption still hurts performance. Enterprises that choose performance over data security face serious risks of data leaks and damage to their business in the big data era. Haifeng Chen shares proven ways to speed up data encryption in Hadoop and Spark, as well as the latest progress in open source, and demystifies using hardware acceleration technology to protecting your data.

Topics include:

  • The performance state and challenges from Java AES Cipher and SASL DIGEST-MD5-based RPC and network encryption
  • Why and how to utilize Apache Commons Crypto to speed up encryption performance based on hardware acceleration
  • The latest work the community has done in Apache Hadoop and Spark to solve the performance challenges of encryption (and how it performs)
Photo of Haifeng Chen

Haifeng Chen

Intel

Haifeng Chen is a senior software architect at Intel’s Asia Pacific R&D Center. He has more than 12 years’ experience in software design and development, big data, and security, with a particular interest in image processing. Haifeng is the author of image browsing, editing, and processing software ColorStorm.

联系OReillyData

关注OReillyData微信号获取最新会议信息并浏览前沿数据文章。

WeChat QRcode

 

Stay Connected Image 1
Stay Connected Image 3
Stay Connected Image 2

阅读关于大数据的最新理念。

ORB Data Site