微信分享
SPDK/PMDK/VTune™ Amplifier China Summit 2019

使用微信扫一扫分享到朋友圈

活动分享
SPDK/PMDK/VTune™ Amplifier China Summit 2019

使用微信扫一扫进入小程序分享活动

日程概览

Agenda.png


日程详情
2019-09-05
2019-09-06
2019-09-05
08:30 -09:00
Register

Front of Ballroom A and Ballroom B


2019-09-05
09:00 -11:40
Ballroom A+BallroomB
2019-09-05
09:00-09:10

Welcome to the Summit

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Lin Zhou
Software Engineering Director, Intel Corporation
2019-09-05
09:10-09:40

SPDK: State of the Project

SPDK is continuing to evolve – from both a technology and community perspective.  In this talk, Jim with review the significant changes over the last year, and provide insight into what to expect from SPDK over the coming year.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jim Harris
Principal Engineer SPDK Chief Architect, Intel Corporation
2019-09-05
09:40-10:10

PMDK: State of the Project

The SNIA NVM Programming Model is an agreement between dozens of companies on how the Operating System exposes persistent memory, building on the standard storage APIs.  But to make the most of persistent memory, application writers want to access persistence directly using memory semantics, and this can be tricky programming.  This is where PMDK comes in.  In this talk, Andy will explain the goals of PMDK, the primary motivation for creating it, and how well it has met those goals so far.  Andy will talk about what has worked well, as well as some of the challenges we still have ahead of us for PMDK.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Andy Rudoff
Senior Principal Engineer, Intel Corporation
2019-09-05
10:10-10:40

VTune: State of the Product

TBD

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sri Doddapaneni
Director, Analysis & Monitoring Engineering, Intel Corporation
2019-09-05
10:40-10:55

Morning break

2019-09-05
10:55-11:40

Squeezing Compression and Encryption into SPDK

SPDK has already enabled encryption and compression bdev by fully leveraging DPDK’s existing variety of drivers.

This talk will first give an introduction on compress bdev about its overall architecture and explain in detail how we are managing the layout of the device and leveraging the Persistent Memory Development Kit(PMDK) to store metadata in super-fast persistent memory. Then we will talk about encryption related feature (encryption bdev & SED opal) which will give an overview on how it works and how we can use it. 


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jim Harris
Principal Engineer SPDK Chief Architect, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Chunyang Hui
Senior Software Engineer, Intel Corporation
2019-09-05
10:55 -11:40
No.2 Meeting
2019-09-05
10:55-11:40

VTune and Analyzers Overview (first part)

Overview of Intel Tools (e.g. Intel® Parallel Studio, Emon, etc), methodology to characterize workloads/systems, Intel® Optane™ DC Persistent Memory (Apache Pass) tools, and examples on which to use depending on the situation

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sri Doddapaneni
Director, Analysis & Monitoring Engineering, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yang Wang
Technical Consulting Engineer Manager, Intel Corporation
2019-09-05
11:40 -13:30
Lunch Break
2019-09-05
13:30 -17:05
Ballroom A
2019-09-05
13:30-14:15

FusionEngine 2.0--Alibaba user-space full stack solution for storage

FusionEngine is a user-space storage system developed by Alibaba. FusionEngine provide user space storage stack for single node at the very beginning and it achieved great advancements recently which we announce as FusionEngine 2.0. It provides the capability of tiered storage for one single node and storage capability across network, all the solution help to improve performance, reduces CPU utilization and simplified the troubleshooting greatly.


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yi Zhang
Storage Technical Specialist, Alibaba
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Zhengyong Wang
Storage Technical Specialist, Alibaba
2019-09-05
14:25-15:10

Full stack optimization for Udisk with SPDK


UDisk provides persistent block storage to virtual cloud hosts in UCloud, which is automatically replicated to protect users from component failure. Currently, UDisk-SSD cannot meet the performance requirements of some users. We still had a lot of work to do to take full use of CPU, NVMe SSD and network. With the help of solutions provided by SPDK and some technologies such as RDMA, we made a deep optimization of whole IO path, making a great breakthrough in performance. New Generation UDisk-RSSD provides up to 1.2M iops and latency is as low as 100us. In this presentation, we will share the experience and results of performance optimization, and some work we will do in the future


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yutian Yang
Senior Software Engineer, UCloud
2019-09-05
15:10-15:25

Afternoon break

2019-09-05
15:25-16:10

Prepare for the next generation of memory, is your application a good candidate?

Applications are developing an insatiable appetite for DRAM memory. It is well known that the limited availability of system memory has a direct impact on performance for many software programs. To keep up with this demand, platforms have added more and more expensive memory since alternative solutions were not widely available… until now. This talk provides step-by-step instructions on how to use Intel® VTune™ Amplifier to determine whether an application may be a good candidate for using Intel Optane DC persistent memory as an affordable, high-capacity, volatile memory. 

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jackson Marusarz
Lead Technical Consulting Engineer (TCE), Intel Corporation
2019-09-05
16:20-17:05

Optimize system configurations and workloads for Intel® Optane™ DC persistent memory

Have you ever wondered if your system is configured well for its typical loads? Or if your typical workloads are well optimized for your system? Will your workloads benefit from Intel Optane DC persistent memory? State of the art performance analysis tools, for longer runs, do not always give sufficiently detailed performance metrics. More detailed performance analysis tools can overwhelm the user with huge amount of fine-grained data. Intel® VTune™ Amplifier’s Platform Profiler provides an adequate amount of data for a user to detect if there is any problem with the system configuration, or if there is any pressure on specific system components like memory or I/O that cause performance bottlenecks.  This presentation focuses on how to use Intel® VTune™ Amplifier Platform Profiler for (1) Analyzing suitability of your workload for Intel® Optane™ DC PMM and (2) Analyzing performance on an Intel® Optane™ DC PMM enabled system.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jackson Marusarz
Lead Technical Consulting Engineer (TCE), Intel Corporation
2019-09-05
13:30 -17:05
Ballroom B
2019-09-05
13:30-14:15

PMDK essentials

The SNIA NVM Programming Model is an agreement between dozens of companies on how an OS exposes persistent memory, building on the standard storage APIs.  But to make the most of persistent memory, application writers want to access persistence directly using memory semantics, and this can be tricky programming.  This is where PMDK comes in.  In this talk, Andy will explain the goals of PMDK, the primary motivation for creating it, and how well it has met those goals so far.  Andy will talk about what has worked well, as well as some of the challenges we still have ahead of us for PMDK.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Andy Rudoff
Senior Principal Engineer, Intel Corporation
2019-09-05
14:25-15:10

High Performance Pooled Storage for RSD Architectures

Driving efficiency and performance is critical to modern data center architectures, this talk will cover how the features of SPDK (lockless design, user space lib, core affinity, bdev stacking, and debug ability) were used to provide high performance nondurable block storage with RAID 0, think provisioning QOS, Clones, Snapshots and Redfish/RSD compliant management.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Steve Miller
Senior Principal Engineer and Director of Storage Architecture, Intel Corporation
2019-09-05
15:10-15:25

Afternoon break

2019-09-05
15:25-16:10

SPDK based user space NVMe/TCP transport solution and Intel’s 100Gb NIC update

In November 2018, NVM express releases the new spec of TCP transport for NVMe over fabrics. In this talk,  we would like to introduce the design, implementation and development plan of NVMe-oF TCP transport in SPDK . Currently, SPDK implements both TCP transport in host and target side, and can be tested against Linux kernel solution with good interoperability.  Besides,  some experiments results will be presented to demonstrate the performance and scalability of SPDK's NVMe-oF TCP transport implementation.  Moreover,  we will introduce some techniques for the further performance improvement of SPDK's solution, e.g.,  (1) leveraging user space TCP stack to replace the kernel TCP stack; (2) leveraging some features of NICs, we will introduce Intel’s New 100 Gb NIC. Compared with kernel solution, SPDK based NVMe-oF solution has much better per CPU core performance in different aspects (e.g., IOPS, latency).

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Ziye Yang
Senior Software Engineer, Intel Corporation
2019-09-05
16:20-17:05

Accelerating Redis with Intel Optane DC Persistent Memory

This talk introduces the optimizations of Redis on DCPMM with the detail designs on different data structures,  migrate data to DCPMM by identify hot and cold data, and leverage DCPMM persistent capability to improve the persistent performance.  With the optimization, the performance of redis show the same level of performance and latency of DRAM and meet the customer’s SLA requirements. Since data persistent in the DCPMM and we don’t need to store the real data instead of data location in AOF that will reduce the disk IO throughput dramatically and improve the redis persistent performance over 2x.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Dennis Wu
Cloud Software Engineer, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yuan Zhou
Senior Software Development Engineer, Intel Corporation
2019-09-05
13:30 -17:05
No.2 Meeting Room
2019-09-05
13:30-14:15

VTune and Analyzers OverviewV(second part)

Overview of Intel Tools (e.g. Intel® Parallel Studio, Emon, etc), methodology to characterize workloads/systems, Intel® Optane™ DC Persistent Memory (Apache Pass) tools, and examples on which to use depending on the situation.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sri Doddapaneni
Director, Analysis & Monitoring Engineering, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yang Wang
Technical Consulting Engineer Manager, Intel Corporation
2019-09-05
14:25-15:10

Persistent Memory Provisioning/Configuration tools

This session is aimed at System Administrators or Application Developers with minimal or no experience working with persistent memory. Usha will introduce and demonstrate how to provision persistent memory in Linux using the open source ndctl utility.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Usha Upadhyayula
Software Engineer, Intel Corporation
2019-09-05
15:10-15:25

Afternoon break

2019-09-05
15:25-16:10

Persistent Memory Programming Made Easy with pmemkv

Introducing pmemkv, an open-source local key/value store for persistent memory based on PMDK. Written in C/C++, pmemkv provides optimized language bindings for Java, JavaScript, and Ruby. Pmemkv includes multiple storage engines that are tailored for different use-cases. Fast, flexible and bulletproof, pmemkv is an easy way to modify applications to use persistent memory

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Szymon Romik
Software Engineer, Intel Corporation
2019-09-05
16:20-17:05

End-to-end data protection with SPDK NVMe/TCP target

This talk is an update to end-to-end data protection with SPDK since the last SPDK US summit.

The strategy for SPDK iSCSI target goes well and TCP transport of SPDK NVMe-oF target support DIF insert/strip next.

There are some differences between SPDK iSCSI target and TCP transport of SPDK NVMe-oF target.

SPDK NVMe-oF target already have supported DIF passthrough. TCP transport of SPDK NVMe-oF target convert SGL to data sent within a PDU series for transmission across a TCP fabric.

This talk will mainly for the difference and the initial performance evaluation for DIF insert/strip with TCP transport of SPDK NVMe-oF target.


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Shuhei Matsumoto
Engineering Manager, IT Platform Products and Management Division,Hitachi
2019-09-06
08:30 -09:00
Register

Front of Ballroom A and Ballroom B

2019-09-06
09:00 -11:40
Ballroom A
2019-09-06
09:00-09:45

Introduce a new VM and Container file accelerator and live recovery feature in SPDK Vhost

In this presentation, we propose an SPDK  user space vhost-user-fs solution, which can be used to accelerate file access in VMs and Containers.

We will present this solution in detail including the utilization of techniques such as virtio-fs, blobfs. Relying on this solution,

we are going to build a fast, consistent and secure manner to share directory tree on host to guests.

Live recovery is very useful in production environment, it can let users upgrade their vhost process without interrupting VMs, in this presentation,

We will introduce this new feature.


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Changpeng Liu
Senior Software Engineer, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Xiaodong Liu
Senior Software Engineer, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jin Yu
Senior Software Enginner, Intel Corporation
2019-09-06
09:55-10:40

Lessons learned from MemVerge, an avid PMDK user

MemVerge is a startup based in Silicon Valley, focusing on building the next generation high performance data infrastructure based on persistent memory. In this presentation, we would start by briefly introducing some of the data infrastructure software that MemVerge has been working on followed by discussing a few use cases we are currently exploring. As an avid user of PMDK, we would like to further share a few lessons learned during our product development, where some product components are being actively prototyped with PMDK. In particular, we would like to talk about our experience using PMDK’s memory allocator. We discuss a few memory fragmentation challenges that we encountered, and present our solutions based on allocation class and the control functions on memory arena that was recently introduced in PMDK 1.6.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yue Li
Co-Founder and CTO, Memverge
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Wei Kang
Core Software Architect, Memverge
2019-09-06
10:40-10:55

Morning break

2019-09-06
10:55-11:40

Introduction of Baidu Chitu Storage with SPDK NVMe-oF Application

In the deep learning scenario, video and graphics are trained by GPU, which requires high concurrency and random reading of a large number of small data blocks. Under the common HDFS storage architecture, the performance of small files and the utilization of storage space are both low. High-speed GPU computing components need to match high-speed NVMe storage, HDFS storage architecture is difficult to unleash NVMe storage’s extreme performance.

 

Baidu Chitu Storage provides high throughput and low latency shared NVMe storage for GPU cluster, and adopts a layered architecture. The lower layer is a distributed high-availability block-level logical volume system based on NVMe-oF, and the upper layer is a parallel file system called Baidu Parallel FS (bpfs) on the logical volume. Small files and their meta-information are packaged and stored in logical volumes. The client accesses small files directly through NVMe-oF to the remote storage server. SPDK NVMe-oF is the key module of data path.

 

Baidu Chitu's storage latency is 10us higher than local NVMe. On one single client, multithreaded random IO of 16K small file can saturate the 100G network, and 500K IOPS for small files. Before reaching the hardware bottleneck, the aggregation throughput of multi-storage servers increases linearly. Meanwhile the aggregation throughput of multi-client random reads also increases linearly and the latency remains unchanged. Test performance from video and image trainings of 2 billion files is equivalent to the local multi-NVMe RAID0. Under the pressure of millions of IOPS on storage servers, using SPDK NVMe-oF saves 8 times CPU overhead than using Linux kernel modules. At the same time, the development and operation efficiency of SPDK user-mode program is much higher than that of kernel module.


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Zhenyuan Sun
Senior System Engineer, Baidu
2019-09-06
09:00 -11:40
Ballroom B
2019-09-06
09:00-09:45

Optimize your PMDK application’s performance with the help of Intel® VTune™ Amplifier profiler

Take a deep dive into the details of profiling to optimize performance with persistent memory.  If you want to take advantage of the Intel® Optane® DC persistent memory in AppDirect mode then PMDK library is probably your best bet. But what can you do if the performance you get doesn’t satisfy you? In this talk you will learn how to use Intel® VTune™ Amplifier to optimize PMDK-based applications.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sergei Vinogradov
Senior Software Development Engineer, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Zhuowei Si
Technical Consulting Engineer, Intel Corporation
2019-09-06
09:55-10:40

Intel NVM technology and solution evolutions

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Benny Ni
Strategic Business Development Manager, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Ping She
Strategic Planner, Intel Corporation
2019-09-06
10:40-10:55

Morning break

2019-09-06
10:55-11:40

Integrating SPDK in the NAS gateway

The goal of integrating SPDK in our NAS system is to build a highly available and high performenc cache layer with low latencies. We will use SPDK to take over local nvme device and export it out with SDPK iscsi target or NVMe-OF of the SPDK for higher performence. Then in our gateway nodes ,one local nvme device and one remote nvme device can be made mirrors as a cache layer in our NAS system.In this talk, we will go over the cache layer design of our NAS system,and how we use the SPDK to use remote nvme device in our system. 

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Erlang Li
Senior Software Engineer, XSKY
2019-09-06
09:00 -11:40
No.2 Meeting Room
2019-09-06
09:00-09:45

Accelerate Spark with Intel Optane DC Persistent Memory

The capacity of data grows rapidly in big data area, more and more memory are consumed either in the computation or holding the intermediate data for analytic jobs. For those memory intensive workloads, end-point users have to scale out the computation cluster or extend memory with storage like HDD or SSD to meet the requirement of computing tasks. For scaling out the cluster, the extra cost from cluster management, operation and maintenance will increase the total cost if the extra CPU resources are not fully utilized. To address the shortcoming above, Intel Optane DC persistent memory (Optane DCPM) brings the break to the traditional memory/storage hierarchy and scale up the computing server. It brings higher capacity than memory and higher bandwidth & lower latency than storage like SSD or HDD. And Spark is widely used in the analytics like SQL and ML on the cloud environment. For cloud environment, low performance of remote data access is typical stop gap for users especially for some I/O intensive queries. For the ML workload, it’s an iterative model which I/O bandwidth is key to the end-2-end performance. In this talk, we will introduce how to accelerate Spark SQL with OAP (https://github.com/Intel-bigdata/OAP) to accelerate SQL performance on Cloud to archive 8X performance gain and RDD cache to improve K-means performance leveraging Intel Optane DCPMM with 2.5X performance improvement. Also we will have a deep dive about the root cause for those performance gains.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yuqiang Ye
Software Engineer, Intel Corporation
2019-09-06
09:55-10:40

Persistent Memory – which mode do I want? Where are the “gotchas” hidden?(first part)

Intel  Optane DC persistent memory can be configured either as persistent memory (AppDirect) or as main memory, with DRAM used as a cache (memory mode).  Each mode has some challenges for adoption and to extract the best performance from this memory technology and identify which configuration mode is best suited for your application, it is necessary to understand the architectural flow from the core to the memory and some key glass jaws. In this presentation, we will present an overview of the uncore architecture leading to architectural glass jaw issues to monitor when using Intel Optane DC persistent memory and the conditions to monitor when using Intel Optane DC persistent memory in both memory configurations with the relevant architectural background, recommendation on what tools/profiles to use with customer applications.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sudha Udanapalli Thiagarajan
Performance Monitoring Engineer, Intel Corporation
2019-09-06
10:40-10:55

Morning break

2019-09-06
10:55-11:40

Persistent Memory – which mode do I want? Where are the “gotchas” hidden?(second part)

Intel  Optane DC persistent memory can be configured either as persistent memory (AppDirect) or as main memory, with DRAM used as a cache (memory mode).  Each mode has some challenges for adoption and to extract the best performance from this memory technology and identify which configuration mode is best suited for your application, it is necessary to understand the architectural flow from the core to the memory and some key glass jaws. In this presentation, we will present an overview of the uncore architecture leading to architectural glass jaw issues to monitor when using Intel Optane DC persistent memory and the conditions to monitor when using Intel Optane DC persistent memory in both memory configurations with the relevant architectural background, recommendation on what tools/profiles to use with customer applications.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sudha Udanapalli Thiagarajan
Performance Monitoring Engineer, Intel Corporation
2019-09-06
11:40 -13:30
Lunch break
2019-09-06
13:30 -16:30
Ballroom A
2019-09-06
13:30-14:15

VTune - Performance characterization of SPDK using Intel®  VTune™ Amplifier

With traditional interrupt driven I/O, the CPU is either doing something useful or waiting.  With SPDK’s polled I/O the CPU is always 100% busy so traditional profiling techniques don’t work.  Intel® VTune™ Amplifier can identify “empty” spinning so you can balance core loading, balance SSDs, see the throughput per device, PCIe traffic breakdown and lots of good stuff.  Learn how to use Intel VTune Amplifier to optimize your I/O performance.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Roman Sudarikov
Senior Software Development Engineer, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yang Wang
Technical Consulting Engineer Manager, Intel Corporation
2019-09-06
14:25-15:10

Why SSD developers need pynvme, and why pynvme needs SPDK?

SSD is becoming ubiquitous in both Client and Data Center markets. The requirements on function, performance and reliability are refreshed frequently. As a result, SSD design, especially the firmware, has been keeping upgrading and restructuring for the decade. 


The test makes the change under control. However, the firmware test is not as mature as the software test. We have well developed methodologies, processes and tools for software. But the embedded platform, where the firmware executes, only provides the limited resources on computation and memory. So, it is difficult to run full test in the native embedded environment. Practically, SSD vendors run system tests with 3-rd party software, consuming huge resources. The existed tools lacks the flexibility to make efficient tests against vendor's own features and flaws. SSD developers need an infrastructure to implement their test s or programs in low cost. Our pynvme is just the answer. 


The test-dedicated light-weighted NVMe driver is the most essential part of the solution, where we rely on SPDK. First, SPDK is reliable. It is designed and tested in large-scale Data Center. Second, SPDK is highly modularized. We can choose modules we need, and extend them with our own features. Last, but not the least, SPDK is active and open. People work for better quality and latest features, so we can focus on the features for testing. I even forget to mention the best-in-class performance.


As part of the SPDK community, pynvme also contributes to the up-stream. And another interesting side-effect is that, since SSD devices pass the test of pynvme s, they also pass the very first test of SPDK! 


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Crane Chu
Software Engineer
2019-09-06
14:25-15:10

Afternoon break

2019-09-06
15:10-17:05

[Lab 1] SPDK Hands on Lab

2019-09-06
13:30 -16:30
Ballroom B
2019-09-06
13:30-14:15

SPDK NVMe-OF acceleration

• Latest progress done with NVMe-OF RDMA performance.

• Introduce initial proposal to extend the internal POSIX-like transport API to allow better integration with zero-copy enabled TCP stacks, such as Mellanox’s VMA.

• Explain how Mellanox T10-DIF offload can be used to add integrity functionality to NVMe-OF protocol at initiator and target sides Including adding/striping/verifying T10-DIF or simple CRC.


嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sasha Kotchubievsky
Director, SW, Mellanox
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Oren Duer
Principal Software Architect, Mellanox
2019-09-06
14:25-15:10

Creating C++ apps with libpmemobj

With persistent memory, data can be retained after a program crash or power failure. In this session, learn how to make your C++ application persistent memory aware using the Persistent Memory Developers Kit (PMDK). The presentation includes C++ code samples walkthrough.

嘉宾
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Szymon Romik
Software Engineer, Intel Corporation
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sean Whiteley
Founder, AxoMem
2019-09-06
15:10-15:25

Afternoon break

2019-09-06
15:25-17:05

[Lab 2] PMDK Hands on Lab

2019-09-06
13:30 -16:30
No.2 Meeting Room
2019-09-06
14:30-16:30

[Lab 3] Intel® VTune™ Amplifier Hands on Lab

Welcome to the Summit

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Lin Zhou
Software Engineering Director, Intel Corporation
Lin Zhou is a Software Engineering Director at Intel China. He joined Intel in 2004 and currently he oversees NPG PRC software engineering activities. He manages software teams for network/storage acceleration and transformation including development and validation for Intel® QuickAssist Technology (QAT), Data Plane Development Kit (DPDK), Storage Performance Development Kit (SPDK), Intel® Intelligent Storage Acceleration Library (ISA-L) and several SDN/NFV related open source projects. Before Intel, Lin had worked in Motorola for two years.

SPDK: State of the Project

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jim Harris
Principal Engineer SPDK Chief Architect, Intel Corporation
Jim Harris is a principal software engineer in Intel’s Data Center Group and the chief software architect of the Storage Performance Development Kit (SPDK) open source project. Jim was instrumental in starting the SPDK project at Intel in 2013 to provide a framework for building high performant and efficient storage software to take advantage of current and next generation non-volatile media. Jim has served in a wide variety of storage software related roles during his 18 years at Intel. He holds an MS in computer science from Case Western Reserve University.

PMDK: State of the Project

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Andy Rudoff
Senior Principal Engineer, Intel Corporation
Andy Rudoff is a Senior Principal Engineer at Intel Corporation, focusing on Non-Volatile Memory programming. He is a contributor to the SNIA NVM Programming Technical Work Group. His more than 30 years industry experience includes design and development work in operating systems, file systems, networking, and fault management at companies large and small, including Sun Microsystems and VMware. Andy has taught various Operating Systems classes over the years and is a co-author of the popular UNIX Network Programming text book.

VTune: State of the Product

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sri Doddapaneni
Director, Analysis & Monitoring Engineering, Intel Corporation
Sri Doddapaneni leads development of software analyzers products spanning compute and graphics performance, parallelism, power, software correctness. With over 25 years of experience in compilers, debuggers, profilers, emulators, distributed & embedded systems, and hardware platforms, he specializes in designing and developing analysis tools that provide accurate and holistic profiles of software application on Intel platforms. Sri holds a B.Tech.(Honors) from Indian Institute of Technology at Kharagpur and a PhD from Georgia Institute of Technology, both in computer science.

Morning break

Squeezing Compression and Encryption into SPDK

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jim Harris
Principal Engineer SPDK Chief Architect, Intel Corporation
Jim Harris is a principal software engineer in Intel’s Data Center Group and the chief software architect of the Storage Performance Development Kit (SPDK) open source project. Jim was instrumental in starting the SPDK project at Intel in 2013 to provide a framework for building high performant and efficient storage software to take advantage of current and next generation non-volatile media. Jim has served in a wide variety of storage software related roles during his 18 years at Intel. He holds an MS in computer science from Case Western Reserve University.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Chunyang Hui
Senior Software Engineer, Intel Corporation
Chunyang Hui is a senior software engineer at Intel and involved in SPDK (storage performance development kit) development work and ISA-L (Intel software acceleration library)

VTune and Analyzers Overview (first part)

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sri Doddapaneni
Director, Analysis & Monitoring Engineering, Intel Corporation
Sri Doddapaneni leads development of software analyzers products spanning compute and graphics performance, parallelism, power, software correctness. With over 25 years of experience in compilers, debuggers, profilers, emulators, distributed & embedded systems, and hardware platforms, he specializes in designing and developing analysis tools that provide accurate and holistic profiles of software application on Intel platforms. Sri holds a B.Tech.(Honors) from Indian Institute of Technology at Kharagpur and a PhD from Georgia Institute of Technology, both in computer science.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yang Wang
Technical Consulting Engineer Manager, Intel Corporation
Yang Wang is the technical consulting engineer manager from Intel Compute Performance & Developer Products Division. He specializes in enabling customers to use Intel Software Development tools to build, debug, profile and optimize their system/applications across all lines of Intel processors. Yang is an expert in embedded/IoT platforms and spent 15 years working on software development and consultancy with Intel Compilers, Debuggers and Profilers to broader customers.

FusionEngine 2.0--Alibaba user-space full stack solution for storage

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yi Zhang
Storage Technical Specialist, Alibaba
Yi Zhang is storage technical specialist from Alibaba, majorly focuses on Ceph, distributed storage, RocksDB, user space File System, driver and SSD performance tuning related work.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Zhengyong Wang
Storage Technical Specialist, Alibaba
Zhengyong Wang is storage technical specialist from Alibaba, majorly focuses on distributed storage, user space File System, driver and SSD performance tuning related work.

Full stack optimization for Udisk with SPDK


SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yutian Yang
Senior Software Engineer, UCloud
Yutian Yang, a software engineer, from UCloud block storage team, participated in the research and development of high performance RSSD.

Afternoon break

Prepare for the next generation of memory, is your application a good candidate?

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jackson Marusarz
Lead Technical Consulting Engineer (TCE), Intel Corporation
Jackson Marusarz is a lead technical consulting engineer (TCE) in Intel's Compute Performance & Developer Products Division. As the lead TCE for Intel® VTune™ Amplifier, Jackson’s main focus is on software performance analysis and tuning for both serial and multi-threaded applications. His time is split between figuring out how to analyze and tune software, and how to create tools that help others do the same.

Optimize system configurations and workloads for Intel® Optane™ DC persistent memory

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jackson Marusarz
Lead Technical Consulting Engineer (TCE), Intel Corporation
Jackson Marusarz is a lead technical consulting engineer (TCE) in Intel's Compute Performance & Developer Products Division. As the lead TCE for Intel® VTune™ Amplifier, Jackson’s main focus is on software performance analysis and tuning for both serial and multi-threaded applications. His time is split between figuring out how to analyze and tune software, and how to create tools that help others do the same.

PMDK essentials

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Andy Rudoff
Senior Principal Engineer, Intel Corporation
Andy Rudoff is a Senior Principal Engineer at Intel Corporation, focusing on Non-Volatile Memory programming. He is a contributor to the SNIA NVM Programming Technical Work Group. His more than 30 years industry experience includes design and development work in operating systems, file systems, networking, and fault management at companies large and small, including Sun Microsystems and VMware. Andy has taught various Operating Systems classes over the years and is a co-author of the popular UNIX Network Programming text book.

High Performance Pooled Storage for RSD Architectures

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Steve Miller
Senior Principal Engineer and Director of Storage Architecture, Intel Corporation
Steve Miller is the Sr. Principal Engineer and Director of Storage Architecture for Intel’s Data Center Group. Steve and his team are responsible for identifying trends and technologies across the datacenter related to storage and driving innovation into Data Center Products. Prior to joining Intel, Steve spent 10 years at NetApp as the Sr. Technical Director for storage systems. In this role Steve was responsible for storage system architecture, hardware innovation and silicon vendor technical relationships. Steve was responsible for creating the flash cache product, the first use of flash in enterprise storage systems. Prior to NetApp, Steve spent 14 years at Silicon Graphics, as a Chief Engineer, responsible for Origin and Altix supercomputer architectures as well as indigo2 and octane workstations. While at SGI, Steve was an integral part of the MIPS to Itanium CPU transition, developed several ASICs for I/O and graphics interconnects, served as Principal Investigator for DARPA’s HPCS program as well as several other government sponsored research programs. Steve has 52 issued US patents in the areas of storage, I/O, and high performance computing.

Afternoon break

SPDK based user space NVMe/TCP transport solution and Intel’s 100Gb NIC update

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Ziye Yang
Senior Software Engineer, Intel Corporation
Ziye Yang is a senior software engineer at Intel and involved in SPDK (storage performance development kit) development work. Before that, Ziye worked at EMC for 4.5 years. Ziye is interested in system virtualization, file system and storage related research and development work. Ziye currently has 14 granted patents in US and 7 granted patents in PRC. Ziye holds a master degree in computer science from Fudan University in 2009

Accelerating Redis with Intel Optane DC Persistent Memory

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Dennis Wu
Cloud Software Engineer, Intel Corporation
Dennis Wu is a Cloud Software Engineer at Intel. He is the key player of Intel Could Engineering team and mainly focuses on the software and solution analysis and optimization for the China CSP customers. In the recent two years he is mainly working on optimizing Redis, RocksDB on DCPMM and promotes the solutions to customers. He also works closely with PMDK development team and promote PMDK to China CSP customers.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yuan Zhou
Senior Software Development Engineer, Intel Corporation
Yuan Zhou is a senior software development engineer in the Software and Service Group at Intel, where he works on the Open Source Technology Center team primarily focused on big data storage software. He's been working in databases, virtualization, and cloud computing for most of his 7+ year career at Intel.

VTune and Analyzers OverviewV(second part)

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sri Doddapaneni
Director, Analysis & Monitoring Engineering, Intel Corporation
Sri Doddapaneni leads development of software analyzers products spanning compute and graphics performance, parallelism, power, software correctness. With over 25 years of experience in compilers, debuggers, profilers, emulators, distributed & embedded systems, and hardware platforms, he specializes in designing and developing analysis tools that provide accurate and holistic profiles of software application on Intel platforms. Sri holds a B.Tech.(Honors) from Indian Institute of Technology at Kharagpur and a PhD from Georgia Institute of Technology, both in computer science.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yang Wang
Technical Consulting Engineer Manager, Intel Corporation
Yang Wang is the technical consulting engineer manager from Intel Compute Performance & Developer Products Division. He specializes in enabling customers to use Intel Software Development tools to build, debug, profile and optimize their system/applications across all lines of Intel processors. Yang is an expert in embedded/IoT platforms and spent 15 years working on software development and consultancy with Intel Compilers, Debuggers and Profilers to broader customers.

Persistent Memory Provisioning/Configuration tools

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Usha Upadhyayula
Software Engineer, Intel Corporation
Usha Upadhyayula is a software engineer at Intel with 15+ years of experience working in various areas of product development life cycle. She is currently focused on enabling customers to fully utilize and accelerate the adoption of Intel® Optane™ Persistent Memory technology.

Afternoon break

Persistent Memory Programming Made Easy with pmemkv

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Szymon Romik
Software Engineer, Intel Corporation
Szymon Romik is a software engineer at Intel currently focusing on Persistent Memory Programming. Previously, he worked as a lead software engineer at Ericsson focusing on 5G technologies. Szymon received his M.Sc. in Mathematics from Jagiellonian University in Cracow.

End-to-end data protection with SPDK NVMe/TCP target

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Shuhei Matsumoto
Engineering Manager, IT Platform Products and Management Division,Hitachi
Shuhei Matsumoto is an engineering manager at Hitachi in IT Platform Products and Management Devision. He is responsible for providing technical oversight for the SPDK project as one of core maintainers, and driving SPDK adoption and open source efforts in Hitachi. Prior to starting SPDK, he was a chief architect and developer of x86 and IA64 hypervisor for the Hitachi blade server. He has a BEng and MEng in System Engineering from Keio Uniersity.

Introduce a new VM and Container file accelerator and live recovery feature in SPDK Vhost

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Changpeng Liu
Senior Software Engineer, Intel Corporation
Changpeng Liu is a senior software engineer at Intel and the core maintainer of SPDK (storage performance development kit) project.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Xiaodong Liu
Senior Software Engineer, Intel Corporation
Xiaodong Liu is a senior software engineer at Intel and involved in SPDK (storage performance development kit) development work.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Jin Yu
Senior Software Enginner, Intel Corporation
Jin Yu is a senior software engineer at Intel and involved in SPDK (storage performance development kit) development work.

Lessons learned from MemVerge, an avid PMDK user

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yue Li
Co-Founder and CTO, Memverge
Yue Li is a co-founder and the Chief Technology Officer of MemVerge. Previously, he worked as a senior post-doctoral scholar in memory systems at the California Institute of Technology. Yue has extensive research experience on both theoretical and experimental aspects of algorithms for non-volatile memories. His research has been published in top journals and conferences on data storage. Yue received his PhD in computer science from Texas A&M University, and his B.Sc. in Information Security from Huazhong University of Science and Technology.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Wei Kang
Core Software Architect, Memverge
Wei Kang is a core software architect in MemVerge. Previously, he worked as product manager at Loongstore and software engineer at EMC. Wei has more than ten years of working experience on file system development and storage product management. Wei graduated from Institute of Computing Technology, Chinese Academy of Sciences with a master’s degree and got his bachelor’s degree in Computer Science from Xi’an Jiao Tong university.

Morning break

Introduction of Baidu Chitu Storage with SPDK NVMe-oF Application

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Zhenyuan Sun
Senior System Engineer, Baidu
Senior Systems Engineer of Baidu, Ph. D., graduated from Blue Whale Storage Laboratory, Institute of Computing, Chinese Academy of Sciences. His scope of work includes distributed storage and single-machine storage engine.

Optimize your PMDK application’s performance with the help of Intel® VTune™ Amplifier profiler

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sergei Vinogradov
Senior Software Development Engineer, Intel Corporation
Sergei Vinogradov is a Senior Software Development Engineer at Intel. He has been working at Intel more than 7 years on performance profiling tools and threading runtime libraries. Sergei developed several new features to Intel® VTune™ Amplifier XE and prototyped new features for heterogeneous computations in Intel® Threading Building Blocks library. During the past three years, Sergey has been working on persistent memory programming support for C++ developers.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Zhuowei Si
Technical Consulting Engineer, Intel Corporation
Zhuowei Si is a technical consulting engineer in Intel's Compute Performance & Developer Products Division located at Shanghai. James mainly covers the Intel VTune Amplifier and Intel Optimized AI Frameworks support and has 3 years’ experience in performance analysis and profiling with VTune. James also has delivered tens of trainings, hands-on labs and on-site support in areas of the Intel products he covers to customers and developers.

Intel NVM technology and solution evolutions

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Benny Ni
Strategic Business Development Manager, Intel Corporation
Benny Ni is a 16-year veteran of the flash memory and storage, previously working on Intel NOR flash development, SSD development and SSD application engineering. Benny currently works as Strategic Business Development Manager of Intel NVM Solutions Group, managing datacenter business in China.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Ping She
Strategic Planner, Intel Corporation
Ping She is strategic planner for storage software at Intel Non-volatile Memory Solution Group. Before that, Ping has been firmware and driver software engineer for storage device for 10 years, Technical Marketing Engineer and Product Line Manager for 4 years.

Morning break

Integrating SPDK in the NAS gateway

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Erlang Li
Senior Software Engineer, XSKY
Erlang Li comes from XSKY, a high-tech enterprise focused on Software Defined Infrastructure business and focuses on storage systems for 7 years.

Accelerate Spark with Intel Optane DC Persistent Memory

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yuqiang Ye
Software Engineer, Intel Corporation
Yuqiang Ye is a software engineering of Intel Big Data team. He worked for big data area for more than 4 years. Current his focus is about IA optimization for data analytics area.

Persistent Memory – which mode do I want? Where are the “gotchas” hidden?(first part)

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sudha Udanapalli Thiagarajan
Performance Monitoring Engineer, Intel Corporation
Sudha Udanapalli Thiagarajan is a Performance Monitoring Engineer at Intel. Her current primary focus is Intel® Optane™ DC Persistent Memory and Intel® Xeon processors performance monitoring validation. Prior to being a Performance Monitoring Engineer she worked for several years as an Application Engineer focused on tuning, analysis and optimizing applications in the HPC domain.

Morning break

Persistent Memory – which mode do I want? Where are the “gotchas” hidden?(second part)

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sudha Udanapalli Thiagarajan
Performance Monitoring Engineer, Intel Corporation
Sudha Udanapalli Thiagarajan is a Performance Monitoring Engineer at Intel. Her current primary focus is Intel® Optane™ DC Persistent Memory and Intel® Xeon processors performance monitoring validation. Prior to being a Performance Monitoring Engineer she worked for several years as an Application Engineer focused on tuning, analysis and optimizing applications in the HPC domain.

VTune - Performance characterization of SPDK using Intel®  VTune™ Amplifier

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Roman Sudarikov
Senior Software Development Engineer, Intel Corporation
Roman Sudarikov is a Senior Software Development Engineer at Intel’s CVCG’s Developer Products Division. He is a part of Intel® VTune™ Amplifier development team and is leading I/O performance analysis in the product.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Yang Wang
Technical Consulting Engineer Manager, Intel Corporation
Yang Wang is the technical consulting engineer manager from Intel Compute Performance & Developer Products Division. He specializes in enabling customers to use Intel Software Development tools to build, debug, profile and optimize their system/applications across all lines of Intel processors. Yang is an expert in embedded/IoT platforms and spent 15 years working on software development and consultancy with Intel Compilers, Debuggers and Profilers to broader customers.

Why SSD developers need pynvme, and why pynvme needs SPDK?

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Crane Chu
Software Engineer
Crane Chu, a software engineer interested on Flash file system, SSD firmware and storage system. He was trying to introduce concepts and practices of continuous integration, Agile development, and software-defined storage to SSD firmware developing and testing. The pynvme, an open-source project based on SPDK NVMe driver, is one of his efforts to improve SSD developing efficiency and quality.

Afternoon break

[Lab 1] SPDK Hands on Lab

SPDK NVMe-OF acceleration

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sasha Kotchubievsky
Director, SW, Mellanox
Sasha Kotchubievsky,Director, SW in Mellanox. Sasha has been in Mellanox for 7 years in engineering and managing positions. He brings more than 20 years’ experience in software development. In Mellanox, Sasha leads SW development in a number of projects in Inifiniband management and storage areas including in-network computation. Sasha holds an MS in Applied Mathematics from Novosibirsk State University. He is a proud dad of three daughters.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Oren Duer
Principal Software Architect, Mellanox
Oren Duer,Principal Software Architect 11 years in Mellanox focusing on storage RDMA protocols R&D and architecture. Last couple of years main focus around NVMe and NVMe-oF, including offloads and accelerations that are part of the ConnectX and BlueField device families.

Creating C++ apps with libpmemobj

SPDK/PMDK/VTune™ Amplifier China Summit 2019
Szymon Romik
Software Engineer, Intel Corporation
Szymon Romik is a software engineer at Intel currently focusing on Persistent Memory Programming. Previously, he worked as a lead software engineer at Ericsson focusing on 5G technologies. Szymon received his M.Sc. in Mathematics from Jagiellonian University in Cracow.
SPDK/PMDK/VTune™ Amplifier China Summit 2019
Sean Whiteley
Founder, AxoMem
Sean Whiteley is the Founder of AxoMem.io. Based in Singapore, AxoMem is building a new generation analytics platform that natively supports Intel® Optane™ Persistent Memory and large CPU core counts, while enabling 3D, VR and AR capable front-end interfaces. Sean recently implemented an in-memory IT monitoring, automation and 3D visualisation solution for a large automotive company, managing over 4,500 servers and 30,000 disks across APAC.

Afternoon break

[Lab 2] PMDK Hands on Lab

[Lab 3] Intel® VTune™ Amplifier Hands on Lab