Back To Schedule
Thursday, July 11 • 11:15am - 11:35am
NICA: An Infrastructure for Inline Acceleration of Network Applications

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

With rising network rates, cloud vendors increasingly deploy FPGA-based SmartNICs (F-NICs), leveraging their inline processing capabilities to offload hypervisor networking infrastructure. However, the use of F-NICs for accelerating general-purpose server applications in clouds has been limited.

NICA is a hardware-software co-designed framework for inline acceleration of the application data plane on F-NICs in multi-tenant systems. A new ikernel programming abstraction, tightly integrated with the network stack, enables application control of F-NIC computations that process application network traffic, with minimal code changes. In addition, NICA’s virtualization architecture supports fine-grain time-sharing of F-NIC logic and provides I/O path virtualization. Together these features enable cost-effective sharing of F-NICs across virtual machines with strict performance guarantees.

We prototype NICA on Mellanox F-NICs and integrate ikernels with the high-performance VMA network stack and the KVM hypervisor. We demonstrate significant acceleration of real-world applications in both bare-metal and virtualized environments, while requiring only minor code modifications to accelerate them on F-NICs. For example, a transparent key-value store cache ikernel added to the stock memcached server reaches 40 Gbps server throughput (99% line-rate) at 6 μs 99th-percentile latency for 16-byte key-value pairs, which is 21× the throughput of a 6-core CPU with a kernel-bypass network stack. The throughput scales linearly for up to 6 VMs running independent instances of memcached.


Haggai Eran

Technion – Israel Institute of Technology & Mellanox Technologies

Lior Zeno

Technion – Israel Institute of Technology

Maroun Tork

Technion – Israel Institute of Technology

Gabi Malka

Technion – Israel Institute of Technology

Mark Silberstein

Technion – Israel Institute of Technology

Thursday July 11, 2019 11:15am - 11:35am PDT
USENIX ATC Track I: Grand Ballroom I–VI