24-28 August 2020
US/Pacific timezone

Fast checkpointing with criu-image-streamer

24 Aug 2020, 09:10
20m
Microconference1/Virtual-Room (LPC 2020)

Microconference1/Virtual-Room

LPC 2020

150
Containers and Checkpoint/Restore MC Containers and Checkpoint/Restore MC

Speaker

Nicolas Viennot (Two Sigma)

Description

New cloud offerings such as Google preemtible VMs are up to 5x cheaper than regular machines. These VMs come with tight eviction deadlines (~30secs). This introduces a new goal: How can we evacuate an application from a machine as fast as possible?

Note that this problem is different from live migration, which aims at minimizing application downtime.

To do fast checkpointing, we developed criu-image-streamer. It enables streaming of images to and from CRIU during checkpoint/restore with low overhead.

The talk will cover the criu-image-streamer architecture, and shows the Linux mechanisms used to achieve checkpointing rates of 15GB/s and load-balance the checkpointed image output on an array of UNIX pipes.

The criu-image-streamer tool is open-source and can be found at https://github.com/checkpoint-restore/criu-image-streamer

I agree to abide by the anti-harassment policy I agree

Primary author

Nicolas Viennot (Two Sigma)

Presentation Materials