Timekeeping in virtual machines: Difference between revisions
[unchecked revision] | [unchecked revision] |
m s/suck/such |
Document pvclock |
||
Line 38:
== pvclock ==
pvclock is a simple protocol and the fastest way to properly track system time in a VM.
To use it, write a 64-bit 4-byte aligned physical address to MSR_KVM_SYSTEM_TIME_NEW (<code>0x4b564d01</code>).
The presence of this MSR is indicated by bit 3 in EAX from leaf 0x4000001 of CPUID.
The host will write the following structure to this address:
<source lang="C">
Line 50 ⟶ 57:
u8 pad[2];
};
The host will automatically update this structure when necessary (e.g. when finishing a migration).
The system time is calculated with <code>(rdtsc() - tsc_timestamp >> tsc_shift) * tsc_to_system_mul + system_time</code>.
The version field is used to detect when the structure has been / is being updated.
If the version is odd an update is in progress and the guest must not read the other fields yet.
</source>
Line 69 ⟶ 83:
* [https://docs.kernel.org/virt/kvm/x86/hypercalls.html Linux KVM Hypercall]
* [https://docs.kernel.org/virt/kvm/x86/msr.html KVM-specific MSRs]
* [https://opensource.com/article/17/6/timekeeping-linux-vms An introduction to timekeeping in Linux VMs]
|
Revision as of 19:49, 27 August 2022
There are several ways to keep track of time in a VM, but they're either very slow (e.g. HPET) or do not work correctly if the VM is migrated (e.g. TSC).
To work around this, VMs such as QEMU/KVM provide several ways keep track of time whilst sacrificing little performance.
KVM_HC_CLOCK_PAIRING
This hypercall is used to get the parameters to calculate a host's clock (KVM_CLOCK_PAIRING_WALLCLOCK for CLOCK_REALTIME).
The host copies the following structure to a physical address given by the guest:
struct kvm_clock_pairing {
s64 sec;
s64 nsec;
u64 tsc;
u32 flags;
u32 pad[9];
};
A hypercall is performed with the `vmcall` instruction. On KVM, RBX, RCX, RDX and RSI are used for arguments, RAX as the hypercall number and as the return value. No other registers are clobbered (unless explicitly noted).
For example, calling KVM_HC_CLOCK_PAIRING can be done as follows on x86_64:
; rdi: physical address to copy structure to
; rsi: clock type (KVM_CLOCK_PAIRING_WALLCLOCK = 0)
kvm_hc_clock_pairing:
mov eax, 9 ; KVM_HC_CLOCK_PAIRING
mov rbx, rdi
mov rcx, rsi
vmcall
ret
pvclock
pvclock is a simple protocol and the fastest way to properly track system time in a VM.
To use it, write a 64-bit 4-byte aligned physical address to MSR_KVM_SYSTEM_TIME_NEW (0x4b564d01
).
The presence of this MSR is indicated by bit 3 in EAX from leaf 0x4000001 of CPUID.
The host will write the following structure to this address:
struct pvclock_vcpu_time_info {
u32 version;
u32 pad0;
u64 tsc_timestamp;
u64 system_time;
u32 tsc_to_system_mul;
s8 tsc_shift;
u8 flags;
u8 pad[2];
};
The host will automatically update this structure when necessary (e.g. when finishing a migration).
The system time is calculated with <code>(rdtsc() - tsc_timestamp >> tsc_shift) * tsc_to_system_mul + system_time</code>.
The version field is used to detect when the structure has been / is being updated.
If the version is odd an update is in progress and the guest must not read the other fields yet.
Hyper-V TSC page
struct ms_hyperv_tsc_page {
volatile u32 tsc_sequence;
u32 reserved1;
volatile u64 tsc_scale;
volatile s64 tsc_offset;
u64 reserved2[509];
};