Unix and Linux Stack Exchange
Unix and Linux Stack Exchange

Questions tagged [huge-pages]

22 questions
5
votes
1 answer

Understanding main memory fragmentation and hugepages

I have a machine that is intended for general use and which I also used to run a QEMU virtual machine. Because the virtual machine should be as performant as possible, I want to back the VM memory with hugepages, ideally 1GB hugepages. The machine…
Max Ehrlich
  • 101
  • 5
3
votes
1 answer

Can a Linux Swap Partition Be Too Big?

Can a Linux swap partition be too big? I'm pretty certain the answer is, "no" but I haven't found any resources on-point, so thought I'd ask. In contrast, the main Windows swap file, pagefile.sys, can be too large. A commonly cited cap is 3x…
ebsf
  • 271
  • 2
  • 11
3
votes
2 answers

Discover huge page support on POSIX or Linux

I'm working on a program which needs to detect at runtime whether the system it's running on supports hugepages, and if so, what sizes are available. Ideally I'd like this to work for any POSIX platform, but a Linux-specific solution would be a…
joshlf
  • 345
  • 3
  • 17
2
votes
2 answers

How to enable HugeTLB controller in cgroup v2 on Ubuntu

I am trying to enable HugeTLB Controller on cgroup v2 on my system but can't figure out how. This is the list of controllers on my system: cat /sys/fs/cgroup/cgroup.controllers cpuset cpu io memory pids rdma And this is what I see for the meminfo…
Harshdeep Gupta
  • 21
  • 2
2
votes
2 answers

Increasing hw.pagesize in FreeBSD

I have a server rocking FreeBSD 13. From the documentation of sysctl I can read that hw.pagesize cannot be changes on the go. This makes sense to me as this type of parameter depends on the kernel. I can read also there this: Some of the variables…
Navarro
  • 470
  • 1
  • 5
  • 13
2
votes
0 answers

Pmem and huge pages

In my Ubuntu 18.04 Intel system, there are 356gb of DDR. Out of this memory, 300gb, are pre-allocated using the pmem mechanism (since we have an external HW that sends us contiguous data chunks of 10gb). We are accessing this memory in a totally…
TomE
  • 21
  • 1
2
votes
0 answers

Allocate pools of hugepages separately on each NUMA doamin

On my dual-socket machine, I'm trying to allocated two pools of hugepages (one for each socket), so that the application A, which is pinned on the first socket, uses the first pool, and the application B on the second socket uses it's own local…
Vahid Noormofidi
  • 162
  • 7
1
vote
0 answers

linux enable large page management

I am doing some experiments. Some huge pages (2MB) are used in the experiment, so that the 21-bit page offset can remain unchanged when performing virtual address translation. I found some methods on how to enable huge pages on the Internet. And…
Yujie
  • 183
  • 6
1
vote
1 answer

Linux use huge pages only

I have a x64 Linux system. The page size reported by getconf is 4 k: $ getconf PAGESIZE 4096 I want the kernel to use only large pages (2 M or 4 M) for all memory allocations. I've calculated that I have enough RAM to handle the memory that will be…
fctorial
  • 203
  • 1
  • 6
1
vote
0 answers

Using libhugetlbfs to transparently back up glibc malloc calls in a multi-threaded application

I'm trying to back up the memory allocations of a multi-threaded application with 1GiB hugepages using libhugetlbfs. However, only the main thread allocations are being assigned hugepages. If I restrict the maximum number of Glibc malloc arenas to…
aleixrocks
  • 305
  • 4
  • 11
1
vote
1 answer

Which distributions enable transparent huge pages "for all applications"?

I am puzzled by LWN again. Huge pages, slow drives, and long delays -- LWN.net, 2011 It is a rare event, but it is no fun when it strikes. Plug in a slow storage device - a USB stick or a music player, for example - and run something like rsync to…
sourcejedi
  • 48,311
  • 17
  • 143
  • 296
1
vote
1 answer

Error configuring large page support on Centos 7 VPS

I am trying to mine Monero with my VPS, but I encountered an error when trying to enable large pages support. The miner I am trying to use is XMR STAK CPU, but I do not believe this to be the issue, although when I run it, it says "MEMORY ALLOC…
StealthBadger747
  • 11
  • 1
1
vote
2 answers

Zend OPcache huge_code_pages: madvise(HUGEPAGE) failed

I've got this error while running a PHP command-line script on a freshly installed server: PHP Warning: Zend OPcache huge_code_pages: madvise(HUGEPAGE) failed: Invalid argument The server is running CentOS 7.3, with PHP 7.1.4 from the remi…
BenMorel
  • 4,447
  • 8
  • 36
  • 46
0
votes
0 answers

Linux HugeTLB: What is the advantage of the filesystem approach?

Moved Post Notice I just moved this question (with slight modifications) from a StackOverflow question (which I have deleted, since cross-posting is strongly discouraged), which has not been answered over there and might be better suited here. There…
Lukas Barth
  • 181
  • 5
0
votes
0 answers

Is it possible ro remap huge pages (e.g. 2 MiB) into smaller ones (4 KiB)?

In my application I have a huge chunk of memory allocated using mmap. Depending on runtime configuration options this chunk can be allocated using huge pages (i.e. with the MAP_HUGETLB flag). This memory chunk is managed by application in smaller…
user3234005
  • 101
1
2