Tuning for SPEC CPU 2017 Performance Optimization

Industry-standard benchmarks play a critical role in evaluating and comparing server performance across different processor architectures, operating systems, and hardware platforms. Among these benchmarks, SPEC CPU 2017 is widely recognized for measuring compute-intensive performance using a diverse collection of integer and floating-point workloads that represent real-world applications such as artificial intelligence, simulation, image processing, and data analytics. As organizations are increasingly relying on benchmark data for infrastructure planning and procurement decisions, achieving competitive benchmark results has become an important objective for system manufacturers and technology providers.

Achieving industry-leading benchmark performance requires more than powerful hardware. Significant gains can be realized through careful optimization of BIOS settings, operating system configuration, and kernel parameters.

Our engineering teams have collaborated with system manufacturers and technology partners to optimize platforms for benchmark performance. These efforts have contributed to multiple top-ranking results across a variety of processor architectures and server platforms.

This article summarizes common tuning methodologies and best practices that can help maximize SPEC CPU 2017 performance.

Understanding the optimization stack

SPEC CPU 2017 performance depends on several layers:

• Hardware architecture

• BIOS configuration

• OS tuning

• Kernel parameter optimization

• Compiler and runtime settings

Although processor capabilities do form a foundation, platform tuning often comes into picture when a competitive or record-level performance is required.

BIOS Tuning Best Practices

1. Power Management Configuration

Modern processors provide multiple power-saving features. For benchmark workloads, performance-oriented settings are typically preferred.

Common considerations include:

• Performance power profiles

• Turbo/Boost technologies

• C-state management

• P-state management

• Autonomous frequency control

Compute intensive benchmarks often benefit from aggressive frequency boosting.

Think about 500.perlbench_r, which benefits from high single-thread frequency, or 502.gcc_r that is highly sensitive to processor frequency.

2. NUMA Optimization

NUMA configuration is particularly important on multi-socket systems.

Commonly evaluated systems include:

• NUMA enable/disable

• NUMA grouping

• Node interleaving

• Virtual NUMAs

Workloads with large memory footprints often benefit from maintaining memory locality.

Like the 554.roms_r (FP) having large memory footprint and NUMAaware behavior.

3. Memory configuration

Memory subsystem tuning is one of the most important areas for benchmark optimization.

Some areas commonly reviewed:

• Maximum supported memory frequency

• DIMM population strategy

• Memory interleaving

4. Processor features

Modern processors expose numerous performance-related controls.

One of the frequently evaluated options is: Hyper-Threading.

When configuring enterprise servers for the industry-standard SPEC CPU2017 benchmark, your Hyper-Threading (Intel) or SMT (AMD) BIOS setting is dictated entirely by your target metric. For SPECrate (throughput) submissions, you should always enable HT/SMT. This maximizes concurrent processing by creating two logical threads per core, filling idle CPU cycles to drive up overall workload volume. Conversely for SPECspeed(raw speed) submissions, you must disable HT/SMT. This eliminates resource contention and minimizes latency and accelerates single-task execution time. 

5. Operating System Tuning

OS tuning plays a critical role in ensuring that processor and memory resources are utilized efficiently. During SPEC CPU2017 benchmarking activities, we have evaluated multiple enterprise Linux distributions, including Red Hat Enterprise Linux (RHEL), SUSE Linux Enterprise Server (SLES), and Ubuntu Server.

Although the tuning objectives remain similar across distributions, each OS provides different mechanisms for performance optimization.

The tuned framework allows administrators to apply predefined system profiles. Taking an example: tuned-adm profile throughput-performance. This setting explicitly changes the CPU scaling governor to performance mode, locking the CPU at its highest frequency and disabling dynamic power saving C-states.

One of the most impactful operating system settings is the CPU frequency governor. 

Common governors include:

performance - maintains maximum operating frequency

powersave - prioritize power efficiency

ondemand - dynamically adjusts frequency

schedutil - Scheduler-driven frequency scaling

For benchmark execution, the performance governor is commonly preferred because it minimizes frequency scaling latency and helps maintain consistent execution behaviour. 

Looking Ahead: SPEC CPU 2026

While SPEC CPU 2017 continues to serve as a widely adopted benchmark, the industry is steadily transitioning toward newer benchmark suites that better reflect modern computing workloads. In addition to our ongoing work with SPEC CPU 2017, our performance engineering teams are actively evaluating and optimizing platforms for SPEC CPU 2026.

Leveraging our experience gained from system tuning, we are applying similar performance engineering methodologies to help customers maximize results on next-generation server platforms.

Challenges Encountered During SPEC CPU 2017 Benchmarking

Achieving top-tier SPEC CPU 2017 results involves significantly more than executing benchmark workloads on high-performance hardware. One of the primary challenges is identifying the optimal combination of BIOS settings and runtime settings on each platform. Multi socket systems introduce additional complexity through NUMA topology and memory locality. Another challenge is balancing aggressive performance tuning with the strict compliance and disclosure requirements of SPEC submissions, where every reported result must be reproducible and conform to benchmark rules.

Despite these challenges, our performance engineering team has successfully optimized a wide range of server platforms across multiple processor generations and operating systems. Through a combination of BIOS optimization, OS tuning, workload characterization, and extensive validation, our organization has contributed to numerous industry-leading benchmark submissions. These efforts have resulted in multiple world-record and top-ranking SPEC CPU benchmark results published on the SPEC website for leading server manufacturers and enterprise customers. The experience gained from these engagements has helped establish a systematic methodology for maximizing performance.