r/Amd•
Koreenium

Flawed methodology used for testing CPU gaming performance.

Meta

We have seen that gaming performance for Ryzen 1700, 1800 are very inconsistent from reviewer to reviewer. And it all comes down the methodology used to measure the "gaming" performance.
In order to get the "full gaming" performance of the CPU they lower the resolution, graphical settings to make sure that the GPU is not bottlenecking (99% usage) but rather it would be the other way around and force the CPU to bottleneck. This way of testing gives us results where Ryzen 1700, 1800 perform significantly worse than high-end i7 CPU's and equal to i5 CPU's in some scenarios. I personally think that this has its own purpose and place. It helps us to see which CPU can handle more powerful GPU's better but at the same time it is also flawed.

For example a person who buys a GTX 1080 wants to crank up resolution and graphical settings to get best visual quality and also try to balance them so they get 60+ fps. If they see that their GPU usage is 99% then that is a good thing because they know that their GPU is taken to its limit and not bottlenecked by the CPU. If they experience stuttering or even have their system freeze and see that their CPU is hitting 99-100% usage then that is a bad sign because CPU is your PC's brain and now it is bottlenecking and ruining your gaming experience. This means you have to lower settings or close background applications that use CPU to free up some room to get smoother gaming experience. Not ideal.
This is where Ryzen 1700, 1800 come in handy compared to its similarly priced intel i7 counterparts.

If you play at 1080p/1440p, max settings with GTX 1080 and the GPU usage is 99%, only then we can see the true real world gaming performance. If with i7 7700K you get average of 70fps then that is good and with Ryzen 1700, 1800 you get 60fps then that is still pretty good but obviously one CPU is weaker in this task than the other. But if you also look how much CPU is being used then we might see that i7 7700K is being used more than 70% while Ryzen 1700 only 40%. This makes it pretty clear that if you like to multitask and have applications open in the background that use a lot of CPU then Ryzen 1700, 1800 in overall offers better experience even if you sacrifice 5-15% fps.

Reviewers should of made this very clear and instead focuse more on real world gaming performance with current high end GPU's like GTX 1080 and GTX Titan XP because average gamer might buy one of these in 2-3 years which is a long enough period where the Ryzen 1700, 1800 are not really going to be a significant limiting factor and get replaced with better and more powerful models.

Posted Mar 3, 2017, 9:54 AM UTC

237
MarmotaOtaAMD 8350FX HD7950•

Some reviewers have stated that gaming is smoother, there is no hitch or stutter, as you would find even on the best i7s

7
kb3035583•

There's less framerate variance, but if minimums, averages and maximums are higher all around on the i5/i7 there's no reason to choose the Ryzen chip over the i5/i7 simply because there's less variance in frame times. Would you rather have a framerate that fluctuates from 32-36 as compared to one that fluctuates from 50-60, for instance. That's what I'm getting at here.

1
MarmotaOtaAMD 8350FX HD7950•

Well, yeah. Both would be pretty bad imo. I either game at 60+ or just put the game back on the shelf. At maxed fps though, I've seen the i7 stutter where my 8350 fx didn't (battlefield 4), so I wouldn't be surprised if ryzen was actually better for gaming.

1
Valkaro•

You don't understand, Ryzen is not that far under i7, And the Ryzen CPU can push easily over 60fps. The thing is look at this video at minute 7:08 https://www.youtube.com/watch?v=BXVIPo_qbc4 See how i7 tanks the framerates, this is what we're talking about, when there is a CPU bottleneck(100% CPU utilization) i7 7700k will fall behind.

1
kb3035583•

Those are just scene variances. Let me put it this way - record 2 ingame videos following a path as similar as possible, put them side by side and see whether framerate and GPU/CPU utilization coincide at every point in time. Hint: they won't.

1
Valkaro•

Yes but you miss the point, r1700 has more resources than 7700k therefor will not be limited in situations where i7700k would be at 100% i.e heavy cpu situations.

1
Valkaro•

This, i7700k can tank games due to 100% utilization while Ryzen will not drop them at that point because it would still not bottle neck the GPU.

1
originfoomanchu•

To test any component to the max you have to turn vsync off which makes the gfx card work at 99%,

If you put vsync on the CPU will only give enough power to give you the fps your monitor allows,

If you tried csgo go with vsync on both the GPU and CPU will not be working to the best of its ability,

Even at 720p with vsync off the gfx card will be working at 100%.

4
p1_nt•

Where on earth are you getting this idea?

The GPU will only be at 100% if the CPU is supplying it with enough work to stay busy.

At 720p with vsync off and GPU intensive settings turned down (tessellation, AA, etc) your GPU will be bored to death.

http://i.imgur.com/RJ82kYu.png

That is with a 6600k @ 5ghz and a GTX 1080 @ 2150mhz.

1
originfoomanchu•

Ok put it this way if your CPU can give you 200fps regardless of your GPU,

If you turn vsync on now the CPU cannot give you the 200fps because your limited to 144hz this means the CPU will only be working at 75% because at 75% it reaches the max fps it can give you.

Now with vsync off nothing is stopping it go full power.

3
p1_nt•

I understand that vsync will prevent 100% GPU usage in some cases.

But even if you turn vsync off, you will still hit a frame cap, either because of an engine limitation, or because your CPU can't feed the GPU with enough work. And once you hit that frame cap, your GPU usage will plummet.

So to say that turning vsync off "makes the gfx card work at 99%" is not true.

1
originfoomanchu•

Ok that makes sense with the screen shot you sent me as well and thinking about it I have vsync off and ultra on most games which is why I've always seen 99% gfx usage with it off,

I also don't think ryzen was/is performing at its best I was just using different methodology like on the video reviews a lot of the amd cores go down to 0% usage while all the Intel cores were at 60% or more so it seems the threads were not being distributed correctly,

This is why I'm giving it 3 months (and hopefully a couple of bios updates/bug fixes)

Then we should be able to gauge it's performance.

1
kb3035583•

If you play at 1080p/1440p, max settings with GTX 1080 and the GPU usage is 99%, only then we can see the true real world gaming performance.

I hope you realize that if you have 2 CPUs and both are able to feed a GPU to 99% GPU utilization there will be absolutely no difference in FPS.

2
KoreeniumOP[ RX 480 Nitro+ | 1300mhz @ 1056mv ] --- [ i5 3570K ]•

Even if in both cases GPU usage is 99% the CPU still plays some sort of role on FPS. And Jokers video clearly showed that Ryzen 1700 getting slightly less fps despite GPU usage being the same.

1
kb3035583•

Even if in both cases GPU usage is 99% the CPU still plays some sort of role on FPS. And Jokers video clearly showed that Ryzen 1700 getting slightly less fps despite GPU usage being the same.

Do this

  1. Record a benchmark run

  2. Record a second benchmark run following the first as similarly as possible on the exact same hardware

  3. Put the 2 videos side by side and see whether you're going to get the exact same FPS in a frame by frame comparison. Hint: You won't.

1
Gumbi1012•

You have valid points. I think it's shoddy on the part of the reviewers not to explain their results, while giving both sides of the story.

It's worth mentioning too that even with a high end GPU, some games still struggle with multi core usage (off the top of my head, SC2 doesn't scale past two cores, nor does WoW AFAIK - and SC2 becomes very CPU limited in lategame scenarios). In those cases IPC is king and Ryzen will struggle vs higher clocked Kaby Lake chips.

Hopefully AMD can eke out a few more % points of performance by fixing some BIOS issues (RAM is a pretty major problem right now vs Intel, and this definitely affects performance in CPU bound scenarios) as well as Microsoft updating their scheduling.

This, however, won't add a ton of performance, the core point still stands. Kaby lake has superior IPC and.clock way higher, and this must be taken into account.

1
Dr_Ravenshoe2500K | R9 290 | 16GB•

we might see that i7 7700K is being used more than 70% while Ryzen 1700 only 40%

So the entire point of your post is, that multitaskers benefit from more cores? Not everyone runs multiple "heavy" programs while gaming (I don't) and for gaming performance tests it's irrelevant.
It might be beneficial to include average core load data in tests though.

1
KoreeniumOP[ RX 480 Nitro+ | 1300mhz @ 1056mv ] --- [ i5 3570K ]•

No. What I am trying to say is that the real world gaming performance is not as bad as some reviewers have showed us.

1
Dr_Ravenshoe2500K | R9 290 | 16GB•

Then you don't understand the point of CPU gaming tests. They exist to expose CPU limits.
Why not test CPUs by running Witcher 3 in 1440p on a RX 480? That seems realistic but now you can't compare CPU performance between the tested CPUs because they are all limited by the GPU.
What if you buy a GTX 1180Ti next year but then your CPU limits performance even though the "real world" performance graphs last year showed no real difference between the CPUs tested?

1
[deleted]•

[deleted]

1
skjutengris•

and the 7700k is 20% slower in the division so what to do now?

You fucked. http://www.toptengamer.com/wp-content/uploads/2017/03/R7-1700-vs-i7-7700k-GTX-1080-Minimum-FPS-1080p.jpg

add freesync screen and you wont perceive difference when gaming.

1
[deleted]•

[deleted]

1
ragtev•

I'm such a stickler for fps that even 10% fps is not a compromise I'm willing to make. I was really hopeful for this CPU but I can't justify it for my needs . I hope it sells well and spurs on further innovation from both sides of the aisle.

0
teksturi•

I'm such a stickler for fps that even 10% fps is not a compromise I'm willing to make. I was really hopeful for this CPU but I can't justify it for my needs . I hope it sells well and spurs on further innovation from both sides of the aisle.

So when you are gaming do you stop browsers, spotify, dropbox etc... Because thouse things matters.

1