Steam Introduces The Interactive Recommender

Steam main advantage over competitors is its massive catalogue of games from developers big and small and in almost every genre. However, with so many games to choose from, users often get lost in the library. Valve now have come up with a new tool for Steam to help sort through the games in its catalogue. Valve’s new tool, Interactive Recommender, now brings about machine learning to give players personalized recommendations based on their own individual play patterns combined with real-time controls to adjust results. See below for the information provided by Valve.

How it works:

Underlying this new recommender is a neural-network model that is trained to recommend games based on a user's playtime history, along with other salient data. We train the model based on data from many millions of Steam users and many billions of play sessions, giving us robust results that capture the nuances of different play patterns and covers our catalog. The model is parameterized so that we can restrict output to games released within a specified time-window and can be adjusted to prefer games a higher or lower underlying popularity. These parameters are exposed to the user, allowing you to select whether to see only recent releases in the results, or go all the way back to include games released a decade ago. Similarly, you can choose whether to see mainstream hits, or deep cuts from the catalog. Regardless of the settings of the sliders, the results will always be personalized and relevant to the individual user.

Machine learning across the Steam store:

Unlike more traditional approaches, we don't explicitly feed our model information about the games. Instead, the model learns about the games for itself during the training process. In fact, the only information about a game that gets explicitly fed into the process is the release date, enabling us to do time-windowing for the release-date slider. It turns out that using release date as part of the model training process yields better quality results than simply applying it as filter on the output.

Notably, we do not use information about tags or review scores when creating the model. This means reviews or tags alone simply cannot affect results. The model infers properties of games by learning what users do, not by looking at other extrinsic data.

We do allow users to filter the final results by tag, so they can narrow down to the kind of game they're in the mood for at that time, but this isn't part of underlying model.

A neural network informed by the Steam Community of players:

One direction is to gather every single piece of information about a game, and then make guesses about what games are similar, and then recommend those “similar” games. But that allows for all sorts of weird distortions— just because you play a lot of Beat Saber, doesn’t mean we should only ever recommend you VR rhythm games. This model takes a different approach. It disregards most of the usual data about a game, like genre or price point. Instead, it looks at what games you play and what games other people play, then makes informed suggestions based on the decisions of other people playing games on Steam. The idea is that if players with broadly similar play habits to you also tend to play another game you haven't tried yet, then that game is likely to be a good recommendation for you.

Popularity:

We chose “popularity” just because there might not be a more accurate term, but you could also think of it as “mainstream-ness”. Just like books or music or movies, there’s a huge range of what people are looking for. One person wants to know the newest and most popular games around, and the next person wants the opposite: games that are interesting and relevant but not necessarily well-known. We think this tool will be helpful to those on both ends of that spectrum. We've found that, especially for people who play a lot of games, digging into the "niche” end of the range can be a very effective way to find hidden gems.

Recommendations on Steam:

Rather than introducing a big change to the way customized recommendations are determined on Steam, we’re introducing this new recommender as an experiment customers can seek out and try. This will help us get better usage data while voiding any sudden shifts that we know can be frustrating for customers and developers who are accustomed to Steam. Should the interactive recommender or related experiments prove useful, we’ll share an update before rolling out any big changes to the way Steam recommends titles to people. The data driving Popular, New, and Trending is different from that of the Discovery Queue, this new recommender, and so on. We view this new interactive recommender as one discovery element among many, and look forward to introducing more ways to connect customers with interesting content and developers.

Recommendations and new games:

New games in a system such as this one have a chicken-and-egg effect known as the “cold start” problem. The model can't recommend games that don't have players yet, because it has no data about them. It can react quite quickly, and when re-trained it picks up on new releases with just a few days of data. That said, it can't fill the role played by the Discovery Queue in surfacing brand new content, and so we view this tool to be additive to existing mechanisms rather than a replacement for them.

No need for developer optimization:

Sometimes, computer-driven discovery makes creators focus on optimizing for “The Algorithm” rather than customers. You might ask, how is this any different? We designed the recommender to be driven by what players do, not by extrinsic elements like tags or reviews. The best way for a developer to optimize for this model is to make a game that people enjoy playing. While it's important to supply users with useful information about your game on its store page, you shouldn't agonize about whether tags or other metadata will affect how a recommendations model sees your game.