The problem of acquiring only 500 cases


I want to retrieve video data for a university research project, but I can only retrieve 500 videos.

The documentation says “When searching by game_id,the response contains a maximum of 500 videos that show this content.”
Is it impossible to retrieve more than 500?

The language used is python.

Please help me to solve this problem.

def get_all_streams(cursor, counter=7):
    while counter != 0:
        url = '' + (f'&after={cursor}' if cursor else '')
        headers = {
            'Client-ID': client_id,
            'Authorization': f'Bearer {access_token}',
            'Content-Type': 'application/x-www-form-urlencoded; charset=UTF-8'

        response_json = requests.get(url, headers=headers).json()

        if counter == 1:
            return data
        print(len(data), cursor)

        if 'cursor' in response_json['pagination']:
            return get_all_streams(response_json['pagination']['cursor'], counter - 1)
            return data


df = pd.DataFrame(data[1:], columns=data[0])
df.to_csv("out.csv", index=True)

You answered your own question

With this API and using a game_id you cannot get more than 500 videos

Thank you for your reply.
That’s certainly true.

If I use user_id, less than 100 will be output, even though the user’s channel has more than 100 videos.

Do you know anything about this issue?

If you are looking at the users page you might be thinking clips are videos, and clips show on the clips API

Or you are comparing highlights and archives and uploads on the page but only asking for archives via the API

Or some other combination

Thank you for your response. I really appreciate it.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.