[server] increase getToken bucket size

[filiptronicek]

Description

It seems like the rate limits we put in place with #20391 were not enough. This PR bumps the rate limits further to 500 reqs / minute. At this point, you'd have to be querying for the token 8 times per second to get rate limited.

Related Issue(s)

Fixes https://gitpod.slack.com/archives/C083C24UMHN

How to test

1. Join my org
2. Auth against our self-hosted bitbucket
3. Start a workspace from https://ft-bump-gec41629acd9.preview.gitpod-dev.com/orgs/join?inviteId=5c4119ff-c3e2-48fc-adac-e47a814e23b9

Here are a few scripts that helped me with testing this:

For trying out git clones:

#!/bin/bash

mkdir -p ~/workspace/test-repos
cd ~/workspace/test-repos

for i in {0..1000}
do
REPO_URL="https://bitbucket.gitpod-dev.com/scm/tes/2k-repos-$i.git"
echo "Cloning repository $i: $REPO_URL"
git clone $REPO_URL
if [ $? -ne 0 ]; then
    echo "Failed to clone repository $i"
    # Continue with the next repository even if one fails
    continue
fi
done

echo "Finished cloning repositories"

For directly calling supervisor to get a token:

#!/bin/bash

# Initialize counters
total_time=0
success_count=0
fail_count=0
start_time=$(date +%s.%N)

for i in {0..1000}
do
    # Time each individual call
    iter_start=$(date +%s.%N)
    
    # Run the credential helper
    echo "host=github.com" | gp credential-helper get | grep "password" > /dev/null
    
    # Capture the exit status
    status=$?
    iter_end=$(date +%s.%N)
    
    # Calculate iteration time
    iter_time=$(echo "$iter_end - $iter_start" | bc)
    total_time=$(echo "$total_time + $iter_time" | bc)
    
    if [ $status -ne 0 ]; then
        echo "❌ iteration $i (took ${iter_time}s)"
        ((fail_count++))
    else
        echo "✅ iteration $i (took ${iter_time}s)"
        ((success_count++))
        # Uncomment next line if you want to see successful iterations too
        # echo "Success iteration $i (took ${iter_time}s)"
    fi
done

end_time=$(date +%s.%N)
total_runtime=$(echo "$end_time - $start_time" | bc)

# Calculate statistics
avg_time=$(echo "scale=3; $total_time / 1001" | bc)

echo "----------------------------------------"
echo "Execution Statistics:"
echo "Total Runtime: ${total_runtime}s"
echo "Average Time per Call: ${avg_time}s"
echo "Successful Calls: $success_count"
echo "Failed Calls: $fail_count"
echo "----------------------------------------"

[filiptronicek]

On the linked preview env, I was able to clone 363 repos before being rate limited

[filiptronicek]

And for the credential helper calls:

✅ iteration 495 (took .022262539s)
✅ iteration 496 (took .020367080s)
✅ iteration 497 (took .017887390s)
✅ iteration 498 (took .020238330s)
✅ iteration 499 (took .020113700s)
❌ iteration 500 (took .017011259s)
❌ iteration 501 (took .017615850s)

[geropl]

Did not test, but change LGTM 👍