Leaderboard
How do we calculate our rating in the Leaderboard?
We use the ELO system to determine the relative strength of products based on the results of battles between them. Each product receives a numerical rating that changes after each battle depending on the result and the strength of the opponent.
We use ELO for every category (Legal research, Document drafting, etc)
How Does the System Work?
Initial Conditions
- Starting Rating: each new product receives 1000 points
- K-factor: 32 (determines the speed of rating change)
Types of Battle Results
- Product A Victory - Product A gets +1.0 point, Product B gets 0.0 points
- Product B Victory - Product B gets +1.0 point, Product A gets 0.0 points
- Tie - Both products get 0.5 points each
- Both Bad - Each product gets 0.5 points (processed as a tie)
Calculation Formula
Expected Result:
Expected_A = 1 / (1 + 10^((Rating_B - Rating_A) / 400))
Expected_B = 1 - Expected_A
Rating Update:
New_Rating = Old_Rating + K_factor × (Actual_Score - Expected_Score)
Win Rate Calculation
Win_Rate = (Wins + 0.5 × Ties) / Total_Battles
Note: ties count as half a win, percentage is calculated only when battles exist
Calculation Examples
Example 1: Equal Opponents
- Product A: 1000 rating
- Product B: 1000 rating
- Expected result: 50% vs 50%
- If A wins: A gains +16 points, B loses 16 points
Example 2: Strong vs Weak
- Product A: 1200 rating (strong)
- Product B: 1000 rating (weak)
- Expected result: ~76% in favor of A
- If B wins unexpectedly: B gains +24 points, A loses 24 points