Infrastructure deployment tasks for path-to-ranking

[peppy]

From a high level, tracking the order of deployment tasks that have dependencies on other changes.

Tasks

Preview Give feedback

1. Populate max_combo in osu_beatmaps using osu-difficulty-calculator #22
   +0
   
2. Apply Considerations for solo_scores table structure / indices #15 (required for osu-queue-score-statistics changes in master for rank count increase efficiency)
3. Leaderboard replays are unavailable osu#24229
   9 of 9
   area:results type:online +2
   
4. Figure out the final partitioning structure for solo_scores #16
   +0
   
5. Add partitioning to solo_scores table #13
   +0
   
6. Redeploy server components with new legacy difficulty attribute storage #21
   13 of 13
   +0
   
7. Update schema in line with performance testing osu-elastic-indexer#153
   +0
8. Score statistics processor needs to process PP for imported highscores #25
   +0
   
9. Update osu-queue-score-statistics after next nuget build (mod multiplier changes)
10. Check on created_at being 0000-00-00 00:00:00 after import (https://github.com/peppy/osu-queue-score-statistics/commit/f1cc5d9c883894fd534266a4a38605c25ef781fe)
11. Playcount incrementing should check for valid plays osu-queue-score-statistics#63
    +0
    
12. Add method for cleaning up non-high scores osu-queue-score-statistics#141
    6 of 7
    +0
    
13. Remove updated_at column from scores table (pending on osu-web to stop using it)
14. Consider moving scores to block storage
15. Re-import stable scores to scores table
16. Update stable score import watcher with new command style and pp processing considerations
17. Add datadog coverage of queue lengths, indexing, etc.
18. Profile and optimise live osu-server-spectator
19. Recreate score_tokens (removed to disable score submission via non-lazer. endpoint) and don’t forget partitioning
20. Switch osu-web to new branch
21. Consider dropping score_process_history (deemed likely unnecessary)
22. Migrate old lazer scores across (including multiplayer linking for playlists)
23. Consider migrating pinned scores
24. Consider removing modded entries from osu_beatmap_difficulty (deemed likely unnecessary)
25. Re-run indexing on ES index for all rulesets

Testing notes for self:

To reset everything:

# nuke all indices
osu.ElasticIndexer# dotnet run index nuke

# view all indices
curl -X GET "localhost:9200/_cat/indices?v&pretty"

# restart es service
systemctl restart elasticsearch

truncate table scores;truncate table score_legacy_id_map;truncate table score_performance;

Ongoing stuff which needs to be run:

# osu-queue-store-statistics
cd ~/repos/osu-queue-score-statistics/osu.Server.Queues.ScoreStatisticsProcessor
git fetch; git reset --hard peppy/new-table-names
SCHEMA=20231208 dotnet run queue import-high-scores --start-id 0

# osu-elastic-indexer
cd ~/repos/osu-elastic-indexer/osu.ElasticIndexer
git fetch --all; git reset --hard peppy/new-table-names
SCHEMA=20231208 dotnet run queue watch

[peppy]

As a heads up, I've migrated all my remaining tasks from my private todo list to this issue, so it should be up-to-date with everything remaining.