Hi,

Welcome to Code Arena!

Code Arena is a dedicated platform for evaluating Code LLMs, focusing on both functional correctness and code efficiency.

[To the ACL reviewers: please note that CodeArena is submitted to the DEMO track. Our primary focus is showcasing the platform itself, rather than emphasizing metric computation or theoretical analysis. Thank you!

We offer user-friendly APIs for submitting and testing code generated by LLMs.

GitHub: CodeArena

We are currently working on the new version of CodeArena 🚧

Warm regards,

Mingzhe

from codearena import codearena

# Initilize CodeArena Client
client = codearena.CodeArena(url_root='https://codearena.online', token='<codearena_token>')

# Get Problem List
problems = client.get_problems()

# Get Problem Details
problem = client.get_problem(problem_id='<problem_id>')

# Get Submission List
submissions = client.get_submissions()

# Get Submission Details
submission = client.get_submission(<submission_id>)

# Submit Solution
submission_result = client.post_submission(problem_code="<problem_id>", language="<language>", source="<source_code>")

To facilitate exploration, we provide a trial account (Account: Test / Password: Haveatry!) for anyone interested in browsing our data. Enjoy!