Comparing code generation capabilities of various models.
could you create a 2D scroll shooter with 3D effect using a runjs block and three js ?
Make it colorful and poppy !
I want the game area to feel comfy
we should have live,
random bonus drop:
enemy get faster or stronger other time
| Model | Response Size | Code Size | Completion Tokens | Prompt Tokens | TTFT | Total Time |
|---|---|---|---|---|---|---|
| claude-sonnet-4 | 24.68 KB | 23.11 KB | 6771 | 3392 | 5.31s | 84.01s |
| deepseek-r1-0528 | 16.97 KB | 15.88 KB | 7438 | 2801 | 96.39s | 107.17s |
| devstral-small | 3.06 KB | 3.03 KB | 772 | 2885 | 1.96s | 35.14s |
| gemini-2.0-flash-001 | 13.38 KB | 9.81 KB | 3364 | 3156 | 757ms | 16.78s |
| gemini-2.5-flash | 34.06 KB | 28.63 KB | 8967 | 3156 | 1.56s | 55.06s |
| gemma-3-27b-it | 12.39 KB | 9.89 KB | 3031 | 3170 | 3.10s | 102.70s |
| gpt-4.1-mini | 17.3 KB | 16.57 KB | 4464 | 2712 | 1.08s | 101.89s |
| gpt-4.1-nano | 14.02 KB | 13.11 KB | 3647 | 2712 | 911ms | 98.34s |
| gpt-4.1 | 16.5 KB | 15.46 KB | 5087 | 2712 | 2.39s | 102.71s |
| kimi-dev-72b | 27.97 KB | 8.39 KB | 6488 | 2738 | 2.87s | 111.88s |
| llama-4-scout | 7.59 KB | 7.42 KB | 1715 | 2706 | 1.10s | 75.66s |
| magistral-small-2506 | 20.4 KB | 20.39 KB | 4955 | 2885 | 623ms | 77.76s |
| mistral-small-3.2-24b-instruct | 14.8 KB | 13.92 KB | 4367 | 2885 | 3.59s | 123.39s |
| qwen3-30b-a3b | 8.77 KB | 8.76 KB | 3845 | 2739 | 62.19s | 104.18s |
| qwen3-32b | 12.72 KB | 11.9 KB | 4639 | 2739 | 74.83s | 109.61s |