{"$k":["id","title","columns","rows"],"$r":[["arena-fairness","What is comparable: each comparison and what keeps it fair",{"$k":["key","label","unit"],"$r":[["what","Comparison","text"],["fair","Fair across all seven?","text"],["why","Why","text"]]},{"$k":["what","fair","why"],"$r":[["Accuracy, consistency, calibration, \"none of these\", prompt injection","Yes","Same 1,085 items and the same states for every model. The open models ran as 4- or 8-bit files, so a full-precision run could differ a little; our order of the models agrees with the independent Decision Index (rank correlation 0.93)."],["Turn-based games","Yes","No clock: a move counts only by its quality."],["Pong decision quality (right zone per decision)","Yes","Judged per decision against the ideal intercept; time does not enter."],["Speed on this Mac","Among the six open models only","The six ran on one machine, one call at a time. Jev ran on TypeSafe's servers."],["Speed on one GPU (Decision Index)","Among the six open models only","Third party, one GPU, one harness. Jev is a hosted API there and includes the network."],["Speed through one gateway (OpenRouter)","Yes for the four it lists","One gateway measures all four. Providers differ and the numbers change daily."],["Price per 1,000 decisions","Yes for Jev, Clef and Clef-Flash","Cloudflare Workers AI prices all three on one list."],["Pong and other real-time games as deployed","No","Each answer takes effect after its own call time on its own machine, so the result mixes decision quality with hardware."],["Real-time games in fair mode (Tron, Snake and Pong in the arena)","Yes","Every player's answer takes effect after the same simulated 150 ms, whatever its real call time, so hosted and local models stand on the same footing and only decision quality counts. The models are still called for real. The leagues are one seed with 2 to 4 games per pairing, so the intervals are wide."]]}],["arena-models","Every model, every measure",{"$k":["key","label","unit"],"$r":[["model","Model","text"],["runs","Runs as","text"],["acc","Accuracy","text"],["robust","Right in all 3 presentations","text"],["groups","Consistent groups","text"],["escape","Escaped when it should","text"],["falseEscape","Escaped when it should not","text"],["ece","Calibration error (ECE)","ratio"],["brier","Brier","ratio"],["p50","Median ms (where it ran: this Mac, or Jev's servers)","ms"],["p95","p95 ms","ms"],["same","Same answer twice","text"],["errors","Errors","count"]]},{"$k":["model","runs","acc","robust","groups","escape","falseEscape","ece","brier","p50","p95","same","errors"],"$r":[["Jev 1.13","Hosted API","76.8% (805/1048)","764/1048","40/53","126/147","34/618",0.03,0.18,137,189,"58/60",0],["Clef 27B","Q4_K_M in llama.cpp, 19.23 GB","69.9% (733/1048)","685/1048","38/53","112/147","16/618",0.28,0.429,1919,2792,"60/60",8],["Clef-Flash 9B","Q4_K_M in llama.cpp, 6.49 GB","65.2% (683/1048)","625/1048","42/53","89/147","9/618",0.287,0.476,566,816,"60/60",0],["Kev 4B","Q4_K_M in llama.cpp, 3.03 GB","64.0% (671/1048)","597/1048","35/53","91/147","50/618",0.037,0.326,307,600,"60/60",0],["lev 4B","Q4_K_M in llama.cpp, 3.01 GB","58.6% (614/1048)","560/1048","38/53","69/147","21/618",0.145,0.364,425,646,"60/60",0],["Laya","Q8_0 in llama.cpp, 0.45 GB","27.4% (287/1048)","166/1048","35/53","26/147","85/618",0.203,0.603,43,68,"60/60",0],["Julia-1","Q8_0 in llama.cpp, 0.17 GB","25.9% (271/1048)","168/1048","28/53","33/147","102/618",0.547,0.681,13,22,"60/60",0]]}],["arena-pairwise","Head to head on the same items: who was right where the other was wrong (exact McNemar test)",{"$k":["key","label","unit"],"$r":[["pair","Pair","text"],["aOnly","Only the first right","count"],["bOnly","Only the second right","count"],["p","p","ratio"],["verdict","Verdict","text"]]},{"$k":["pair","aOnly","bOnly","p","verdict"],"$r":[["Jev 1.13 vs Clef 27B",158,86,0,"Jev 1.13 is ahead"],["Jev 1.13 vs Clef-Flash 9B",208,86,0,"Jev 1.13 is ahead"],["Jev 1.13 vs lev 4B",270,79,0,"Jev 1.13 is ahead"],["Jev 1.13 vs Kev 4B",212,78,0,"Jev 1.13 is ahead"],["Jev 1.13 vs Laya",584,66,0,"Jev 1.13 is ahead"],["Jev 1.13 vs Julia-1",599,65,0,"Jev 1.13 is ahead"],["Clef 27B vs Clef-Flash 9B",141,91,0.0012,"Clef 27B is ahead"],["Clef 27B vs lev 4B",209,90,0,"Clef 27B is ahead"],["Clef 27B vs Kev 4B",178,116,0.0004,"Clef 27B is ahead"],["Clef 27B vs Laya",529,83,0,"Clef 27B is ahead"],["Clef 27B vs Julia-1",543,81,0,"Clef 27B is ahead"],["Clef-Flash 9B vs lev 4B",168,99,0,"Clef-Flash 9B is ahead"],["Clef-Flash 9B vs Kev 4B",158,146,0.5282,"not clear"],["Clef-Flash 9B vs Laya",486,90,0,"Clef-Flash 9B is ahead"],["Clef-Flash 9B vs Julia-1",510,98,0,"Clef-Flash 9B is ahead"],["lev 4B vs Kev 4B",111,168,0.0008,"Kev 4B is ahead"],["lev 4B vs Laya",425,98,0,"lev 4B is ahead"],["lev 4B vs Julia-1",452,109,0,"lev 4B is ahead"],["Kev 4B vs Laya",471,87,0,"Kev 4B is ahead"],["Kev 4B vs Julia-1",503,103,0,"Kev 4B is ahead"],["Laya vs Julia-1",190,174,0.4318,"not clear"]]}],["arena-examples","One item per suite that split the field: about half the models right",{"$k":["key","label","unit"],"$r":[["suite","Suite","text"],["item","Item","text"],["question","Question","text"],["answer","Right answer","text"],["right","Right","text"],["wrong","Wrong","text"],["why","Why","text"]]},{"$k":["suite","item","question","answer","right","wrong","why"],"$r":[["Games","Find the poisoned column","Y is to move. R has no winning move at the moment. Exactly one column is unsafe: if Y drops a disc in it, R can win on the very next move. Choose that unsafe column.","Drop a disc in column 3","Jev 1.13, lev 4B, Kev 4B, Laya","Clef 27B, Clef-Flash 9B, Julia-1","A Y disc in column 3 lands directly under the cell where R completes four, so R wins on the very next move. All other columns leave R without an immediate win."],["Logic and thought experiments","Flagged application: how likely is the fault?","One application was picked at random from those checked, and it was flagged. Which band holds the chance that it really has a copied answer?","The chance is 30% to under 60%.","Jev 1.13, Clef 27B, Clef-Flash 9B","lev 4B, Kev 4B, Laya, Julia-1","Among the flagged items, the share that truly have the fault is 35.5% (Bayes' rule), which falls in the band \"30% to under 60%\"."],["Policy cases, 20 industries","Delay exactly on the long-delay line, refund requested, no missed connection","Which action does the policy require for this passenger case? Apply the numbered rules in order and choose exactly one action.","Offer no remedy: no rebooking and no refund","Jev 1.13, Clef-Flash 9B, lev 4B, Kev 4B","Clef 27B, Laya, Julia-1","R4: the delay is 300 minutes, which does not meet \"less than 150 minutes\" and meets \"300 minutes or less\", and no connection was missed, so there is no remedy."],["Usability intents","Buttons lost against the background","Pick the one action the app should run now for what the user just said. Use the screen state and the rules in the state.","Turn on high-contrast colors","Jev 1.13, Clef 27B, Clef-Flash 9B, lev 4B","Kev 4B, Laya, Julia-1","Buttons that blend into the background are a contrast problem, so High contrast."],["Stress tests","Loud alert names and big counts versus the severity rule","Apply the routing rules to the alert and pick the action.","Open a ticket","Jev 1.13, Clef 27B, Clef-Flash 9B, Kev 4B","lev 4B, Laya, Julia-1","Severity 2 is below the page level, so no page; it is at least 2, so open_ticket, whatever the name or customer count says."]]}],["arena-families","Every item family: right answers per model (first presentation)",{"$k":["key","label","unit"],"$r":[["suite","Suite","text"],["family","Family","text"],["jev","Jev 1.13","text"],["clef","Clef 27B","text"],["clef-flash","Clef-Flash 9B","text"],["kev-4b","Kev 4B","text"],["lev","lev 4B","text"],["laya","Laya","text"],["julia-1","Julia-1","text"]]},{"$k":["suite","family","jev","clef","clef-flash","kev-4b","lev","laya","julia-1"],"$r":[["Games","tic-tac-toe","8/23","7/23","6/23","8/23","11/23","5/23","1/23"],["Games","connect-four","7/26","4/26","6/26","7/26","7/26","4/26","5/26"],["Games","nim","12/22","7/22","9/22","5/22","5/22","1/22","6/22"],["Games","pong-intercept","6/18","9/18","8/18","9/18","6/18","3/18","4/18"],["Games","sudoku-single","6/17","5/17","2/17","6/17","3/17","2/17","2/17"],["Games","wordle","10/16","7/16","3/16","9/16","9/16","3/16","4/16"],["Games","maze","7/16","4/16","2/16","5/16","3/16","5/16","4/16"],["Games","hanoi","5/16","6/16","8/16","4/16","2/16","4/16","5/16"],["Games","coin-weighing","11/17","11/17","9/17","9/17","8/17","4/17","6/17"],["Games","knight-moves","9/21","9/21","6/21","12/21","4/21","3/21","3/21"],["Logic and thought experiments","syllogism","13/13","12/13","12/13","13/13","9/13","7/13","4/13"],["Logic and thought experiments","quantifier-logic","6/6","5/6","2/6","4/6","5/6","1/6","2/6"],["Logic and thought experiments","conditional-logic","12/12","11/12","10/12","10/12","7/12","3/12","7/12"],["Logic and thought experiments","wason-selection","5/6","5/6","6/6","5/6","3/6","1/6","1/6"],["Logic and thought experiments","knights-knaves","4/12","2/12","2/12","2/12","2/12","3/12","3/12"],["Logic and thought experiments","seating-order","7/12","5/12","3/12","5/12","3/12","1/12","4/12"],["Logic and thought experiments","monty-hall","7/10","8/10","7/10","4/10","9/10","3/10","3/10"],["Logic and thought experiments","base-rate","9/10","9/10","3/10","2/10","3/10","2/10","2/10"],["Logic and thought experiments","dice-cards","9/10","6/10","6/10","5/10","6/10","4/10","4/10"],["Logic and thought experiments","gamble-ev","6/9","9/9","6/9","9/9","5/9","1/9","2/9"],["Logic and thought experiments","sunk-cost","5/6","5/6","4/6","5/6","5/6","2/6","2/6"],["Logic and thought experiments","gamblers-fallacy","9/11","9/11","7/11","7/11","8/11","4/11","4/11"],["Logic and thought experiments","denominator-neglect","1/3","1/3","1/3","1/3","2/3","1/3","2/3"],["Logic and thought experiments","conjunction","4/5","2/5","4/5","2/5","2/5","2/5","2/5"],["Logic and thought experiments","simpson","2/4","0/4","1/4","1/4","2/4","1/4","1/4"],["Logic and thought experiments","sample-size","4/5","4/5","5/5","1/5","1/5","1/5","3/5"],["Logic and thought experiments","anchoring","4/4","2/4","3/4","2/4","2/4","2/4","1/4"],["Logic and thought experiments","units","4/9","3/9","4/9","3/9","2/9","2/9","5/9"],["Logic and thought experiments","calendar-time","5/9","3/9","5/9","4/9","3/9","3/9","2/9"],["Policy cases, 20 industries","insurance","10/17","11/17","15/17","9/17","8/17","8/17","4/17"],["Policy cases, 20 industries","retail","9/13","7/13","10/13","7/13","7/13","2/13","1/13"],["Policy cases, 20 industries","banking","12/16","13/16","10/16","8/16","11/16","3/16","1/16"],["Policy cases, 20 industries","fraud","12/14","10/14","11/14","11/14","11/14","3/14","5/14"],["Policy cases, 20 industries","airline","14/14","11/14","13/14","10/14","11/14","2/14","4/14"],["Policy cases, 20 industries","hotel","14/16","11/16","10/16","8/16","6/16","4/16","4/16"],["Policy cases, 20 industries","logistics","13/13","10/13","10/13","9/13","9/13","1/13","4/13"],["Policy cases, 20 industries","saas","13/13","13/13","11/13","10/13","11/13","3/13","2/13"],["Policy cases, 20 industries","telecom","15/15","13/15","11/15","12/15","9/15","4/15","3/15"],["Policy cases, 20 industries","utilities","8/14","10/14","10/14","11/14","9/14","5/14","3/14"],["Policy cases, 20 industries","hr-leave","13/13","12/13","9/13","12/13","10/13","3/13","3/13"],["Policy cases, 20 industries","hr-expense","10/12","11/12","11/12","10/12","9/12","4/12","5/12"],["Policy cases, 20 industries","realestate","9/15","4/15","7/15","9/15","2/15","6/15","5/15"],["Policy cases, 20 industries","education","13/15","8/15","9/15","8/15","6/15","5/15","6/15"],["Policy cases, 20 industries","food","10/15","13/15","10/15","12/15","11/15","4/15","5/15"],["Policy cases, 20 industries","manufacturing","9/12","6/12","9/12","5/12","4/12","3/12","5/12"],["Policy cases, 20 industries","health-billing","10/12","10/12","8/12","7/12","6/12","3/12","2/12"],["Policy cases, 20 industries","health-scheduling","3/7","3/7","3/7","5/7","5/7","2/7","0/7"],["Policy cases, 20 industries","permits","14/14","12/14","12/14","11/14","9/14","2/14","2/14"],["Policy cases, 20 industries","itsec","12/14","9/14","9/14","11/14","8/14","6/14","5/14"],["Usability intents","clear intent","28/31","29/31","31/31","27/31","30/31","16/31","8/31"],["Usability intents","screen or history context","38/39","33/39","34/39","29/39","33/39","7/39","3/39"],["Usability intents","out of scope","18/19","18/19","17/19","17/19","14/19","12/19","0/19"],["Usability intents","ambiguous request","17/20","13/20","7/20","3/20","6/20","1/20","8/20"],["Usability intents","destructive needs confirm","27/27","24/27","25/27","23/27","25/27","5/27","4/27"],["Usability intents","slang and typos","17/18","18/18","17/18","16/18","17/18","5/18","3/18"],["Usability intents","multilingual","33/34","29/34","28/34","31/34","29/34","13/34","6/34"],["Usability intents","accessibility","13/17","16/17","17/17","15/17","17/17","5/17","1/17"],["Usability intents","undo, redo and back","20/21","21/21","20/21","20/21","15/21","9/21","3/21"],["Stress tests","injection","38/40","36/40","31/40","38/40","27/40","13/40","18/40"],["Stress tests","needle","22/22","21/22","15/22","16/22","15/22","7/22","8/22"],["Stress tests","distractor","15/16","15/16","13/16","12/16","9/16","3/16","4/16"],["Stress tests","negation","17/21","19/21","18/21","13/21","16/21","8/21","6/21"],["Stress tests","threshold","13/25","13/25","7/25","7/25","12/25","12/25","12/25"],["Stress tests","out-of-scope","19/19","18/19","16/19","16/19","15/19","4/19","9/19"],["Stress tests","near-options","12/14","9/14","10/14","12/14","10/14","4/14","4/14"],["Stress tests","many-options","16/16","14/16","9/16","14/16","11/16","1/16","0/16"],["Stress tests","paraphrase","22/27","20/27","20/27","18/27","14/27","11/27","11/27"]]}],["arena-industries","Policy cases by industry: right answers per model (first presentation)",{"$k":["key","label","unit"],"$r":[["industry","Industry","text"],["jev","Jev 1.13","text"],["clef","Clef 27B","text"],["clef-flash","Clef-Flash 9B","text"],["kev-4b","Kev 4B","text"],["lev","lev 4B","text"],["laya","Laya","text"],["julia-1","Julia-1","text"]]},{"$k":["industry","jev","clef","clef-flash","kev-4b","lev","laya","julia-1"],"$r":[["Airline rebooking","14/14","11/14","13/14","10/14","11/14","2/14","4/14"],["Banking and card disputes","12/16","13/16","10/16","8/16","11/16","3/16","1/16"],["Education admissions and registration","13/15","8/15","9/15","8/15","6/15","5/15","6/15"],["HR leave and expense policy","23/25","23/25","20/25","22/25","19/25","7/25","8/25"],["Healthcare administration","13/19","13/19","11/19","12/19","11/19","5/19","2/19"],["Hotel booking changes","14/16","11/16","10/16","8/16","6/16","4/16","4/16"],["IT security access requests","12/14","9/14","9/14","11/14","8/14","6/14","5/14"],["Insurance claims","10/17","11/17","15/17","9/17","8/17","8/17","4/17"],["Logistics and shipping exceptions","13/13","10/13","10/13","9/13","9/13","1/13","4/13"],["Manufacturing quality control","9/12","6/12","9/12","5/12","4/12","3/12","5/12"],["Payments fraud flags","12/14","10/14","11/14","11/14","11/14","3/14","5/14"],["Public-sector permits","14/14","12/14","12/14","11/14","9/14","2/14","2/14"],["Real-estate rental applications","9/15","4/15","7/15","9/15","2/15","6/15","5/15"],["Restaurant and food delivery","10/15","13/15","10/15","12/15","11/15","4/15","5/15"],["Retail returns","9/13","7/13","10/13","7/13","7/13","2/13","1/13"],["SaaS customer support routing","13/13","13/13","11/13","10/13","11/13","3/13","2/13"],["Telecom plan changes","15/15","13/15","11/15","12/15","9/15","4/15","3/15"],["Utilities and energy billing","8/14","10/14","10/14","11/14","9/14","5/14","3/14"]]}],["arena-games-table","Round robin by game: wins-draws-losses",{"$k":["key","label","unit"],"$r":[["model","Model","text"],["ttt","Tic-tac-toe","text"],["c4","Connect Four","text"],["nim","Nim","text"],["dab","Dots and Boxes","text"],["illegal","Illegal moves","count"]]},{"$k":["model","ttt","c4","nim","dab","illegal"],"$r":[["Jev 1.13","37-6-37","56-0-24","31-0-49","59-0-21",0],["Clef 27B","38-5-37","42-0-38","45-0-35","23-0-57",0],["Clef-Flash 9B","34-7-39","38-0-42","36-0-44","31-0-49",0],["lev 4B","29-9-42","45-0-35","29-0-51","34-0-46",0],["Kev 4B","33-9-38","27-0-53","38-0-42","34-0-46",0],["Laya","20-13-47","17-0-63","34-0-46","44-0-36",0],["Julia-1","29-6-45","26-0-54","38-0-42","23-0-57",0]]}],["arena-pong-table","Pong round robin: every model, speed and accuracy side by side",{"$k":["key","label","unit"],"$r":[["model","Model","text"],["record","Games W-D-L","text"],["medianMs","Median decision (ms)","ms"],["decisions","Decisions","count"],["perfect","Right zone when the ball came","text"],["returnRate","Shots returned","text"]]},{"$k":["model","record","medianMs","decisions","perfect","returnRate"],"$r":[["Jev 1.13","13-0-3",132.4,1436,"100% (523/523)","86%"],["Kev 4B","12-0-4",284.7,815,"98% (303/310)","80%"],["lev 4B","9-0-7",417.8,451,"99% (151/153)","59%"],["Clef-Flash 9B","8-0-8",527.6,336,"83% (112/135)","49%"],["Clef 27B","4-0-12",1789.1,84,"100% (31/31)","26%"],["Julia-1","4-0-12",12.4,7451,"21% (603/2811)","21%"],["Laya","3-0-13",36.2,2460,"12% (122/999)","12%"]]}],["arena-pong-featured","Featured Pong series (4 games each, seed 2)",{"$k":["key","label","unit"],"$r":[["pair","Pair","text"],["aWins","First won","count"],["bWins","Second won","count"]]},{"$k":["pair","aWins","bWins"],"$r":[["Clef 27B vs Clef-Flash 9B",1,1],["Clef 27B vs Jev 1.13",0,2],["Jev 1.13 vs Laya",4,0]]}],["arena-pong-sides","Featured Pong match (Jev 1.13 vs Laya): who played which side",{"$k":["key","label","unit"],"$r":[["side","Side","text"],["model","Model","text"],["id","Id","text"],["medianMs","Median decision time (ms)","ms"],["decisions","Decisions in the match","count"],["points","Points","count"]]},[{"side":"left","model":"Jev 1.13","id":"jev","medianMs":123.6,"decisions":54,"points":3},{"side":"right","model":"Laya","id":"laya","medianMs":37.2,"decisions":156,"points":0}]],["arena-c4-players","Featured Connect Four game: players and result",{"$k":["key","label","unit"],"$r":[["side","Side","text"],["model","Model","text"],["result","Result","text"]]},[{"side":"A","model":"Jev 1.13","result":"won"},{"side":"B","model":"Clef 27B","result":"lost"}]],["arena-pong-rally","Featured Pong rally (Jev 1.13 vs Laya): ball and paddle positions every 80 ms, 0 to 1",{"$k":["key","label","unit"],"$r":[["t","Seconds","seconds"],["x","Ball x","ratio"],["y","Ball y","ratio"],["left","Left paddle","ratio"],["right","Right paddle","ratio"]]},{"$k":["t","x","y","left","right"],"$r":[[0,0.5,0.5,0.5,0.5],[0.083,0.5,0.5,0.5,0.5],[0.167,0.5,0.5,0.5,0.5],[0.25,0.5,0.5,0.5,0.5],[0.333,0.5,0.5,0.5,0.5],[0.417,0.5,0.5,0.5,0.5],[0.5,0.5,0.5,0.5,0.5],[0.583,0.5488,0.471,0.5,0.48],[0.667,0.5975,0.441,0.5,0.43],[0.75,0.6463,0.412,0.49,0.38],[0.833,0.695,0.382,0.44,0.33],[0.917,0.7438,0.353,0.39,0.3],[1,0.7925,0.323,0.34,0.3],[1.083,0.8413,0.294,0.29,0.3],[1.167,0.89,0.264,0.24,0.3],[1.25,0.9106,0.235,0.19,0.28],[1.333,0.8563,0.206,0.14,0.25],[1.417,0.8019,0.177,0.13,0.3],[1.5,0.7475,0.149,0.18,0.3],[1.583,0.6931,0.12,0.23,0.3],[1.667,0.6388,0.091,0.28,0.3],[1.75,0.5838,0.062,0.3,0.29],[1.833,0.5294,0.033,0.3,0.3],[1.917,0.475,0.035,0.3,0.3],[2,0.4206,0.064,0.3,0.3],[2.083,0.3663,0.093,0.3,0.3],[2.167,0.3119,0.122,0.3,0.3],[2.25,0.2575,0.151,0.3,0.3],[2.333,0.2031,0.179,0.3,0.3],[2.417,0.1488,0.208,0.3,0.3],[2.5,0.0944,0.237,0.3,0.3],[2.583,0.1125,0.227,0.3,0.3],[2.667,0.1719,0.192,0.3,0.27],[2.75,0.2306,0.156,0.3,0.26],[2.833,0.2894,0.121,0.3,0.23],[2.917,0.3488,0.085,0.28,0.18],[3,0.4075,0.05,0.23,0.13],[3.083,0.4669,0.026,0.18,0.1],[3.167,0.5256,0.061,0.13,0.1],[3.25,0.5844,0.097,0.1,0.1],[3.333,0.6438,0.132,0.1,0.1],[3.417,0.7025,0.167,0.1,0.1],[3.5,0.7619,0.203,0.1,0.1],[3.583,0.8206,0.238,0.1,0.1],[3.667,0.8794,0.274,0.1,0.1],[3.75,0.9388,0.309,0.1,0.1],[3.833,0.9975,0.345,0.15,0.11]]}],["arena-c4-game","Featured Connect Four game (Jev 1.13 vs Clef 27B): every move. Rule: The longest Connect Four game between jev and clef in the turn-based round robin (most moves, openings included); ties go to the earliest.",{"$k":["key","label","unit"],"$r":[["moveNo","Move","count"],["opening","Random opening move","text"],["side","Side","text"],["col","Column","count"],["p","Probability","ratio"],["optimal","Perfect move","text"],["best","Best columns","text"]]},{"$k":["moveNo","opening","side","col","p","optimal","best"],"$r":[[1,true,"A",4,null,null,""],[2,true,"B",4,null,null,""],[3,true,"A",3,null,null,""],[4,true,"B",3,null,null,""],[5,false,"A",4,0.44,false,"2,5"],[6,false,"B",4,0.1926,false,"5"],[7,false,"A",3,0.39,false,"2,5"],[8,false,"B",3,0.1899,false,"5"],[9,false,"A",3,0.44,false,"2,5"],[10,false,"B",4,0.1815,false,"2"],[11,false,"A",3,0.58,false,"2,5"],[12,false,"B",4,0.2549,false,"2"],[13,false,"A",5,0.62,true,"2,5"],[14,false,"B",2,0.2223,null,""],[15,false,"A",5,0.6,false,"6"],[16,false,"B",6,0.2136,true,"6"],[17,false,"A",5,0.61,true,"5"],[18,false,"B",5,0.2408,true,"5"],[19,false,"A",5,0.67,false,"2"],[20,false,"B",5,0.2192,true,"5"],[21,false,"A",6,0.48,true,"6"],[22,false,"B",6,0.3235,true,"6"],[23,false,"A",6,0.74,true,"6"],[24,false,"B",6,0.3626,false,"1"],[25,false,"A",6,0.62,true,"6"],[26,false,"B",2,0.4789,false,"7"],[27,false,"A",2,0.54,true,"2"]]}],["arena-leagues-table","Arena leagues: wins-draws-losses and Elo per model",{"$k":["key","label","unit"],"$r":[["model","Player","text"],["c0","Othello","text"],["c1","Pong, fair mode 150 ms","text"],["c2","Snake, fair mode 150 ms","text"],["c3","Tron, fair mode 150 ms","text"]]},{"$k":["model","c0","c1","c2","c3"],"$r":[["perfect","32-0-0 (1280)","7-0-0 (1098)","–","–"],["Clef 27B","20-2-10 (1082)","–","11-0-5 (1068)","12-3-17 (956)"],["random","17-0-15 (1015)","1-0-6 (930)","6-0-10 (954)","8-4-20 (898)"],["Laya","15-1-16 (990)","0-0-7 (902)","1-1-14 (850)","7-1-24 (852)"],["Julia-1","13-2-17 (965)","2-0-5 (958)","9-0-7 (1022)","2-1-29 (761)"],["lev 4B","14-0-18 (964)","4-0-3 (1014)","4-0-12 (908)","14-3-15 (991)"],["Clef-Flash 9B","11-1-20 (924)","3-0-4 (986)","9-1-6 (1034)","17-1-14 (1025)"],["Kev 4B","9-1-22 (891)","6-0-1 (1070)","2-1-13 (875)","17-2-13 (1031)"],["Jev 1.13","9-1-22 (890)","5-0-2 (1042)","12-1-3 (1103)","27-3-2 (1219)"],["expert","–","–","16-0-0 (1185)","30-2-0 (1267)"]]}]]}