Atari Environment Benchmark

🥇 Atari Environment Benchmark Result

Env. \ Alg.

DQN

DDQN+PER

A2C (GAE)

A2C (n-step)

PPO

Adventure

-0.94

-0.92

-0.77

-0.85

-0.3

AirRaid

1876

3974

4202

3557

4028

Alien

822

1574

1519

1627

1413

Amidar

90.95

431

577

418

795

Assault

1392

2567

3366

3312

3619

Asterix

1253

6866

5559

5223

6132

Asteroids

439

426

2951

2147

2186

Atlantis

68679

644810

2747371

2259733

2148077

BankHeist

131

623

855

1170

1183

BattleZone

6564

6395

4336

4533

13649

BeamRider

2799

5870

2659

4139

4299

Berzerk

319

401

1073

763

860

Bowling

30.29

39.5

24.51

23.75

31.64

Boxing

72.11

90.98

1.57

1.26

96.53

Breakout

80.88

182

377

398

443

Carnival

4280

4773

2473

1827

4566

Centipede

1899

2153

3909

4202

5003

ChopperCommand

1083

4020

3043

1280

3357

CrazyClimber

46984

88814

106256

109998

116820

Defender

281999

313018

665609

657823

534639

DemonAttack

1705

19856

23779

19615

121172

DoubleDunk

-21.44

-22.38

-5.15

-13.3

-6.01

ElevatorAction

32.62

17.91

9966

8818

6471

Enduro

437

959

787

0.0

1926

FishingDerby

-88.14

-1.7

16.54

1.65

36.03

Freeway

24.46

30.49

30.97

0.0

32.11

Frostbite

98.8

2497

277

261

1062

Gopher

1095

7562

929

1545

2933

Gravitar

87.34

258

313

433

223

Hero

1051

12579

16502

19322

17412

IceHockey

-14.96

-14.24

-5.79

-6.06

-6.43

Jamesbond

44.87

702

521

453

561

JourneyEscape

-4818

-2003

-921

-2032

-1094

Kangaroo

1965

8897

67.62

554

4989

Krull

5522

6650

7785

6642

8477

KungFuMaster

2288

16547

31199

25554

34523

MontezumaRevenge

0.0

0.02

0.08

0.19

1.08

MsPacman

1175

2215

1965

2158

2350

NameThisGame

3915

4474

5178

5795

6386

Phoenix

2909

8179

16345

13586

30504

Pitfall

-68.83

-73.65

-101

-31.13

-35.93

Pong

18.48

20.5

19.31

19.56

20.58

Pooyan

1958

2741

2862

2531

6799

PrivateEye

784

303

93.22

78.07

50.12

Qbert

5494

11426

12405

13590

13460

Riverraid

953

10492

8308

7565

9636

RoadRunner

15237

29047

30152

31030

32956

Robotank

3.43

9.05

2.98

2.27

Seaquest

1185

4405

1070

1684

1715

Skiing

-14094

-12883

-19481

-14234

-24713

Solaris

612

1396

2115

2236

1892

SpaceInvaders

451

670

733

750

797

StarGunner

3565

38238

44816

48410

60579

Tennis

-23.78

-10.33

-22.42

-19.06

-11.52

TimePilot

2819

1884

3331

3440

4398

Tutankham

35.03

159

161

175

211

UpNDown

2043

11632

89769

18878

262208

Venture

4.56

9.61

0.0

11.84

VideoPinball

8056

79730

35371

40423

58096

WizardOfWor

869

328

1516

1247

4283

YarsRevenge

5816

15698

27097

11742

10114

Zaxxon

442

54.28

64.72

24.7

641

The table above presents results for 62 Atari games. All agents were trained for 10M frames (40M including skipped frames). Reported results are the episode score at the end of training, averaged over the previous 100 evaluation checkpoints with each checkpoint averaged over 4 Sessions. Agents were checkpointed every 10k training frames.