add op-challenger

Author: dajuguan

L2/op-challenger.md

@@ -0,0 +1,59 @@
+# Tools
+A [Python script](./scripts/play-op-challenger.py) is provided to facilitate listing games in progress and simulating a dishonest actor attacking the game up to maxGameDepth.
+To see all available commands and options, run: `python3 ./scripts/play-op-challenger.py -h`
+
+## Environment setup
+- Install `cast` and `make op-challenger`
+- Replace `OP_CHALLENGER`, `L1_RPC`, and `DISPUTE_GAME_FACTORY_PROXY` in `play-op-challenger.py` with your configurations or provide these options as command-line arguments (see help for details).
+
+> In the following tutorials, `--l1-rpc`, `--fdg-addr`, and `--binpath` are optional if `OP_CHALLENGER`, `L1_RPC`, and `DISPUTE_GAME_FACTORY_PROXY` have been provided in the code.
+
+## List games with absolute prestates
+
+```sh
+python3 ./play-op-challenger.py list-games --status 1 --l1-rpc $L1_RPC --fdg-addr $DISPUTE_GAME_FACTORY_PROXY --binpath $OP_CHALLENGER_BINARY_PATH
+```
+
+This command differs from `op-challenger`'s default `list-games` command in that you can filter games by `--status` (see help for its meaning) and the absolute prestate is queried, allowing you to check if the game's absolute prestate matches the current implementation.
+
+## 1v1 actor to attack a game to maxGameDepth
+
+### Attacking a game with an honest root Claim
+The following script simulates a dishonest actor attacking an existing game with random claims against every honest claim, itll wait any honest actor to respond to every attack using `op-challenger` after each attack, and repeat attacking until the specified maxGameDepth.
+
+```sh
+python3 ./play-op-challenger.py attack-all --game-addr $ADDR --parent-index $INDEX --maxGameDepth 73 --pk $PRIVATE_KEY --l1-rpc $L1_RPC --fdg-addr $DISPUTE_GAME_FACTORY_PROXY --binpath $OP_CHALLENGER_BINARY_PATH 
+```
+The `parent-index` is the index of the honest claim you want to start attacking. If no one has attacked it before, the default index is 0.
+
+### Create a game with a dishonest root claim and attack honest challenger's Claims
+- First, create a game with a dishonest root claim:
+
+```sh
+python3 test.py create-game --output-root "any value" --l2-block-num $NUMBER --pk $PK --l1-rpc $L1_RPC --fdg-addr $DISPUTE_GAME_FACTORY_PROXY --binpath $OP_CHALLENGER_BINARY_PATH 
+```
+
+- Then, attack the game after receiving the first response from any honest challenger:
+
+```sh
+python3 ./play-op-challenger.py attack-all --game-addr $ADDR --parent-index 1 --pk $PRIVATE_KEY --l1-rpc $L1_RPC --fdg-addr $DISPUTE_GAME_FACTORY_PROXY --binpath $OP_CHALLENGER_BINARY_PATH 
+```
+
+If the game reaches `maxGameDepth` (default is 73), a dishonest actor attempting to win would need to call the game contract's `step` function themselves. However, this call will always revert, assuming the game contract is functioning correctly and enforces the rules properly.
+
+## List claims
+
+```sh
+python3 ./play-op-challenger.py list-claims --game-addr $ADDR
+```
+
+# Grafana Monitor 
+Incorrect Forecast Value Scenarios:
+
+- Warning: Dishonest actors are attacking the game
+    - disagree_challenger_ahead (danger): The root claim of a game is dishonest, but the honest `op-challenger` hasn't responded to the dishonest claims for a while. This might cause an incorrect output root to be updated in the `AnchorStateRegistry`.
+    - agree_challenger_ahead: The root claim of a game is honest, but dishonest actors are challenging the game and the honest `op-challenger` hasn't responded to the dishonest actors for a while.
+
+- Fatal: Dishonest actors have won the game
+    - disagree_defender_wins: The dishonest actors have won the game and the honest actors have forfeited their bonds. Besides, the dishonest root claims have been updated in the `AnchorStateRegistry`! 
+    - agree_challenger_wins: The dishonest actors have won the game, and the honest actors have lost the game and forfeited their bonds.

L2/scripts/play-op-challenger.py

@@ -0,0 +1,281 @@
+#!/bin/python3
+# dependencies: cast, op-challenger
+import argparse
+import os
+from dataclasses import dataclass
+from enum import Enum
+import pprint
+
+OP_CHALLENGER = rf"op-challenger binary absolute path"
+L1_RPC = "http://88.99.30.186:8545"
+DISPUTE_GAME_FACTORY_PROXY = "0x4b2215d682208b2a598cb04270f96562f5ab225f"
+
+
+class GameStatus(Enum):
+    IN_PROGRESS = 1
+    CHALLENGER_WINS = 2
+    DEFENDER_WINS = 3
+
+
+@dataclass
+class Game:
+    gameAddr: str
+    status: GameStatus | str = GameStatus.IN_PROGRESS
+    gameType: int = 0  # 0:cannon, 1:permissoned, 255:fastgame
+    index: int | None = None
+    created: str | None = None
+    l2BlockNum: int | None = None
+    rootClaim: str | None = None
+    claimsCount: int | None = None
+    prestate: str | None = None
+
+    def __post_init__(self):
+        if type(self.status) == str:
+            if "IN_PROGRESS" in self.status:
+                self.status = GameStatus.IN_PROGRESS
+            if "CHALLENGER_WINS" in self.status:
+                self.status = GameStatus.CHALLENGER_WINS
+            if "DEFENDER_WINS" in self.status:
+                self.status = GameStatus.DEFENDER_WINS
+        self.setAbsolutePrestate()
+
+    def lenClaims(self):
+        cmd = rf'cast call {self.gameAddr} "claimDataLen()" --rpc-url {L1_RPC}'
+        res = os.popen(cmd).read()
+        res = res.strip()
+        return int(res, 16)
+
+    def setAbsolutePrestate(self):
+        cmd = rf'cast call {self.gameAddr} "absolutePrestate()" --rpc-url {L1_RPC}'
+        res = os.popen(cmd).read()
+        res = res.strip()
+        self.prestate = res
+
+    def move(self, claim, pk, parentIndex=None):
+        if parentIndex == None:
+            parentIndex = self.lenClaims() - 1
+
+        cmd = rf'''{OP_CHALLENGER} move --l1-eth-rpc {L1_RPC} --game-address {self.gameAddr} --attack --parent-index {parentIndex} --claim {claim} --private-key {pk}  --mnemonic ""'''
+        res = os.popen(cmd).read()
+        print(f"counter {parentIndex} with claim:", claim)
+        print(f"counter {parentIndex} move resp:", res)
+
+    def claimAt(self, index):
+        cmd = rf'cast call {self.gameAddr} "claimData(uint256)" {index} --rpc-url {L1_RPC}'
+        res = os.popen(cmd).read()
+        res = res.strip()[2:]
+        return {
+            "parentIndex": res[:64],
+            "counteredBy": res[64 : 64 * 2],
+            "claimant": res[64 * 2 : 64 * 3],
+            # bond:res[64*3:64*4],
+            "claim": res[64 * 4 : 64 * 5],
+            # position:res[64*5:64*6],
+            # clock:res[64*6:64*7]
+        }
+
+    def absolutePrestate(self):
+        cmd = rf'cast call {self.gameAddr} "absolutePrestate()" --rpc-url {L1_RPC}'
+        res = os.popen(cmd).read()
+        return res.strip()
+
+    def list_claims(self):
+        cmd = rf"{OP_CHALLENGER} list-claims --l1-eth-rpc {L1_RPC} --game-address {self.gameAddr}"
+        res = os.popen(cmd).read()
+        return res.strip()
+
+    def gameType(self):
+        cmd = rf'cast call {self.gameAddr} "gameType()" --rpc-url {L1_RPC}'
+        res = os.popen(cmd).read()
+        return res.strip()
+
+    def gameStatus(self):
+        cmd = rf'cast call {self.gameAddr} "status()" --rpc-url {L1_RPC}'
+        res = os.popen(cmd).read()
+        return GameStatus(int(res.strip(), 16))
+
+    def maxGameDepth(self):
+        cmd = rf'cast call {self.gameAddr} "maxGameDepth()" --rpc-url {L1_RPC}'
+        res = os.popen(cmd).read()
+        return res.strip()
+
+    def attackToMaxDepth(self, parent_index, maxdepth, pk):
+        # attack with a random false claim when honest challenger responds
+        maxDepth = maxdepth
+        depth = parent_index - 1
+        while depth < maxDepth:
+            curDepth = self.lenClaims() - 1
+            if curDepth == depth + 1:
+                print("got op-challenger's move:", self.claimAt(curDepth))
+                # the first 2 hex must be 01 or 02 to meet the _verifyExecBisectionRoot requirements
+                randClaim = f"0x012222222222222222222222222221022222222222222222222222222222{curDepth+10}01"
+                self.move(randClaim, pk)
+                depth += 2
+        print(
+            """Max depth reached. Waiting for op-challenger (always honest) to:
+        1. Call step() and resolve() if rootClaim is honest.
+        2. Call resolve() (it's the dishonest actor's job to call step(), which will always revert) if rootClaim is dishonest.
+        """
+        )
+
+
+def list_games(status, l1_rpc, fdg_addr, **kargs):
+    cmd = rf"{OP_CHALLENGER} list-games --l1-eth-rpc {l1_rpc} --game-factory-address {fdg_addr}"
+    res = os.popen(cmd).read()
+    res = res.strip()
+    res = res.split("\n")
+    res = res[1:]  # remove the header fields and last line
+    games = []
+    for line in res:
+        idx = line[:4].strip()
+        gameAddr = line[4 : 4 + 43].strip()
+        gameType = line[4 + 43 : 4 + 43 + 5].strip()
+        created = line[4 + 43 + 5 : 4 + 43 + 5 + 21].strip()
+        l2BlockNum = line[4 + 43 + 5 + 21 : 4 + 43 + 5 + 22 + 15].strip()
+        rootClaim = line[4 + 43 + 5 + 22 + 15 : 4 + 43 + 5 + 22 + 15 + 66].strip()
+        claimsCount = line[
+            4 + 43 + 5 + 22 + 15 + 67 : 4 + 43 + 5 + 22 + 15 + 67 + 6
+        ].strip()
+        status = line[
+            4 + 43 + 5 + 22 + 15 + 67 + 7 : 4 + 43 + 5 + 22 + 15 + 67 + 7 + 14
+        ].strip()
+        game = Game(
+            gameAddr=gameAddr,
+            gameType=gameType,
+            status=status,
+            index=idx,
+            created=created,
+            l2BlockNum=l2BlockNum,
+            rootClaim=rootClaim,
+            claimsCount=claimsCount,
+            prestate=None,
+        )
+        games.append(game)
+    if status != 0:
+        games = list(filter(lambda x: x.status == status, games))
+
+    pprint.pprint(games)
+
+
+def attack_game_to_max_depth(game_addr, parent_index, maxdepth, pk, **kargs):
+    game = Game(gameAddr=game_addr)
+    game.attackToMaxDepth(parent_index, maxdepth, pk)
+
+
+def list_claims(game_addr, **kargs):
+    game = Game(gameAddr=game_addr)
+    claims = game.list_claims()
+    print(claims)
+
+
+def create_game(output_root, l2_block_num, pk, **kargs):
+    cmd = rf"{OP_CHALLENGER} create-game --l1-eth-rpc {L1_RPC} --game-factory-address {DISPUTE_GAME_FACTORY_PROXY} --output-root {output_root} --l2-block-num {l2_block_num} --private-key {pk}"
+    res = os.popen(cmd).read()
+    print(res)
+
+
+def main():
+    global L1_RPC, OP_CHALLENGER, DISPUTE_GAME_FACTORY_PROXY
+    parser = argparse.ArgumentParser(description="Game management script")
+    parser.add_argument("--l1-rpc", type=str, default=L1_RPC, help="l1 EL rpc url")
+    parser.add_argument(
+        "--fdg-addr",
+        type=str,
+        default=DISPUTE_GAME_FACTORY_PROXY,
+        help="Dispute game factory address",
+    )
+    parser.add_argument(
+        "--binpath",
+        type=str,
+        default=OP_CHALLENGER,
+        help="Op-challenger absolute binary path",
+    )
+    subparsers = parser.add_subparsers(dest="command")
+
+    # Subparser for the list-games command
+    parser_list = subparsers.add_parser("list-games", help="List all games")
+    parser_list.add_argument(
+        "--status",
+        type=int,
+        default=1,
+        choices=[0, 1, 2, 3],
+        help="Game status, 0:all, 1:in-progress, 2:challenger-wins, 3:defender-wins",
+    )
+    parser_list.set_defaults(func=list_games)
+
+    # Subparser for the attack command
+    parser_attack = subparsers.add_parser(
+        "attack-all",
+        help="Attack a game for every counter claim by honest challenger to maxDepth with random claim values",
+    )
+    parser_attack.add_argument(
+        "--game-addr",
+        type=str,
+        required=True,
+        help="Contract address of the game to attack, e.g.:0x11",
+    )
+    parser_attack.add_argument(
+        "--pk", type=str, required=True, help="Private key, e.g.:0x11"
+    )
+    parser_attack.add_argument(
+        "--parent-index",
+        type=int,
+        default=0,
+        help="Parent index to start attacking from, usually claimsCount-1",
+    )
+    parser_attack.add_argument(
+        "--maxdepth", type=int, default=73, help="MaxGameDepth of the attack ending"
+    )
+    parser_attack.set_defaults(func=attack_game_to_max_depth)
+
+    # Subparser for the list-claims command
+    parser_claims = subparsers.add_parser(
+        "list-claims",
+        help="List claims for a given game",
+    )
+    parser_claims.add_argument(
+        "--game-addr",
+        type=str,
+        required=True,
+        help="Contract address of the game to attack, e.g.:0x11",
+    )
+    parser_claims.set_defaults(func=list_claims)
+
+    # Subparser for the create-game command
+    parser_create_game = subparsers.add_parser(
+        "create-game",
+        help="create a game with specified root claim and l2 block number",
+    )
+    parser_create_game.add_argument(
+        "--output-root",
+        type=str,
+        default="0xffff",
+        help="The output root for the fault dispute game, e.g.: 0x11",
+    )
+    parser_create_game.add_argument(
+        "--l2-block-num",
+        type=str,
+        required=True,
+        help="The l2 block number for the game",
+    )
+    parser_create_game.add_argument(
+        "--pk", type=str, required=True, help="Private key, e.g.: 0x11"
+    )
+    parser_create_game.set_defaults(func=create_game)
+
+    args = parser.parse_args()
+    if args.l1_rpc:
+        L1_RPC = args.l1_rpc
+    if args.binpath:
+        OP_CHALLENGER = args.binpath
+    if args.fdg_addr:
+        DISPUTE_GAME_FACTORY_PROXY = args.fdg_addr
+
+    if args.command:
+        args.func(**vars(args))
+    else:
+        parser.print_help()
+
+
+if __name__ == "__main__":
+    main()