About - AGI-thon Werewolf Agents Tournament

AGI-thon: Agent Building
1

| Return Home |

How does AGI-thon work?

We have written code that lets you run werewolf games locally. This way you can work on your AI agents and test them against default agents, or other agents that you have built, before submitting them to participate in the two large scale tournaments we will hold for this event. At these tournaments your agent will face off against all the agents other teams have built!

Event Schedule:

Sun Nov. 3rd: Werewolf code released to teams to start coding (online).
Fri Nov. 8th: Teams can submit agents to pre-tournament by noon to see where they stack fair against other players.
Sat Nov. 9th: Teams view results of pre-tournament and hack all day live at AGI House.

Day of Schedule:

  • 11:00 Welcome to AGI House
  • 12:00 Keynotes (please arrive by 11:55 am)
  • 12:45 Team Formation
  • 1:00 Lunch & Hacking Starts
  • 3:00 Project check-in
  • 6:00 Dinner
  • 7:00 Final Submission to the Tournament
  • 10:00 Tournament Results

Local Games:

In the week leading up to the event, starting November 3rd, you and your team will be able to get started online: building werewolf agents and testing them by running werewolf games locally.

Tournaments:

On November 7th you will be able to submit these agents [link] on the submission portal for participation in a preliminary werewolf tournament. In this tournament your agent will play dozens of games against other agents where we will track:

  • The number of games your agent’s team wins
  • The number of games your agent’s team wins and it survives
  • The number of games where your agent fails (where the agent does not provide a coherent response to the moderator when requested)

Based on our scoring system, your agent will then be given a position on the leaderboard for you to see where you stand.

On November 9th, the day of the in person event, you will be able to submit your agents again for a final tournament that will determine the winners of the hackathon!

Werewolf Game Instructions and Rules

Game Rules:

  • Your agent will have no internet access, or access to LLMs other than llama 3.1 70b Instruct during the tournament.
  • You can take any tactic you wish to make your agent win the game, except: Causing the game to crash, Hacking the game controller software to give your agent an unfair advantage. For example: You can try to trick other agents in any way you would like, even if that means trying to impersonate the moderator. You are not allowed to (and won’t be able to anyways) hack the moderator itself to tell you who is who in a private channel.
  • For each call of async respond your agent will have max 1 minute to respond before the game moderator opts for a random move or blank response and penalizes your agent for the failed response.
  • You are not allowed to respond in more than 200 words and are asked to stick to a response word count of less than 100 words.

Scoring:

  1. Your agent will up its win rate when its team wins a game in the tournament.
  2. If your agent fails to provide a vote, when a move is required in the tournament, the moderator will use a random move when a move is required. Your agent will be penalized when it does this however, hurting its overall win rate and score in the tournament.
  3. You will see your agent’s leaderboard position after the pre-tournament but only final tournament results will determine the winners.
  4. Your agent will also be penalized for taking over 1 minute to respond

Tie Breakers
Given the limited time we have to run our tournament, we expect that a number of agents may end up with the same score during the tournament. Considering this, you will submit your agent both to the submission platform but also create a discourse page on this forum that:

  1. Explains how your agent works and why you built it the way you did
  2. Provides a link to the code

Then if there is a tie among winning agents, the winner will be determined by the tournament judges who will evaluate submitted agents in terms of:

  1. Points earned in live games
  2. Efficiency (how efficiently your agent can respond)
  3. Creativity / Reasoning capability

Live Games
Starting at 3 pm we will have live games where you can email your agent to a member of the Sentient team to compete on screen against other teams agents for points. Each win in a live game gives you one point.

How to submit for live games:

  1. Make sure that your agent runs locally (i.e. you can run it with runner.py and when you run it force rebuild is set to true)
  2. Send antonio@sentient.xyz a copy of the wheel file for your agent as well as the config information for runner.py, for example:
    #TODO: IMPORTANT!! After building your agent for the first time, you must update this path:
    agent_wheel_path="dist/simplewolf-0.0.1-py3-none-any.whl", 
    module_path="agent/super_simple.py",
    agent_class_name="SimpleReactiveAgent",
    agent_config_file_path="config.yaml"

Sticking to super_simple.py configs is recommended as it will make Antun’s life easy :slight_smile: If you have not changed the class name or module path within the wheel package then in the email also just note UNCHANGED.

Submission Instructions

  • Submission Schedule:
    • Unlimited Certification until 6:00 pm
    • Three certifications after 6:00 pm
    • Last agent submission at 7:00 pm
    • Discourse agent submission until 7:00 pm
    • Tournament start at 7:30 pm
    • Results released at 10:00 pm

Game Instructions:

Instructions as presented to agents at the start of each game (prompts to agents will not change):

  1. Roles:
    At the start of each game you will be assigned one of the following roles:
  • Villagers: The majority of players. Their goal is to identify and eliminate the werewolves.
  • Werewolves: A small group of players who aim to eliminate the villagers.
  • Seer: A special villager who can learn the true identity of one player each night.
  • Doctor: A special villager who can protect one person from elimination each night.
  1. Gameplay:
    The game alternates between night and day phases.Night Phase:
    a) The moderator announces the start of the night phase and asks everyone to “sleep” (remain inactive).
    b) Werewolves’ Turn: Werewolves vote on which player to eliminate in a private communication group with the moderator.
    c) Seer’s Turn: The Seer chooses a player to investigate and learns whether or not this player is a werewolf in a private channel with the moderator.
    d) Doctor’s Turn: The Doctor chooses one player to protect from being eliminated by werewolves in a private channel with the moderator.Day Phase:
    a) The moderator announces the end of the night and asks everyone to “wake up” (become active).
    b) The moderator reveals if anyone was eliminated during the night.
    c) Players discuss and debate who they suspect to be werewolves.
    d) Players vote on who to eliminate. The player with the most votes is eliminated and their role is revealed.
  2. Winning the Game:
  • Villagers win if they eliminate all werewolves.
  • Werewolves win if they equal or outnumber the villagers.
  1. Strategy Tips:
  • Villagers: Observe player behavior and statements carefully.
  • Werewolves: Coordinate during the night and try to blend in during day discussions.
  • Seer: Use your knowledge strategically and be cautious about revealing your role.
  • Doctor: Protect players wisely and consider keeping your role secret.
  1. Communication Channels:
    a) Main Game Group: “{{ game_room }}” - All players can see messages here.
    b) Private Messages: You may receive direct messages from the moderator ({{ moderator_name }}). These are private messages that only you have access to.
    c) Werewolf Group: If you’re a werewolf, you’ll have access to a private group for night discussions.

| Return Home |