-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bump PMAT version to 0.9.3, simplify calculate_bet_amount
for KnownOutcomeAgent
#51
Conversation
WalkthroughThe recent update to the Changes
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (invoked as PR comments)
Additionally, you can add CodeRabbit Configration File (
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 0
Review Status
Configuration used: CodeRabbit UI
Files ignored due to path filters (1)
pyproject.toml
is excluded by!**/*.toml
Files selected for processing (1)
- prediction_market_agent/agents/known_outcome_agent/deploy.py (2 hunks)
Additional comments not posted (1)
prediction_market_agent/agents/known_outcome_agent/deploy.py (1)
85-85
: Consider adding a comment explaining the rationale behind using a fixed bet amount and relying onmarket.currency
directly in thecalculate_bet_amount
method. This will help maintain clarity and understanding for future maintenance or enhancements.
), | ||
currency=Currency.xDai, | ||
) | ||
return BetAmount(amount=(Decimal(1.0)), currency=market.currency) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I know we now filtering for markets with liquidity, but people can still create markets with for example, $0.01 in liquidity and then it doesn't make much sense to me to bet more than the minimal bet. wdyt?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good point. In that case, I think it makes sense to filter the market at the pick_markets
stage, so as not to waste openai API credits. I've made that change above
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Don't you want to keep them for benchmark purposes?
If not, okay by me, just that
elif market.get_liquidity_in_xdai() > 5:
print(
f"Skipping market {market.id=} {market.question=}, because it has insufficient liquidity."
)
Should it be with the opposite sign, probably?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oops! 😆
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Don't you want to keep them for benchmark purposes?
I'm not too concerned about that, more about trying to get the markets that should be p_yes/no==0.95 to that point
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 0
Review Status
Configuration used: CodeRabbit UI
Files ignored due to path filters (1)
poetry.lock
is excluded by!**/*.lock
Files selected for processing (2)
- prediction_market_agent/agents/known_outcome_agent/deploy.py (4 hunks)
- prediction_market_agent/agents/known_outcome_agent/known_outcome_agent.py (1 hunks)
Files skipped from review due to trivial changes (1)
- prediction_market_agent/agents/known_outcome_agent/known_outcome_agent.py
Files skipped from review as they are similar to previous changes (1)
- prediction_market_agent/agents/known_outcome_agent/deploy.py
@@ -28,14 +27,19 @@ def market_is_saturated(market: AgentMarket) -> bool: | |||
|
|||
|
|||
class DeployableKnownOutcomeAgent(DeployableAgent): | |||
model = "gpt-4-1106-preview" | |||
model = "gpt-4-turbo-preview" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I just noticed this as well, this can point to a different model in future without notice, is that desirable?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmm good question. Maybe in general not, but I reckon for this case it's good - my reasoning being that otherwise over time the agent will get less and less 'up to date with current events' which I would assume is bad for making future predictions.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 0
Review Status
Configuration used: CodeRabbit UI
Files selected for processing (1)
- prediction_market_agent/agents/known_outcome_agent/deploy.py (4 hunks)
Files skipped from review as they are similar to previous changes (1)
- prediction_market_agent/agents/known_outcome_agent/deploy.py
Summary by CodeRabbit