Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Multi-Agent Swarm for Logistics #515

Open
evelynmitchell opened this issue Jun 25, 2024 · 1 comment
Open

[BUG] Multi-Agent Swarm for Logistics #515

evelynmitchell opened this issue Jun 25, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@evelynmitchell
Copy link
Contributor

evelynmitchell commented Jun 25, 2024

In colab, without an image file uploaded.

Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1




Image file not found: factory_image1.jpg
2024-06-25T01:10:56.107112+0000 Attempt 1: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:56.554826+0000 Attempt 2: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:56.967989+0000 Attempt 3: Error generating response: 'choices'
2024-06-25T01:10:56.976875+0000 Failed to generate a valid response after retry attempts.
Error with the request: 'choices'
Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1




Image file not found: factory_image1.jpg
2024-06-25T01:10:57.433397+0000 Attempt 1: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:57.854453+0000 Attempt 2: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:58.353338+0000 Attempt 3: Error generating response: 'choices'
2024-06-25T01:10:58.362766+0000 Failed to generate a valid response after retry attempts.
Error with the request: 'choices'
Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1




Image file not found: factory_image1.jpg
2024-06-25T01:10:59.192636+0000 Attempt 1: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:59.678470+0000 Attempt 2: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:11:00.045673+0000 Attempt 3: Error generating response: 'choices'
2024-06-25T01:11:00.053300+0000 Failed to generate a valid response after retry attempts.
Error with the request: 'choices'
Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1

Upvote & Fund

  • We're using Polar.sh so you can upvote and help fund this issue.
  • We receive the funding once the issue is completed & confirmed by you.
  • Thank you in advance for helping prioritize & fund our backlog.
Fund with Polar
@evelynmitchell evelynmitchell added the bug Something isn't working label Jun 25, 2024
@patrickbdevaney
Copy link
Contributor

In colab, without an image file uploaded.

Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1




Image file not found: factory_image1.jpg
2024-06-25T01:10:56.107112+0000 Attempt 1: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:56.554826+0000 Attempt 2: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:56.967989+0000 Attempt 3: Error generating response: 'choices'
2024-06-25T01:10:56.976875+0000 Failed to generate a valid response after retry attempts.
Error with the request: 'choices'
Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1




Image file not found: factory_image1.jpg
2024-06-25T01:10:57.433397+0000 Attempt 1: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:57.854453+0000 Attempt 2: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:58.353338+0000 Attempt 3: Error generating response: 'choices'
2024-06-25T01:10:58.362766+0000 Failed to generate a valid response after retry attempts.
Error with the request: 'choices'
Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1




Image file not found: factory_image1.jpg
2024-06-25T01:10:59.192636+0000 Attempt 1: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:10:59.678470+0000 Attempt 2: Error generating response: 'choices'
Error with the request: 'choices'
Image file not found: factory_image1.jpg
2024-06-25T01:11:00.045673+0000 Attempt 3: Error generating response: 'choices'
2024-06-25T01:11:00.053300+0000 Failed to generate a valid response after retry attempts.
Error with the request: 'choices'
Initializing Autonomous Agent swarm-worker-01...
Autonomous Agent Activated.
All systems operational. Executing task...

Loop 1 of 1

Upvote & Fund

  • We're using Polar.sh so you can upvote and help fund this issue.
  • We receive the funding once the issue is completed & confirmed by you.
  • Thank you in advance for helping prioritize & fund our backlog.

Fund with Polar

I updated the OpenAI API in the logistics example to use gpt-4o-mini and accept an image URL as input instead of relying on the deprecated VisionAPI or local image uploads. With this change, the logistics example now works as expected.

However, there is a caveat: some agents in the flow occasionally fail to process the image URL, despite the overall setup being consistent. A potential solution is to increase the max_loops value for each agent to allow additional attempts at processing the input, which may improve reliability and reduce the occurrence of these random failures.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants