Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] browser_use cannot write text #48

Open
HairlessVillager opened this issue Feb 6, 2025 · 1 comment
Open

[BUG] browser_use cannot write text #48

HairlessVillager opened this issue Feb 6, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@HairlessVillager
Copy link
Collaborator

Description

browser_use tool cannot write text on some websites, like Gmail, Google Docs or QQmail.

Steps to Reproduce

Gmail:

  1. Open https://mail.google.com and login.
  2. Click the "Compose" button and maximize the writing window.

Image

  1. Open Eko extension with DevTools and run prompt input "123" in the Body textarea on the current page, but not input the Subject ot Recipients.
  2. There's no new text on the page.

Google Docs

  1. Open https://docs.google.com/ and login.
  2. Open a new document.

Image

  1. Open Eko extension with DevTools and run prompt input "123" in the textarea on the current Google Docs page.
  2. There's no new text on the page.

QQmail

  1. Open https://wx.mail.qq.com/ and login.
  2. Click the "写信" button.

Image

  1. Open Eko extension with DevTools and run prompt input "123" in the Body textarea on the current page, but not input the Subject ot Recipients.
  2. There's no new text on the page.

Expected Behavior

For all 3 cases, there's should have a "123" text or something like this.

Environment

Windows, Chrome or Edge, Eko v1.0.8

Additional Context

For some cases, like Gmail or Google Docs, the browser_use tool executed "successfully" in logs:

Image

Image

For some cases, like QQmail, the browser_use tool failed:

Image

@HairlessVillager HairlessVillager added the bug Something isn't working label Feb 6, 2025
veasion added a commit that referenced this issue Feb 7, 2025
@HairlessVillager
Copy link
Collaborator Author

Thank you for your patch! The bug in the original Gmail and QQmail scenarios has been fixed. However, there are more scenarios where similar issues still occur:

Gmail Reply:

  1. Open https://mail.google.com/ and login.
  2. Enter an email received and click the "Reply" button.

Image

  1. Open Eko extension with DevTools and run prompt input "123" in the Reply textarea on the current page.
  2. There's no text on the page, and the tool throws an error.
    Image

X

  1. Open https://x.com and login.
  2. Open Eko extension with DevTools and run prompt write a hello-world post in the current page.
  3. There's a "hello, world" text in the textarea, but I cannot post it.

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant