Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trying simple commands fail? #11

Open
dlipsy-supintel opened this issue Feb 27, 2025 · 2 comments
Open

Trying simple commands fail? #11

dlipsy-supintel opened this issue Feb 27, 2025 · 2 comments

Comments

@dlipsy-supintel
Copy link

I tried to ask to navigate to File Explorer and navigate to c:\developer, and the mouse couldn't find the Explorer window. It said the Display dimensions are 4000x2500 and it kept navigating and selecting icons on the desktop rather than the opened File Explorer window. As a result, it couldn't find the address bar or any navigation elements on the Explorer bar. I'm in Windows 10 22H2

@erik-dunteman
Copy link
Contributor

Sorry you're running into issues! LLMs aren't perfect but mouse issues tend to just be solvable.

Cursor issues tend to happen based on screen dimension confusions - models like Claude appear to be trained on specific dimensions 1024x768 so it tends to guess within that dimension space. The chat agent operates thinking its in 1024x768 space as a result, scaling coordinates to match your actual screen dimensions. Though I haven't tested as large as 4000x2500

Could you clarify

  • are you using the chat or SDK
  • if SDK, which model are you using to drive the tool calling

thanks

@dlipsy-supintel
Copy link
Author

Yes, for some reason I didn't get the notification on GH from my phone. Hence, I just saw this. I was using the chat after connecting my local machine to the API key. I don't believe I chose the model, so it's the default model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants