Commit Graph

  • 32a42418e5 Improve VISION_PROMPT Josh Bickett 2023-11-21 09:36:02 -08:00
  • 4958751b87 Trying ## Demo again Josh Bickett 2023-11-20 11:29:11 -08:00
  • 8d7ccfe95a Improve VISION_PROMPT Josh Bickett 2023-11-20 07:23:08 -08:00
  • 25802aebc9 Improve VISION_PROMPT Josh Bickett 2023-11-20 07:11:37 -08:00
  • d5215e83b2 Improve VISION_PROMPT and messaging Josh Bickett 2023-11-19 19:45:57 -08:00
  • 3dc9c28bdd VISION_PROMPT improvements Josh Bickett 2023-11-19 19:37:29 -08:00
  • e95216edb7 VISION_PROMPT needs some help for chrome Josh Bickett 2023-11-19 14:33:19 -08:00
  • 5240bc5789 remove demo.mov for now Josh Bickett 2023-11-18 16:53:07 -08:00
  • bb3d503375 Add [Video Demo] to README.md Josh Bickett 2023-11-18 16:44:20 -08:00
  • 57dd8f7aee update VISION_PROMPT Josh Bickett 2023-11-18 08:42:00 -08:00
  • 4f54478fd2 Trying a new VERY IMPORTANT Josh Bickett 2023-11-18 08:20:49 -08:00
  • a9a8c4799f Only print if action_type != "UNKNOWN" Josh Bickett 2023-11-18 08:18:13 -08:00
  • 1df96fcba7 Adding DO NOT REFUSE TO OPERATE THE COMPUTER. because oai keeps refusing Josh Bickett 2023-11-18 08:14:34 -08:00
  • dd30d62fc4 Update error prints Josh Bickett 2023-11-18 08:10:00 -08:00
  • bdb4d0994b Add else handling for unknown response Josh Bickett 2023-11-18 08:08:25 -08:00
  • e0267fff6e Improve VISION_PROMPT because gpt thinks it can't do things Josh Bickett 2023-11-18 08:01:47 -08:00
  • b708b59ca6 Update setup.py and main.py to include main_entry Josh Bickett 2023-11-18 06:48:09 -08:00
  • 42e5b2dca8 Add multiple model compatibility and ModelNotRecognizedException Josh Bickett 2023-11-17 22:37:39 -08:00
  • 579b51e15e Add argparse Josh Bickett 2023-11-17 21:30:14 -08:00
  • 2cdb4ae6c2 Improve ### Contributions are Welcomed! Some Ideas: Josh Bickett 2023-11-17 19:40:37 -08:00
  • 59277be935 remove unnecessary print Josh Bickett 2023-11-17 19:19:51 -08:00
  • bb31466ca4 Update SUMMARY_PROMPT further Josh Bickett 2023-11-17 19:12:28 -08:00
  • c46ca725e7 improve SUMMARY_PROMPT further Josh Bickett 2023-11-17 19:11:08 -08:00
  • fe0d8821b6 Improve SUMMARY_PROMPT Josh Bickett 2023-11-17 19:05:18 -08:00
  • 6a5c0b4a7b Update summarize Josh Bickett 2023-11-17 14:15:24 -08:00
  • d70ab48ba8 Update summarize function Josh Bickett 2023-11-17 14:15:06 -08:00
  • dcf31c091e Always press enter after keyboard_type Josh Bickett 2023-11-17 13:33:56 -08:00
  • 947c4852aa Add ## Demo placeholder Josh Bickett 2023-11-17 13:30:41 -08:00
  • 82dc6ca2d1 More README.md updates Josh Bickett 2023-11-17 13:08:26 -08:00
  • d13598ce63 Center title in README.md Josh Bickett 2023-11-17 12:58:20 -08:00
  • 1990b9d244 remove unnecessary parameter for format_summary_prompt Josh Bickett 2023-11-17 12:57:09 -08:00
  • b4a07c05f2 Add new png to README.md Josh Bickett 2023-11-17 12:56:34 -08:00
  • d885056e0c Add new png Josh Bickett 2023-11-17 12:55:34 -08:00
  • e56a585017 More README.md updates Josh Bickett 2023-11-17 12:46:01 -08:00
  • 12ecc57945 align images in readme.md center Josh Bickett 2023-11-17 12:37:47 -08:00
  • 5306d17e3e I trusted chatgpt too much Josh Bickett 2023-11-17 11:34:34 -08:00
  • fa90ba4db2 Wow you can do all kinds of crazy stuff in README.mds Josh Bickett 2023-11-17 11:33:40 -08:00
  • 199d16e139 Oh cool, it works. Make images smaller in README.md Josh Bickett 2023-11-17 11:32:38 -08:00
  • 9939ad2aa1 I guess this works? Josh Bickett 2023-11-17 11:32:14 -08:00
  • eac1305eb1 More README.md updates Josh Bickett 2023-11-17 11:30:21 -08:00
  • cc382e85cc Add README.md tutorial screenshots Josh Bickett 2023-11-17 11:27:44 -08:00
  • 8abb1f53f5 Another README.md step Josh Bickett 2023-11-17 11:16:24 -08:00
  • 24f47b7dc5 Update README.md with openai step Josh Bickett 2023-11-17 11:15:15 -08:00
  • 91a631077f Add .example.env for README.md setup Josh Bickett 2023-11-17 11:13:26 -08:00
  • 96a7ea37f5 remove unnecessary else Josh Bickett 2023-11-17 11:00:45 -08:00
  • 33b8504e32 Remove unused vars tools, etc. Josh Bickett 2023-11-17 10:59:25 -08:00
  • 57bbd143cd import cleanup Josh Bickett 2023-11-17 10:53:45 -08:00
  • 0f37b631d2 Add print, improve prompt, remove old code Josh Bickett 2023-11-17 10:45:01 -08:00
  • d14c9cbe0c Improve VISION_PROMPT and prints Josh Bickett 2023-11-17 10:35:40 -08:00
  • bab7cbb7a2 Update prints and add break when done Josh Bickett 2023-11-17 10:16:09 -08:00
  • 85138904f0 Update framework prints and delete old code Josh Bickett 2023-11-17 10:06:09 -08:00
  • 13cdffe8c0 Improve VISION_PROMPT and remove SYSTEM_PROMPT Josh Bickett 2023-11-17 10:01:13 -08:00
  • ced164865b improve VISION_PROMPT Josh Bickett 2023-11-17 09:08:43 -08:00
  • 882f51b0cd Update mouse_click Josh Bickett 2023-11-17 08:40:11 -08:00
  • f272dc98df Maybe gpt-4v doesn't play well with SYSTEM_PROMPT Josh Bickett 2023-11-17 08:27:01 -08:00
  • d9237cab5d Reinforce done state Josh Bickett 2023-11-17 08:23:03 -08:00
  • f828d70382 Create screenshots_dir if it doesn't exist Josh Bickett 2023-11-17 08:14:48 -08:00
  • 634002b67d Remove WITH_REFLECTION Josh Bickett 2023-11-17 08:12:12 -08:00
  • fc96b94f48 Merge branch 'rewrite' of https://github.com/OthersideAI/self-driving-computer into rewrite Josh Bickett 2023-11-17 08:07:18 -08:00
  • 16495f5884 Bug fix, thanks Matt for finding Josh Bickett 2023-11-17 08:07:16 -08:00
  • f8b5e9caf6 fix small bug mshumer 2023-11-17 11:06:48 -05:00
  • dfedf2808c Improve main loop Josh Bickett 2023-11-17 08:04:04 -08:00
  • 31b7c0362d Add parse_oai_response and other minor changes Josh Bickett 2023-11-17 07:35:51 -08:00
  • 97037dbff6 Create new VISION_PROMPT approach Josh Bickett 2023-11-17 07:14:37 -08:00
  • 7c6dd0f7d0 more print changes Josh Bickett 2023-11-16 19:32:35 -08:00
  • a88e7d492c Remove click_instruction Josh Bickett 2023-11-16 19:32:00 -08:00
  • 1c54499c9e Try without WITH_REFLECTION Josh Bickett 2023-11-16 19:28:09 -08:00
  • 88dbbde87d Remove unnecessary spaces from prints Josh Bickett 2023-11-16 19:22:38 -08:00
  • 66ff31c2b3 Fix wrap Josh Bickett 2023-11-16 10:17:06 -08:00
  • 9c689f7b03 prompt adjustments Josh Bickett 2023-11-16 10:04:48 -08:00
  • 851049abbc Add summarize function Josh Bickett 2023-11-15 17:31:58 -08:00
  • 37a6d7afe1 update .gitignore Josh Bickett 2023-11-15 17:31:47 -08:00
  • 57709228c1 Improve format_mouse_prompt Josh Bickett 2023-11-15 17:12:37 -08:00
  • 337edac152 REFLECTION_PROMPT improvements and turn off debugging Josh Bickett 2023-11-15 16:57:54 -08:00
  • 20bbce5035 Improve REFLECTION_PROMPT Josh Bickett 2023-11-15 16:27:29 -08:00
  • 210ce489d8 readme.md updates Josh Bickett 2023-11-15 16:00:24 -08:00
  • 66e549dd4a improve add_grid_to_image Josh Bickett 2023-11-15 11:22:12 -08:00
  • f6ca26d8f2 Add reflect Josh Bickett 2023-11-15 11:01:42 -08:00
  • 21eec1905b Update .gitignore for screenshots Josh Bickett 2023-11-15 10:55:52 -08:00
  • 06b4347d43 Add ### Additional Thoughts Josh Bickett 2023-11-15 10:47:05 -08:00
  • db632b216a changes to add_grid_to_image, etc. Josh Bickett 2023-11-14 22:58:30 -08:00
  • fc8853771b Minor prompt and USER_QUESTION improvements Josh Bickett 2023-11-14 22:47:01 -08:00
  • 9f81238986 Remove USER_TOOL_PROMPT Josh Bickett 2023-11-14 22:37:52 -08:00
  • 79d71ccca4 more read me improvements Josh Bickett 2023-11-14 19:40:54 -08:00
  • 276930c668 Improve ### Instructions Josh Bickett 2023-11-14 19:36:44 -08:00
  • 3561b95d91 Make README.md prettier Josh Bickett 2023-11-14 19:25:29 -08:00
  • a85a6b4c22 Update README.md intro Josh Bickett 2023-11-14 19:22:38 -08:00
  • 3e92b9ff8f More pretty prints Josh Bickett 2023-11-14 14:45:15 -08:00
  • 8e78515e07 Oops, Falsee..... Josh Bickett 2023-11-14 14:38:47 -08:00
  • 0b07e30fa9 Update README.md Josh Bickett 2023-11-14 14:36:28 -08:00
  • 73113f8072 Update prompts and add ANSI_BLUE Josh Bickett 2023-11-14 14:26:00 -08:00
  • ceef1cb522 Fix undefined var bug Josh Bickett 2023-11-14 14:14:51 -08:00
  • 20762cf0d7 update README.md Josh Bickett 2023-11-14 14:07:21 -08:00
  • 3e19ed941f Add setup.py for streamline setup Josh Bickett 2023-11-14 14:01:37 -08:00
  • ddd72cff2a Improve styles and prompts Josh Bickett 2023-11-14 13:02:41 -08:00
  • 68a0fa52b8 Add more styles Josh Bickett 2023-11-14 09:05:39 -08:00
  • a6ab16d628 Remove unused TYPE_PROMPT Josh Bickett 2023-11-13 19:20:54 -08:00
  • d81fd60dcf Improve MOUSE_PROMPT Josh Bickett 2023-11-13 11:25:55 -08:00
  • 287a7dc14f Improve prompt & prints Josh Bickett 2023-11-13 11:09:25 -08:00
  • e419cca1fb remove .sleep and improve MOUSE_PROMPT Josh Bickett 2023-11-13 10:56:25 -08:00